2024-09-11T23:57:06.531 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-11T23:57:06.552 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-11T23:57:06.647 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830 branch: wip-cls-rgw-busy-resharding description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} email: null first_in_suite: false job_id: '7901830' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cls-rgw-busy-resharding ceph: conf: client: debug rgw: 20 debug rgw notification: 20 rgw bucket counters cache: true rgw crypt require ssl: false rgw crypt s3 kms backend: testing rgw crypt s3 kms encryption keys: testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= rgw reshard progress judge interval: 10 rgw s3 auth use sts: true rgw sts key: abcdefghijklmnop rgw torrent flag: true rgw user counters cache: true setgroup: ceph setuser: ceph global: mon client directed command retry: 5 ms inject socket failures: 5000 osd_max_pg_log_entries: 10 osd_min_pg_log_entries: 10 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 lockdep: true osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug objclass: 20 debug osd: 20 debug rocksdb: 4/10 lockdep: true mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - \(OSD_SLOW_PING_TIME sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f rgw: compression type: random ec-data-pool: true frontend: beast storage classes: LUKEWARM, FROZEN s3tests: accounts: iam alt root: RGW99999999999999999 iam root: RGW88888888888888888 force-branch: ceph-master slow_backend: true storage classes: LUKEWARM, FROZEN thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-67986 sha1: 6a169fc940965ab446a63954fde870aa497efde7 owner: scheduled_cbodley@teuthology priority: 90 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 2206 sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f sleep_before_teardown: 0 suite: rgw suite_branch: wip-67986 suite_path: /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa suite_relpath: qa suite_repo: https://github.com/cbodley/ceph.git suite_sha1: 6a169fc940965ab446a63954fde870aa497efde7 targets: smithi078.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9joc2NYjgNhtXsS8kx91Vb3mIwzGDEKU/v2sy01Q1LvFExs5BSLu07/bq7wOtruMwOXEWGeEv7VilLPBHNDWQ= smithi171.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKefAEex4lXE77I7AlGUGIKT8n/siG+WHYz9da3xoXO7AXvy/iZMVqO9+64Up6adj5uBRS+/082b1Gvx5bbNN7U= tasks: - install: extra_system_packages: deb: - s3cmd - maven rpm: - s3cmd - maven - ceph: null - openssl_keys: null - rgw: client.0: null - tox: - client.0 - workunit: clients: client.0: - rgw/run-bucket-check.sh - workunit: clients: client.0: - cls/test_cls_lock.sh - cls/test_cls_log.sh - cls/test_cls_refcount.sh - cls/test_cls_rgw.sh - cls/test_cls_rgw_gc.sh - cls/test_cls_rgw_stats.sh - cls/test_cls_cmpomap.sh - cls/test_cls_2pc_queue.sh - cls/test_cls_user.sh - rgw/test_rgw_gc_log.sh - rgw/test_rgw_obj.sh - rgw/test_librgw_file.sh - rgw/test_awssdkv4_sig.sh - workunit: clients: client.0: - rgw/test_rgw_s3_mp_reupload.sh - ragweed: client.0: force-branch: wip-67986 rgw_server: client.0 stages: prepare,check - workunit: clients: client.0: - rgw/run-reshard.sh - s3tests-java: client.0: force-branch: ceph-master force-repo: https://github.com/ceph/java_s3tests.git - s3tests: client.0: rgw_server: client.0 - workunit: clients: client.0: - rgw/run-versioning.sh teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-11_23:33:24 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-11T23:57:06.647 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa; will attempt to use it 2024-09-11T23:57:06.648 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa/tasks 2024-09-11T23:57:06.648 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-11T23:57:06.650 INFO:teuthology.task.internal:Checking packages... 2024-09-11T23:57:06.671 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd011c522bb171e70fc5782f1e7a71ce5f37e573f' 2024-09-11T23:57:06.671 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-11T23:57:06.671 INFO:teuthology.packaging:ref: None 2024-09-11T23:57:06.671 INFO:teuthology.packaging:tag: None 2024-09-11T23:57:06.671 INFO:teuthology.packaging:branch: wip-cls-rgw-busy-resharding 2024-09-11T23:57:06.671 INFO:teuthology.packaging:sha1: d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-11T23:57:06.671 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cls-rgw-busy-resharding 2024-09-11T23:57:06.825 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4753-gd011c522-1jammy 2024-09-11T23:57:06.826 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-11T23:57:06.833 INFO:teuthology.task.internal:no buildpackages task found 2024-09-11T23:57:06.834 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-11T23:57:06.840 INFO:teuthology.task.internal:Saving configuration 2024-09-11T23:57:06.857 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-11T23:57:06.864 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-11T23:57:06.897 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi078.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:51:10.602576', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIE8WYhmcCGfrKviQQjbWm96ma4eY0rFVHQdA+cYk18by'} 2024-09-11T23:57:06.928 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi171.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-11 23:51:10.603991', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIPD3ORZMVNNADv6kmpGdkbM/mkzJJHIoFXV1COE6ngZQ'} 2024-09-11T23:57:06.928 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-11T23:57:06.935 INFO:teuthology.task.internal:roles: ubuntu@smithi078.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-11T23:57:06.935 INFO:teuthology.task.internal:roles: ubuntu@smithi171.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-11T23:57:06.935 INFO:teuthology.run_tasks:Running task console_log... 2024-09-11T23:57:07.011 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f352fca7490>, signals=[15]) 2024-09-11T23:57:07.011 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-11T23:57:07.017 INFO:teuthology.task.internal:Opening connections... 2024-09-11T23:57:07.018 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi078.front.sepia.ceph.com 2024-09-11T23:57:07.019 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:57:07.107 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi171.front.sepia.ceph.com 2024-09-11T23:57:07.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:57:07.197 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-11T23:57:07.203 DEBUG:teuthology.orchestra.run.smithi078:> uname -m 2024-09-11T23:57:07.208 INFO:teuthology.orchestra.run.smithi078.stdout:x86_64 2024-09-11T23:57:07.208 DEBUG:teuthology.orchestra.run.smithi078:> cat /etc/os-release 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:NAME="Ubuntu" 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_ID="22.04" 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:VERSION_CODENAME=jammy 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:ID=ubuntu 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:ID_LIKE=debian 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:57:07.256 INFO:teuthology.orchestra.run.smithi078.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:57:07.257 INFO:teuthology.orchestra.run.smithi078.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:57:07.257 INFO:teuthology.lock.ops:Updating smithi078.front.sepia.ceph.com on lock server 2024-09-11T23:57:07.287 DEBUG:teuthology.orchestra.run.smithi171:> uname -m 2024-09-11T23:57:07.292 INFO:teuthology.orchestra.run.smithi171.stdout:x86_64 2024-09-11T23:57:07.293 DEBUG:teuthology.orchestra.run.smithi171:> cat /etc/os-release 2024-09-11T23:57:07.337 INFO:teuthology.orchestra.run.smithi171.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-09-11T23:57:07.337 INFO:teuthology.orchestra.run.smithi171.stdout:NAME="Ubuntu" 2024-09-11T23:57:07.337 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_ID="22.04" 2024-09-11T23:57:07.337 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-09-11T23:57:07.337 INFO:teuthology.orchestra.run.smithi171.stdout:VERSION_CODENAME=jammy 2024-09-11T23:57:07.338 INFO:teuthology.orchestra.run.smithi171.stdout:ID=ubuntu 2024-09-11T23:57:07.338 INFO:teuthology.orchestra.run.smithi171.stdout:ID_LIKE=debian 2024-09-11T23:57:07.338 INFO:teuthology.orchestra.run.smithi171.stdout:HOME_URL="https://www.ubuntu.com/" 2024-09-11T23:57:07.338 INFO:teuthology.orchestra.run.smithi171.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-09-11T23:57:07.338 INFO:teuthology.orchestra.run.smithi171.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-09-11T23:57:07.338 INFO:teuthology.orchestra.run.smithi171.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-09-11T23:57:07.338 INFO:teuthology.orchestra.run.smithi171.stdout:UBUNTU_CODENAME=jammy 2024-09-11T23:57:07.338 INFO:teuthology.lock.ops:Updating smithi171.front.sepia.ceph.com on lock server 2024-09-11T23:57:07.375 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-11T23:57:07.388 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-11T23:57:07.393 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-11T23:57:07.394 DEBUG:teuthology.orchestra.run.smithi078:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:57:07.396 DEBUG:teuthology.orchestra.run.smithi171:> test '!' -e /home/ubuntu/cephtest 2024-09-11T23:57:07.400 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-11T23:57:07.407 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-11T23:57:07.407 DEBUG:teuthology.orchestra.run.smithi078:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:57:07.442 DEBUG:teuthology.orchestra.run.smithi171:> test -z $(ls -A /var/lib/ceph) 2024-09-11T23:57:07.456 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-11T23:57:07.524 INFO:teuthology.run_tasks:Running task kernel... 2024-09-11T23:57:07.538 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-11T23:57:07.538 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-11T23:57:07.538 DEBUG:teuthology.orchestra.run.smithi078:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:57:07.539 DEBUG:teuthology.orchestra.run.smithi171:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-11T23:57:07.543 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:57:07.543 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-11T23:57:07.544 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-11T23:57:07.545 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-11T23:57:07.590 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-56-generic 2024-09-11T23:57:07.590 INFO:teuthology.task.kernel:Running kernel on smithi171: 5.15.0-56-generic 2024-09-11T23:57:07.590 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get clean 2024-09-11T23:57:07.592 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-56-generic 2024-09-11T23:57:07.592 INFO:teuthology.task.kernel:Running kernel on smithi078: 5.15.0-56-generic 2024-09-11T23:57:07.592 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-09-11T23:57:07.710 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-09-11T23:57:07.726 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-11T23:57:07.836 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:57:07.858 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:57:07.869 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:57:07.881 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [128 kB] 2024-09-11T23:57:07.927 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:57:07.945 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [127 kB] 2024-09-11T23:57:07.953 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:57:07.981 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://security.ubuntu.com/ubuntu jammy-security InRelease [129 kB] 2024-09-11T23:57:08.072 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:57:08.127 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:57:08.133 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,988 kB] 2024-09-11T23:57:08.166 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:57:08.170 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:57:08.170 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:57:08.191 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:57:08.191 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:57:08.195 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:57:08.195 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:57:08.202 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:57:08.211 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:57:08.213 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:57:08.214 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:57:08.230 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [690 kB] 2024-09-11T23:57:08.234 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [349 kB] 2024-09-11T23:57:08.237 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [17.8 kB] 2024-09-11T23:57:08.237 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [39.3 kB] 2024-09-11T23:57:08.238 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [2,386 kB] 2024-09-11T23:57:08.240 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:57:08.241 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:57:08.241 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:57:08.242 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:57:08.242 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:57:08.243 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:57:08.243 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:57:08.243 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:57:08.257 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:57:08.258 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [410 kB] 2024-09-11T23:57:08.262 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [616 B] 2024-09-11T23:57:08.263 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [731 kB] 2024-09-11T23:57:08.269 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,123 kB] 2024-09-11T23:57:08.275 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:57:08.275 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:57:08.279 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [261 kB] 2024-09-11T23:57:08.324 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [26.2 kB] 2024-09-11T23:57:08.325 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,752 B] 2024-09-11T23:57:08.325 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [43.3 kB] 2024-09-11T23:57:08.325 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.8 kB] 2024-09-11T23:57:08.326 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [444 B] 2024-09-11T23:57:08.326 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.8 kB] 2024-09-11T23:57:08.326 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.9 kB] 2024-09-11T23:57:08.327 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.1 kB] 2024-09-11T23:57:08.327 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-09-11T23:57:08.342 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.3 kB] 2024-09-11T23:57:08.359 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.8 kB] 2024-09-11T23:57:08.359 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.5 kB] 2024-09-11T23:57:08.359 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [672 B] 2024-09-11T23:57:08.400 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:57:08.434 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [533 kB] 2024-09-11T23:57:08.683 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:57:08.718 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,771 kB] 2024-09-11T23:57:08.855 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:57:08.867 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:57:08.868 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:57:08.891 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [291 kB] 2024-09-11T23:57:08.904 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [13.3 kB] 2024-09-11T23:57:08.904 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:57:08.906 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [2,327 kB] 2024-09-11T23:57:08.953 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [37.7 kB] 2024-09-11T23:57:08.954 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:57:08.962 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:57:08.962 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:57:08.986 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:57:08.990 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [400 kB] 2024-09-11T23:57:08.998 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [584 B] 2024-09-11T23:57:08.999 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [901 kB] 2024-09-11T23:57:09.013 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:57:09.018 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:57:09.018 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:57:09.019 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:57:09.022 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [626 kB] 2024-09-11T23:57:09.050 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [176 kB] 2024-09-11T23:57:09.054 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [19.2 kB] 2024-09-11T23:57:09.055 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-09-11T23:57:09.056 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-09-11T23:57:09.056 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:57:09.099 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-09-11T23:57:09.100 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:57:09.136 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [228 B] 2024-09-11T23:57:14.254 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 15.8 MB in 2s (7,591 kB/s) 2024-09-11T23:57:14.833 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 15.8 MB in 2s (7,375 kB/s) 2024-09-11T23:57:15.746 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-11T23:57:15.765 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:57:15.822 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-11T23:57:16.023 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-09-11T23:57:16.024 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-09-11T23:57:16.187 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:57:16.187 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:57:16.187 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:57:16.187 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:57:16.188 INFO:teuthology.orchestra.run.smithi171.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:57:16.188 INFO:teuthology.orchestra.run.smithi171.stdout: python2.7-minimal 2024-09-11T23:57:16.188 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:57:16.189 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-09-11T23:57:16.189 INFO:teuthology.orchestra.run.smithi171.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:57:16.189 INFO:teuthology.orchestra.run.smithi171.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:57:16.189 INFO:teuthology.orchestra.run.smithi171.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:57:16.190 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-09-11T23:57:16.190 INFO:teuthology.orchestra.run.smithi171.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:57:16.191 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2024-09-11T23:57:16.191 INFO:teuthology.orchestra.run.smithi171.stdout: thermald 2024-09-11T23:57:16.232 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-09-11T23:57:16.233 INFO:teuthology.orchestra.run.smithi171.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:57:16.233 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:57:16.233 INFO:teuthology.orchestra.run.smithi171.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:57:16.234 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages will be upgraded: 2024-09-11T23:57:16.235 INFO:teuthology.orchestra.run.smithi171.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:57:16.242 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-11T23:57:16.259 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:57:16.286 INFO:teuthology.orchestra.run.smithi171.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:57:16.286 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 113 MB of archives. 2024-09-11T23:57:16.286 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:57:16.287 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:57:16.314 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-11T23:57:16.499 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-11T23:57:16.499 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-11T23:57:16.664 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:57:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:57:16.664 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:57:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:57:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-09-11T23:57:16.665 INFO:teuthology.orchestra.run.smithi078.stdout: python2.7-minimal 2024-09-11T23:57:16.665 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:57:16.666 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-11T23:57:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:57:16.666 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-generic linux-image-5.15.0-119-generic 2024-09-11T23:57:16.667 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-5.15.0-119-generic linux-modules-extra-5.15.0-119-generic 2024-09-11T23:57:16.668 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-11T23:57:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-09-11T23:57:16.668 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-09-11T23:57:16.668 INFO:teuthology.orchestra.run.smithi078.stdout: thermald 2024-09-11T23:57:16.714 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-11T23:57:16.714 INFO:teuthology.orchestra.run.smithi078.stdout: linux-headers-5.15.0-119 linux-headers-5.15.0-119-generic 2024-09-11T23:57:16.714 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.15.0-119-generic linux-modules-5.15.0-119-generic 2024-09-11T23:57:16.715 INFO:teuthology.orchestra.run.smithi078.stdout: linux-modules-extra-5.15.0-119-generic 2024-09-11T23:57:16.715 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages will be upgraded: 2024-09-11T23:57:16.716 INFO:teuthology.orchestra.run.smithi078.stdout: linux-generic linux-headers-generic linux-image-generic 2024-09-11T23:57:16.723 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:57:16.810 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:57:16.895 INFO:teuthology.orchestra.run.smithi078.stdout:3 upgraded, 5 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:57:16.895 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 113 MB of archives. 2024-09-11T23:57:16.895 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 583 MB of additional disk space will be used. 2024-09-11T23:57:16.895 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-119-generic amd64 5.15.0-119.129 [22.6 MB] 2024-09-11T23:57:17.635 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:57:17.635 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:57:17.636 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:57:17.755 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:57:17.776 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:57:18.171 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 113 MB in 2s (73.8 MB/s) 2024-09-11T23:57:18.262 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-119-generic amd64 5.15.0-119.129 [11.5 MB] 2024-09-11T23:57:18.352 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:57:18.655 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-119-generic amd64 5.15.0-119.129 [63.9 MB] 2024-09-11T23:57:20.397 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:57:20.402 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:20.487 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:20.825 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.119.119 [1,694 B] 2024-09-11T23:57:20.825 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.119.119 [2,502 B] 2024-09-11T23:57:20.826 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119 all 5.15.0-119.129 [12.3 MB] 2024-09-11T23:57:21.219 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-119-generic amd64 5.15.0-119.129 [2,879 kB] 2024-09-11T23:57:21.266 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.119.119 [2,350 B] 2024-09-11T23:57:21.685 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 113 MB in 5s (24.9 MB/s) 2024-09-11T23:57:21.864 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-5.15.0-119-generic. 2024-09-11T23:57:22.578 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:57:22.600 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:22.692 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:23.115 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:57:23.135 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:23.165 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:23.904 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-09-11T23:57:23.909 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-linux-modules-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:23.977 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:26.686 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-image-5.15.0-119-generic. 2024-09-11T23:57:26.708 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-linux-image-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:26.805 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:27.239 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-119-generic. 2024-09-11T23:57:27.251 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:27.289 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:29.774 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:57:29.899 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:57:30.207 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:57:30.304 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:57:30.591 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:57:30.609 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:57:30.649 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:57:33.623 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-linux-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:57:33.750 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:57:34.101 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:57:34.237 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-image-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:57:34.507 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-119. 2024-09-11T23:57:34.530 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-linux-headers-5.15.0-119_5.15.0-119.129_all.deb ... 2024-09-11T23:57:34.565 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:57:36.397 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:57:36.416 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:36.455 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:39.042 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:57:39.166 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:57:39.515 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:57:39.637 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:39.763 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:57:39.892 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:40.140 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package linux-headers-5.15.0-119-generic. 2024-09-11T23:57:40.176 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-linux-headers-5.15.0-119-generic_5.15.0-119.129_amd64.deb ... 2024-09-11T23:57:40.206 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:41.219 INFO:teuthology.orchestra.run.smithi171.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:57:41.219 INFO:teuthology.orchestra.run.smithi171.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:57:41.220 INFO:teuthology.orchestra.run.smithi171.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:57:41.220 INFO:teuthology.orchestra.run.smithi171.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:41.368 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:42.736 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:43.260 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.119.119_amd64.deb ... 2024-09-11T23:57:43.561 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking linux-headers-generic (5.15.0.119.119) over (5.15.0.56.54) ... 2024-09-11T23:57:44.611 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-119 (5.15.0-119.129) ... 2024-09-11T23:57:44.622 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:57:44.716 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:44.747 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:57:44.825 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-headers-generic (5.15.0.119.119) ... 2024-09-11T23:57:44.873 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:44.933 INFO:teuthology.orchestra.run.smithi171.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:57:44.933 INFO:teuthology.orchestra.run.smithi171.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:44.946 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:46.261 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:57:46.261 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-09-11T23:57:46.261 INFO:teuthology.orchestra.run.smithi078.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:57:46.261 INFO:teuthology.orchestra.run.smithi078.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:46.423 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:47.841 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-modules-extra-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:49.217 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-image-generic (5.15.0.119.119) ... 2024-09-11T23:57:50.152 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up linux-generic (5.15.0.119.119) ... 2024-09-11T23:57:50.311 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for linux-image-5.15.0-119-generic (5.15.0-119.129) ... 2024-09-11T23:57:50.376 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-09-11T23:57:50.377 INFO:teuthology.orchestra.run.smithi078.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:57:59.328 INFO:teuthology.orchestra.run.smithi171.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:57:59.329 INFO:teuthology.orchestra.run.smithi171.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:57:59.343 INFO:teuthology.orchestra.run.smithi171.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:57:59.370 INFO:teuthology.orchestra.run.smithi171.stdout:Generating grub configuration file ... 2024-09-11T23:57:59.683 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:57:59.696 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:58:00.012 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:58:00.018 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:58:00.093 INFO:teuthology.orchestra.run.smithi171.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:58:00.098 INFO:teuthology.orchestra.run.smithi171.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:58:00.253 INFO:teuthology.orchestra.run.smithi171.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:58:00.253 INFO:teuthology.orchestra.run.smithi171.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:58:00.253 INFO:teuthology.orchestra.run.smithi171.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:58:00.296 INFO:teuthology.orchestra.run.smithi171.stdout:done 2024-09-11T23:58:00.688 DEBUG:teuthology.orchestra.run.smithi171:> dpkg -s linux-image-generic 2024-09-11T23:58:00.704 INFO:teuthology.orchestra.run.smithi171.stdout:Package: linux-image-generic 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Status: install ok installed 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Priority: optional 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Section: kernel 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Installed-Size: 21 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: amd64 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Source: linux-meta 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Version: 5.15.0.119.119 2024-09-11T23:58:00.705 INFO:teuthology.orchestra.run.smithi171.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:58:00.706 INFO:teuthology.orchestra.run.smithi171.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:58:00.706 INFO:teuthology.orchestra.run.smithi171.stdout:Recommends: thermald 2024-09-11T23:58:00.706 INFO:teuthology.orchestra.run.smithi171.stdout:Description: Generic Linux kernel image 2024-09-11T23:58:00.706 INFO:teuthology.orchestra.run.smithi171.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:58:00.706 INFO:teuthology.orchestra.run.smithi171.stdout: available. 2024-09-11T23:58:00.706 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:58:00.706 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:58:00.706 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:58:00.707 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-11T23:58:00.707 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi171.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:58:00.707 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get clean 2024-09-11T23:58:00.858 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-09-11T23:58:00.979 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:58:00.979 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:58:00.991 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:58:01.009 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:58:02.355 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-11T23:58:02.373 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:58:02.427 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-11T23:58:02.613 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-09-11T23:58:02.624 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-09-11T23:58:02.795 INFO:teuthology.orchestra.run.smithi171.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:58:02.845 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:58:02.846 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:58:02.846 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:58:02.846 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:58:02.846 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:58:02.846 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:58:02.846 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:58:02.847 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:58:02.847 DEBUG:teuthology.orchestra.run.smithi171:> dpkg -s linux-image-generic 2024-09-11T23:58:02.904 INFO:teuthology.orchestra.run.smithi171.stdout:Package: linux-image-generic 2024-09-11T23:58:02.904 INFO:teuthology.orchestra.run.smithi171.stdout:Status: install ok installed 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Priority: optional 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Section: kernel 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Installed-Size: 21 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Architecture: amd64 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Source: linux-meta 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Version: 5.15.0.119.119 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Recommends: thermald 2024-09-11T23:58:02.905 INFO:teuthology.orchestra.run.smithi171.stdout:Description: Generic Linux kernel image 2024-09-11T23:58:02.906 INFO:teuthology.orchestra.run.smithi171.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:58:02.906 INFO:teuthology.orchestra.run.smithi171.stdout: available. 2024-09-11T23:58:02.906 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-11T23:58:02.954 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.KKI0ZE7HIx 2024-09-11T23:58:02.955 DEBUG:teuthology.orchestra.run.smithi171:> sudo cp /boot/grub/grub.cfg /tmp/tmp.KKI0ZE7HIx 2024-09-11T23:58:03.009 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.KKI0ZE7HIx 2024-09-11T23:58:03.141 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.KKI0ZE7HIx is 10KB 2024-09-11T23:58:03.153 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.KKI0ZE7HIx 2024-09-11T23:58:03.159 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:58:03.217 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-11T23:58:03.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:58:03.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:58:03.283 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:58:03.284 DEBUG:teuthology.orchestra.run.smithi171:> sudo update-grub 2024-09-11T23:58:04.372 INFO:teuthology.orchestra.run.smithi078.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-09-11T23:58:04.372 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub' 2024-09-11T23:58:04.388 INFO:teuthology.orchestra.run.smithi078.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:58:04.409 INFO:teuthology.orchestra.run.smithi078.stdout:Generating grub configuration file ... 2024-09-11T23:58:04.559 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:58:04.560 INFO:teuthology.orchestra.run.smithi171.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:58:04.562 INFO:teuthology.orchestra.run.smithi171.stderr:Generating grub configuration file ... 2024-09-11T23:58:04.691 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:58:04.710 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:58:04.742 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:58:04.747 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:58:04.992 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:58:04.997 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:58:05.003 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:58:05.010 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:58:05.033 INFO:teuthology.orchestra.run.smithi171.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:58:05.041 INFO:teuthology.orchestra.run.smithi171.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:58:05.085 INFO:teuthology.orchestra.run.smithi078.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:58:05.090 INFO:teuthology.orchestra.run.smithi078.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:58:05.142 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:58:05.142 INFO:teuthology.orchestra.run.smithi171.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:58:05.142 INFO:teuthology.orchestra.run.smithi171.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:58:05.159 INFO:teuthology.orchestra.run.smithi171.stderr:done 2024-09-11T23:58:05.169 DEBUG:teuthology.orchestra.run.smithi171:> sudo shutdown -r now 2024-09-11T23:58:05.270 INFO:teuthology.orchestra.run.smithi078.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:58:05.270 INFO:teuthology.orchestra.run.smithi078.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:58:05.270 INFO:teuthology.orchestra.run.smithi078.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:58:05.304 INFO:teuthology.orchestra.run.smithi078.stdout:done 2024-09-11T23:58:05.771 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-09-11T23:58:05.814 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.119.119 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-09-11T23:58:05.815 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-09-11T23:58:05.816 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:58:05.816 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-09-11T23:58:05.816 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-119-generic 2024-09-11T23:58:05.816 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-11T23:58:05.817 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-11T23:58:05.817 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-11T23:58:05.817 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi078.front.sepia.ceph.com, path=None, version=distro) 2024-09-11T23:58:05.817 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get clean 2024-09-11T23:58:05.988 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-11T23:58:06.125 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-11T23:58:06.223 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-11T23:58:06.304 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-11T23:58:06.385 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-11T23:58:07.511 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-11T23:58:07.530 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-09-11T23:58:07.594 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-11T23:58:07.800 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-11T23:58:07.801 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-11T23:58:07.969 INFO:teuthology.orchestra.run.smithi078.stdout:linux-image-generic is already the newest version (5.15.0.119.119). 2024-09-11T23:58:07.970 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-11T23:58:07.970 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-11T23:58:07.970 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-11T23:58:07.970 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-11T23:58:07.970 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-11T23:58:07.970 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-11T23:58:07.971 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-11T23:58:08.009 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 0 newly installed, 0 to remove and 344 not upgraded. 2024-09-11T23:58:08.011 DEBUG:teuthology.orchestra.run.smithi078:> dpkg -s linux-image-generic 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Package: linux-image-generic 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Status: install ok installed 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Priority: optional 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Section: kernel 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Installed-Size: 21 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Maintainer: Ubuntu Kernel Team 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Architecture: amd64 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Source: linux-meta 2024-09-11T23:58:08.067 INFO:teuthology.orchestra.run.smithi078.stdout:Version: 5.15.0.119.119 2024-09-11T23:58:08.068 INFO:teuthology.orchestra.run.smithi078.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.4), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-119), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.4) 2024-09-11T23:58:08.068 INFO:teuthology.orchestra.run.smithi078.stdout:Depends: linux-image-5.15.0-119-generic, linux-modules-extra-5.15.0-119-generic, linux-firmware, intel-microcode, amd64-microcode 2024-09-11T23:58:08.068 INFO:teuthology.orchestra.run.smithi078.stdout:Recommends: thermald 2024-09-11T23:58:08.068 INFO:teuthology.orchestra.run.smithi078.stdout:Description: Generic Linux kernel image 2024-09-11T23:58:08.068 INFO:teuthology.orchestra.run.smithi078.stdout: This package will always depend on the latest generic kernel image 2024-09-11T23:58:08.068 INFO:teuthology.orchestra.run.smithi078.stdout: available. 2024-09-11T23:58:08.068 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-11T23:58:08.117 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.3YPh2PvKfX 2024-09-11T23:58:08.118 DEBUG:teuthology.orchestra.run.smithi078:> sudo cp /boot/grub/grub.cfg /tmp/tmp.3YPh2PvKfX 2024-09-11T23:58:08.172 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.3YPh2PvKfX 2024-09-11T23:58:08.303 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.3YPh2PvKfX is 10KB 2024-09-11T23:58:08.323 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.3YPh2PvKfX 2024-09-11T23:58:08.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-09-11T23:58:08.384 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-11T23:58:08.384 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-09-11T23:58:08.385 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-09-11T23:58:08.453 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-119-generic 2024-09-11T23:58:08.454 DEBUG:teuthology.orchestra.run.smithi078:> sudo update-grub 2024-09-11T23:58:09.667 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub' 2024-09-11T23:58:09.668 INFO:teuthology.orchestra.run.smithi078.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-09-11T23:58:09.671 INFO:teuthology.orchestra.run.smithi078.stderr:Generating grub configuration file ... 2024-09-11T23:58:09.875 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-119-generic 2024-09-11T23:58:09.881 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-119-generic 2024-09-11T23:58:10.123 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-09-11T23:58:10.129 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-09-11T23:58:10.169 INFO:teuthology.orchestra.run.smithi078.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-09-11T23:58:10.174 INFO:teuthology.orchestra.run.smithi078.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-09-11T23:58:10.290 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-09-11T23:58:10.290 INFO:teuthology.orchestra.run.smithi078.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-09-11T23:58:10.291 INFO:teuthology.orchestra.run.smithi078.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-09-11T23:58:10.312 INFO:teuthology.orchestra.run.smithi078.stderr:done 2024-09-11T23:58:10.314 DEBUG:teuthology.orchestra.run.smithi078:> sudo shutdown -r now 2024-09-11T23:58:35.197 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-11T23:58:35.198 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-11T23:58:35.199 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:40.321 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-11T23:58:40.321 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-11T23:58:40.321 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:58:53.757 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-11T23:58:58.878 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-11T23:59:02.761 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-11T23:59:02.762 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:59:05.821 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.171 2024-09-11T23:59:07.880 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-11T23:59:07.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:59:10.941 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-11T23:59:17.827 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-11T23:59:17.828 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:59:22.945 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-11T23:59:22.946 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:59:41.373 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.78 2024-09-11T23:59:56.389 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-11T23:59:56.390 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-11T23:59:56.742 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-11T23:59:57.514 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-11T23:59:57.514 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-119-generic"... 2024-09-11T23:59:57.515 DEBUG:teuthology.orchestra.run.smithi078:> uname -r 2024-09-11T23:59:57.559 INFO:teuthology.orchestra.run.smithi078.stdout:5.15.0-119-generic 2024-09-11T23:59:57.559 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-11T23:59:57.560 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-11T23:59:57.560 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-11T23:59:58.560 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-11T23:59:58.561 DEBUG:teuthology.orchestra.run.smithi078:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-11T23:59:58.642 INFO:teuthology.orchestra.run.smithi078.stdout:ttyS1 2024-09-11T23:59:58.685 DEBUG:teuthology.parallel:result is None 2024-09-12T00:00:17.857 DEBUG:teuthology.orchestra.remote:timed out 2024-09-12T00:00:32.859 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-12T00:00:32.860 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:00:33.222 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-12T00:00:33.903 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-12T00:00:33.903 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-119-generic"... 2024-09-12T00:00:33.903 DEBUG:teuthology.orchestra.run.smithi171:> uname -r 2024-09-12T00:00:33.948 INFO:teuthology.orchestra.run.smithi171.stdout:5.15.0-119-generic 2024-09-12T00:00:33.949 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-119-generic vs 5.15.0-119-generic 2024-09-12T00:00:33.949 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-12T00:00:33.949 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-09-12T00:00:34.950 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-12T00:00:34.950 DEBUG:teuthology.orchestra.run.smithi171:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-12T00:00:35.300 INFO:teuthology.orchestra.run.smithi171.stdout:ttyS1 2024-09-12T00:00:35.330 DEBUG:teuthology.parallel:result is None 2024-09-12T00:00:35.331 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-12T00:00:35.338 INFO:teuthology.task.internal:Creating test directory... 2024-09-12T00:00:35.339 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:00:35.341 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-12T00:00:35.347 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-12T00:00:35.354 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-12T00:00:35.367 INFO:teuthology.task.internal:Creating archive directory... 2024-09-12T00:00:35.367 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:00:35.388 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-12T00:00:35.416 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-12T00:00:35.437 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-12T00:00:35.437 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:00:35.448 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-12T00:00:35.465 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:00:35.473 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:00:35.473 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:00:35.478 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-12T00:00:35.480 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-12T00:00:35.492 INFO:teuthology.task.internal:Configuring sudo... 2024-09-12T00:00:35.493 DEBUG:teuthology.orchestra.run.smithi078:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:00:35.524 DEBUG:teuthology.orchestra.run.smithi171:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-12T00:00:35.538 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-12T00:00:35.548 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-12T00:00:35.548 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:00:35.580 DEBUG:teuthology.orchestra.run.smithi171:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-12T00:00:35.585 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:00:35.632 DEBUG:teuthology.orchestra.run.smithi078:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:00:35.683 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:00:35.683 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:00:35.742 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-12T00:00:35.748 DEBUG:teuthology.orchestra.run.smithi171:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-12T00:00:35.801 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:00:35.801 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-12T00:00:35.870 DEBUG:teuthology.orchestra.run.smithi078:> sudo service rsyslog restart 2024-09-12T00:00:35.872 DEBUG:teuthology.orchestra.run.smithi171:> sudo service rsyslog restart 2024-09-12T00:00:35.937 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-12T00:00:35.947 INFO:teuthology.task.internal:Starting timer... 2024-09-12T00:00:35.947 INFO:teuthology.run_tasks:Running task pcp... 2024-09-12T00:00:35.968 INFO:teuthology.run_tasks:Running task selinux... 2024-09-12T00:00:35.986 DEBUG:teuthology.task.selinux:Excluding smithi078: OS 'ubuntu' does not support SELinux 2024-09-12T00:00:35.987 DEBUG:teuthology.task.selinux:Excluding smithi171: OS 'ubuntu' does not support SELinux 2024-09-12T00:00:35.987 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-12T00:00:35.987 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-09-12T00:00:35.987 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-12T00:00:35.987 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-12T00:00:36.005 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-12T00:00:36.016 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-12T00:00:36.017 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi078.front.sepia.ceph.com,smithi171.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-12T00:08:12.917 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi078.front.sepia.ceph.com'), Remote(name='ubuntu@smithi171.front.sepia.ceph.com')] 2024-09-12T00:08:12.918 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-12T00:08:12.919 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi078.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:08:13.012 DEBUG:teuthology.orchestra.run.smithi078:> true 2024-09-12T00:08:13.085 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi078.front.sepia.ceph.com' 2024-09-12T00:08:13.086 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-12T00:08:13.086 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi171.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-12T00:08:13.179 DEBUG:teuthology.orchestra.run.smithi171:> true 2024-09-12T00:08:13.257 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi171.front.sepia.ceph.com' 2024-09-12T00:08:13.257 INFO:teuthology.run_tasks:Running task clock... 2024-09-12T00:08:13.275 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-12T00:08:13.276 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:08:13.276 DEBUG:teuthology.orchestra.run.smithi078:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:08:13.279 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-12T00:08:13.279 DEBUG:teuthology.orchestra.run.smithi171:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:08:13.305 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:08:13.306 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Command line: ntpd -gq 2024-09-12T00:08:13.306 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: ---------------------------------------------------- 2024-09-12T00:08:13.306 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:08:13.306 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:08:13.306 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: corporation. Support and training for ntp-4 are 2024-09-12T00:08:13.307 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: available at https://www.nwtime.org/support 2024-09-12T00:08:13.307 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: ---------------------------------------------------- 2024-09-12T00:08:13.308 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: proto: precision = 0.067 usec (-24) 2024-09-12T00:08:13.308 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: basedate set to 2022-02-04 2024-09-12T00:08:13.308 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:08:13.309 INFO:teuthology.orchestra.run.smithi078.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:08:13.310 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:08:13.310 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:08:13.310 INFO:teuthology.orchestra.run.smithi078.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:08:13.312 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:08:13.312 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:08:13.312 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:08:13.312 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Listen normally on 3 enp3s0f1 172.21.15.78:123 2024-09-12T00:08:13.313 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Listen normally on 4 lo [::1]:123 2024-09-12T00:08:13.313 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d4dd%5]:123 2024-09-12T00:08:13.313 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:13 ntpd[18618]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:08:13.323 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Command line: ntpd -gq 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: ---------------------------------------------------- 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: ntp-4 is maintained by Network Time Foundation, 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: corporation. Support and training for ntp-4 are 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: available at https://www.nwtime.org/support 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: ---------------------------------------------------- 2024-09-12T00:08:13.324 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: proto: precision = 0.058 usec (-24) 2024-09-12T00:08:13.325 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: basedate set to 2022-02-04 2024-09-12T00:08:13.325 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: gps base set to 2022-02-06 (week 2196) 2024-09-12T00:08:13.325 INFO:teuthology.orchestra.run.smithi171.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:08:13.325 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-09-12T00:08:13.326 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:08:13.326 INFO:teuthology.orchestra.run.smithi171.stderr:restrict ::: KOD does nothing without LIMITED. 2024-09-12T00:08:13.327 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Listen and drop on 0 v6wildcard [::]:123 2024-09-12T00:08:13.327 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-09-12T00:08:13.327 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Listen normally on 2 lo 127.0.0.1:123 2024-09-12T00:08:13.327 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Listen normally on 3 enp3s0f1 172.21.15.171:123 2024-09-12T00:08:13.327 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Listen normally on 4 lo [::1]:123 2024-09-12T00:08:13.327 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f6d%5]:123 2024-09-12T00:08:13.327 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:13 ntpd[18626]: Listening on routing socket on fd #22 for interface updates 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:14.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:14 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:15.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:15 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:15 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:15 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:15 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:15 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:15.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:15 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:16 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:16 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:16 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:16 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:16.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:16 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:16 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:16.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:16 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:16.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:16 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:16.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:16 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:16.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:16 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:16.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:16 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:16.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:16 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:17.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:17 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:17.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:17 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:17.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:17 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:17.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:17 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:17.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:17 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:17.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:17 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:17.326 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:17.326 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:17.327 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:17 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:18.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:18.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:18 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:18.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:18.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:18.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:18.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:18.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:18.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:18.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:18.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:18 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:19 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:19 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:19 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:19 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:19.306 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:19 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:19.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:19 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:19.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:19.326 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:19.326 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:19.326 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:19 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:20.307 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:20.308 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:20.308 INFO:teuthology.orchestra.run.smithi078.stdout:12 Sep 00:08:20 ntpd[18618]: ntpd: time slew -0.003314 s 2024-09-12T00:08:20.308 INFO:teuthology.orchestra.run.smithi078.stdout:ntpd: time slew -0.003314s 2024-09-12T00:08:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:08:20.309 INFO:teuthology.orchestra.run.smithi078.stderr:12 Sep 00:08:20 ntpd[18618]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:08:20.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:20 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:20.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:20 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:20.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:20 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:20.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:20 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:20.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:20 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:20.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:20 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:08:20.363 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-09-12T00:08:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:20.363 INFO:teuthology.orchestra.run.smithi078.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:20.364 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:21.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:21.324 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: can't open /var/log/ntpstats/rawstats.20240912: Permission denied 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: can't open /var/log/ntpstats/peerstats.20240912: Permission denied 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stdout:12 Sep 00:08:21 ntpd[18626]: ntpd: time slew -0.000495 s 2024-09-12T00:08:21.325 INFO:teuthology.orchestra.run.smithi171.stdout:ntpd: time slew -0.000495s 2024-09-12T00:08:21.326 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-09-12T00:08:21.326 INFO:teuthology.orchestra.run.smithi171.stderr:12 Sep 00:08:21 ntpd[18626]: can't open /var/log/ntpstats/loopstats.20240912: Permission denied 2024-09-12T00:08:21.376 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:08:21.376 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2024-09-12T00:08:21.376 INFO:teuthology.orchestra.run.smithi171.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:21.376 INFO:teuthology.orchestra.run.smithi171.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:21.377 INFO:teuthology.orchestra.run.smithi171.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:21.377 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-09-12T00:08:21.378 INFO:teuthology.run_tasks:Running task install... 2024-09-12T00:08:21.386 DEBUG:teuthology.task.install:project ceph 2024-09-12T00:08:21.386 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}} 2024-09-12T00:08:21.386 DEBUG:teuthology.task.install:config {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'} 2024-09-12T00:08:21.386 INFO:teuthology.task.install:Using flavor: default 2024-09-12T00:08:21.392 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-12T00:08:21.392 INFO:teuthology.task.install:extra packages: [] 2024-09-12T00:08:21.392 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-key list | grep Ceph 2024-09-12T00:08:21.393 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-key list | grep Ceph 2024-09-12T00:08:21.459 INFO:teuthology.orchestra.run.smithi078.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:08:21.480 INFO:teuthology.orchestra.run.smithi171.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-09-12T00:08:21.490 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:08:21.490 INFO:teuthology.orchestra.run.smithi078.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:08:21.491 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:08:21.491 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:08:21.491 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:08:21.509 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-09-12T00:08:21.509 INFO:teuthology.orchestra.run.smithi171.stdout:uid [ unknown] Ceph.com (release key) 2024-09-12T00:08:21.510 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-09-12T00:08:21.510 INFO:teuthology.task.install.deb:Installing system (non-project) packages: s3cmd, maven on remote deb x86_64 2024-09-12T00:08:21.510 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:08:21.650 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:08:21.650 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:21.666 INFO:teuthology.task.install.deb:Pulling from https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default/ 2024-09-12T00:08:21.666 INFO:teuthology.task.install.deb:Package version is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:21.774 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:08:21.774 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:08:21.784 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:08:21.784 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-09-12T00:08:21.788 DEBUG:teuthology.orchestra.run.smithi078:> sudo apt-get update 2024-09-12T00:08:21.798 DEBUG:teuthology.orchestra.run.smithi171:> sudo apt-get update 2024-09-12T00:08:21.958 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:08:21.967 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-09-12T00:08:21.968 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:08:21.976 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-09-12T00:08:21.985 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:08:21.993 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-09-12T00:08:22.013 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:08:22.021 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:4 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy InRelease 2024-09-12T00:08:22.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:08:22.044 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release [7,689 B] 2024-09-12T00:08:22.057 INFO:teuthology.orchestra.run.smithi078.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:08:22.065 INFO:teuthology.orchestra.run.smithi171.stdout:Ign:6 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-09-12T00:08:22.078 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:08:22.084 INFO:teuthology.orchestra.run.smithi078.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:08:22.086 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.1 kB] 2024-09-12T00:08:22.092 INFO:teuthology.orchestra.run.smithi171.stdout:Hit:8 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-09-12T00:08:22.105 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:08:22.113 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,414 B] 2024-09-12T00:08:22.301 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 29.2 kB in 0s (87.3 kB/s) 2024-09-12T00:08:22.308 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 29.2 kB in 0s (89.0 kB/s) 2024-09-12T00:08:23.246 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-12T00:08:23.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:23.324 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-12T00:08:23.331 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-12T00:08:23.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.3.0-4753-gd011c522-1jammy cephadm=19.3.0-4753-gd011c522-1jammy ceph-mds=19.3.0-4753-gd011c522-1jammy ceph-mgr=19.3.0-4753-gd011c522-1jammy ceph-common=19.3.0-4753-gd011c522-1jammy ceph-fuse=19.3.0-4753-gd011c522-1jammy ceph-test=19.3.0-4753-gd011c522-1jammy ceph-volume=19.3.0-4753-gd011c522-1jammy radosgw=19.3.0-4753-gd011c522-1jammy python3-rados=19.3.0-4753-gd011c522-1jammy python3-rgw=19.3.0-4753-gd011c522-1jammy python3-cephfs=19.3.0-4753-gd011c522-1jammy python3-rbd=19.3.0-4753-gd011c522-1jammy libcephfs2=19.3.0-4753-gd011c522-1jammy libcephfs-dev=19.3.0-4753-gd011c522-1jammy librados2=19.3.0-4753-gd011c522-1jammy librbd1=19.3.0-4753-gd011c522-1jammy rbd-fuse=19.3.0-4753-gd011c522-1jammy 2024-09-12T00:08:23.404 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-12T00:08:23.541 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-12T00:08:23.542 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-12T00:08:23.620 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-09-12T00:08:23.621 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-09-12T00:08:23.755 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:08:23.755 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:08:23.755 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:08:23.755 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:08:23.755 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:08:23.756 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:08:23.756 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:08:23.756 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-12T00:08:23.756 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:08:23.758 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:08:23.759 INFO:teuthology.orchestra.run.smithi078.stdout: xmlstarlet zip 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout:Recommended packages: 2024-09-12T00:08:23.760 INFO:teuthology.orchestra.run.smithi078.stdout: btrfs-tools 2024-09-12T00:08:23.819 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:08:23.819 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:08:23.819 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:08:23.819 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:08:23.820 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:08:23.820 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:08:23.820 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:08:23.820 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-09-12T00:08:23.821 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-09-12T00:08:23.822 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-09-12T00:08:23.823 INFO:teuthology.orchestra.run.smithi171.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: xmlstarlet zip 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-09-12T00:08:23.824 INFO:teuthology.orchestra.run.smithi171.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-09-12T00:08:23.825 INFO:teuthology.orchestra.run.smithi171.stdout:Recommended packages: 2024-09-12T00:08:23.825 INFO:teuthology.orchestra.run.smithi171.stdout: btrfs-tools 2024-09-12T00:08:23.864 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-12T00:08:23.864 INFO:teuthology.orchestra.run.smithi078.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:08:23.864 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:08:23.866 INFO:teuthology.orchestra.run.smithi078.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:08:23.867 INFO:teuthology.orchestra.run.smithi078.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:08:23.927 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-09-12T00:08:23.928 INFO:teuthology.orchestra.run.smithi171.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-09-12T00:08:23.929 INFO:teuthology.orchestra.run.smithi171.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-09-12T00:08:23.930 INFO:teuthology.orchestra.run.smithi171.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-09-12T00:08:23.930 INFO:teuthology.orchestra.run.smithi171.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-09-12T00:08:23.932 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:08:23.932 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 251 MB of archives. 2024-09-12T00:08:23.932 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:08:23.932 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:08:23.987 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 118 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:08:23.988 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 251 MB of archives. 2024-09-12T00:08:23.988 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 933 MB of additional disk space will be used. 2024-09-12T00:08:23.988 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-09-12T00:08:24.008 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:08:24.016 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:08:24.017 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:08:24.035 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:08:24.069 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.3.0-4753-gd011c522-1jammy [3,628 kB] 2024-09-12T00:08:24.081 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-09-12T00:08:24.081 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-09-12T00:08:24.098 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:08:24.099 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-09-12T00:08:24.103 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:08:24.116 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:08:24.120 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:08:24.121 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:08:24.121 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:08:24.130 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:08:24.132 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:08:24.135 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:08:24.136 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:08:24.137 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:08:24.139 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:08:24.154 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:08:24.156 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:08:24.157 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:08:24.157 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:08:24.158 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:08:24.158 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:08:24.159 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:08:24.159 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-09-12T00:08:24.159 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:08:24.164 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-09-12T00:08:24.173 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:08:24.173 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:08:24.177 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-09-12T00:08:24.181 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-09-12T00:08:24.181 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-09-12T00:08:24.182 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-09-12T00:08:24.191 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-09-12T00:08:24.191 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:08:24.193 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-09-12T00:08:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:08:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:08:24.194 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:08:24.195 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:08:24.195 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-09-12T00:08:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:08:24.196 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:08:24.197 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-09-12T00:08:24.197 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:08:24.199 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-09-12T00:08:24.201 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-09-12T00:08:24.206 INFO:teuthology.orchestra.run.smithi078.stdout:Get:36 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:08:24.208 INFO:teuthology.orchestra.run.smithi078.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:08:24.209 INFO:teuthology.orchestra.run.smithi078.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:08:24.215 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-09-12T00:08:24.217 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-09-12T00:08:24.217 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-09-12T00:08:24.218 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-09-12T00:08:24.219 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-09-12T00:08:24.219 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-09-12T00:08:24.219 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-09-12T00:08:24.220 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-09-12T00:08:24.232 INFO:teuthology.orchestra.run.smithi078.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:08:24.233 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-09-12T00:08:24.234 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-09-12T00:08:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:08:24.243 INFO:teuthology.orchestra.run.smithi078.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:08:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:08:24.245 INFO:teuthology.orchestra.run.smithi078.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:08:24.248 INFO:teuthology.orchestra.run.smithi078.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:08:24.251 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-09-12T00:08:24.252 INFO:teuthology.orchestra.run.smithi078.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:08:24.253 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-09-12T00:08:24.254 INFO:teuthology.orchestra.run.smithi078.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:08:24.254 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-09-12T00:08:24.254 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-09-12T00:08:24.255 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-09-12T00:08:24.256 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-09-12T00:08:24.256 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-09-12T00:08:24.257 INFO:teuthology.orchestra.run.smithi078.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:08:24.257 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-webob all 1:1.8.6-1.1ubuntu0.1 [86.7 kB] 2024-09-12T00:08:24.257 INFO:teuthology.orchestra.run.smithi078.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:08:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:08:24.267 INFO:teuthology.orchestra.run.smithi078.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:08:24.268 INFO:teuthology.orchestra.run.smithi171.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-09-12T00:08:24.269 INFO:teuthology.orchestra.run.smithi078.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:08:24.269 INFO:teuthology.orchestra.run.smithi171.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-09-12T00:08:24.277 INFO:teuthology.orchestra.run.smithi171.stdout:Get:38 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.3.0-4753-gd011c522-1jammy [3,322 kB] 2024-09-12T00:08:24.279 INFO:teuthology.orchestra.run.smithi078.stdout:Get:52 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:08:24.285 INFO:teuthology.orchestra.run.smithi078.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:08:24.285 INFO:teuthology.orchestra.run.smithi171.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-09-12T00:08:24.291 INFO:teuthology.orchestra.run.smithi171.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-09-12T00:08:24.291 INFO:teuthology.orchestra.run.smithi171.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-09-12T00:08:24.292 INFO:teuthology.orchestra.run.smithi171.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-09-12T00:08:24.292 INFO:teuthology.orchestra.run.smithi171.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-09-12T00:08:24.294 INFO:teuthology.orchestra.run.smithi171.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-09-12T00:08:24.295 INFO:teuthology.orchestra.run.smithi171.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-idna all 3.3-1ubuntu0.1 [52.1 kB] 2024-09-12T00:08:24.296 INFO:teuthology.orchestra.run.smithi171.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-09-12T00:08:24.303 INFO:teuthology.orchestra.run.smithi171.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-09-12T00:08:24.303 INFO:teuthology.orchestra.run.smithi078.stdout:Get:54 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:08:24.304 INFO:teuthology.orchestra.run.smithi171.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.2 [181 kB] 2024-09-12T00:08:24.310 INFO:teuthology.orchestra.run.smithi078.stdout:Get:55 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:08:24.311 INFO:teuthology.orchestra.run.smithi078.stdout:Get:56 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:08:24.320 INFO:teuthology.orchestra.run.smithi171.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-09-12T00:08:24.321 INFO:teuthology.orchestra.run.smithi171.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-09-12T00:08:24.322 INFO:teuthology.orchestra.run.smithi171.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-09-12T00:08:24.326 INFO:teuthology.orchestra.run.smithi171.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-09-12T00:08:24.328 INFO:teuthology.orchestra.run.smithi078.stdout:Get:57 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:08:24.329 INFO:teuthology.orchestra.run.smithi078.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:08:24.336 INFO:teuthology.orchestra.run.smithi078.stdout:Get:59 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:08:24.356 INFO:teuthology.orchestra.run.smithi078.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:08:24.357 INFO:teuthology.orchestra.run.smithi078.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:08:24.358 INFO:teuthology.orchestra.run.smithi078.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:08:24.358 INFO:teuthology.orchestra.run.smithi078.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:08:24.359 INFO:teuthology.orchestra.run.smithi078.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:08:24.377 INFO:teuthology.orchestra.run.smithi171.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-09-12T00:08:24.378 INFO:teuthology.orchestra.run.smithi078.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:08:24.379 INFO:teuthology.orchestra.run.smithi171.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.2 [108 kB] 2024-09-12T00:08:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:08:24.379 INFO:teuthology.orchestra.run.smithi078.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:08:24.380 INFO:teuthology.orchestra.run.smithi171.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-09-12T00:08:24.380 INFO:teuthology.orchestra.run.smithi171.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-09-12T00:08:24.381 INFO:teuthology.orchestra.run.smithi171.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-09-12T00:08:24.386 INFO:teuthology.orchestra.run.smithi171.stdout:Get:58 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.3.0-4753-gd011c522-1jammy [722 kB] 2024-09-12T00:08:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:08:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:08:24.394 INFO:teuthology.orchestra.run.smithi078.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:08:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:08:24.395 INFO:teuthology.orchestra.run.smithi078.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:08:24.396 INFO:teuthology.orchestra.run.smithi078.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:08:24.410 INFO:teuthology.orchestra.run.smithi078.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:08:24.411 INFO:teuthology.orchestra.run.smithi078.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:08:24.414 INFO:teuthology.orchestra.run.smithi078.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:08:24.428 INFO:teuthology.orchestra.run.smithi078.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:08:24.429 INFO:teuthology.orchestra.run.smithi078.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:08:24.430 INFO:teuthology.orchestra.run.smithi171.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-09-12T00:08:24.430 INFO:teuthology.orchestra.run.smithi171.stdout:Get:60 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.3.0-4753-gd011c522-1jammy [356 kB] 2024-09-12T00:08:24.430 INFO:teuthology.orchestra.run.smithi078.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:08:24.432 INFO:teuthology.orchestra.run.smithi171.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-09-12T00:08:24.432 INFO:teuthology.orchestra.run.smithi171.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-09-12T00:08:24.432 INFO:teuthology.orchestra.run.smithi078.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:08:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:08:24.435 INFO:teuthology.orchestra.run.smithi078.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:08:24.436 INFO:teuthology.orchestra.run.smithi078.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:08:24.437 INFO:teuthology.orchestra.run.smithi171.stdout:Get:63 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.3.0-4753-gd011c522-1jammy [32.8 kB] 2024-09-12T00:08:24.438 INFO:teuthology.orchestra.run.smithi171.stdout:Get:64 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.3.0-4753-gd011c522-1jammy [180 kB] 2024-09-12T00:08:24.442 INFO:teuthology.orchestra.run.smithi171.stdout:Get:65 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.3.0-4753-gd011c522-1jammy [71.3 kB] 2024-09-12T00:08:24.444 INFO:teuthology.orchestra.run.smithi171.stdout:Get:66 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.3.0-4753-gd011c522-1jammy [338 kB] 2024-09-12T00:08:24.445 INFO:teuthology.orchestra.run.smithi078.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:08:24.445 INFO:teuthology.orchestra.run.smithi078.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:08:24.445 INFO:teuthology.orchestra.run.smithi171.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-09-12T00:08:24.446 INFO:teuthology.orchestra.run.smithi171.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-09-12T00:08:24.446 INFO:teuthology.orchestra.run.smithi171.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-09-12T00:08:24.446 INFO:teuthology.orchestra.run.smithi171.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-09-12T00:08:24.447 INFO:teuthology.orchestra.run.smithi171.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-09-12T00:08:24.447 INFO:teuthology.orchestra.run.smithi171.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-09-12T00:08:24.448 INFO:teuthology.orchestra.run.smithi171.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-09-12T00:08:24.448 INFO:teuthology.orchestra.run.smithi078.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:08:24.452 INFO:teuthology.orchestra.run.smithi171.stdout:Get:74 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.3.0-4753-gd011c522-1jammy [7,983 kB] 2024-09-12T00:08:24.462 INFO:teuthology.orchestra.run.smithi078.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:08:24.462 INFO:teuthology.orchestra.run.smithi078.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:08:24.463 INFO:teuthology.orchestra.run.smithi078.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:08:24.464 INFO:teuthology.orchestra.run.smithi078.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:08:24.465 INFO:teuthology.orchestra.run.smithi078.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:08:24.465 INFO:teuthology.orchestra.run.smithi171.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-09-12T00:08:24.469 INFO:teuthology.orchestra.run.smithi171.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-09-12T00:08:24.471 INFO:teuthology.orchestra.run.smithi171.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-09-12T00:08:24.471 INFO:teuthology.orchestra.run.smithi078.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:08:24.471 INFO:teuthology.orchestra.run.smithi078.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:08:24.472 INFO:teuthology.orchestra.run.smithi171.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-09-12T00:08:24.472 INFO:teuthology.orchestra.run.smithi171.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-09-12T00:08:24.475 INFO:teuthology.orchestra.run.smithi171.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-09-12T00:08:24.477 INFO:teuthology.orchestra.run.smithi171.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-09-12T00:08:24.479 INFO:teuthology.orchestra.run.smithi078.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:08:24.481 INFO:teuthology.orchestra.run.smithi078.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:08:24.481 INFO:teuthology.orchestra.run.smithi078.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:08:24.483 INFO:teuthology.orchestra.run.smithi171.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-09-12T00:08:24.483 INFO:teuthology.orchestra.run.smithi171.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.2 [473 kB] 2024-09-12T00:08:24.489 INFO:teuthology.orchestra.run.smithi171.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-09-12T00:08:24.500 INFO:teuthology.orchestra.run.smithi171.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-09-12T00:08:24.503 INFO:teuthology.orchestra.run.smithi171.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-09-12T00:08:24.503 INFO:teuthology.orchestra.run.smithi171.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-09-12T00:08:24.504 INFO:teuthology.orchestra.run.smithi171.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-09-12T00:08:24.504 INFO:teuthology.orchestra.run.smithi171.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-09-12T00:08:24.506 INFO:teuthology.orchestra.run.smithi171.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-09-12T00:08:24.506 INFO:teuthology.orchestra.run.smithi171.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-09-12T00:08:24.517 INFO:teuthology.orchestra.run.smithi171.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-09-12T00:08:24.518 INFO:teuthology.orchestra.run.smithi171.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-09-12T00:08:24.518 INFO:teuthology.orchestra.run.smithi171.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-09-12T00:08:24.535 INFO:teuthology.orchestra.run.smithi171.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-09-12T00:08:24.535 INFO:teuthology.orchestra.run.smithi171.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-09-12T00:08:24.586 INFO:teuthology.orchestra.run.smithi078.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:08:24.589 INFO:teuthology.orchestra.run.smithi078.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:08:24.598 INFO:teuthology.orchestra.run.smithi078.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:08:24.723 INFO:teuthology.orchestra.run.smithi171.stdout:Get:97 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.3.0-4753-gd011c522-1jammy [112 kB] 2024-09-12T00:08:24.726 INFO:teuthology.orchestra.run.smithi171.stdout:Get:98 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.3.0-4753-gd011c522-1jammy [473 kB] 2024-09-12T00:08:24.757 INFO:teuthology.orchestra.run.smithi171.stdout:Get:99 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.3.0-4753-gd011c522-1jammy [28.3 MB] 2024-09-12T00:08:25.589 INFO:teuthology.orchestra.run.smithi078.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:08:25.665 INFO:teuthology.orchestra.run.smithi078.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:08:25.683 INFO:teuthology.orchestra.run.smithi078.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:08:25.685 INFO:teuthology.orchestra.run.smithi078.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:08:25.731 INFO:teuthology.orchestra.run.smithi078.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:08:25.812 INFO:teuthology.orchestra.run.smithi171.stdout:Get:100 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.3.0-4753-gd011c522-1jammy [5,210 kB] 2024-09-12T00:08:25.903 INFO:teuthology.orchestra.run.smithi078.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:08:25.921 INFO:teuthology.orchestra.run.smithi171.stdout:Get:101 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.3.0-4753-gd011c522-1jammy [251 kB] 2024-09-12T00:08:25.925 INFO:teuthology.orchestra.run.smithi171.stdout:Get:102 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.3.0-4753-gd011c522-1jammy [124 kB] 2024-09-12T00:08:25.928 INFO:teuthology.orchestra.run.smithi171.stdout:Get:103 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.3.0-4753-gd011c522-1jammy [1,562 kB] 2024-09-12T00:08:25.997 INFO:teuthology.orchestra.run.smithi171.stdout:Get:104 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.3.0-4753-gd011c522-1jammy [6,308 kB] 2024-09-12T00:08:26.217 INFO:teuthology.orchestra.run.smithi171.stdout:Get:105 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.3.0-4753-gd011c522-1jammy [23.1 MB] 2024-09-12T00:08:26.685 INFO:teuthology.orchestra.run.smithi078.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:08:26.686 INFO:teuthology.orchestra.run.smithi078.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:08:26.703 INFO:teuthology.orchestra.run.smithi078.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:08:26.743 INFO:teuthology.orchestra.run.smithi078.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:08:26.753 INFO:teuthology.orchestra.run.smithi078.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:08:26.755 INFO:teuthology.orchestra.run.smithi078.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:08:27.115 INFO:teuthology.orchestra.run.smithi171.stdout:Get:106 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.3.0-4753-gd011c522-1jammy [14.0 kB] 2024-09-12T00:08:27.116 INFO:teuthology.orchestra.run.smithi171.stdout:Get:107 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.3.0-4753-gd011c522-1jammy [880 kB] 2024-09-12T00:08:27.132 INFO:teuthology.orchestra.run.smithi171.stdout:Get:108 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.3.0-4753-gd011c522-1jammy [2,438 kB] 2024-09-12T00:08:27.174 INFO:teuthology.orchestra.run.smithi171.stdout:Get:109 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.3.0-4753-gd011c522-1jammy [812 kB] 2024-09-12T00:08:27.184 INFO:teuthology.orchestra.run.smithi171.stdout:Get:110 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.3.0-4753-gd011c522-1jammy [160 kB] 2024-09-12T00:08:27.187 INFO:teuthology.orchestra.run.smithi171.stdout:Get:111 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.3.0-4753-gd011c522-1jammy [61.4 MB] 2024-09-12T00:08:29.170 INFO:teuthology.orchestra.run.smithi078.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:08:29.377 INFO:teuthology.orchestra.run.smithi078.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:08:29.378 INFO:teuthology.orchestra.run.smithi078.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:08:30.241 INFO:teuthology.orchestra.run.smithi171.stdout:Get:112 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.3.0-4753-gd011c522-1jammy [8,625 kB] 2024-09-12T00:08:30.556 INFO:teuthology.orchestra.run.smithi171.stdout:Get:113 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.3.0-4753-gd011c522-1jammy [14.2 kB] 2024-09-12T00:08:30.556 INFO:teuthology.orchestra.run.smithi171.stdout:Get:114 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.3.0-4753-gd011c522-1jammy [55.8 MB] 2024-09-12T00:08:31.548 INFO:teuthology.orchestra.run.smithi078.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:08:31.550 INFO:teuthology.orchestra.run.smithi078.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:08:31.552 INFO:teuthology.orchestra.run.smithi078.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:08:32.185 INFO:teuthology.orchestra.run.smithi078.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:08:32.754 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 251 MB in 8s (30.2 MB/s) 2024-09-12T00:08:32.881 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:08:32.938 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:08:32.943 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:08:33.030 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:08:33.061 INFO:teuthology.orchestra.run.smithi171.stdout:Get:115 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.3.0-4753-gd011c522-1jammy [130 kB] 2024-09-12T00:08:33.064 INFO:teuthology.orchestra.run.smithi171.stdout:Get:116 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.3.0-4753-gd011c522-1jammy [38.9 kB] 2024-09-12T00:08:33.069 INFO:teuthology.orchestra.run.smithi171.stdout:Get:117 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.3.0-4753-gd011c522-1jammy [15.9 MB] 2024-09-12T00:08:33.359 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:08:33.385 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:08:33.425 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:08:33.561 INFO:teuthology.orchestra.run.smithi171.stdout:Get:118 https://4.chacra.ceph.com/r/ceph/wip-cls-rgw-busy-resharding/d011c522bb171e70fc5782f1e7a71ce5f37e573f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.3.0-4753-gd011c522-1jammy [91.2 kB] 2024-09-12T00:08:33.737 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:08:33.763 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:08:33.803 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:08:34.134 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 251 MB in 10s (26.1 MB/s) 2024-09-12T00:08:34.257 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:08:34.283 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:08:34.297 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-09-12T00:08:34.332 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:34.397 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165988 files and directories currently installed.) 2024-09-12T00:08:34.402 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-09-12T00:08:34.497 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:08:34.685 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:08:34.711 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:08:34.743 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:34.824 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-09-12T00:08:34.850 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-09-12T00:08:34.890 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:08:35.080 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:08:35.109 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:08:35.147 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:35.252 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-09-12T00:08:35.278 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-09-12T00:08:35.318 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:08:35.491 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:08:35.522 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:08:35.558 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:08:35.689 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-09-12T00:08:35.715 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:08:35.763 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:35.886 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librados2. 2024-09-12T00:08:35.912 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:35.944 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:36.358 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-09-12T00:08:36.385 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:08:36.425 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:36.572 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:08:36.598 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:36.639 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:36.770 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-09-12T00:08:36.796 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-09-12T00:08:36.894 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:08:37.192 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:08:37.217 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:37.258 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:37.289 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-09-12T00:08:37.305 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-09-12T00:08:37.339 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:08:37.536 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:08:37.562 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:37.602 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:37.676 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librados2. 2024-09-12T00:08:37.702 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../007-librados2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:37.742 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:37.872 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:08:37.898 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:08:37.938 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:38.186 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librbd1. 2024-09-12T00:08:38.207 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:08:38.212 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../008-librbd1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:38.223 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:38.253 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:38.266 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:38.569 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:08:38.584 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:08:38.636 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:38.723 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs2. 2024-09-12T00:08:38.749 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../009-libcephfs2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:38.789 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:38.947 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:08:38.974 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:08:39.014 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:08:39.025 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rados. 2024-09-12T00:08:39.040 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../010-python3-rados_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:39.075 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:39.333 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:08:39.360 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:08:39.394 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-09-12T00:08:39.400 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:08:39.421 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:08:39.461 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:39.644 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:08:39.660 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:39.703 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:39.713 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cephfs. 2024-09-12T00:08:39.729 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../012-python3-cephfs_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:39.772 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:40.014 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:08:40.040 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:08:40.066 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-ceph-common. 2024-09-12T00:08:40.081 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:08:40.081 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../013-python3-ceph-common_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:08:40.116 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:40.358 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:08:40.375 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:08:40.377 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-wcwidth. 2024-09-12T00:08:40.392 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-09-12T00:08:40.417 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:08:40.427 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:08:40.720 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:08:40.722 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-prettytable. 2024-09-12T00:08:40.746 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:08:40.748 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-09-12T00:08:40.786 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:08:40.788 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-09-12T00:08:41.033 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rbd. 2024-09-12T00:08:41.048 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../016-python3-rbd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:41.073 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:08:41.089 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:08:41.091 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:41.123 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:08:41.435 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:08:41.461 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:08:41.501 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:08:41.611 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-09-12T00:08:41.637 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-09-12T00:08:41.677 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:08:41.771 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package zip. 2024-09-12T00:08:41.786 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:08:41.829 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:08:41.997 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-09-12T00:08:42.023 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-09-12T00:08:42.063 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:08:42.141 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package unzip. 2024-09-12T00:08:42.156 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:08:42.191 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:08:42.341 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-09-12T00:08:42.356 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-09-12T00:08:42.391 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:08:42.595 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:08:42.621 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:08:42.670 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:08:42.694 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua5.1. 2024-09-12T00:08:42.721 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-09-12T00:08:42.761 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:08:43.036 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:08:43.063 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:43.072 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-any. 2024-09-12T00:08:43.099 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-09-12T00:08:43.102 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:43.139 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-any (27ubuntu1) ... 2024-09-12T00:08:43.383 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package zip. 2024-09-12T00:08:43.398 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-09-12T00:08:43.433 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking zip (3.0-12build2) ... 2024-09-12T00:08:43.672 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:08:43.687 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:43.694 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package unzip. 2024-09-12T00:08:43.710 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-09-12T00:08:43.722 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:43.744 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:08:44.058 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:08:44.085 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:08:44.124 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package luarocks. 2024-09-12T00:08:44.124 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:08:44.150 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-09-12T00:08:44.190 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:08:44.453 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:08:44.479 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:44.520 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:44.564 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package librgw2. 2024-09-12T00:08:44.591 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../025-librgw2_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:44.631 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:44.890 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:08:44.916 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:44.948 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:45.242 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rgw. 2024-09-12T00:08:45.257 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../026-python3-rgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:45.292 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:45.594 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package liboath0:amd64. 2024-09-12T00:08:45.621 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-09-12T00:08:45.653 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:08:45.981 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libradosstriper1. 2024-09-12T00:08:46.007 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../028-libradosstriper1_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:46.047 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:46.387 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:08:46.413 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:46.471 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:46.476 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-common. 2024-09-12T00:08:46.502 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../029-ceph-common_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:46.542 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:47.176 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:08:47.201 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:08:47.241 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:08:47.502 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:08:47.529 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:08:47.560 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:08:47.847 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:08:47.874 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:08:47.914 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:08:48.106 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-base. 2024-09-12T00:08:48.133 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../030-ceph-base_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:48.181 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:48.217 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:08:48.243 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:08:48.283 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:08:48.570 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:08:48.596 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:08:48.636 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:08:48.727 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-09-12T00:08:48.753 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-09-12T00:08:48.785 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:08:48.889 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:08:48.904 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:08:48.939 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:08:49.071 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cheroot. 2024-09-12T00:08:49.098 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-09-12T00:08:49.137 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:08:49.225 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:08:49.252 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:08:49.292 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:08:49.449 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-09-12T00:08:49.476 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-09-12T00:08:49.516 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:08:49.620 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:08:49.646 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:08:49.686 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:08:49.818 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.text. 2024-09-12T00:08:49.845 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-09-12T00:08:49.885 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:08:49.948 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:08:49.974 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:08:50.006 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:08:50.146 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-09-12T00:08:50.162 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-09-12T00:08:50.196 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:08:50.302 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:08:50.328 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:08:50.360 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:08:50.482 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempora. 2024-09-12T00:08:50.509 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-09-12T00:08:50.549 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-09-12T00:08:50.680 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:08:50.706 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:08:50.746 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:08:50.852 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-portend. 2024-09-12T00:08:50.878 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-09-12T00:08:50.918 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-09-12T00:08:51.049 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:08:51.076 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:08:51.116 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:08:51.213 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-09-12T00:08:51.239 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-09-12T00:08:51.279 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-09-12T00:08:51.394 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:08:51.420 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:08:51.460 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:08:51.507 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cherrypy3. 2024-09-12T00:08:51.534 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-09-12T00:08:51.574 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:08:51.756 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:08:51.782 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:08:51.822 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:08:52.081 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-natsort. 2024-09-12T00:08:52.108 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-09-12T00:08:52.142 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:08:52.168 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:08:52.208 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:08:52.219 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-09-12T00:08:52.511 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:08:52.531 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-logutils. 2024-09-12T00:08:52.537 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:08:52.557 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-09-12T00:08:52.578 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:08:52.597 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-09-12T00:08:52.898 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:08:52.900 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-markupsafe. 2024-09-12T00:08:52.924 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:08:52.927 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-09-12T00:08:52.967 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:08:52.967 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:08:53.242 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:08:53.269 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:08:53.278 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-mako. 2024-09-12T00:08:53.301 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:08:53.304 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-09-12T00:08:53.344 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:08:53.629 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:08:53.655 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:08:53.681 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplegeneric. 2024-09-12T00:08:53.695 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:08:53.707 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-09-12T00:08:53.747 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:08:53.973 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:08:53.989 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:08:54.017 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-singledispatch. 2024-09-12T00:08:54.025 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:08:54.043 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-09-12T00:08:54.075 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:08:54.326 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:08:54.353 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:08:54.393 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:08:54.394 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webob. 2024-09-12T00:08:54.410 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1ubuntu0.1_all.deb ... 2024-09-12T00:08:54.452 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:08:54.721 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:08:54.747 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:08:54.788 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:08:54.806 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-waitress. 2024-09-12T00:08:54.832 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-09-12T00:08:54.875 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:08:55.074 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:08:55.101 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:08:55.141 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:08:55.184 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-tempita. 2024-09-12T00:08:55.210 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-09-12T00:08:55.273 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:08:55.462 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:08:55.485 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:08:55.520 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:08:55.553 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-paste. 2024-09-12T00:08:55.580 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-09-12T00:08:55.619 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:08:55.824 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:08:55.850 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:08:55.890 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:08:55.949 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-09-12T00:08:55.963 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-09-12T00:08:56.006 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:08:56.201 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:08:56.228 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:08:56.284 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastedeploy. 2024-09-12T00:08:56.311 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-09-12T00:08:56.350 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:08:56.610 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:08:56.637 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-webtest. 2024-09-12T00:08:56.664 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-09-12T00:08:56.703 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-09-12T00:08:57.014 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pecan. 2024-09-12T00:08:57.041 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-09-12T00:08:57.081 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:08:57.580 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:08:57.606 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:08:57.646 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:08:57.916 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:08:57.943 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:08:57.974 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:08:58.261 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:08:58.288 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:08:58.320 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-certifi. 2024-09-12T00:08:58.328 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:58.347 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-09-12T00:08:58.386 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-09-12T00:08:58.674 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:08:58.701 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:58.723 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-idna. 2024-09-12T00:08:58.741 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:58.749 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../055-python3-idna_3.3-1ubuntu0.1_all.deb ... 2024-09-12T00:08:58.789 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:08:59.037 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:08:59.042 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-urllib3. 2024-09-12T00:08:59.057 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-09-12T00:08:59.062 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:08:59.100 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:08:59.101 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:08:59.395 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests. 2024-09-12T00:08:59.405 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:08:59.422 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-09-12T00:08:59.432 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:08:59.461 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:08:59.471 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:08:59.758 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:08:59.773 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-werkzeug. 2024-09-12T00:08:59.784 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:08:59.799 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.2_all.deb ... 2024-09-12T00:08:59.816 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:08:59.839 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:09:00.075 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-09-12T00:09:00.091 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:00.134 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:00.203 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:09:00.229 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:00.269 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:00.472 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-09-12T00:09:00.488 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:00.530 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:00.817 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-bcrypt. 2024-09-12T00:09:00.843 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-09-12T00:09:00.873 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:09:00.883 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:09:00.900 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:00.940 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:01.186 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-openssl. 2024-09-12T00:09:01.212 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-09-12T00:09:01.252 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-09-12T00:09:01.514 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr. 2024-09-12T00:09:01.541 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../063-ceph-mgr_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:01.572 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:01.968 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph. 2024-09-12T00:09:01.983 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:02.000 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mon. 2024-09-12T00:09:02.018 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:02.027 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../064-ceph-mon_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:02.067 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:02.321 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:09:02.347 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:02.397 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:02.670 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-osd. 2024-09-12T00:09:02.697 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../065-ceph-osd_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:02.736 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:02.749 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:09:02.776 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:02.815 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:03.177 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:09:03.203 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:03.235 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:03.513 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:09:03.528 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:09:03.571 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:09:03.759 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph. 2024-09-12T00:09:03.774 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../066-ceph_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:03.817 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:03.866 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:09:03.881 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:09:03.916 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:04.136 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-fuse. 2024-09-12T00:09:04.163 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../067-ceph-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:04.202 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:04.564 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mds. 2024-09-12T00:09:04.591 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../068-ceph-mds_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:04.630 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:04.942 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:09:04.969 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:09:04.984 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package cephadm. 2024-09-12T00:09:05.010 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../069-cephadm_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:05.012 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:05.050 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:05.307 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:09:05.334 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:09:05.374 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:09:05.386 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-asyncssh. 2024-09-12T00:09:05.413 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-09-12T00:09:05.452 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-09-12T00:09:05.710 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:09:05.737 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:05.763 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-babel-localedata. 2024-09-12T00:09:05.777 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:05.779 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:09:05.821 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:06.097 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:09:06.124 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:09:06.165 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:09:06.410 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:09:06.437 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:09:06.468 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:09:06.780 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:09:06.793 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-babel. 2024-09-12T00:09:06.806 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:06.821 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-09-12T00:09:06.838 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:06.860 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:07.139 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-jinja2. 2024-09-12T00:09:07.165 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.2_all.deb ... 2024-09-12T00:09:07.204 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:09:07.515 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-09-12T00:09:07.542 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:07.798 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:08.152 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-repoze.lru. 2024-09-12T00:09:08.179 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-09-12T00:09:08.218 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-09-12T00:09:08.505 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-routes. 2024-09-12T00:09:08.532 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-09-12T00:09:08.621 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:09:08.941 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-09-12T00:09:08.968 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:09.007 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:09.827 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:09:09.845 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:09:09.885 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:09:10.330 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:09:10.358 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:09:10.397 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:09:10.784 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:09:10.812 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:09:10.850 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:09:11.145 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:09:11.173 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:09:11.211 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:09:11.779 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-09-12T00:09:11.795 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-09-12T00:09:11.837 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:09:11.887 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:09:11.916 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:12.039 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:12.315 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-joblib. 2024-09-12T00:09:12.343 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-09-12T00:09:12.382 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:09:12.752 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-09-12T00:09:12.780 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-09-12T00:09:12.818 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:09:12.993 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:09:13.021 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:09:13.060 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:09:13.080 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-sklearn. 2024-09-12T00:09:13.107 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-09-12T00:09:13.146 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:09:13.363 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:09:13.391 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:09:13.429 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:09:13.749 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:09:13.765 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:09:13.807 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:09:13.871 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-09-12T00:09:13.900 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:14.015 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:14.119 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:09:14.149 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:09:14.185 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:09:14.473 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:09:14.501 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:09:14.531 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:09:14.860 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:09:14.888 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:09:14.926 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:09:14.944 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-cachetools. 2024-09-12T00:09:14.972 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-09-12T00:09:15.010 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-09-12T00:09:15.196 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:09:15.224 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:09:15.262 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:09:15.330 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1. 2024-09-12T00:09:15.358 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-09-12T00:09:15.396 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:09:15.582 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:09:15.598 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:09:15.640 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:09:15.699 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-09-12T00:09:15.727 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-09-12T00:09:15.766 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:09:16.077 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-rsa. 2024-09-12T00:09:16.105 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-09-12T00:09:16.135 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-rsa (4.8-1) ... 2024-09-12T00:09:16.263 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:09:16.280 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:16.321 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:16.439 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-google-auth. 2024-09-12T00:09:16.467 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-09-12T00:09:16.505 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-09-12T00:09:16.624 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:09:16.652 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:09:16.682 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:09:16.784 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-09-12T00:09:16.801 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-09-12T00:09:16.842 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:09:17.011 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:09:17.038 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:09:17.077 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:09:17.128 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-websocket. 2024-09-12T00:09:17.156 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-09-12T00:09:17.194 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-09-12T00:09:17.338 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package jq. 2024-09-12T00:09:17.354 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:09:17.396 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:09:17.514 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-kubernetes. 2024-09-12T00:09:17.542 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-09-12T00:09:17.581 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:09:17.649 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package socat. 2024-09-12T00:09:17.697 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:09:17.707 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:09:18.119 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:09:18.135 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:09:18.169 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:09:18.523 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:09:18.551 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:18.590 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:18.653 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-09-12T00:09:18.670 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:18.703 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:19.014 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libonig5:amd64. 2024-09-12T00:09:19.045 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-09-12T00:09:19.080 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:09:19.426 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjq1:amd64. 2024-09-12T00:09:19.454 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:09:19.492 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:09:19.719 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package jq. 2024-09-12T00:09:19.735 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-09-12T00:09:19.769 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-09-12T00:09:19.963 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package socat. 2024-09-12T00:09:19.980 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-09-12T00:09:20.013 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:09:20.308 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package xmlstarlet. 2024-09-12T00:09:20.324 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-09-12T00:09:20.366 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:09:20.696 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-test. 2024-09-12T00:09:21.163 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../097-ceph-test_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:21.164 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:21.212 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:09:21.240 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:21.278 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:21.607 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:09:21.623 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:21.665 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:21.977 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:09:22.005 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:09:22.043 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:09:22.365 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:09:22.393 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:09:22.431 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:09:22.802 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:09:22.830 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:09:22.868 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:09:23.274 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:09:23.302 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:09:23.325 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package ceph-volume. 2024-09-12T00:09:23.341 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:09:23.353 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../098-ceph-volume_19.3.0-4753-gd011c522-1jammy_all.deb ... 2024-09-12T00:09:23.391 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:23.585 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:09:23.602 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:09:23.643 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:09:23.728 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcephfs-dev. 2024-09-12T00:09:23.757 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../099-libcephfs-dev_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:23.795 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:24.039 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:09:24.067 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:09:24.105 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:09:24.116 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-socket:amd64. 2024-09-12T00:09:24.143 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-09-12T00:09:24.181 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:09:24.408 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:09:24.436 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:09:24.470 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package lua-sec:amd64. 2024-09-12T00:09:24.475 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:09:24.501 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-09-12T00:09:24.536 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:09:24.795 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:09:24.823 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:09:24.861 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:09:24.906 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package nvme-cli. 2024-09-12T00:09:24.934 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.2_amd64.deb ... 2024-09-12T00:09:24.974 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:09:25.172 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:09:25.200 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:09:25.230 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:09:25.427 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package pkg-config. 2024-09-12T00:09:25.455 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-09-12T00:09:25.494 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:09:25.567 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:09:25.595 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:09:25.633 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:09:25.755 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-09-12T00:09:25.783 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-09-12T00:09:25.821 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:09:25.954 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:09:25.982 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:09:26.020 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:09:26.258 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-iniconfig. 2024-09-12T00:09:26.286 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-09-12T00:09:26.324 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-09-12T00:09:26.466 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:09:26.494 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:09:26.532 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:09:26.569 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pastescript. 2024-09-12T00:09:26.585 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-09-12T00:09:26.619 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-09-12T00:09:26.810 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:09:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:09:26.860 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:09:26.913 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pluggy. 2024-09-12T00:09:26.943 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-09-12T00:09:26.980 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:09:27.138 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:09:27.166 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:09:27.204 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:09:27.291 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-psutil. 2024-09-12T00:09:27.320 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-09-12T00:09:27.357 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-09-12T00:09:27.525 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:09:27.553 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:09:27.608 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:09:27.685 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-py. 2024-09-12T00:09:27.714 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-09-12T00:09:27.752 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-py (1.10.0-1) ... 2024-09-12T00:09:27.853 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:09:27.881 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:09:27.911 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:09:28.080 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pygments. 2024-09-12T00:09:28.109 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-09-12T00:09:28.146 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:09:28.593 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pyinotify. 2024-09-12T00:09:28.598 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:09:28.621 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-09-12T00:09:28.626 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:28.656 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:28.659 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:09:28.962 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-toml. 2024-09-12T00:09:28.990 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-09-12T00:09:29.028 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-09-12T00:09:29.331 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-pytest. 2024-09-12T00:09:29.359 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-09-12T00:09:29.397 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:09:29.543 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:09:29.559 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:29.601 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:29.701 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-simplejson. 2024-09-12T00:09:29.717 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-09-12T00:09:29.776 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:09:29.897 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:09:30.028 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-09-12T00:09:30.045 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-09-12T00:09:30.086 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:09:30.156 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:09:30.274 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:09:30.515 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:09:30.824 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package radosgw. 2024-09-12T00:09:30.852 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../116-radosgw_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:30.882 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:09:30.890 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:31.341 INFO:teuthology.orchestra.run.smithi078.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:09:31.594 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:31.818 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package rbd-fuse. 2024-09-12T00:09:31.835 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../117-rbd-fuse_19.3.0-4753-gd011c522-1jammy_amd64.deb ... 2024-09-12T00:09:31.901 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:32.110 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user cephadm....done 2024-09-12T00:09:32.189 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-09-12T00:09:32.266 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:09:32.439 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-09-12T00:09:32.527 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:09:32.565 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up nvme-cli (1.16-3ubuntu0.2) ... 2024-09-12T00:09:32.786 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:09:32.832 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-09-12T00:09:32.912 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:09:33.149 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-09-12T00:09:33.172 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:09:33.423 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:09:33.549 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:09:33.603 INFO:teuthology.orchestra.run.smithi171.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-09-12T00:09:33.811 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:33.843 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:09:34.194 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:09:34.446 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:09:34.483 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user cephadm....done 2024-09-12T00:09:34.631 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-09-12T00:09:34.722 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:09:34.916 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-09-12T00:09:34.982 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:09:35.176 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-09-12T00:09:35.241 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:09:35.302 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-09-12T00:09:35.501 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:09:35.553 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-09-12T00:09:35.810 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:35.820 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-09-12T00:09:35.938 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-py (1.10.0-1) ... 2024-09-12T00:09:36.069 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:09:36.196 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:09:36.273 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-09-12T00:09:36.322 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:09:36.431 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:09:36.642 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-09-12T00:09:36.674 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:09:36.836 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:09:36.863 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:09:36.893 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-09-12T00:09:36.918 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:09:37.036 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:09:37.169 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-09-12T00:09:37.404 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:37.413 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-09-12T00:09:37.530 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:09:37.655 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-09-12T00:09:37.789 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:09:37.914 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-09-12T00:09:38.032 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:09:38.165 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-argparse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:38.341 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:09:38.433 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-09-12T00:09:38.468 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:09:38.551 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-09-12T00:09:38.652 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-09-12T00:09:38.761 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-09-12T00:09:39.003 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-09-12T00:09:39.111 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:09:39.173 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-09-12T00:09:39.200 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-09-12T00:09:39.264 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-09-12T00:09:39.379 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:09:39.390 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-09-12T00:09:39.522 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:09:39.623 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:09:39.750 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:39.851 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-09-12T00:09:39.907 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:09:40.110 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-09-12T00:09:40.284 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:09:40.361 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-09-12T00:09:40.527 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:09:40.671 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up zip (3.0-12build2) ... 2024-09-12T00:09:40.797 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-09-12T00:09:40.903 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:09:41.196 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:09:41.498 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-09-12T00:09:41.547 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:09:41.772 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-09-12T00:09:41.799 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:09:41.893 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-09-12T00:09:41.922 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:41.987 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-09-12T00:09:42.193 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:09:42.270 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-09-12T00:09:42.519 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:09:42.645 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-09-12T00:09:42.888 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-09-12T00:09:43.281 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-09-12T00:09:43.574 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.2) ... 2024-09-12T00:09:43.658 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:09:43.909 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-09-12T00:09:43.919 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:09:44.053 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:09:44.152 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-09-12T00:09:44.269 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:44.321 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:09:44.447 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:09:44.570 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-idna (3.3-1ubuntu0.1) ... 2024-09-12T00:09:44.572 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:09:44.857 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:09:44.897 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-09-12T00:09:45.117 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:09:45.352 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:09:45.478 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:09:45.771 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:09:46.030 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:09:46.069 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-09-12T00:09:46.273 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:09:46.295 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:09:46.430 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-toml (0.10.2-1) ... 2024-09-12T00:09:46.524 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:09:46.706 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-09-12T00:09:46.767 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:09:46.832 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-09-12T00:09:46.966 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-09-12T00:09:47.043 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:09:47.195 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:09:47.243 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-09-12T00:09:47.471 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:09:47.494 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-09-12T00:09:47.597 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:09:47.747 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:09:47.871 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-09-12T00:09:47.873 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:09:48.166 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:09:48.172 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-09-12T00:09:48.400 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:09:48.431 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-09-12T00:09:48.501 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:09:48.619 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:48.708 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:09:48.708 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-09-12T00:09:48.937 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:09:48.975 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-09-12T00:09:49.063 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:09:49.226 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-09-12T00:09:49.440 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:09:49.683 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:09:49.711 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-09-12T00:09:49.784 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:09:49.811 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-09-12T00:09:50.037 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:09:50.088 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-09-12T00:09:50.163 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:09:50.213 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-09-12T00:09:50.498 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webob (1:1.8.6-1.1ubuntu0.1) ... 2024-09-12T00:09:50.514 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:09:50.799 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-09-12T00:09:50.806 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:09:51.050 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-09-12T00:09:51.074 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:09:51.159 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-09-12T00:09:51.184 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:09:51.285 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-09-12T00:09:51.375 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-09-12T00:09:51.443 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:09:51.620 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-09-12T00:09:51.711 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:09:51.746 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-09-12T00:09:52.055 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:09:52.148 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-09-12T00:09:52.407 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up lua-any (27ubuntu1) ... 2024-09-12T00:09:52.432 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:09:52.519 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-portend (3.0.0-1) ... 2024-09-12T00:09:52.717 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:09:52.770 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-09-12T00:09:52.896 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.2) ... 2024-09-12T00:09:53.036 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:09:53.170 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:53.223 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-09-12T00:09:53.296 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:53.406 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:09:53.532 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-09-12T00:09:53.692 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:53.800 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-09-12T00:09:53.818 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:53.927 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rsa (4.8-1) ... 2024-09-12T00:09:53.944 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:09:54.195 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-09-12T00:09:54.237 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:54.363 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:54.463 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-09-12T00:09:54.489 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:54.701 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:09:54.701 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:09:54.808 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-09-12T00:09:55.182 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:55.202 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-09-12T00:09:55.300 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:55.471 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-09-12T00:09:55.717 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:55.807 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-09-12T00:09:55.934 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librados2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:55.985 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:09:56.069 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsqlite3-mod-ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:56.178 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-09-12T00:09:56.540 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:56.666 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libradosstriper1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:56.793 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-09-12T00:09:57.078 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librbd1 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.188 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.196 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-modules-core (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.290 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.322 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.390 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.500 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.536 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:09:57.536 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-09-12T00:09:57.626 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:57.982 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcephfs-dev (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:58.109 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rados (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:58.168 INFO:teuthology.orchestra.run.smithi078.stdout:Adding group ceph....done 2024-09-12T00:09:58.235 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up librgw2 (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:58.361 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-09-12T00:09:58.503 INFO:teuthology.orchestra.run.smithi078.stdout:Adding system user ceph....done 2024-09-12T00:09:58.663 INFO:teuthology.orchestra.run.smithi078.stdout:Setting system user ceph properties....done 2024-09-12T00:09:58.682 INFO:teuthology.orchestra.run.smithi078.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:09:58.821 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:09:59.189 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:09:59.557 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rbd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:59.658 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up rbd-fuse (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:59.660 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:59.786 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:59.793 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-rgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:09:59.920 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-cephfs (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:00.046 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-common (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:00.254 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:00.254 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:00.598 INFO:teuthology.orchestra.run.smithi171.stdout:Adding group ceph....done 2024-09-12T00:10:00.679 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:00.967 INFO:teuthology.orchestra.run.smithi171.stdout:Adding system user ceph....done 2024-09-12T00:10:01.036 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:10:01.136 INFO:teuthology.orchestra.run.smithi171.stdout:Setting system user ceph properties....done 2024-09-12T00:10:01.152 INFO:teuthology.orchestra.run.smithi171.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-09-12T00:10:01.293 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-09-12T00:10:01.481 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:01.634 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-09-12T00:10:01.704 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:01.704 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:02.100 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-test (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:02.177 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:02.226 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up radosgw (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:02.392 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:02.392 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:02.709 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:02.709 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-09-12T00:10:02.868 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:03.127 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:03.127 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:03.212 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-base (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:03.569 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-09-12T00:10:03.594 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:03.720 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:03.871 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:04.025 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mds (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:04.078 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:04.078 INFO:teuthology.orchestra.run.smithi078.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:04.257 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:04.257 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-09-12T00:10:04.539 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:04.673 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:04.716 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:04.783 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:04.922 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:04.937 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:04.938 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-09-12T00:10:05.279 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:10:05.394 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-osd (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:05.396 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:10:05.547 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:10:05.683 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:05.683 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-09-12T00:10:06.171 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-k8sevents (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:06.298 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-diskprediction-local (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:06.448 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mon (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:06.657 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:10:06.667 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:06.668 INFO:teuthology.orchestra.run.smithi171.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-09-12T00:10:07.150 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-cephadm (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:07.302 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:07.325 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:10:07.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:10:07.385 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-12T00:10:07.427 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-mgr-dashboard (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:07.570 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up ceph-volume (19.3.0-4753-gd011c522-1jammy) ... 2024-09-12T00:10:07.603 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-12T00:10:07.604 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-12T00:10:07.811 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:10:07.811 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:10:07.812 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:10:07.812 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:10:07.812 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:10:07.812 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:10:07.812 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:10:07.815 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-12T00:10:07.815 INFO:teuthology.orchestra.run.smithi078.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:10:07.815 INFO:teuthology.orchestra.run.smithi078.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:10:07.815 INFO:teuthology.orchestra.run.smithi078.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:10:07.816 INFO:teuthology.orchestra.run.smithi078.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:10:07.817 INFO:teuthology.orchestra.run.smithi078.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:10:07.817 INFO:teuthology.orchestra.run.smithi078.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:10:07.817 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-12T00:10:07.817 INFO:teuthology.orchestra.run.smithi078.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:10:07.817 INFO:teuthology.orchestra.run.smithi078.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:10:07.817 INFO:teuthology.orchestra.run.smithi078.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:10:07.818 INFO:teuthology.orchestra.run.smithi078.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:10:07.818 INFO:teuthology.orchestra.run.smithi078.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:10:07.858 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-12T00:10:07.858 INFO:teuthology.orchestra.run.smithi078.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:10:07.858 INFO:teuthology.orchestra.run.smithi078.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:10:07.858 INFO:teuthology.orchestra.run.smithi078.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:10:07.858 INFO:teuthology.orchestra.run.smithi078.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:10:07.859 INFO:teuthology.orchestra.run.smithi078.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:10:07.859 INFO:teuthology.orchestra.run.smithi078.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:10:07.859 INFO:teuthology.orchestra.run.smithi078.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:10:07.859 INFO:teuthology.orchestra.run.smithi078.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:10:07.859 INFO:teuthology.orchestra.run.smithi078.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:10:07.859 INFO:teuthology.orchestra.run.smithi078.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:10:07.859 INFO:teuthology.orchestra.run.smithi078.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:10:07.860 INFO:teuthology.orchestra.run.smithi078.stdout: s3cmd 2024-09-12T00:10:07.913 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:10:07.914 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:10:07.914 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:10:07.914 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:10:07.915 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:10:07.930 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:10:07.931 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:10:07.934 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:10:07.969 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:10:07.983 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:10:07.985 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:10:08.015 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:10:08.036 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:10:08.037 INFO:teuthology.orchestra.run.smithi078.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:10:08.038 INFO:teuthology.orchestra.run.smithi078.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:10:08.088 INFO:teuthology.orchestra.run.smithi078.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:10:08.089 INFO:teuthology.orchestra.run.smithi078.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:10:08.107 INFO:teuthology.orchestra.run.smithi078.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:10:08.107 INFO:teuthology.orchestra.run.smithi078.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:10:08.108 INFO:teuthology.orchestra.run.smithi078.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:10:08.109 INFO:teuthology.orchestra.run.smithi078.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:10:08.109 INFO:teuthology.orchestra.run.smithi078.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:10:08.112 INFO:teuthology.orchestra.run.smithi078.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:10:08.113 INFO:teuthology.orchestra.run.smithi078.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:10:08.119 INFO:teuthology.orchestra.run.smithi078.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:10:08.126 INFO:teuthology.orchestra.run.smithi078.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:10:08.138 INFO:teuthology.orchestra.run.smithi078.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:10:08.139 INFO:teuthology.orchestra.run.smithi078.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:10:08.139 INFO:teuthology.orchestra.run.smithi078.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:10:08.140 INFO:teuthology.orchestra.run.smithi078.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:10:08.140 INFO:teuthology.orchestra.run.smithi078.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:10:08.142 INFO:teuthology.orchestra.run.smithi078.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:10:08.145 INFO:teuthology.orchestra.run.smithi078.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:10:08.147 INFO:teuthology.orchestra.run.smithi078.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:10:08.158 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:10:08.162 INFO:teuthology.orchestra.run.smithi078.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:10:08.162 INFO:teuthology.orchestra.run.smithi078.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:10:08.180 INFO:teuthology.orchestra.run.smithi078.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:10:08.180 INFO:teuthology.orchestra.run.smithi078.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:10:08.180 INFO:teuthology.orchestra.run.smithi078.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:10:08.311 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:10:08.625 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 10.4 MB in 0s (33.2 MB/s) 2024-09-12T00:10:08.695 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:10:08.753 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:10:08.758 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:10:08.803 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:10:09.055 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:10:09.084 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:10:09.123 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:10:09.375 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:10:09.397 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-09-12T00:10:09.402 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:10:09.441 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:10:09.727 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:10:09.757 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:10:09.793 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:10:10.041 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:10:10.043 DEBUG:teuthology.orchestra.run.smithi171:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install s3cmd maven 2024-09-12T00:10:10.054 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:10:10.071 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:10:10.100 INFO:teuthology.orchestra.run.smithi171.stdout:Reading package lists... 2024-09-12T00:10:10.104 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:10:10.309 INFO:teuthology.orchestra.run.smithi171.stdout:Building dependency tree... 2024-09-12T00:10:10.310 INFO:teuthology.orchestra.run.smithi171.stdout:Reading state information... 2024-09-12T00:10:10.357 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:10:10.375 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:10:10.415 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:10:10.497 INFO:teuthology.orchestra.run.smithi171.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:10:10.497 INFO:teuthology.orchestra.run.smithi171.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:10:10.497 INFO:teuthology.orchestra.run.smithi171.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:10:10.497 INFO:teuthology.orchestra.run.smithi171.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:10:10.498 INFO:teuthology.orchestra.run.smithi171.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:10:10.498 INFO:teuthology.orchestra.run.smithi171.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:10:10.498 INFO:teuthology.orchestra.run.smithi171.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:10:10.499 INFO:teuthology.orchestra.run.smithi171.stdout:The following additional packages will be installed: 2024-09-12T00:10:10.499 INFO:teuthology.orchestra.run.smithi171.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:10:10.499 INFO:teuthology.orchestra.run.smithi171.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:10:10.499 INFO:teuthology.orchestra.run.smithi171.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:10:10.499 INFO:teuthology.orchestra.run.smithi171.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout: libwagon-http-shaded-java libwagon-provider-api-java python3-magic 2024-09-12T00:10:10.500 INFO:teuthology.orchestra.run.smithi171.stdout:Suggested packages: 2024-09-12T00:10:10.501 INFO:teuthology.orchestra.run.smithi171.stdout: libaopalliance-java-doc libatinject-jsr330-api-java-doc libel-api-java 2024-09-12T00:10:10.501 INFO:teuthology.orchestra.run.smithi171.stdout: libcommons-io-java-doc libcommons-lang3-java-doc libasm-java libcglib-java 2024-09-12T00:10:10.501 INFO:teuthology.orchestra.run.smithi171.stdout: libjsr305-java-doc libmaven-shared-utils-java-doc liblogback-java 2024-09-12T00:10:10.501 INFO:teuthology.orchestra.run.smithi171.stdout: libplexus-classworlds-java-doc libplexus-sec-dispatcher-java-doc 2024-09-12T00:10:10.501 INFO:teuthology.orchestra.run.smithi171.stdout: libplexus-utils2-java-doc testng libcommons-logging-java liblog4j1.2-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout:The following NEW packages will be installed: 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libaopalliance-java libapache-pom-java libatinject-jsr330-api-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libcdi-api-java libcommons-cli-java libcommons-io-java libcommons-lang3-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libcommons-parent-java libgeronimo-annotation-1.3-spec-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libgeronimo-interceptor-3.0-spec-java libguava-java libguice-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libhawtjni-runtime-java libjansi-java libjansi-native-java libjsr305-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libmaven-parent-java libmaven-resolver-java libmaven-shared-utils-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libmaven3-core-java libplexus-cipher-java libplexus-classworlds-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libplexus-component-annotations-java libplexus-interpolation-java 2024-09-12T00:10:10.539 INFO:teuthology.orchestra.run.smithi171.stdout: libplexus-sec-dispatcher-java libplexus-utils2-java libsisu-inject-java 2024-09-12T00:10:10.540 INFO:teuthology.orchestra.run.smithi171.stdout: libsisu-plexus-java libslf4j-java libwagon-file-java 2024-09-12T00:10:10.540 INFO:teuthology.orchestra.run.smithi171.stdout: libwagon-http-shaded-java libwagon-provider-api-java maven python3-magic 2024-09-12T00:10:10.540 INFO:teuthology.orchestra.run.smithi171.stdout: s3cmd 2024-09-12T00:10:10.603 INFO:teuthology.orchestra.run.smithi171.stdout:0 upgraded, 35 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:10:10.603 INFO:teuthology.orchestra.run.smithi171.stdout:Need to get 10.4 MB of archives. 2024-09-12T00:10:10.603 INFO:teuthology.orchestra.run.smithi171.stdout:After this operation, 13.9 MB of additional disk space will be used. 2024-09-12T00:10:10.603 INFO:teuthology.orchestra.run.smithi171.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libapache-pom-java all 18-1 [4,720 B] 2024-09-12T00:10:10.621 INFO:teuthology.orchestra.run.smithi171.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libatinject-jsr330-api-java all 1.0+ds1-5 [5,348 B] 2024-09-12T00:10:10.621 INFO:teuthology.orchestra.run.smithi171.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-interceptor-3.0-spec-java all 1.0.1-4fakesync [8,616 B] 2024-09-12T00:10:10.627 INFO:teuthology.orchestra.run.smithi171.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcdi-api-java all 1.2-3 [54.3 kB] 2024-09-12T00:10:10.661 INFO:teuthology.orchestra.run.smithi171.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-cli-java all 1.4-2 [55.8 kB] 2024-09-12T00:10:10.667 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:10:10.676 INFO:teuthology.orchestra.run.smithi171.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-parent-java all 43-1 [10.8 kB] 2024-09-12T00:10:10.679 INFO:teuthology.orchestra.run.smithi171.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-io-java all 2.11.0-2 [297 kB] 2024-09-12T00:10:10.695 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:10:10.709 INFO:teuthology.orchestra.run.smithi171.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libcommons-lang3-java all 3.11-1 [526 kB] 2024-09-12T00:10:10.729 INFO:teuthology.orchestra.run.smithi171.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libgeronimo-annotation-1.3-spec-java all 1.3-1 [11.2 kB] 2024-09-12T00:10:10.730 INFO:teuthology.orchestra.run.smithi171.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjsr305-java all 0.1~+svn49-11 [27.0 kB] 2024-09-12T00:10:10.731 INFO:teuthology.orchestra.run.smithi171.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguava-java all 29.0-6 [2,418 kB] 2024-09-12T00:10:10.734 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:10:10.777 INFO:teuthology.orchestra.run.smithi171.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libaopalliance-java all 20070526-6 [9,084 B] 2024-09-12T00:10:10.778 INFO:teuthology.orchestra.run.smithi171.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libguice-java all 4.2.3-2 [1,434 kB] 2024-09-12T00:10:10.795 INFO:teuthology.orchestra.run.smithi171.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libhawtjni-runtime-java all 1.17-1 [28.8 kB] 2024-09-12T00:10:10.795 INFO:teuthology.orchestra.run.smithi171.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-native-java all 1.8-1 [23.8 kB] 2024-09-12T00:10:10.796 INFO:teuthology.orchestra.run.smithi171.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libjansi-java all 1.18-1 [56.8 kB] 2024-09-12T00:10:10.797 INFO:teuthology.orchestra.run.smithi171.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-parent-java all 31-2 [5,140 B] 2024-09-12T00:10:10.797 INFO:teuthology.orchestra.run.smithi171.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-utils2-java all 3.3.0-1 [250 kB] 2024-09-12T00:10:10.801 INFO:teuthology.orchestra.run.smithi171.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-provider-api-java all 3.3.4-1 [48.5 kB] 2024-09-12T00:10:10.801 INFO:teuthology.orchestra.run.smithi171.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven-resolver-java all 1.4.2-3build1 [555 kB] 2024-09-12T00:10:10.806 INFO:teuthology.orchestra.run.smithi171.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libmaven-shared-utils-java all 3.3.0-1ubuntu0.22.04.1 [148 kB] 2024-09-12T00:10:10.808 INFO:teuthology.orchestra.run.smithi171.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-cipher-java all 1.8-2 [15.1 kB] 2024-09-12T00:10:10.814 INFO:teuthology.orchestra.run.smithi171.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-classworlds-java all 2.6.0-1 [49.4 kB] 2024-09-12T00:10:10.825 INFO:teuthology.orchestra.run.smithi171.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-component-annotations-java all 2.1.0-1 [6,564 B] 2024-09-12T00:10:10.825 INFO:teuthology.orchestra.run.smithi171.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-interpolation-java all 1.26-1 [76.8 kB] 2024-09-12T00:10:10.826 INFO:teuthology.orchestra.run.smithi171.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libplexus-sec-dispatcher-java all 1.4-4 [28.1 kB] 2024-09-12T00:10:10.827 INFO:teuthology.orchestra.run.smithi171.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libslf4j-java all 1.7.32-1 [141 kB] 2024-09-12T00:10:10.828 INFO:teuthology.orchestra.run.smithi171.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-inject-java all 0.3.4-2 [347 kB] 2024-09-12T00:10:10.831 INFO:teuthology.orchestra.run.smithi171.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libsisu-plexus-java all 0.3.4-3 [181 kB] 2024-09-12T00:10:10.833 INFO:teuthology.orchestra.run.smithi171.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libmaven3-core-java all 3.6.3-5 [1,535 kB] 2024-09-12T00:10:10.847 INFO:teuthology.orchestra.run.smithi171.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-file-java all 3.3.4-1 [7,928 B] 2024-09-12T00:10:10.847 INFO:teuthology.orchestra.run.smithi171.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libwagon-http-shaded-java all 3.3.4-1 [1,855 kB] 2024-09-12T00:10:10.865 INFO:teuthology.orchestra.run.smithi171.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/universe amd64 maven all 3.6.3-5 [17.8 kB] 2024-09-12T00:10:10.865 INFO:teuthology.orchestra.run.smithi171.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-magic all 2:0.4.24-2 [12.6 kB] 2024-09-12T00:10:10.865 INFO:teuthology.orchestra.run.smithi171.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/universe amd64 s3cmd all 2.2.0-1 [120 kB] 2024-09-12T00:10:11.003 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:10:11.032 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:10:11.069 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:10:11.245 INFO:teuthology.orchestra.run.smithi171.stdout:Fetched 10.4 MB in 0s (32.6 MB/s) 2024-09-12T00:10:11.329 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libapache-pom-java. 2024-09-12T00:10:11.388 INFO:teuthology.orchestra.run.smithi171.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 176248 files and directories currently installed.) 2024-09-12T00:10:11.393 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../00-libapache-pom-java_18-1_all.deb ... 2024-09-12T00:10:11.437 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libapache-pom-java (18-1) ... 2024-09-12T00:10:11.440 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:10:11.469 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:10:11.506 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:10:11.698 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libatinject-jsr330-api-java. 2024-09-12T00:10:11.715 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../01-libatinject-jsr330-api-java_1.0+ds1-5_all.deb ... 2024-09-12T00:10:11.742 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:10:11.757 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:10:11.771 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:10:11.809 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:10:11.976 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libgeronimo-interceptor-3.0-spec-java. 2024-09-12T00:10:11.993 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../02-libgeronimo-interceptor-3.0-spec-java_1.0.1-4fakesync_all.deb ... 2024-09-12T00:10:12.035 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:10:12.070 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:10:12.086 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:10:12.128 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:10:12.289 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcdi-api-java. 2024-09-12T00:10:12.316 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../03-libcdi-api-java_1.2-3_all.deb ... 2024-09-12T00:10:12.355 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcdi-api-java (1.2-3) ... 2024-09-12T00:10:12.522 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:10:12.539 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:10:12.572 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:10:12.633 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcommons-cli-java. 2024-09-12T00:10:12.661 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../04-libcommons-cli-java_1.4-2_all.deb ... 2024-09-12T00:10:12.700 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcommons-cli-java (1.4-2) ... 2024-09-12T00:10:12.791 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:10:12.820 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:10:12.858 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:10:12.919 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcommons-parent-java. 2024-09-12T00:10:12.936 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../05-libcommons-parent-java_43-1_all.deb ... 2024-09-12T00:10:12.978 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcommons-parent-java (43-1) ... 2024-09-12T00:10:13.228 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:10:13.230 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcommons-io-java. 2024-09-12T00:10:13.245 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:10:13.247 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../06-libcommons-io-java_2.11.0-2_all.deb ... 2024-09-12T00:10:13.286 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:10:13.289 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcommons-io-java (2.11.0-2) ... 2024-09-12T00:10:13.539 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:10:13.550 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libcommons-lang3-java. 2024-09-12T00:10:13.555 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:10:13.567 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../07-libcommons-lang3-java_3.11-1_all.deb ... 2024-09-12T00:10:13.597 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:10:13.609 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libcommons-lang3-java (3.11-1) ... 2024-09-12T00:10:13.850 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:10:13.862 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libgeronimo-annotation-1.3-spec-java. 2024-09-12T00:10:13.874 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:10:13.878 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../08-libgeronimo-annotation-1.3-spec-java_1.3-1_all.deb ... 2024-09-12T00:10:13.912 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:10:13.916 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:10:14.165 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjsr305-java. 2024-09-12T00:10:14.177 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:10:14.193 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../09-libjsr305-java_0.1~+svn49-11_all.deb ... 2024-09-12T00:10:14.205 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:10:14.231 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:10:14.243 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:10:14.454 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:10:14.482 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:10:14.485 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libguava-java. 2024-09-12T00:10:14.501 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../10-libguava-java_29.0-6_all.deb ... 2024-09-12T00:10:14.521 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:10:14.543 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libguava-java (29.0-6) ... 2024-09-12T00:10:14.798 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:10:14.814 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:10:14.857 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:10:14.938 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libaopalliance-java. 2024-09-12T00:10:14.955 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../11-libaopalliance-java_20070526-6_all.deb ... 2024-09-12T00:10:14.988 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libaopalliance-java (20070526-6) ... 2024-09-12T00:10:15.092 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:10:15.109 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:10:15.151 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:10:15.457 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:10:15.460 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libguice-java. 2024-09-12T00:10:15.471 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:10:15.489 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../12-libguice-java_4.2.3-2_all.deb ... 2024-09-12T00:10:15.513 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:10:15.536 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libguice-java (4.2.3-2) ... 2024-09-12T00:10:15.748 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:10:15.762 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:10:15.798 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:10:15.882 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libhawtjni-runtime-java. 2024-09-12T00:10:15.898 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../13-libhawtjni-runtime-java_1.17-1_all.deb ... 2024-09-12T00:10:15.940 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:10:16.026 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:10:16.042 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:10:16.084 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:10:16.177 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjansi-native-java. 2024-09-12T00:10:16.193 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../14-libjansi-native-java_1.8-1_all.deb ... 2024-09-12T00:10:16.235 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjansi-native-java (1.8-1) ... 2024-09-12T00:10:16.336 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:10:16.365 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:10:16.488 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libjansi-java. 2024-09-12T00:10:16.513 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:10:16.516 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../15-libjansi-java_1.18-1_all.deb ... 2024-09-12T00:10:16.555 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libjansi-java (1.18-1) ... 2024-09-12T00:10:16.748 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:10:16.765 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:10:16.774 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmaven-parent-java. 2024-09-12T00:10:16.791 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../16-libmaven-parent-java_31-2_all.deb ... 2024-09-12T00:10:16.806 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:10:16.824 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmaven-parent-java (31-2) ... 2024-09-12T00:10:17.052 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libplexus-utils2-java. 2024-09-12T00:10:17.067 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:10:17.069 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../17-libplexus-utils2-java_3.3.0-1_all.deb ... 2024-09-12T00:10:17.083 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:10:17.111 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:10:17.117 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:10:17.345 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:10:17.373 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:10:17.389 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libwagon-provider-api-java. 2024-09-12T00:10:17.405 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../18-libwagon-provider-api-java_3.3.4-1_all.deb ... 2024-09-12T00:10:17.411 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:10:17.447 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:10:17.690 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:10:17.701 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmaven-resolver-java. 2024-09-12T00:10:17.706 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:10:17.734 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../19-libmaven-resolver-java_1.4.2-3build1_all.deb ... 2024-09-12T00:10:17.748 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:10:17.767 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:10:18.051 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:10:18.067 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:10:18.072 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmaven-shared-utils-java. 2024-09-12T00:10:18.089 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../20-libmaven-shared-utils-java_3.3.0-1ubuntu0.22.04.1_all.deb ... 2024-09-12T00:10:18.109 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:10:18.131 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:10:18.370 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:10:18.386 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:10:18.392 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libplexus-cipher-java. 2024-09-12T00:10:18.408 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../21-libplexus-cipher-java_1.8-2_all.deb ... 2024-09-12T00:10:18.428 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:10:18.469 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libplexus-cipher-java (1.8-2) ... 2024-09-12T00:10:18.729 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libplexus-classworlds-java. 2024-09-12T00:10:18.745 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../22-libplexus-classworlds-java_2.6.0-1_all.deb ... 2024-09-12T00:10:18.782 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:10:18.787 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:10:18.796 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:10:18.840 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:10:19.040 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libplexus-component-annotations-java. 2024-09-12T00:10:19.068 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../23-libplexus-component-annotations-java_2.1.0-1_all.deb ... 2024-09-12T00:10:19.093 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:10:19.098 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:10:19.109 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:10:19.151 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:10:19.334 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libplexus-interpolation-java. 2024-09-12T00:10:19.351 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../24-libplexus-interpolation-java_1.26-1_all.deb ... 2024-09-12T00:10:19.393 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:10:19.612 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package maven. 2024-09-12T00:10:19.640 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:10:19.654 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libplexus-sec-dispatcher-java. 2024-09-12T00:10:19.671 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../25-libplexus-sec-dispatcher-java_1.4-4_all.deb ... 2024-09-12T00:10:19.678 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:10:19.713 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:10:19.966 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libslf4j-java. 2024-09-12T00:10:19.982 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:10:19.993 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../26-libslf4j-java_1.7.32-1_all.deb ... 2024-09-12T00:10:19.998 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:10:20.024 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libslf4j-java (1.7.32-1) ... 2024-09-12T00:10:20.032 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:10:20.271 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsisu-inject-java. 2024-09-12T00:10:20.299 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../27-libsisu-inject-java_0.3.4-2_all.deb ... 2024-09-12T00:10:20.318 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:10:20.337 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:10:20.346 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:10:20.386 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:10:20.739 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:10:20.865 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:10:20.990 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:10:21.110 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libsisu-plexus-java. 2024-09-12T00:10:21.116 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:10:21.138 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../28-libsisu-plexus-java_0.3.4-3_all.deb ... 2024-09-12T00:10:21.176 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:10:21.242 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:10:21.368 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:10:21.446 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libmaven3-core-java. 2024-09-12T00:10:21.592 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:10:21.593 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../29-libmaven3-core-java_3.6.3-5_all.deb ... 2024-09-12T00:10:21.593 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:10:21.671 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:10:21.805 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:10:21.893 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libwagon-file-java. 2024-09-12T00:10:21.909 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../30-libwagon-file-java_3.3.4-1_all.deb ... 2024-09-12T00:10:21.914 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:10:21.951 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libwagon-file-java (3.3.4-1) ... 2024-09-12T00:10:22.040 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:10:22.166 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:10:22.213 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package libwagon-http-shaded-java. 2024-09-12T00:10:22.241 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../31-libwagon-http-shaded-java_3.3.4-1_all.deb ... 2024-09-12T00:10:22.279 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:10:22.292 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:10:22.418 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:10:22.544 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:10:22.670 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:10:22.724 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package maven. 2024-09-12T00:10:22.753 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../32-maven_3.6.3-5_all.deb ... 2024-09-12T00:10:22.791 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking maven (3.6.3-5) ... 2024-09-12T00:10:22.938 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:10:23.047 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:10:23.111 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package python3-magic. 2024-09-12T00:10:23.140 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../33-python3-magic_2%3a0.4.24-2_all.deb ... 2024-09-12T00:10:23.156 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:10:23.178 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking python3-magic (2:0.4.24-2) ... 2024-09-12T00:10:23.282 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:10:23.409 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:10:23.440 INFO:teuthology.orchestra.run.smithi171.stdout:Selecting previously unselected package s3cmd. 2024-09-12T00:10:23.456 INFO:teuthology.orchestra.run.smithi171.stdout:Preparing to unpack .../34-s3cmd_2.2.0-1_all.deb ... 2024-09-12T00:10:23.490 INFO:teuthology.orchestra.run.smithi171.stdout:Unpacking s3cmd (2.2.0-1) ... 2024-09-12T00:10:23.534 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:10:23.660 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:10:23.836 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libslf4j-java (1.7.32-1) ... 2024-09-12T00:10:23.961 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:10:23.963 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libplexus-utils2-java (3.3.0-1) ... 2024-09-12T00:10:24.065 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libplexus-classworlds-java (2.6.0-1) ... 2024-09-12T00:10:24.087 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:10:24.191 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjsr305-java (0.1~+svn49-11) ... 2024-09-12T00:10:24.205 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:10:24.307 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:10:24.319 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libaopalliance-java (20070526-6) ... 2024-09-12T00:10:24.407 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:10:24.443 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcommons-cli-java (1.4-2) ... 2024-09-12T00:10:24.525 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:10:24.570 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libplexus-component-annotations-java (2.1.0-1) ... 2024-09-12T00:10:24.650 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:10:24.696 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libplexus-cipher-java (1.8-2) ... 2024-09-12T00:10:24.776 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:10:24.822 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libgeronimo-annotation-1.3-spec-java (1.3-1) ... 2024-09-12T00:10:24.902 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:10:24.923 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libgeronimo-interceptor-3.0-spec-java (1.0.1-4fakesync) ... 2024-09-12T00:10:25.028 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:10:25.049 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libapache-pom-java (18-1) ... 2024-09-12T00:10:25.154 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:10:25.200 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libatinject-jsr330-api-java (1.0+ds1-5) ... 2024-09-12T00:10:25.289 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:10:25.327 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libplexus-interpolation-java (1.26-1) ... 2024-09-12T00:10:25.454 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libplexus-sec-dispatcher-java (1.4-4) ... 2024-09-12T00:10:25.506 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:10:25.588 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libwagon-http-shaded-java (3.3.4-1) ... 2024-09-12T00:10:25.609 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:10:25.714 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up python3-magic (2:0.4.24-2) ... 2024-09-12T00:10:25.965 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcdi-api-java (1.2-3) ... 2024-09-12T00:10:26.092 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libhawtjni-runtime-java (1.17-1) ... 2024-09-12T00:10:26.261 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libwagon-provider-api-java (3.3.4-1) ... 2024-09-12T00:10:26.371 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmaven-parent-java (31-2) ... 2024-09-12T00:10:26.505 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcommons-parent-java (43-1) ... 2024-09-12T00:10:26.631 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsisu-inject-java (0.3.4-2) ... 2024-09-12T00:10:26.758 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up s3cmd (2.2.0-1) ... 2024-09-12T00:10:26.985 INFO:teuthology.orchestra.run.smithi078.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:10:26.991 DEBUG:teuthology.parallel:result is None 2024-09-12T00:10:27.059 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libsisu-plexus-java (0.3.4-3) ... 2024-09-12T00:10:27.186 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmaven-resolver-java (1.4.2-3build1) ... 2024-09-12T00:10:27.312 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libguava-java (29.0-6) ... 2024-09-12T00:10:27.430 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcommons-lang3-java (3.11-1) ... 2024-09-12T00:10:27.556 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjansi-native-java (1.8-1) ... 2024-09-12T00:10:27.682 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libwagon-file-java (3.3.4-1) ... 2024-09-12T00:10:27.810 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libcommons-io-java (2.11.0-2) ... 2024-09-12T00:10:27.943 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libguice-java (4.2.3-2) ... 2024-09-12T00:10:28.069 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libjansi-java (1.18-1) ... 2024-09-12T00:10:28.221 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmaven-shared-utils-java (3.3.0-1ubuntu0.22.04.1) ... 2024-09-12T00:10:28.339 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up libmaven3-core-java (3.6.3-5) ... 2024-09-12T00:10:28.465 INFO:teuthology.orchestra.run.smithi171.stdout:Setting up maven (3.6.3-5) ... 2024-09-12T00:10:28.747 INFO:teuthology.orchestra.run.smithi171.stdout:update-alternatives: using /usr/share/maven/bin/mvn to provide /usr/bin/mvn (mvn) in auto mode 2024-09-12T00:10:28.820 INFO:teuthology.orchestra.run.smithi171.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:10:30.158 INFO:teuthology.orchestra.run.smithi171.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-09-12T00:10:30.163 DEBUG:teuthology.parallel:result is None 2024-09-12T00:10:30.164 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:10:30.316 DEBUG:teuthology.orchestra.run.smithi078:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:10:30.338 INFO:teuthology.orchestra.run.smithi078.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:10:30.339 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:10:30.339 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:10:30.341 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d011c522bb171e70fc5782f1e7a71ce5f37e573f 2024-09-12T00:10:30.493 DEBUG:teuthology.orchestra.run.smithi171:> dpkg-query -W -f '${Version}' ceph 2024-09-12T00:10:30.512 INFO:teuthology.orchestra.run.smithi171.stdout:19.3.0-4753-gd011c522-1jammy 2024-09-12T00:10:30.513 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4753-gd011c522-1jammy 2024-09-12T00:10:30.513 INFO:teuthology.task.install:The correct ceph version 19.3.0-4753-gd011c522-1jammy is installed. 2024-09-12T00:10:30.516 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-12T00:10:30.516 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:30.516 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:10:30.531 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:10:30.531 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-12T00:10:30.571 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-12T00:10:30.571 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:30.572 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:10:30.586 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:10:30.640 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:10:30.640 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/daemon-helper 2024-09-12T00:10:30.654 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-12T00:10:30.710 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-12T00:10:30.711 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:30.711 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:10:30.725 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:10:30.781 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:10:30.781 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-12T00:10:30.795 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-12T00:10:30.849 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-12T00:10:30.849 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:30.849 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:10:30.862 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:10:30.916 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:10:30.916 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/usr/bin/stdin-killer 2024-09-12T00:10:30.929 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-12T00:10:30.985 INFO:teuthology.run_tasks:Running task ceph... 2024-09-12T00:10:31.066 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-12T00:10:31.066 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 777 /var/log/ceph 2024-09-12T00:10:31.069 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 777 /var/log/ceph 2024-09-12T00:10:31.082 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-12T00:10:31.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:10:31.126 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-12T00:10:31.139 INFO:tasks.ceph:Creating extra log directories... 2024-09-12T00:10:31.139 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:10:31.182 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-12T00:10:31.205 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-12T00:10:31.206 INFO:tasks.ceph:config {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-12T00:10:31.206 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830', 'branch': 'wip-cls-rgw-busy-resharding', 'description': 'rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep}', 'email': None, 'first_in_suite': False, 'job_id': '7901830', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cls-rgw-busy-resharding'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'global': {'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'lockdep': True}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', '\\(OSD_SLOW_PING_TIME'], 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, 'rgw': {'compression type': 'random', 'ec-data-pool': True, 'frontend': 'beast', 'storage classes': 'LUKEWARM, FROZEN'}, 's3tests': {'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-67986', 'sha1': '6a169fc940965ab446a63954fde870aa497efde7'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 90, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 2206, 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-67986', 'suite_path': '/home/teuthworker/src/github.com_cbodley_ceph_6a169fc940965ab446a63954fde870aa497efde7/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/cbodley/ceph.git', 'suite_sha1': '6a169fc940965ab446a63954fde870aa497efde7', 'targets': {'smithi078.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBE9joc2NYjgNhtXsS8kx91Vb3mIwzGDEKU/v2sy01Q1LvFExs5BSLu07/bq7wOtruMwOXEWGeEv7VilLPBHNDWQ=', 'smithi171.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKefAEex4lXE77I7AlGUGIKT8n/siG+WHYz9da3xoXO7AXvy/iZMVqO9+64Up6adj5uBRS+/082b1Gvx5bbNN7U='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_system_packages': {'deb': ['s3cmd', 'maven'], 'rpm': ['s3cmd', 'maven']}, 'flavor': 'default', 'sha1': 'd011c522bb171e70fc5782f1e7a71ce5f37e573f'}}, {'ceph': None}, {'openssl_keys': None}, {'rgw': {'client.0': None}}, {'tox': ['client.0']}, {'workunit': {'clients': {'client.0': ['rgw/run-bucket-check.sh']}}}, {'workunit': {'clients': {'client.0': ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh']}}}, {'workunit': {'clients': {'client.0': ['rgw/test_rgw_s3_mp_reupload.sh']}}}, {'ragweed': {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-reshard.sh']}}}, {'s3tests-java': {'client.0': {'force-branch': 'ceph-master', 'force-repo': 'https://github.com/ceph/java_s3tests.git'}}}, {'s3tests': {'client.0': {'rgw_server': 'client.0'}}}, {'workunit': {'clients': {'client.0': ['rgw/run-versioning.sh']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-11_23:33:24', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-12T00:10:31.206 DEBUG:teuthology.orchestra.run.smithi078:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:10:31.238 DEBUG:teuthology.orchestra.run.smithi171:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-12T00:10:31.243 DEBUG:teuthology.orchestra.run.smithi078:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:10:31.286 DEBUG:teuthology.orchestra.run.smithi171:> sudo install -d -m0777 -- /var/run/ceph 2024-09-12T00:10:31.299 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:31.299 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:10:31.346 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:10:31.346 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_1 2024-09-12T00:10:31.394 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:10:31.394 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:31.394 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 874 Links: 1 2024-09-12T00:10:31.394 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:31.394 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-12 00:04:42.548951433 +0000 2024-09-12T00:10:31.395 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-12 00:04:42.300953648 +0000 2024-09-12T00:10:31.395 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-12 00:04:42.300953648 +0000 2024-09-12T00:10:31.395 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-12T00:10:31.395 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:10:31.447 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-12T00:10:31.447 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-12T00:10:31.448 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000451157 s, 1.1 MB/s 2024-09-12T00:10:31.449 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:10:31.499 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_2 2024-09-12T00:10:31.545 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:10:31.545 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:31.545 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 888 Links: 1 2024-09-12T00:10:31.545 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:31.545 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-12 00:04:43.044947002 +0000 2024-09-12T00:10:31.545 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-12 00:04:42.788949289 +0000 2024-09-12T00:10:31.546 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-12 00:04:42.788949289 +0000 2024-09-12T00:10:31.546 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-12T00:10:31.546 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:10:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-12T00:10:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-12T00:10:31.599 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000310642 s, 1.6 MB/s 2024-09-12T00:10:31.600 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:10:31.652 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_3 2024-09-12T00:10:31.705 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:10:31.706 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:31.706 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 909 Links: 1 2024-09-12T00:10:31.706 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:31.706 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-12 00:04:43.560942393 +0000 2024-09-12T00:10:31.706 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-12 00:04:43.276944929 +0000 2024-09-12T00:10:31.706 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-12 00:04:43.276944929 +0000 2024-09-12T00:10:31.706 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-12T00:10:31.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:10:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-12T00:10:31.760 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-12T00:10:31.760 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.000438227 s, 1.2 MB/s 2024-09-12T00:10:31.761 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:10:31.812 DEBUG:teuthology.orchestra.run.smithi078:> stat /dev/vg_nvme/lv_4 2024-09-12T00:10:31.862 INFO:teuthology.orchestra.run.smithi078.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:10:31.862 INFO:teuthology.orchestra.run.smithi078.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:31.862 INFO:teuthology.orchestra.run.smithi078.stdout:Device: 5h/5d Inode: 928 Links: 1 2024-09-12T00:10:31.863 INFO:teuthology.orchestra.run.smithi078.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:31.863 INFO:teuthology.orchestra.run.smithi078.stdout:Access: 2024-09-12 00:04:44.056937963 +0000 2024-09-12T00:10:31.863 INFO:teuthology.orchestra.run.smithi078.stdout:Modify: 2024-09-12 00:04:43.800940249 +0000 2024-09-12T00:10:31.863 INFO:teuthology.orchestra.run.smithi078.stdout:Change: 2024-09-12 00:04:43.800940249 +0000 2024-09-12T00:10:31.864 INFO:teuthology.orchestra.run.smithi078.stdout: Birth: - 2024-09-12T00:10:31.864 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:10:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records in 2024-09-12T00:10:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:1+0 records out 2024-09-12T00:10:31.916 INFO:teuthology.orchestra.run.smithi078.stderr:512 bytes copied, 0.00038749 s, 1.3 MB/s 2024-09-12T00:10:31.918 DEBUG:teuthology.orchestra.run.smithi078:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:10:31.966 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:31.967 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:10:31.967 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/scratch_devs of=/dev/stdout 2024-09-12T00:10:31.973 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-12T00:10:31.974 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_1 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 880 Links: 1 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-12 00:04:37.939165951 +0000 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-12 00:04:37.699168095 +0000 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-12 00:04:37.699168095 +0000 2024-09-12T00:10:32.022 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-12T00:10:32.023 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-12T00:10:32.077 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-12T00:10:32.077 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-12T00:10:32.077 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000383597 s, 1.3 MB/s 2024-09-12T00:10:32.078 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-12T00:10:32.127 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_2 2024-09-12T00:10:32.173 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-12T00:10:32.174 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:32.174 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-09-12T00:10:32.174 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:32.174 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-12 00:04:38.167163915 +0000 2024-09-12T00:10:32.174 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-12 00:04:38.163163950 +0000 2024-09-12T00:10:32.174 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-12 00:04:38.163163950 +0000 2024-09-12T00:10:32.174 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-12T00:10:32.174 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-12T00:10:32.229 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-12T00:10:32.229 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-12T00:10:32.229 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000393319 s, 1.3 MB/s 2024-09-12T00:10:32.230 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-12T00:10:32.279 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_3 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 914 Links: 1 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-12 00:04:38.919157197 +0000 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-12 00:04:38.675159378 +0000 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-12 00:04:38.675159378 +0000 2024-09-12T00:10:32.326 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-12T00:10:32.327 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-12T00:10:32.380 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-12T00:10:32.381 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-12T00:10:32.381 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000444013 s, 1.2 MB/s 2024-09-12T00:10:32.382 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-12T00:10:32.431 DEBUG:teuthology.orchestra.run.smithi171:> stat /dev/vg_nvme/lv_4 2024-09-12T00:10:32.477 INFO:teuthology.orchestra.run.smithi171.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-12T00:10:32.478 INFO:teuthology.orchestra.run.smithi171.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-12T00:10:32.478 INFO:teuthology.orchestra.run.smithi171.stdout:Device: 5h/5d Inode: 930 Links: 1 2024-09-12T00:10:32.478 INFO:teuthology.orchestra.run.smithi171.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-12T00:10:32.478 INFO:teuthology.orchestra.run.smithi171.stdout:Access: 2024-09-12 00:04:39.191154768 +0000 2024-09-12T00:10:32.478 INFO:teuthology.orchestra.run.smithi171.stdout:Modify: 2024-09-12 00:04:39.187154804 +0000 2024-09-12T00:10:32.478 INFO:teuthology.orchestra.run.smithi171.stdout:Change: 2024-09-12 00:04:39.187154804 +0000 2024-09-12T00:10:32.478 INFO:teuthology.orchestra.run.smithi171.stdout: Birth: - 2024-09-12T00:10:32.478 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-12T00:10:32.532 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records in 2024-09-12T00:10:32.532 INFO:teuthology.orchestra.run.smithi171.stderr:1+0 records out 2024-09-12T00:10:32.532 INFO:teuthology.orchestra.run.smithi171.stderr:512 bytes copied, 0.000392906 s, 1.3 MB/s 2024-09-12T00:10:32.533 DEBUG:teuthology.orchestra.run.smithi171:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-12T00:10:32.583 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:32.583 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:10:32.583 INFO:tasks.ceph:Generating config... 2024-09-12T00:10:32.584 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-12T00:10:32.584 INFO:tasks.ceph:[client] debug rgw notification = 20 2024-09-12T00:10:32.584 INFO:tasks.ceph:[client] rgw bucket counters cache = True 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw crypt require ssl = False 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw crypt s3 kms backend = testing 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw reshard progress judge interval = 10 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw s3 auth use sts = True 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw sts key = abcdefghijklmnop 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw torrent flag = True 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] rgw user counters cache = True 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-12T00:10:32.585 INFO:tasks.ceph:[client] setuser = ceph 2024-09-12T00:10:32.585 INFO:tasks.ceph:[global] mon client directed command retry = 5 2024-09-12T00:10:32.585 INFO:tasks.ceph:[global] ms inject socket failures = 5000 2024-09-12T00:10:32.585 INFO:tasks.ceph:[global] osd_max_pg_log_entries = 10 2024-09-12T00:10:32.585 INFO:tasks.ceph:[global] osd_min_pg_log_entries = 10 2024-09-12T00:10:32.586 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-12T00:10:32.586 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-12T00:10:32.586 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-12T00:10:32.586 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-12T00:10:32.586 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-12T00:10:32.586 INFO:tasks.ceph:[mon] lockdep = True 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-12T00:10:32.586 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] lockdep = True 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-12T00:10:32.587 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-09-12T00:10:32.587 INFO:tasks.ceph:Setting up mon.a... 2024-09-12T00:10:32.588 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-12T00:10:32.621 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.keyring 2024-09-12T00:10:32.629 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-12T00:10:32.706 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:10:32.762 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.78'), ('mon.c', '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]'), ('mon.b', '172.21.15.171')] 2024-09-12T00:10:32.762 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.171', 'mon client directed command retry': 5, 'ms inject socket failures': 5000, 'osd_max_pg_log_entries': 10, 'osd_min_pg_log_entries': 10}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug objclass': 20, 'debug osd': 20, 'debug rocksdb': '4/10', 'lockdep': True, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'lockdep': True}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug rgw': 20, 'debug rgw notification': 20, 'rgw bucket counters cache': True, 'rgw crypt require ssl': False, 'rgw crypt s3 kms backend': 'testing', 'rgw crypt s3 kms encryption keys': 'testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo=', 'rgw reshard progress judge interval': 10, 'rgw s3 auth use sts': True, 'rgw sts key': 'abcdefghijklmnop', 'rgw torrent flag': True, 'rgw user counters cache': True, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-09-12T00:10:32.763 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:32.763 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:10:32.809 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.78 --addv c '[v2:172.21.15.78:3301,v1:172.21.15.78:6790]' --add b 172.21.15.171 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:32.896 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:10:32.896 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: generated fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:setting min_mon_release = quincy 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:epoch 0 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:min_mon_release 17 (quincy) 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:election_strategy: 1 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:10:32.897 INFO:teuthology.orchestra.run.smithi078.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-12T00:10:32.899 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-12T00:10:32.945 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b... 2024-09-12T00:10:32.946 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:10:32.990 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-12T00:10:33.015 INFO:teuthology.orchestra.run.smithi078.stdout:[global] 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: chdir = "" 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: auth supported = cephx 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: filestore xattr use omap = true 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: mon clock drift allowed = 1.000 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: osd crush chooseleaf type = 0 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: auth debug = true 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.016 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on old message = true 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: ms die on bug = true 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: mon pg warn max object skew = 0 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default size = 2 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow primary affinity = true 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd allow pg remap = true 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:10:33.017 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on no sortbitwise = false 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon warn on too few osds = false 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon_allow_pool_size_one = true 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: osd default data pool replay window = 5 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon allow pool delete = true 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.018 INFO:teuthology.orchestra.run.smithi078.stdout: mon cluster log file level = debug 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: debug asserts on shutdown = true 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: mon health detail to clog = false 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.171" 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: mon client directed command retry = 5 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: ms inject socket failures = 5000 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: fsid = 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout:[osd] 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: osd journal size = 100 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub load threshold = 5.0 2024-09-12T00:10:33.019 INFO:teuthology.orchestra.run.smithi078.stdout: osd scrub max interval = 600 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd recover clone overlap = true 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd recovery max chunk = 1048576 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug shutdown = true 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug op order = true 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug verify stray on activate = true 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug trim objects = true 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd open classes on start = true 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug pg log writeout = true 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.020 INFO:teuthology.orchestra.run.smithi078.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: osd map max advance = 10 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: journal zero on create = true 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: filestore apply finisher threads = 3 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: bdev debug aio = true 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: osd debug misdirected ops = true 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: bdev async discard = True 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: bdev enable discard = True 2024-09-12T00:10:33.021 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore allocator = bitmap 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore block size = 96636764160 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: bluestore fsck on mount = True 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluefs = 1/20 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: debug bluestore = 1/20 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: debug objclass = 20 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: debug osd = 20 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: debug rocksdb = 4/10 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: lockdep = True 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd full ratio = 0.9 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:10:33.022 INFO:teuthology.orchestra.run.smithi078.stdout: osd objectstore = bluestore 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: osd shutdown pgref assert = True 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr] 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: debug mgr = 20 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: mgr/telemetry/nag = false 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout:[mon] 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: debug ms = 1 2024-09-12T00:10:33.023 INFO:teuthology.orchestra.run.smithi078.stdout: debug mon = 20 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: debug paxos = 20 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: debug auth = 20 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: mon data avail warn = 5 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: mon mgr mkfs grace = 240 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd reporter subtree level = osd 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: mon osd prime pg temp = true 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.024 INFO:teuthology.orchestra.run.smithi078.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: # 1m isn't quite enough 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: lockdep = True 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout:[client] 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: rgw cache enabled = true 2024-09-12T00:10:33.025 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable ops log = true 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw enable usage log = true 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: debug rgw = 20 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: debug rgw notification = 20 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw bucket counters cache = True 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw crypt require ssl = False 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw s3 auth use sts = True 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:10:33.026 INFO:teuthology.orchestra.run.smithi078.stdout: rgw torrent flag = True 2024-09-12T00:10:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: rgw user counters cache = True 2024-09-12T00:10:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: setgroup = ceph 2024-09-12T00:10:33.027 INFO:teuthology.orchestra.run.smithi078.stdout: setuser = ceph 2024-09-12T00:10:33.027 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.a] 2024-09-12T00:10:33.027 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.c] 2024-09-12T00:10:33.027 INFO:teuthology.orchestra.run.smithi078.stdout:[mon.b] 2024-09-12T00:10:33.027 INFO:teuthology.orchestra.run.smithi171.stdout:[global] 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: chdir = "" 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: auth supported = cephx 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: filestore xattr use omap = true 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: mon clock drift allowed = 1.000 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: osd crush chooseleaf type = 0 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: auth debug = true 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on old message = true 2024-09-12T00:10:33.028 INFO:teuthology.orchestra.run.smithi171.stdout: ms die on bug = true 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: mon pg warn max object skew = 0 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: # disable pg_autoscaler by default for new pools 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default size = 2 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow primary affinity = true 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd allow pg remap = true 2024-09-12T00:10:33.029 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on legacy crush tunables = false 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on crush straw calc version zero = false 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on no sortbitwise = false 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on osd down out interval zero = false 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: mon warn on too few osds = false 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: mon_allow_pool_size_one = true 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.030 INFO:teuthology.orchestra.run.smithi171.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: osd default data pool replay window = 5 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: mon allow pool delete = true 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: mon cluster log file level = debug 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: debug asserts on shutdown = true 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: mon health detail to clog = false 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: mon host = "172.21.15.78,[v2:172.21.15.78:3301,v1:172.21.15.78:6790],172.21.15.171" 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: mon client directed command retry = 5 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: ms inject socket failures = 5000 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: osd_max_pg_log_entries = 10 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: osd_min_pg_log_entries = 10 2024-09-12T00:10:33.031 INFO:teuthology.orchestra.run.smithi171.stdout: fsid = 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout:[osd] 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd journal size = 100 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub load threshold = 5.0 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd scrub max interval = 600 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd mclock profile = high_recovery_ops 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd recover clone overlap = true 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd recovery max chunk = 1048576 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug shutdown = true 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug op order = true 2024-09-12T00:10:33.032 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug verify stray on activate = true 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug trim objects = true 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: osd open classes on start = true 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug pg log writeout = true 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: osd deep scrub update digest min age = 30 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: osd map max advance = 10 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: journal zero on create = true 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: filestore ondisk finisher threads = 3 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: filestore apply finisher threads = 3 2024-09-12T00:10:33.033 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: bdev debug aio = true 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: osd debug misdirected ops = true 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: bdev async discard = True 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: bdev enable discard = True 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore allocator = bitmap 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore block size = 96636764160 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: bluestore fsck on mount = True 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluefs = 1/20 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: debug bluestore = 1/20 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: debug objclass = 20 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: debug osd = 20 2024-09-12T00:10:33.034 INFO:teuthology.orchestra.run.smithi171.stdout: debug rocksdb = 4/10 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: lockdep = True 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd backfillfull_ratio = 0.85 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd full ratio = 0.9 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd nearfull ratio = 0.8 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: osd failsafe full ratio = 0.95 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: osd objectstore = bluestore 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: osd shutdown pgref assert = True 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr] 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: debug mgr = 20 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-12T00:10:33.035 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: mgr/telemetry/nag = false 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout:[mon] 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: debug ms = 1 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: debug mon = 20 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: debug paxos = 20 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: debug auth = 20 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: mon data avail warn = 5 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: mon mgr mkfs grace = 240 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min pgs per osd = 4 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd reporter subtree level = osd 2024-09-12T00:10:33.036 INFO:teuthology.orchestra.run.smithi171.stdout: mon osd prime pg temp = true 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: mon reweight min bytes per osd = 10 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: auth mon ticket ttl = 660 # 11m 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: auth service ticket ttl = 240 # 4m 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: # don't complain about insecure global_id in the test suite 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: # 1m isn't quite enough 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: mon_down_mkfs_grace = 2m 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.037 INFO:teuthology.orchestra.run.smithi171.stdout: mon_warn_on_filestore_osds = false 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: lockdep = True 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout:[client] 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: rgw cache enabled = true 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable ops log = true 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: rgw enable usage log = true 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: debug rgw = 20 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: debug rgw notification = 20 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: rgw bucket counters cache = True 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt require ssl = False 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt s3 kms backend = testing 2024-09-12T00:10:33.038 INFO:teuthology.orchestra.run.smithi171.stdout: rgw crypt s3 kms encryption keys = testkey-1=YmluCmJvb3N0CmJvb3N0LWJ1aWxkCmNlcGguY29uZgo= testkey-2=aWIKTWFrZWZpbGUKbWFuCm91dApzcmMKVGVzdGluZwo= 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout: rgw reshard progress judge interval = 10 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout: rgw s3 auth use sts = True 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout: rgw sts key = abcdefghijklmnop 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout: rgw torrent flag = True 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout: rgw user counters cache = True 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout: setgroup = ceph 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout: setuser = ceph 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.a] 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.c] 2024-09-12T00:10:33.039 INFO:teuthology.orchestra.run.smithi171.stdout:[mon.b] 2024-09-12T00:10:33.041 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-12T00:10:33.041 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-12T00:10:33.133 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-12T00:10:33.134 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:33.134 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-12T00:10:33.138 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:33.139 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-12T00:10:33.185 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:10:33.185 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:33.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:10:33.185 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:10:33.250 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:10:33.250 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:33.297 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:10:33.297 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:10:33.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-12T00:10:33.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-12T00:10:33.321 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:10:33.321 DEBUG:teuthology.orchestra.run.smithi171:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:33.374 INFO:tasks.ceph:Setting up mon nodes... 2024-09-12T00:10:33.374 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-12T00:10:33.375 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:10:33.419 INFO:teuthology.orchestra.run.smithi078.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-12T00:10:33.423 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:10:33.466 INFO:teuthology.orchestra.run.smithi171.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-12T00:10:33.474 INFO:tasks.ceph:Setting up mds nodes... 2024-09-12T00:10:33.474 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-12T00:10:33.475 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-12T00:10:33.507 INFO:teuthology.orchestra.run.smithi078.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-12T00:10:33.518 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-12T00:10:33.554 INFO:teuthology.orchestra.run.smithi171.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-12T00:10:33.565 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-12T00:10:33.565 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi078.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi171.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-12T00:10:33.565 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-12T00:10:33.577 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:33.577 INFO:tasks.ceph:role: osd.0 2024-09-12T00:10:33.577 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:10:33.578 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:33.642 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:34.127 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-12T00:10:34.129 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-12T00:10:34.129 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-12T00:10:34.274 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-12T00:10:34.285 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:34.285 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:34.286 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-12T00:10:34.342 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:34.342 INFO:tasks.ceph:role: osd.1 2024-09-12T00:10:34.342 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:10:34.342 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:10:34.403 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:34.404 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:34.849 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-12T00:10:34.850 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-12T00:10:34.851 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-12T00:10:34.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-12T00:10:34.985 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:34.986 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:34.987 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-12T00:10:35.040 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:35.041 INFO:tasks.ceph:role: osd.2 2024-09-12T00:10:35.041 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:10:35.041 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:10:35.105 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:35.105 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:35.105 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:35.105 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:35.105 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:35.105 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:35.108 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:35.109 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:35.109 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:35.109 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:35.572 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-12T00:10:35.573 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-12T00:10:35.574 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-12T00:10:35.689 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-12T00:10:35.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:35.702 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:35.702 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-12T00:10:35.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:35.757 INFO:tasks.ceph:role: osd.3 2024-09-12T00:10:35.757 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:10:35.757 DEBUG:teuthology.orchestra.run.smithi078:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:10:35.820 INFO:teuthology.orchestra.run.smithi078.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:35.820 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:35.821 INFO:teuthology.orchestra.run.smithi078.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:36.334 INFO:teuthology.orchestra.run.smithi078.stdout:Discarding blocks...Done. 2024-09-12T00:10:36.334 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi078.front.sepia.ceph.com -o noatime 2024-09-12T00:10:36.335 DEBUG:teuthology.orchestra.run.smithi078:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-12T00:10:36.491 DEBUG:teuthology.orchestra.run.smithi078:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-12T00:10:36.503 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:36.504 INFO:teuthology.orchestra.run.smithi078.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:36.504 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:36.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:36.612+0000 7f4be25da7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-12T00:10:36.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:36.616+0000 7f4be25da7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-12T00:10:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:36.616+0000 7f4be25da7c0 -1 bdev(0x564680a29800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-12T00:10:36.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:36.616+0000 7f4be25da7c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-12T00:10:39.754 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-12T00:10:39.768 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:39.847+0000 7fe9e75b47c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-12T00:10:39.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:39.847+0000 7fe9e75b47c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-12T00:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:39.847+0000 7fe9e75b47c0 -1 bdev(0x557edb441800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-12T00:10:39.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:39.847+0000 7fe9e75b47c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-12T00:10:43.037 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-12T00:10:43.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:43.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:43.171+0000 7f79dc2517c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-12T00:10:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:43.171+0000 7f79dc2517c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-12T00:10:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:43.171+0000 7f79dc2517c0 -1 bdev(0x558d7a2e3800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-12T00:10:43.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:43.171+0000 7f79dc2517c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-12T00:10:46.307 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-12T00:10:46.360 DEBUG:teuthology.orchestra.run.smithi078:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:46.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:46.439+0000 7f8334a997c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-12T00:10:46.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:46.439+0000 7f8334a997c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-12T00:10:46.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:46.439+0000 7f8334a997c0 -1 bdev(0x5653d2d33800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-12T00:10:46.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:10:46.439+0000 7f8334a997c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-12T00:10:49.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-12T00:10:49.625 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-12T00:10:49.640 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:49.640 INFO:tasks.ceph:role: osd.4 2024-09-12T00:10:49.641 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:10:49.641 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-12T00:10:49.705 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:49.705 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:49.705 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:49.705 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:49.706 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:49.706 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:49.706 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:49.706 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:49.706 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:49.706 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:50.147 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-12T00:10:50.149 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-12T00:10:50.149 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-12T00:10:50.247 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-12T00:10:50.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:50.260 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:50.260 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-12T00:10:50.314 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:50.315 INFO:tasks.ceph:role: osd.5 2024-09-12T00:10:50.315 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:10:50.315 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:50.378 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:50.379 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:50.379 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:50.858 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-12T00:10:50.860 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-12T00:10:50.860 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-12T00:10:50.994 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-12T00:10:51.005 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:51.006 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:51.006 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-12T00:10:51.065 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:51.065 INFO:tasks.ceph:role: osd.6 2024-09-12T00:10:51.065 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:10:51.066 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-12T00:10:51.129 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:51.129 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:51.129 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:51.129 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:51.129 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:51.130 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:51.130 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:51.130 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:51.130 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:51.130 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:51.612 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-12T00:10:51.614 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-12T00:10:51.614 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-12T00:10:51.738 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-12T00:10:51.753 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:51.754 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:51.754 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-12T00:10:51.813 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-12T00:10:51.813 INFO:tasks.ceph:role: osd.7 2024-09-12T00:10:51.814 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:10:51.814 DEBUG:teuthology.orchestra.run.smithi171:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-12T00:10:51.881 INFO:teuthology.orchestra.run.smithi171.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-12T00:10:51.881 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-12T00:10:51.881 INFO:teuthology.orchestra.run.smithi171.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-12T00:10:51.881 INFO:teuthology.orchestra.run.smithi171.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-09-12T00:10:51.881 INFO:teuthology.orchestra.run.smithi171.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-12T00:10:51.881 INFO:teuthology.orchestra.run.smithi171.stdout: = sunit=0 swidth=0 blks 2024-09-12T00:10:51.881 INFO:teuthology.orchestra.run.smithi171.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-12T00:10:51.882 INFO:teuthology.orchestra.run.smithi171.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-09-12T00:10:51.882 INFO:teuthology.orchestra.run.smithi171.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-12T00:10:51.882 INFO:teuthology.orchestra.run.smithi171.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-12T00:10:52.331 INFO:teuthology.orchestra.run.smithi171.stdout:Discarding blocks...Done. 2024-09-12T00:10:52.333 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi171.front.sepia.ceph.com -o noatime 2024-09-12T00:10:52.333 DEBUG:teuthology.orchestra.run.smithi171:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-12T00:10:52.428 DEBUG:teuthology.orchestra.run.smithi171:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-12T00:10:52.437 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:10:52.438 INFO:teuthology.orchestra.run.smithi171.stderr:sudo: /sbin/restorecon: command not found 2024-09-12T00:10:52.438 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:52.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:52.539+0000 7f31a3d3a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-12T00:10:52.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:52.543+0000 7f31a3d3a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-12T00:10:52.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:52.543+0000 7f31a3d3a7c0 -1 bdev(0x563cce623800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-12T00:10:52.543 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:52.543+0000 7f31a3d3a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-12T00:10:55.693 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-12T00:10:55.707 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:55.791 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:55.791+0000 7f67fc7857c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-12T00:10:55.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:55.791+0000 7f67fc7857c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-12T00:10:55.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:55.791+0000 7f67fc7857c0 -1 bdev(0x55ffb43f5800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-12T00:10:55.792 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:55.791+0000 7f67fc7857c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-12T00:10:58.941 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-12T00:10:58.998 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:10:59.078 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:59.079+0000 7fc99916c7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-12T00:10:59.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:59.079+0000 7fc99916c7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-12T00:10:59.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:59.079+0000 7fc99916c7c0 -1 bdev(0x55dc57f93800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-12T00:10:59.079 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:10:59.079+0000 7fc99916c7c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-12T00:11:02.217 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-12T00:11:02.274 DEBUG:teuthology.orchestra.run.smithi171:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:02.356 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:11:02.355+0000 7f338b67e7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-12T00:11:02.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:11:02.355+0000 7f338b67e7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-12T00:11:02.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:11:02.359+0000 7f338b67e7c0 -1 bdev(0x557d8f08f800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-12T00:11:02.357 INFO:teuthology.orchestra.run.smithi171.stderr:2024-09-12T00:11:02.359+0000 7f338b67e7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-12T00:11:05.468 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-12T00:11:05.525 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-12T00:11:05.526 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:05.526 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-12T00:11:05.540 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:05.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-12T00:11:05.596 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:05.596 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-12T00:11:05.653 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:05.653 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-12T00:11:05.708 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:05.708 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-12T00:11:05.768 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:05.768 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-12T00:11:05.781 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:05.781 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-12T00:11:05.836 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:05.836 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-12T00:11:05.897 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:05.897 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-12T00:11:05.952 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:05.952 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-12T00:11:06.004 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:06.004 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-12T00:11:06.010 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:06.010 DEBUG:teuthology.orchestra.run.smithi171:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-12T00:11:06.053 INFO:tasks.ceph:Adding keys to all mons... 2024-09-12T00:11:06.054 DEBUG:teuthology.orchestra.run.smithi078:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:11:06.056 DEBUG:teuthology.orchestra.run.smithi171:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-12T00:11:06.099 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.y] 2024-09-12T00:11:06.099 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB5MeJmgoIaGRAAKp1x67omhx7Sso4GcKgmlA== 2024-09-12T00:11:06.099 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.0] 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB8MeJm2tOwJBAAZan6ojBIsdM1pyDHg8sDFA== 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.1] 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB/MeJmCJHOMhAARF2btvwoq1bez5eVOyILaQ== 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.2] 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCDMeJm4YV6ChAAfspgBMskDe1IoboC4Nkh5g== 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.3] 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCGMeJmuvZxGhAAoWKGDJ3Wtrfv6ocKwBxuiQ== 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout:[mgr.x] 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB5MeJmlAsVHBAAf2vVveDtTsKTSoE+vDSFkA== 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.4] 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCMMeJmi5mIIBAA7gkaYefQPoctE76zu533ww== 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.5] 2024-09-12T00:11:06.100 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCPMeJmBK55LxAAbcSlM3uUlSe88jIJ1uotGw== 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.6] 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCTMeJmp276BBAAvr0htxaUktIVTajL9vB2SA== 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout:[osd.7] 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQCWMeJmRgaNFRAANI5J7gcL31r5L5Es5d07Xw== 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout:[client.0] 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB5MeJmnGtYHhAAuy1UqPSg2ZJruQf+oXGHLA== 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout:[client.1] 2024-09-12T00:11:06.101 INFO:teuthology.orchestra.run.smithi078.stdout: key = AQB5MeJmd7tOIRAAXB45ZnxaALqrSMPpvcxI5g== 2024-09-12T00:11:06.107 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.y] 2024-09-12T00:11:06.107 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB5MeJmgoIaGRAAKp1x67omhx7Sso4GcKgmlA== 2024-09-12T00:11:06.107 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.0] 2024-09-12T00:11:06.107 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB8MeJm2tOwJBAAZan6ojBIsdM1pyDHg8sDFA== 2024-09-12T00:11:06.107 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.1] 2024-09-12T00:11:06.107 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB/MeJmCJHOMhAARF2btvwoq1bez5eVOyILaQ== 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.2] 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCDMeJm4YV6ChAAfspgBMskDe1IoboC4Nkh5g== 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.3] 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCGMeJmuvZxGhAAoWKGDJ3Wtrfv6ocKwBxuiQ== 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout:[mgr.x] 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB5MeJmlAsVHBAAf2vVveDtTsKTSoE+vDSFkA== 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.4] 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCMMeJmi5mIIBAA7gkaYefQPoctE76zu533ww== 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.5] 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCPMeJmBK55LxAAbcSlM3uUlSe88jIJ1uotGw== 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.6] 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCTMeJmp276BBAAvr0htxaUktIVTajL9vB2SA== 2024-09-12T00:11:06.108 INFO:teuthology.orchestra.run.smithi171.stdout:[osd.7] 2024-09-12T00:11:06.109 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQCWMeJmRgaNFRAANI5J7gcL31r5L5Es5d07Xw== 2024-09-12T00:11:06.109 INFO:teuthology.orchestra.run.smithi171.stdout:[client.0] 2024-09-12T00:11:06.109 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB5MeJmnGtYHhAAuy1UqPSg2ZJruQf+oXGHLA== 2024-09-12T00:11:06.109 INFO:teuthology.orchestra.run.smithi171.stdout:[client.1] 2024-09-12T00:11:06.109 INFO:teuthology.orchestra.run.smithi171.stdout: key = AQB5MeJmd7tOIRAAXB45ZnxaALqrSMPpvcxI5g== 2024-09-12T00:11:06.110 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:06.146 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:06.198 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.201 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.244 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.282 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.366 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.417 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.446 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.505 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:06.529 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-12T00:11:06.590 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.614 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.675 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.698 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.760 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.782 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.843 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.870 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-12T00:11:06.928 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:06.958 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:07.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:07.020 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-12T00:11:07.062 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-12T00:11:07.063 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-12T00:11:07.116 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:11:07.206 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-12T00:11:07.216 DEBUG:teuthology.orchestra.run.smithi078:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-12T00:11:07.270 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:11:07.362 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-12T00:11:07.372 DEBUG:teuthology.orchestra.run.smithi171:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-12T00:11:07.387 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-12T00:11:07.482 DEBUG:teuthology.orchestra.run.smithi171:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-12T00:11:07.494 DEBUG:teuthology.orchestra.run.smithi078:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:07.496 DEBUG:teuthology.orchestra.run.smithi171:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-12T00:11:07.544 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-12T00:11:07.545 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-12T00:11:07.545 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-12T00:11:07.548 INFO:tasks.ceph.mon.a:Started 2024-09-12T00:11:07.548 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-12T00:11:07.548 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-12T00:11:07.550 INFO:tasks.ceph.mon.c:Started 2024-09-12T00:11:07.550 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-12T00:11:07.551 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-12T00:11:07.592 INFO:tasks.ceph.mon.b:Started 2024-09-12T00:11:07.593 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-12T00:11:07.593 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-12T00:11:07.593 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-12T00:11:07.595 INFO:tasks.ceph.mgr.y:Started 2024-09-12T00:11:07.595 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-12T00:11:07.595 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-12T00:11:07.597 INFO:tasks.ceph.mgr.x:Started 2024-09-12T00:11:07.597 DEBUG:tasks.ceph:set 0 configs 2024-09-12T00:11:07.598 INFO:tasks.ceph:Setting crush tunables to default 2024-09-12T00:11:07.598 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd crush tunables default 2024-09-12T00:11:13.067 INFO:teuthology.orchestra.run.smithi078.stderr:adjusted tunables profile to default 2024-09-12T00:11:13.085 INFO:tasks.ceph:check_enable_crimson: False 2024-09-12T00:11:13.086 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-12T00:11:13.086 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:13.086 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-12T00:11:13.097 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:13.097 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-12T00:11:13.150 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:13.150 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-12T00:11:13.202 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:11:13.202 DEBUG:teuthology.orchestra.run.smithi078:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-12T00:11:13.255 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:13.255 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-12T00:11:13.268 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:13.268 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-12T00:11:13.320 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:13.320 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-12T00:11:13.377 DEBUG:teuthology.orchestra.run.smithi171:> set -ex 2024-09-12T00:11:13.377 DEBUG:teuthology.orchestra.run.smithi171:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-12T00:11:13.433 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 5cdb3cf6-5125-400d-9866-a3037e1ebe83 0 2024-09-12T00:11:13.694 INFO:teuthology.orchestra.run.smithi171.stdout:0 2024-09-12T00:11:13.710 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new f726fc95-5f4f-4f4a-b3c4-db2902f06b24 1 2024-09-12T00:11:13.913 INFO:teuthology.orchestra.run.smithi171.stdout:1 2024-09-12T00:11:13.929 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821 2 2024-09-12T00:11:14.126 INFO:teuthology.orchestra.run.smithi171.stdout:2 2024-09-12T00:11:14.143 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 6bdbffb1-245f-4cf4-9fb1-7920af67c88f 3 2024-09-12T00:11:14.339 INFO:teuthology.orchestra.run.smithi171.stdout:3 2024-09-12T00:11:14.355 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new 45b971e0-2e7b-4fec-a3b2-8ea970b35b7d 4 2024-09-12T00:11:14.553 INFO:teuthology.orchestra.run.smithi171.stdout:4 2024-09-12T00:11:14.569 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new b4d242df-45e0-4793-92fc-5026219a364e 5 2024-09-12T00:11:14.762 INFO:teuthology.orchestra.run.smithi171.stdout:5 2024-09-12T00:11:14.779 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new ab48cb27-377f-48d0-b2d4-50796590b361 6 2024-09-12T00:11:14.980 INFO:teuthology.orchestra.run.smithi171.stdout:6 2024-09-12T00:11:14.997 DEBUG:teuthology.orchestra.run.smithi171:> sudo ceph --cluster ceph osd new a2a626bb-6b0f-489e-840b-2e47e7fed948 7 2024-09-12T00:11:15.212 INFO:teuthology.orchestra.run.smithi171.stdout:7 2024-09-12T00:11:15.228 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-12T00:11:15.229 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-12T00:11:15.239 INFO:tasks.ceph.osd.0:Started 2024-09-12T00:11:15.239 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-12T00:11:15.240 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-12T00:11:15.254 INFO:tasks.ceph.osd.1:Started 2024-09-12T00:11:15.255 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-12T00:11:15.255 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-12T00:11:15.264 INFO:tasks.ceph.osd.2:Started 2024-09-12T00:11:15.264 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-12T00:11:15.264 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-12T00:11:15.285 INFO:tasks.ceph.osd.3:Started 2024-09-12T00:11:15.286 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-12T00:11:15.286 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-12T00:11:15.297 INFO:tasks.ceph.osd.4:Started 2024-09-12T00:11:15.297 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-12T00:11:15.297 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-12T00:11:15.318 INFO:tasks.ceph.osd.5:Started 2024-09-12T00:11:15.319 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-12T00:11:15.319 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-12T00:11:15.339 INFO:tasks.ceph.osd.6:Started 2024-09-12T00:11:15.340 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-12T00:11:15.340 DEBUG:teuthology.orchestra.run.smithi171:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-12T00:11:15.362 INFO:tasks.ceph.osd.7:Started 2024-09-12T00:11:15.363 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:11:15.579 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:15.579 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":10,"fsid":"78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b","created":"2024-09-12T00:11:12.947588+0000","modified":"2024-09-12T00:11:15.209220+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:11:15.209220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5cdb3cf6-5125-400d-9866-a3037e1ebe83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f726fc95-5f4f-4f4a-b3c4-db2902f06b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bdbffb1-245f-4cf4-9fb1-7920af67c88f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"45b971e0-2e7b-4fec-a3b2-8ea970b35b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4d242df-45e0-4793-92fc-5026219a364e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ab48cb27-377f-48d0-b2d4-50796590b361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2a626bb-6b0f-489e-840b-2e47e7fed948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:11:15.608 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-12T00:11:15.609 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-12T00:11:15.835 INFO:tasks.ceph.mgr.y.smithi078.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:11:15.835 INFO:tasks.ceph.mgr.y.smithi078.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:11:15.835 INFO:tasks.ceph.mgr.y.smithi078.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:11:15.883 INFO:tasks.ceph.mgr.x.smithi171.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-09-12T00:11:15.883 INFO:tasks.ceph.mgr.x.smithi171.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-09-12T00:11:15.883 INFO:tasks.ceph.mgr.x.smithi171.stderr: from numpy import show_config as show_numpy_config 2024-09-12T00:11:16.416 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:11:16.418 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-12T00:11:16.415+0000 7f49c3a727c0 -1 Falling back to public interface 2024-09-12T00:11:16.442 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-12T00:11:16.443+0000 7fde299a57c0 -1 Falling back to public interface 2024-09-12T00:11:16.599 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-12T00:11:16.600 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":10,"fsid":"78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b","created":"2024-09-12T00:11:12.947588+0000","modified":"2024-09-12T00:11:15.209220+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:11:15.209220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5cdb3cf6-5125-400d-9866-a3037e1ebe83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f726fc95-5f4f-4f4a-b3c4-db2902f06b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bdbffb1-245f-4cf4-9fb1-7920af67c88f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"45b971e0-2e7b-4fec-a3b2-8ea970b35b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4d242df-45e0-4793-92fc-5026219a364e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ab48cb27-377f-48d0-b2d4-50796590b361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2a626bb-6b0f-489e-840b-2e47e7fed948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:11:16.614 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:11:16.666 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-12T00:11:16.667+0000 7f10794e77c0 -1 Falling back to public interface 2024-09-12T00:11:16.685 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-12T00:11:16.683+0000 7fae745a07c0 -1 Falling back to public interface 2024-09-12T00:11:16.689 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-12T00:11:16.687+0000 7f0e6b7297c0 -1 Falling back to public interface 2024-09-12T00:11:16.943 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-12T00:11:16.943+0000 7fe4a5d427c0 -1 Falling back to public interface 2024-09-12T00:11:17.126 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-12T00:11:17.123+0000 7f49936667c0 -1 Falling back to public interface 2024-09-12T00:11:17.186 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-12T00:11:17.187+0000 7f8cde08d7c0 -1 Falling back to public interface 2024-09-12T00:11:18.762 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-12T00:11:18.759+0000 7f4bc3308640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-12T00:11:18.763 INFO:tasks.ceph.mgr.y.smithi078.stderr:2024-09-12T00:11:18.759+0000 7f4bc3308640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-12T00:11:20.534 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-12T00:11:20.535+0000 7fde299a57c0 -1 osd.5 0 log_to_monitors true 2024-09-12T00:11:20.762 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-12T00:11:20.763+0000 7f10794e77c0 -1 osd.4 0 log_to_monitors true 2024-09-12T00:11:20.766 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-12T00:11:20.763+0000 7f49c3a727c0 -1 osd.3 0 log_to_monitors true 2024-09-12T00:11:20.971 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-12T00:11:20.967+0000 7f0e6b7297c0 -1 osd.2 0 log_to_monitors true 2024-09-12T00:11:21.016 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-12T00:11:21.015+0000 7fe4a5d427c0 -1 osd.6 0 log_to_monitors true 2024-09-12T00:11:21.085 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-12T00:11:21.083+0000 7fae745a07c0 -1 osd.1 0 log_to_monitors true 2024-09-12T00:11:21.217 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-12T00:11:21.219+0000 7f8cde08d7c0 -1 osd.7 0 log_to_monitors true 2024-09-12T00:11:21.528 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-12T00:11:21.523+0000 7f49936667c0 -1 osd.0 0 log_to_monitors true 2024-09-12T00:11:22.851 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-12T00:11:22.851+0000 7fde2594e640 -1 osd.5 0 waiting for initial osdmap 2024-09-12T00:11:23.011 INFO:tasks.ceph.osd.5.smithi171.stderr:2024-09-12T00:11:23.011+0000 7fde1d780640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:23.420 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:11:23.776 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-12T00:11:23.776 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":13,"fsid":"78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b","created":"2024-09-12T00:11:12.947588+0000","modified":"2024-09-12T00:11:22.761493+0000","last_up_change":"0.000000","last_in_change":"2024-09-12T00:11:15.209220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"5cdb3cf6-5125-400d-9866-a3037e1ebe83","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"f726fc95-5f4f-4f4a-b3c4-db2902f06b24","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"6bdbffb1-245f-4cf4-9fb1-7920af67c88f","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"45b971e0-2e7b-4fec-a3b2-8ea970b35b7d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b4d242df-45e0-4793-92fc-5026219a364e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"ab48cb27-377f-48d0-b2d4-50796590b361","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"a2a626bb-6b0f-489e-840b-2e47e7fed948","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:11:23.796 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-12T00:11:24.480 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-12T00:11:24.479+0000 7f8cda036640 -1 osd.7 0 waiting for initial osdmap 2024-09-12T00:11:24.502 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-12T00:11:24.503+0000 7f1075490640 -1 osd.4 0 waiting for initial osdmap 2024-09-12T00:11:24.503 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-12T00:11:24.503+0000 7fe4a24fd640 -1 osd.6 0 waiting for initial osdmap 2024-09-12T00:11:24.505 INFO:tasks.ceph.osd.7.smithi171.stderr:2024-09-12T00:11:24.507+0000 7f8cd1e68640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:24.517 INFO:tasks.ceph.osd.4.smithi171.stderr:2024-09-12T00:11:24.519+0000 7f106d2c2640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:24.518 INFO:tasks.ceph.osd.6.smithi171.stderr:2024-09-12T00:11:24.519+0000 7fe499b1d640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:24.951 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-12T00:11:24.947+0000 7f498f60f640 -1 osd.0 0 waiting for initial osdmap 2024-09-12T00:11:24.959 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-12T00:11:24.955+0000 7f49bfa1b640 -1 osd.3 0 waiting for initial osdmap 2024-09-12T00:11:24.972 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-12T00:11:24.967+0000 7f0e676d2640 -1 osd.2 0 waiting for initial osdmap 2024-09-12T00:11:24.974 INFO:tasks.ceph.osd.0.smithi078.stderr:2024-09-12T00:11:24.971+0000 7f4987441640 -1 osd.0 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:24.989 INFO:tasks.ceph.osd.3.smithi078.stderr:2024-09-12T00:11:24.987+0000 7f49b784d640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:25.001 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-12T00:11:24.999+0000 7fae70549640 -1 osd.1 0 waiting for initial osdmap 2024-09-12T00:11:25.009 INFO:tasks.ceph.osd.2.smithi078.stderr:2024-09-12T00:11:25.007+0000 7f0e5f504640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:25.025 INFO:tasks.ceph.osd.1.smithi078.stderr:2024-09-12T00:11:25.023+0000 7fae6837b640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-12T00:11:30.603 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-12T00:11:30.907 INFO:teuthology.misc.health.smithi078.stdout: 2024-09-12T00:11:30.907 INFO:teuthology.misc.health.smithi078.stdout:{"epoch":18,"fsid":"78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b","created":"2024-09-12T00:11:12.947588+0000","modified":"2024-09-12T00:11:28.534359+0000","last_up_change":"2024-09-12T00:11:25.519857+0000","last_in_change":"2024-09-12T00:11:15.209220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:11:25.793509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cdb3cf6-5125-400d-9866-a3037e1ebe83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6825","nonce":4270621360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6827","nonce":4270621360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6831","nonce":4270621360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6829","nonce":4270621360}]},"public_addr":"172.21.15.78:6825/4270621360","cluster_addr":"172.21.15.78:6827/4270621360","heartbeat_back_addr":"172.21.15.78:6831/4270621360","heartbeat_front_addr":"172.21.15.78:6829/4270621360","state":["exists","up"]},{"osd":1,"uuid":"f726fc95-5f4f-4f4a-b3c4-db2902f06b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6809","nonce":1578510999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6811","nonce":1578510999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6815","nonce":1578510999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6813","nonce":1578510999}]},"public_addr":"172.21.15.78:6809/1578510999","cluster_addr":"172.21.15.78:6811/1578510999","heartbeat_back_addr":"172.21.15.78:6815/1578510999","heartbeat_front_addr":"172.21.15.78:6813/1578510999","state":["exists","up"]},{"osd":2,"uuid":"4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6817","nonce":1585845466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6819","nonce":1585845466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6823","nonce":1585845466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6821","nonce":1585845466}]},"public_addr":"172.21.15.78:6817/1585845466","cluster_addr":"172.21.15.78:6819/1585845466","heartbeat_back_addr":"172.21.15.78:6823/1585845466","heartbeat_front_addr":"172.21.15.78:6821/1585845466","state":["exists","up"]},{"osd":3,"uuid":"6bdbffb1-245f-4cf4-9fb1-7920af67c88f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6801","nonce":3497928690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6803","nonce":3497928690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6807","nonce":3497928690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6805","nonce":3497928690}]},"public_addr":"172.21.15.78:6801/3497928690","cluster_addr":"172.21.15.78:6803/3497928690","heartbeat_back_addr":"172.21.15.78:6807/3497928690","heartbeat_front_addr":"172.21.15.78:6805/3497928690","state":["exists","up"]},{"osd":4,"uuid":"45b971e0-2e7b-4fec-a3b2-8ea970b35b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6809","nonce":2267522783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6811","nonce":2267522783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6815","nonce":2267522783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6813","nonce":2267522783}]},"public_addr":"172.21.15.171:6809/2267522783","cluster_addr":"172.21.15.171:6811/2267522783","heartbeat_back_addr":"172.21.15.171:6815/2267522783","heartbeat_front_addr":"172.21.15.171:6813/2267522783","state":["exists","up"]},{"osd":5,"uuid":"b4d242df-45e0-4793-92fc-5026219a364e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6801","nonce":4023521963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6803","nonce":4023521963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6807","nonce":4023521963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6805","nonce":4023521963}]},"public_addr":"172.21.15.171:6801/4023521963","cluster_addr":"172.21.15.171:6803/4023521963","heartbeat_back_addr":"172.21.15.171:6807/4023521963","heartbeat_front_addr":"172.21.15.171:6805/4023521963","state":["exists","up"]},{"osd":6,"uuid":"ab48cb27-377f-48d0-b2d4-50796590b361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6817","nonce":997797030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6819","nonce":997797030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6823","nonce":997797030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6821","nonce":997797030}]},"public_addr":"172.21.15.171:6817/997797030","cluster_addr":"172.21.15.171:6819/997797030","heartbeat_back_addr":"172.21.15.171:6823/997797030","heartbeat_front_addr":"172.21.15.171:6821/997797030","state":["exists","up"]},{"osd":7,"uuid":"a2a626bb-6b0f-489e-840b-2e47e7fed948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6825","nonce":2486579375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6827","nonce":2486579375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6831","nonce":2486579375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6829","nonce":2486579375}]},"public_addr":"172.21.15.171:6825/2486579375","cluster_addr":"172.21.15.171:6827/2486579375","heartbeat_back_addr":"172.21.15.171:6831/2486579375","heartbeat_front_addr":"172.21.15.171:6829/2486579375","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.515862+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.135509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.020820+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.745991+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.803336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.511875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.068614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.178830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:11:30.923 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-12T00:11:30.924 INFO:tasks.ceph:Creating RBD pool 2024-09-12T00:11:30.924 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-12T00:11:31.569 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'rbd' created 2024-09-12T00:11:31.593 DEBUG:teuthology.orchestra.run.smithi078:> rbd --cluster ceph pool init rbd 2024-09-12T00:11:31.641 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:31.641 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:34.638 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-12T00:11:34.639 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-12T00:11:34.639 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-12T00:11:34.959 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:35.050 INFO:teuthology.orchestra.run.smithi078.stdout:[{"version":9,"timestamp":"2024-09-12T00:11:25.003572+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"4788.377864"}]}] 2024-09-12T00:11:35.051 INFO:tasks.ceph_manager:config epoch is 9 2024-09-12T00:11:35.051 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-12T00:11:35.051 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-12T00:11:35.051 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-12T00:11:35.403 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:35.418 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":5,"flags":0,"active_gid":4110,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6832","nonce":2754915500},{"type":"v1","addr":"172.21.15.78:6833","nonce":2754915500}]},"active_addr":"172.21.15.78:6833/2754915500","active_change":"2024-09-12T00:11:17.736242+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4102,"name":"x","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:1.26.1","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":947889948}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":3961518521}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":194717701}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.78:0","nonce":1901439333}]}]} 2024-09-12T00:11:35.423 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-12T00:11:35.423 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-12T00:11:35.424 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:11:35.718 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:35.718 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b","created":"2024-09-12T00:11:12.947588+0000","modified":"2024-09-12T00:11:34.595019+0000","last_up_change":"2024-09-12T00:11:25.519857+0000","last_in_change":"2024-09-12T00:11:15.209220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:11:25.793509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:11:31.236417+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cdb3cf6-5125-400d-9866-a3037e1ebe83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6825","nonce":4270621360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6827","nonce":4270621360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6831","nonce":4270621360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6829","nonce":4270621360}]},"public_addr":"172.21.15.78:6825/4270621360","cluster_addr":"172.21.15.78:6827/4270621360","heartbeat_back_addr":"172.21.15.78:6831/4270621360","heartbeat_front_addr":"172.21.15.78:6829/4270621360","state":["exists","up"]},{"osd":1,"uuid":"f726fc95-5f4f-4f4a-b3c4-db2902f06b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6809","nonce":1578510999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6811","nonce":1578510999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6815","nonce":1578510999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6813","nonce":1578510999}]},"public_addr":"172.21.15.78:6809/1578510999","cluster_addr":"172.21.15.78:6811/1578510999","heartbeat_back_addr":"172.21.15.78:6815/1578510999","heartbeat_front_addr":"172.21.15.78:6813/1578510999","state":["exists","up"]},{"osd":2,"uuid":"4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6817","nonce":1585845466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6819","nonce":1585845466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6823","nonce":1585845466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6821","nonce":1585845466}]},"public_addr":"172.21.15.78:6817/1585845466","cluster_addr":"172.21.15.78:6819/1585845466","heartbeat_back_addr":"172.21.15.78:6823/1585845466","heartbeat_front_addr":"172.21.15.78:6821/1585845466","state":["exists","up"]},{"osd":3,"uuid":"6bdbffb1-245f-4cf4-9fb1-7920af67c88f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6801","nonce":3497928690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6803","nonce":3497928690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6807","nonce":3497928690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6805","nonce":3497928690}]},"public_addr":"172.21.15.78:6801/3497928690","cluster_addr":"172.21.15.78:6803/3497928690","heartbeat_back_addr":"172.21.15.78:6807/3497928690","heartbeat_front_addr":"172.21.15.78:6805/3497928690","state":["exists","up"]},{"osd":4,"uuid":"45b971e0-2e7b-4fec-a3b2-8ea970b35b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6809","nonce":2267522783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6811","nonce":2267522783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6815","nonce":2267522783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6813","nonce":2267522783}]},"public_addr":"172.21.15.171:6809/2267522783","cluster_addr":"172.21.15.171:6811/2267522783","heartbeat_back_addr":"172.21.15.171:6815/2267522783","heartbeat_front_addr":"172.21.15.171:6813/2267522783","state":["exists","up"]},{"osd":5,"uuid":"b4d242df-45e0-4793-92fc-5026219a364e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6801","nonce":4023521963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6803","nonce":4023521963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6807","nonce":4023521963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6805","nonce":4023521963}]},"public_addr":"172.21.15.171:6801/4023521963","cluster_addr":"172.21.15.171:6803/4023521963","heartbeat_back_addr":"172.21.15.171:6807/4023521963","heartbeat_front_addr":"172.21.15.171:6805/4023521963","state":["exists","up"]},{"osd":6,"uuid":"ab48cb27-377f-48d0-b2d4-50796590b361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6817","nonce":997797030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6819","nonce":997797030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6823","nonce":997797030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6821","nonce":997797030}]},"public_addr":"172.21.15.171:6817/997797030","cluster_addr":"172.21.15.171:6819/997797030","heartbeat_back_addr":"172.21.15.171:6823/997797030","heartbeat_front_addr":"172.21.15.171:6821/997797030","state":["exists","up"]},{"osd":7,"uuid":"a2a626bb-6b0f-489e-840b-2e47e7fed948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6825","nonce":2486579375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6827","nonce":2486579375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6831","nonce":2486579375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6829","nonce":2486579375}]},"public_addr":"172.21.15.171:6825/2486579375","cluster_addr":"172.21.15.171:6827/2486579375","heartbeat_back_addr":"172.21.15.171:6831/2486579375","heartbeat_front_addr":"172.21.15.171:6829/2486579375","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.515862+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.135509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.020820+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.745991+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.803336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.511875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.068614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.178830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:11:35.736 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-12T00:11:35.737 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:11:36.025 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:36.025 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":22,"fsid":"78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b","created":"2024-09-12T00:11:12.947588+0000","modified":"2024-09-12T00:11:34.595019+0000","last_up_change":"2024-09-12T00:11:25.519857+0000","last_in_change":"2024-09-12T00:11:15.209220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:11:25.793509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:11:31.236417+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cdb3cf6-5125-400d-9866-a3037e1ebe83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6825","nonce":4270621360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6827","nonce":4270621360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6831","nonce":4270621360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6829","nonce":4270621360}]},"public_addr":"172.21.15.78:6825/4270621360","cluster_addr":"172.21.15.78:6827/4270621360","heartbeat_back_addr":"172.21.15.78:6831/4270621360","heartbeat_front_addr":"172.21.15.78:6829/4270621360","state":["exists","up"]},{"osd":1,"uuid":"f726fc95-5f4f-4f4a-b3c4-db2902f06b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6809","nonce":1578510999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6811","nonce":1578510999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6815","nonce":1578510999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6813","nonce":1578510999}]},"public_addr":"172.21.15.78:6809/1578510999","cluster_addr":"172.21.15.78:6811/1578510999","heartbeat_back_addr":"172.21.15.78:6815/1578510999","heartbeat_front_addr":"172.21.15.78:6813/1578510999","state":["exists","up"]},{"osd":2,"uuid":"4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6817","nonce":1585845466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6819","nonce":1585845466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6823","nonce":1585845466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6821","nonce":1585845466}]},"public_addr":"172.21.15.78:6817/1585845466","cluster_addr":"172.21.15.78:6819/1585845466","heartbeat_back_addr":"172.21.15.78:6823/1585845466","heartbeat_front_addr":"172.21.15.78:6821/1585845466","state":["exists","up"]},{"osd":3,"uuid":"6bdbffb1-245f-4cf4-9fb1-7920af67c88f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6801","nonce":3497928690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6803","nonce":3497928690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6807","nonce":3497928690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6805","nonce":3497928690}]},"public_addr":"172.21.15.78:6801/3497928690","cluster_addr":"172.21.15.78:6803/3497928690","heartbeat_back_addr":"172.21.15.78:6807/3497928690","heartbeat_front_addr":"172.21.15.78:6805/3497928690","state":["exists","up"]},{"osd":4,"uuid":"45b971e0-2e7b-4fec-a3b2-8ea970b35b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6809","nonce":2267522783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6811","nonce":2267522783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6815","nonce":2267522783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6813","nonce":2267522783}]},"public_addr":"172.21.15.171:6809/2267522783","cluster_addr":"172.21.15.171:6811/2267522783","heartbeat_back_addr":"172.21.15.171:6815/2267522783","heartbeat_front_addr":"172.21.15.171:6813/2267522783","state":["exists","up"]},{"osd":5,"uuid":"b4d242df-45e0-4793-92fc-5026219a364e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6801","nonce":4023521963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6803","nonce":4023521963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6807","nonce":4023521963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6805","nonce":4023521963}]},"public_addr":"172.21.15.171:6801/4023521963","cluster_addr":"172.21.15.171:6803/4023521963","heartbeat_back_addr":"172.21.15.171:6807/4023521963","heartbeat_front_addr":"172.21.15.171:6805/4023521963","state":["exists","up"]},{"osd":6,"uuid":"ab48cb27-377f-48d0-b2d4-50796590b361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6817","nonce":997797030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6819","nonce":997797030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6823","nonce":997797030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6821","nonce":997797030}]},"public_addr":"172.21.15.171:6817/997797030","cluster_addr":"172.21.15.171:6819/997797030","heartbeat_back_addr":"172.21.15.171:6823/997797030","heartbeat_front_addr":"172.21.15.171:6821/997797030","state":["exists","up"]},{"osd":7,"uuid":"a2a626bb-6b0f-489e-840b-2e47e7fed948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6825","nonce":2486579375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6827","nonce":2486579375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6831","nonce":2486579375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6829","nonce":2486579375}]},"public_addr":"172.21.15.171:6825/2486579375","cluster_addr":"172.21.15.171:6827/2486579375","heartbeat_back_addr":"172.21.15.171:6831/2486579375","heartbeat_front_addr":"172.21.15.171:6829/2486579375","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.515862+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.135509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.020820+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.745991+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.803336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.511875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.068614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.178830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:11:36.042 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-12T00:11:36.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-12T00:11:36.043 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-12T00:11:36.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-12T00:11:36.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-12T00:11:36.044 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-12T00:11:36.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-12T00:11:36.045 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-12T00:11:36.278 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:36.278 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:11:36.303 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:36.303 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:11:36.309 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-09-12T00:11:36.310 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:11:36.311 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:36.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:11:36.312 INFO:teuthology.orchestra.run.smithi078.stdout:60129542151 2024-09-12T00:11:36.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:11:36.317 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:36.318 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:11:36.329 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:36.330 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:11:36.344 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-12T00:11:36.345 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:11:36.780 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:36.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T00:11:36.845 INFO:teuthology.orchestra.run.smithi078.stdout:60129542150 2024-09-12T00:11:36.850 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:36.861 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-12T00:11:36.870 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:36.873 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:36.876 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2024-09-12T00:11:36.880 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-12T00:11:36.888 INFO:teuthology.orchestra.run.smithi078.stdout:64424509442 2024-09-12T00:11:36.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.2 2024-09-12T00:11:36.901 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.4 2024-09-12T00:11:36.903 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-12T00:11:36.909 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.7 2024-09-12T00:11:36.913 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:36.930 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T00:11:37.803 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:11:37.877 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:11:37.881 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:11:37.895 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:11:37.902 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:11:37.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:11:37.910 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:11:37.931 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:11:38.300 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:38.327 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.3 2024-09-12T00:11:38.388 INFO:teuthology.orchestra.run.smithi078.stdout:60129542150 2024-09-12T00:11:38.394 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:38.418 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542150 for osd.5 2024-09-12T00:11:38.422 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.0 2024-09-12T00:11:38.435 INFO:teuthology.orchestra.run.smithi078.stdout:64424509442 2024-09-12T00:11:38.453 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509442 for osd.7 2024-09-12T00:11:38.454 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-12T00:11:38.454 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:38.460 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:38.468 INFO:teuthology.orchestra.run.smithi078.stdout:64424509443 2024-09-12T00:11:38.483 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.6 2024-09-12T00:11:38.487 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509444 for osd.2 2024-09-12T00:11:38.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.4 2024-09-12T00:11:38.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509443 for osd.1 2024-09-12T00:11:39.328 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-12T00:11:39.419 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-12T00:11:39.423 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-12T00:11:39.453 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-12T00:11:39.483 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-12T00:11:39.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-12T00:11:39.488 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-12T00:11:39.491 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-12T00:11:39.796 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:39.828 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.3 2024-09-12T00:11:39.829 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:39.929 INFO:teuthology.orchestra.run.smithi078.stdout:60129542151 2024-09-12T00:11:39.940 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:39.952 INFO:teuthology.orchestra.run.smithi078.stdout:64424509444 2024-09-12T00:11:39.956 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542151 got 60129542151 for osd.5 2024-09-12T00:11:39.956 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:39.960 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.6 2024-09-12T00:11:39.960 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:39.971 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509444 got 64424509444 for osd.7 2024-09-12T00:11:39.971 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:39.999 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:40.017 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.0 2024-09-12T00:11:40.017 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:40.036 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:40.044 INFO:teuthology.orchestra.run.smithi078.stdout:64424509445 2024-09-12T00:11:40.055 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.1 2024-09-12T00:11:40.055 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:40.057 INFO:teuthology.orchestra.run.smithi078.stdout:64424509446 2024-09-12T00:11:40.063 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509445 got 64424509445 for osd.4 2024-09-12T00:11:40.063 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:40.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509446 got 64424509446 for osd.2 2024-09-12T00:11:40.076 DEBUG:teuthology.parallel:result is None 2024-09-12T00:11:40.076 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:11:40.076 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:11:40.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:40.391 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:11:40.407 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T00:11:39.752973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223316,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751404,"statfs":{"total":773094113280,"available":772865437696,"internally_reserved":0,"allocated":2965504,"data_stored":1774678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.179055"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.618193+0000","last_change":"2024-09-12T00:11:34.618193+0000","last_active":"2024-09-12T00:11:34.618193+0000","last_peered":"2024-09-12T00:11:34.618193+0000","last_clean":"2024-09-12T00:11:34.618193+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:11:34.618193+0000","last_undegraded":"2024-09-12T00:11:34.618193+0000","last_fullsized":"2024-09-12T00:11:34.618193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:18.144454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.613977+0000","last_change":"2024-09-12T00:11:34.613977+0000","last_active":"2024-09-12T00:11:34.613977+0000","last_peered":"2024-09-12T00:11:34.613977+0000","last_clean":"2024-09-12T00:11:34.613977+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:11:34.613977+0000","last_undegraded":"2024-09-12T00:11:34.613977+0000","last_fullsized":"2024-09-12T00:11:34.613977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:31.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.617205+0000","last_change":"2024-09-12T00:11:34.617205+0000","last_active":"2024-09-12T00:11:34.617205+0000","last_peered":"2024-09-12T00:11:34.617205+0000","last_clean":"2024-09-12T00:11:34.617205+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:11:34.617205+0000","last_undegraded":"2024-09-12T00:11:34.617205+0000","last_fullsized":"2024-09-12T00:11:34.617205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:51.436105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.873889+0000","last_change":"2024-09-12T00:11:34.874306+0000","last_active":"2024-09-12T00:11:34.873889+0000","last_peered":"2024-09-12T00:11:34.873889+0000","last_clean":"2024-09-12T00:11:34.873889+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:11:34.873889+0000","last_undegraded":"2024-09-12T00:11:34.873889+0000","last_fullsized":"2024-09-12T00:11:34.873889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:04.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.623390+0000","last_change":"2024-09-12T00:11:34.618967+0000","last_active":"2024-09-12T00:11:34.623390+0000","last_peered":"2024-09-12T00:11:34.623390+0000","last_clean":"2024-09-12T00:11:34.623390+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:11:34.623390+0000","last_undegraded":"2024-09-12T00:11:34.623390+0000","last_fullsized":"2024-09-12T00:11:34.623390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.762426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.731346+0000","last_change":"2024-09-12T00:11:34.731346+0000","last_active":"2024-09-12T00:11:34.731346+0000","last_peered":"2024-09-12T00:11:34.731346+0000","last_clean":"2024-09-12T00:11:34.731346+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:11:34.731346+0000","last_undegraded":"2024-09-12T00:11:34.731346+0000","last_fullsized":"2024-09-12T00:11:34.731346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:18.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.617340+0000","last_change":"2024-09-12T00:11:34.617340+0000","last_active":"2024-09-12T00:11:34.617340+0000","last_peered":"2024-09-12T00:11:34.617340+0000","last_clean":"2024-09-12T00:11:34.617340+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:11:34.617340+0000","last_undegraded":"2024-09-12T00:11:34.617340+0000","last_fullsized":"2024-09-12T00:11:34.617340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:34.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.617900+0000","last_change":"2024-09-12T00:11:34.617900+0000","last_active":"2024-09-12T00:11:34.617900+0000","last_peered":"2024-09-12T00:11:34.617900+0000","last_clean":"2024-09-12T00:11:34.617900+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:11:34.617900+0000","last_undegraded":"2024-09-12T00:11:34.617900+0000","last_fullsized":"2024-09-12T00:11:34.617900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.608381+0000","last_change":"2024-09-12T00:11:27.569428+0000","last_active":"2024-09-12T00:11:34.608381+0000","last_peered":"2024-09-12T00:11:34.608381+0000","last_clean":"2024-09-12T00:11:34.608381+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:11:34.608381+0000","last_undegraded":"2024-09-12T00:11:34.608381+0000","last_fullsized":"2024-09-12T00:11:34.608381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_clean_scrub_stamp":"2024-09-12T00:11:26.525321+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.325099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:11:40.408 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:11:40.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:40.693 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:11:40.709 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-12T00:11:39.752973+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":11,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":223316,"kb_used_data":2896,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754751404,"statfs":{"total":773094113280,"available":772865437696,"internally_reserved":0,"allocated":2965504,"data_stored":1774678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":225496626},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.179055"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.618193+0000","last_change":"2024-09-12T00:11:34.618193+0000","last_active":"2024-09-12T00:11:34.618193+0000","last_peered":"2024-09-12T00:11:34.618193+0000","last_clean":"2024-09-12T00:11:34.618193+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:11:34.618193+0000","last_undegraded":"2024-09-12T00:11:34.618193+0000","last_fullsized":"2024-09-12T00:11:34.618193+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:18.144454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.613977+0000","last_change":"2024-09-12T00:11:34.613977+0000","last_active":"2024-09-12T00:11:34.613977+0000","last_peered":"2024-09-12T00:11:34.613977+0000","last_clean":"2024-09-12T00:11:34.613977+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:11:34.613977+0000","last_undegraded":"2024-09-12T00:11:34.613977+0000","last_fullsized":"2024-09-12T00:11:34.613977+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:31.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.617205+0000","last_change":"2024-09-12T00:11:34.617205+0000","last_active":"2024-09-12T00:11:34.617205+0000","last_peered":"2024-09-12T00:11:34.617205+0000","last_clean":"2024-09-12T00:11:34.617205+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:11:34.617205+0000","last_undegraded":"2024-09-12T00:11:34.617205+0000","last_fullsized":"2024-09-12T00:11:34.617205+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:51.436105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.873889+0000","last_change":"2024-09-12T00:11:34.874306+0000","last_active":"2024-09-12T00:11:34.873889+0000","last_peered":"2024-09-12T00:11:34.873889+0000","last_clean":"2024-09-12T00:11:34.873889+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:11:34.873889+0000","last_undegraded":"2024-09-12T00:11:34.873889+0000","last_fullsized":"2024-09-12T00:11:34.873889+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:04.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"22'2","reported_seq":22,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.623390+0000","last_change":"2024-09-12T00:11:34.618967+0000","last_active":"2024-09-12T00:11:34.623390+0000","last_peered":"2024-09-12T00:11:34.623390+0000","last_clean":"2024-09-12T00:11:34.623390+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:11:34.623390+0000","last_undegraded":"2024-09-12T00:11:34.623390+0000","last_fullsized":"2024-09-12T00:11:34.623390+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.762426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":18,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.731346+0000","last_change":"2024-09-12T00:11:34.731346+0000","last_active":"2024-09-12T00:11:34.731346+0000","last_peered":"2024-09-12T00:11:34.731346+0000","last_clean":"2024-09-12T00:11:34.731346+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:11:34.731346+0000","last_undegraded":"2024-09-12T00:11:34.731346+0000","last_fullsized":"2024-09-12T00:11:34.731346+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:18.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.617340+0000","last_change":"2024-09-12T00:11:34.617340+0000","last_active":"2024-09-12T00:11:34.617340+0000","last_peered":"2024-09-12T00:11:34.617340+0000","last_clean":"2024-09-12T00:11:34.617340+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:11:34.617340+0000","last_undegraded":"2024-09-12T00:11:34.617340+0000","last_fullsized":"2024-09-12T00:11:34.617340+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:34.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"20'1","reported_seq":21,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.617900+0000","last_change":"2024-09-12T00:11:34.617900+0000","last_active":"2024-09-12T00:11:34.617900+0000","last_peered":"2024-09-12T00:11:34.617900+0000","last_clean":"2024-09-12T00:11:34.617900+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:11:34.617900+0000","last_undegraded":"2024-09-12T00:11:34.617900+0000","last_fullsized":"2024-09-12T00:11:34.617900+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"17'72","reported_seq":111,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-12T00:11:34.608381+0000","last_change":"2024-09-12T00:11:27.569428+0000","last_active":"2024-09-12T00:11:34.608381+0000","last_peered":"2024-09-12T00:11:34.608381+0000","last_clean":"2024-09-12T00:11:34.608381+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:11:34.608381+0000","last_undegraded":"2024-09-12T00:11:34.608381+0000","last_fullsized":"2024-09-12T00:11:34.608381+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_clean_scrub_stamp":"2024-09-12T00:11:26.525321+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.325099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509444,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27252,"kb_used_data":220,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344588,"statfs":{"total":96636764160,"available":96608858112,"internally_reserved":0,"allocated":225280,"data_stored":74257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27248,"kb_used_data":216,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344592,"statfs":{"total":96636764160,"available":96608862208,"internally_reserved":0,"allocated":221184,"data_stored":74238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542151,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31984,"kb_used_data":796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339856,"statfs":{"total":96636764160,"available":96604012544,"internally_reserved":0,"allocated":815104,"data_stored":664606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:11:40.710 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:11:40.710 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-12T00:11:40.710 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-12T00:11:40.710 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-12T00:11:41.031 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:11:41.031 INFO:teuthology.orchestra.run.smithi078.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-12T00:11:41.048 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-12T00:11:41.049 INFO:teuthology.run_tasks:Running task openssl_keys... 2024-09-12T00:11:41.717 INFO:teuthology.run_tasks:Running task rgw... 2024-09-12T00:11:41.995 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-12T00:11:41.995 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-12T00:11:41.996 INFO:tasks.rgw:Creating data pools 2024-09-12T00:11:41.996 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-12T00:11:41.996 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd erasure-code-profile set client.0 k=2 m=1 crush-failure-domain=osd --cluster ceph 2024-09-12T00:11:42.659 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-12T00:11:44.888 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'default.rgw.buckets.data' created 2024-09-12T00:11:44.918 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-12T00:11:45.898 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-12T00:11:45.948 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-12T00:11:46.890 INFO:teuthology.orchestra.run.smithi078.stderr:pool 'default.rgw.buckets.index' created 2024-09-12T00:11:46.928 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-12T00:11:47.920 INFO:teuthology.orchestra.run.smithi078.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-12T00:11:47.957 DEBUG:tasks.rgw:Pools created 2024-09-12T00:11:47.957 INFO:tasks.rgw:Configuring compression type = random 2024-09-12T00:11:47.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:11:47.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:11:47.957 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:11:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:48.016 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:49.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:49.991+0000 7fd5fbf17640 0 -- >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55650d201bd0 msgr2=0x55650d201fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until injecting socket failure 2024-09-12T00:11:49.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:49.995+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:49.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:49.995+0000 7fd5faf15640 0 -- 172.21.15.78:0/95880871 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55650d218f70 msgr2=0x55650d21b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:11:50.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:50.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 20 realm 2024-09-12T00:11:50.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:50.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:11:50.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:50.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.199+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.203+0000 7fd5fdc109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:11:50.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.203+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.203+0000 7fd5fdc109c0 20 rados_obj.operate() r=0 bl.length=993 2024-09-12T00:11:50.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.203+0000 7fd5fdc109c0 20 searching for the correct realm 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:11:50.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.439+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:11:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 20 zone default found 2024-09-12T00:11:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 4 Realm: () 2024-09-12T00:11:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:11:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:11:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:11:50.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 20 zonegroup default 2024-09-12T00:11:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:50.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:50.443+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:51.951+0000 7fd5fdc109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:51.951+0000 7fd5fdc109c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:51.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:51.951+0000 7fd5fdc109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:51.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:51.951+0000 7fd5fdc109c0 20 started sync module instance, tier type = 2024-09-12T00:11:51.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:51.951+0000 7fd5fdc109c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:11:53.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=0 2024-09-12T00:11:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=1 2024-09-12T00:11:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=2 2024-09-12T00:11:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=3 2024-09-12T00:11:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=4 2024-09-12T00:11:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=5 2024-09-12T00:11:53.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=6 2024-09-12T00:11:53.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 20 add_watcher() i=7 2024-09-12T00:11:53.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.983+0000 7fd5fdc109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:11:53.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 5 tl::expected, obj_version>, boost::system::error_code> logback_generations::read(const DoutPrefixProvider*, optional_yield):410: oid=data_loggenerations_metadata not found 2024-09-12T00:11:53.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.0 2024-09-12T00:11:53.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.0 does not exist 2024-09-12T00:11:53.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.1 2024-09-12T00:11:53.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.1 does not exist 2024-09-12T00:11:53.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.2 2024-09-12T00:11:53.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.2 does not exist 2024-09-12T00:11:53.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.3 2024-09-12T00:11:53.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.3 does not exist 2024-09-12T00:11:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.4 2024-09-12T00:11:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.4 does not exist 2024-09-12T00:11:53.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.5 2024-09-12T00:11:53.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.987+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.5 does not exist 2024-09-12T00:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.6 2024-09-12T00:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.6 does not exist 2024-09-12T00:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.7 2024-09-12T00:11:53.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.7 does not exist 2024-09-12T00:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.8 2024-09-12T00:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.8 does not exist 2024-09-12T00:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.9 2024-09-12T00:11:53.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.9 does not exist 2024-09-12T00:11:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.10 2024-09-12T00:11:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.10 does not exist 2024-09-12T00:11:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.11 2024-09-12T00:11:53.995 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.11 does not exist 2024-09-12T00:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.12 2024-09-12T00:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.991+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.12 does not exist 2024-09-12T00:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.13 2024-09-12T00:11:53.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.997 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.13 does not exist 2024-09-12T00:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.14 2024-09-12T00:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.14 does not exist 2024-09-12T00:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.15 2024-09-12T00:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.15 does not exist 2024-09-12T00:11:53.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.16 2024-09-12T00:11:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.16 does not exist 2024-09-12T00:11:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.17 2024-09-12T00:11:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:53.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.17 does not exist 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.18 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.18 does not exist 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.19 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.995+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.19 does not exist 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.20 2024-09-12T00:11:54.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.20 does not exist 2024-09-12T00:11:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.21 2024-09-12T00:11:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.21 does not exist 2024-09-12T00:11:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.22 2024-09-12T00:11:54.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.22 does not exist 2024-09-12T00:11:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.23 2024-09-12T00:11:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.23 does not exist 2024-09-12T00:11:54.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.24 2024-09-12T00:11:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.24 does not exist 2024-09-12T00:11:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.25 2024-09-12T00:11:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.25 does not exist 2024-09-12T00:11:54.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.26 2024-09-12T00:11:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:53.999+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.26 does not exist 2024-09-12T00:11:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.27 2024-09-12T00:11:54.004 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.27 does not exist 2024-09-12T00:11:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.28 2024-09-12T00:11:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.28 does not exist 2024-09-12T00:11:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.29 2024-09-12T00:11:54.005 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.29 does not exist 2024-09-12T00:11:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.30 2024-09-12T00:11:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.30 does not exist 2024-09-12T00:11:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.31 2024-09-12T00:11:54.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.31 does not exist 2024-09-12T00:11:54.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.32 2024-09-12T00:11:54.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.32 does not exist 2024-09-12T00:11:54.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.33 2024-09-12T00:11:54.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.003+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.33 does not exist 2024-09-12T00:11:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.34 2024-09-12T00:11:54.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.34 does not exist 2024-09-12T00:11:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.35 2024-09-12T00:11:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.35 does not exist 2024-09-12T00:11:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.36 2024-09-12T00:11:54.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.36 does not exist 2024-09-12T00:11:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.37 2024-09-12T00:11:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.37 does not exist 2024-09-12T00:11:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.38 2024-09-12T00:11:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.38 does not exist 2024-09-12T00:11:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.39 2024-09-12T00:11:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.39 does not exist 2024-09-12T00:11:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.40 2024-09-12T00:11:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.007+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.40 does not exist 2024-09-12T00:11:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.41 2024-09-12T00:11:54.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.41 does not exist 2024-09-12T00:11:54.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.42 2024-09-12T00:11:54.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.42 does not exist 2024-09-12T00:11:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.43 2024-09-12T00:11:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.43 does not exist 2024-09-12T00:11:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.44 2024-09-12T00:11:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.44 does not exist 2024-09-12T00:11:54.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.45 2024-09-12T00:11:54.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.45 does not exist 2024-09-12T00:11:54.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.46 2024-09-12T00:11:54.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.011+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.46 does not exist 2024-09-12T00:11:54.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.47 2024-09-12T00:11:54.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.47 does not exist 2024-09-12T00:11:54.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.48 2024-09-12T00:11:54.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.48 does not exist 2024-09-12T00:11:54.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.49 2024-09-12T00:11:54.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.49 does not exist 2024-09-12T00:11:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.50 2024-09-12T00:11:54.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.50 does not exist 2024-09-12T00:11:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.51 2024-09-12T00:11:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.51 does not exist 2024-09-12T00:11:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.52 2024-09-12T00:11:54.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.52 does not exist 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.53 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.015+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.53 does not exist 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.54 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.54 does not exist 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.55 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.55 does not exist 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.56 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.56 does not exist 2024-09-12T00:11:54.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.57 2024-09-12T00:11:54.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.57 does not exist 2024-09-12T00:11:54.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.58 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.58 does not exist 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.59 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.019+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.59 does not exist 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.60 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.60 does not exist 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.61 2024-09-12T00:11:54.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.61 does not exist 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.62 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.62 does not exist 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.63 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.63 does not exist 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.64 2024-09-12T00:11:54.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.64 does not exist 2024-09-12T00:11:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.65 2024-09-12T00:11:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.65 does not exist 2024-09-12T00:11:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.66 2024-09-12T00:11:54.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.023+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.66 does not exist 2024-09-12T00:11:54.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.67 2024-09-12T00:11:54.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.67 does not exist 2024-09-12T00:11:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.68 2024-09-12T00:11:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.68 does not exist 2024-09-12T00:11:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.69 2024-09-12T00:11:54.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.69 does not exist 2024-09-12T00:11:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.70 2024-09-12T00:11:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.70 does not exist 2024-09-12T00:11:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.71 2024-09-12T00:11:54.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.71 does not exist 2024-09-12T00:11:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.72 2024-09-12T00:11:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.72 does not exist 2024-09-12T00:11:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.73 2024-09-12T00:11:54.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.027+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.73 does not exist 2024-09-12T00:11:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.74 2024-09-12T00:11:54.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.74 does not exist 2024-09-12T00:11:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.75 2024-09-12T00:11:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.75 does not exist 2024-09-12T00:11:54.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.76 2024-09-12T00:11:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.76 does not exist 2024-09-12T00:11:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.77 2024-09-12T00:11:54.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.77 does not exist 2024-09-12T00:11:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.78 2024-09-12T00:11:54.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.031+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.78 does not exist 2024-09-12T00:11:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.79 2024-09-12T00:11:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.79 does not exist 2024-09-12T00:11:54.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.80 2024-09-12T00:11:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.80 does not exist 2024-09-12T00:11:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.81 2024-09-12T00:11:54.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.81 does not exist 2024-09-12T00:11:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.82 2024-09-12T00:11:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.82 does not exist 2024-09-12T00:11:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.83 2024-09-12T00:11:54.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.83 does not exist 2024-09-12T00:11:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.84 2024-09-12T00:11:54.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.035+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.84 does not exist 2024-09-12T00:11:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.85 2024-09-12T00:11:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.85 does not exist 2024-09-12T00:11:54.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.86 2024-09-12T00:11:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.86 does not exist 2024-09-12T00:11:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.87 2024-09-12T00:11:54.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.87 does not exist 2024-09-12T00:11:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.88 2024-09-12T00:11:54.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.88 does not exist 2024-09-12T00:11:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.89 2024-09-12T00:11:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.89 does not exist 2024-09-12T00:11:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.90 2024-09-12T00:11:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.039+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.90 does not exist 2024-09-12T00:11:54.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.91 2024-09-12T00:11:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.91 does not exist 2024-09-12T00:11:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.92 2024-09-12T00:11:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.92 does not exist 2024-09-12T00:11:54.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.93 2024-09-12T00:11:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.93 does not exist 2024-09-12T00:11:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.94 2024-09-12T00:11:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.94 does not exist 2024-09-12T00:11:54.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.95 2024-09-12T00:11:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.95 does not exist 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.96 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.043+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.96 does not exist 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.97 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.97 does not exist 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.98 2024-09-12T00:11:54.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.98 does not exist 2024-09-12T00:11:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.99 2024-09-12T00:11:54.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.99 does not exist 2024-09-12T00:11:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.100 2024-09-12T00:11:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.100 does not exist 2024-09-12T00:11:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.101 2024-09-12T00:11:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.101 does not exist 2024-09-12T00:11:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.102 2024-09-12T00:11:54.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.102 does not exist 2024-09-12T00:11:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.103 2024-09-12T00:11:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.047+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.103 does not exist 2024-09-12T00:11:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.104 2024-09-12T00:11:54.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.104 does not exist 2024-09-12T00:11:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.105 2024-09-12T00:11:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.105 does not exist 2024-09-12T00:11:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.106 2024-09-12T00:11:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.106 does not exist 2024-09-12T00:11:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.107 2024-09-12T00:11:54.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.107 does not exist 2024-09-12T00:11:54.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.108 2024-09-12T00:11:54.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.051+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.108 does not exist 2024-09-12T00:11:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.109 2024-09-12T00:11:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.109 does not exist 2024-09-12T00:11:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.110 2024-09-12T00:11:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.110 does not exist 2024-09-12T00:11:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.111 2024-09-12T00:11:54.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.111 does not exist 2024-09-12T00:11:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.112 2024-09-12T00:11:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.112 does not exist 2024-09-12T00:11:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.113 2024-09-12T00:11:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.113 does not exist 2024-09-12T00:11:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.114 2024-09-12T00:11:54.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.055+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.114 does not exist 2024-09-12T00:11:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.115 2024-09-12T00:11:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.115 does not exist 2024-09-12T00:11:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.116 2024-09-12T00:11:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.116 does not exist 2024-09-12T00:11:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.117 2024-09-12T00:11:54.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.117 does not exist 2024-09-12T00:11:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.118 2024-09-12T00:11:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.118 does not exist 2024-09-12T00:11:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.119 2024-09-12T00:11:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.119 does not exist 2024-09-12T00:11:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.120 2024-09-12T00:11:54.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.059+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.120 does not exist 2024-09-12T00:11:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.121 2024-09-12T00:11:54.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.121 does not exist 2024-09-12T00:11:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.122 2024-09-12T00:11:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.122 does not exist 2024-09-12T00:11:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.123 2024-09-12T00:11:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.123 does not exist 2024-09-12T00:11:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.124 2024-09-12T00:11:54.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.124 does not exist 2024-09-12T00:11:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.125 2024-09-12T00:11:54.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.063+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.125 does not exist 2024-09-12T00:11:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.126 2024-09-12T00:11:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.126 does not exist 2024-09-12T00:11:54.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):38 probing oid=data_log.127 2024-09-12T00:11:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 shard_check {anonymous}::probe_shard(const DoutPrefixProvider*, librados::v14_2_0::IoCtx&, const string&, bool&, optional_yield):60: oid=data_log.127 does not exist 2024-09-12T00:11:54.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.067+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::create(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, std::optional >, bool, uint64_t, uint64_t):1211 entering 2024-09-12T00:11:54.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.071+0000 7fd5fdc109c0 20 static int rgw::cls::fifo::FIFO::open(const DoutPrefixProvider*, librados::v14_2_0::IoCtx, std::string, std::unique_ptr*, optional_yield, std::optional, bool):1169 entering 2024-09-12T00:11:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.079+0000 7fd4adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:11:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.079+0000 7fd5fdc109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:54.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:54.079+0000 7fd5fdc109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:56.949 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:56.947+0000 7fd5fdc109c0 10 rgw_init_ioctx warning: failed to set recovery_priority on default.rgw.meta 2024-09-12T00:11:56.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:56.947+0000 7fd5fdc109c0 5 note: GC not initialized 2024-09-12T00:11:56.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:56.963+0000 7fd4acfe1640 20 reqs_thread_entry: start 2024-09-12T00:11:56.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:56.963+0000 7fd5fdc109c0 20 init_complete bucket index max shards: 11 2024-09-12T00:11:56.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:56.963+0000 7fd5fdc109c0 20 Filter name: none 2024-09-12T00:11:56.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:56.963+0000 7fd4167fc640 20 reqs_thread_entry: start 2024-09-12T00:11:57.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.003+0000 7fd4adfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:11:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.007+0000 7fd5fdc109c0 20 remove_watcher() i=0 2024-09-12T00:11:57.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.007+0000 7fd5fdc109c0 2 removed watcher, disabling cache 2024-09-12T00:11:57.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.011+0000 7fd5fdc109c0 20 remove_watcher() i=1 2024-09-12T00:11:57.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.015+0000 7fd5fdc109c0 20 remove_watcher() i=2 2024-09-12T00:11:57.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.015+0000 7fd5fdc109c0 20 remove_watcher() i=3 2024-09-12T00:11:57.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.019+0000 7fd5fdc109c0 20 remove_watcher() i=4 2024-09-12T00:11:57.023 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.023+0000 7fd5fdc109c0 20 remove_watcher() i=5 2024-09-12T00:11:57.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.023+0000 7fd5fdc109c0 20 remove_watcher() i=6 2024-09-12T00:11:57.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.027+0000 7fd5fdc109c0 20 remove_watcher() i=7 2024-09-12T00:11:57.048 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-12T00:11:57.048 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:11:57.048 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:11:57.048 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'modify', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--compression', 'random'] 2024-09-12T00:11:57.049 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement modify --rgw-zone default --placement-id default-placement --compression random 2024-09-12T00:11:57.091 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:57.091 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.119+0000 7fb17924e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:57.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.119+0000 7fb17924e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:57.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.123+0000 7fb034ff9640 20 reqs_thread_entry: start 2024-09-12T00:11:57.147 INFO:teuthology.orchestra.run.smithi078.stdout:{"id":"88185928-eed4-4ed7-91c9-ccae30f6e5e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:11:57.147 DEBUG:tasks.util.rgw: json result: {'id': '88185928-eed4-4ed7-91c9-ccae30f6e5e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:11:57.148 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'list'] 2024-09-12T00:11:57.148 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'list'] 2024-09-12T00:11:57.148 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user list 2024-09-12T00:11:57.230 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:57.230 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:57.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.267+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.267+0000 7f08ab7129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.267+0000 7f08ab7129c0 20 realm 2024-09-12T00:11:57.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.267+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.267+0000 7f08ab7129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.267+0000 7f08ab7129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:11:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.267+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.271+0000 7f08ab7129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:57.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.271+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.271+0000 7f08ab7129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:11:57.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.271+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.271+0000 7f08ab7129c0 20 rados_obj.operate() r=0 bl.length=1009 2024-09-12T00:11:57.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.271+0000 7f08ab7129c0 20 searching for the correct realm 2024-09-12T00:11:57.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.275+0000 7f08a9a19640 0 -- 172.21.15.78:0/1591605283 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f08a406d8e0 msgr2=0x7f08a406d040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:11:57.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.487+0000 7f08a9a19640 0 -- 172.21.15.78:0/1591605283 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x561d823e1fb0 msgr2=0x561d823e4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:11:57.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:11:57.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:11:57.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:11:57.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:11:57.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:11:57.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:11:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:11:57.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.499+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 rados_obj.operate() r=0 bl.length=436 2024-09-12T00:11:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 zone default found 2024-09-12T00:11:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 4 Realm: () 2024-09-12T00:11:57.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:11:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:11:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:11:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 zonegroup default 2024-09-12T00:11:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:57.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:57.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 rados->read ofs=0 len=0 2024-09-12T00:11:57.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:11:57.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 started sync module instance, tier type = 2024-09-12T00:11:57.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.503+0000 7f08ab7129c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:11:57.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.527+0000 7f08ab7129c0 20 add_watcher() i=0 2024-09-12T00:11:57.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.527+0000 7f08ab7129c0 20 add_watcher() i=1 2024-09-12T00:11:57.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.527+0000 7f08ab7129c0 20 add_watcher() i=2 2024-09-12T00:11:57.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.527+0000 7f08ab7129c0 20 add_watcher() i=3 2024-09-12T00:11:57.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.527+0000 7f08ab7129c0 20 add_watcher() i=4 2024-09-12T00:11:57.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.527+0000 7f08ab7129c0 20 add_watcher() i=5 2024-09-12T00:11:57.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.531+0000 7f08ab7129c0 20 add_watcher() i=6 2024-09-12T00:11:57.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.535+0000 7f08ab7129c0 20 add_watcher() i=7 2024-09-12T00:11:57.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.535+0000 7f08ab7129c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:11:57.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f075f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:11:57.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f08ab7129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:57.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f08ab7129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:57.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f08ab7129c0 5 note: GC not initialized 2024-09-12T00:11:57.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f075e7e4640 20 reqs_thread_entry: start 2024-09-12T00:11:57.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f08ab7129c0 20 init_complete bucket index max shards: 11 2024-09-12T00:11:57.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f08ab7129c0 20 Filter name: none 2024-09-12T00:11:57.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.539+0000 7f06cffff640 20 reqs_thread_entry: start 2024-09-12T00:11:57.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.559+0000 7f075f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:11:57.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.567+0000 7f08ab7129c0 20 remove_watcher() i=0 2024-09-12T00:11:57.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.567+0000 7f08ab7129c0 2 removed watcher, disabling cache 2024-09-12T00:11:57.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.567+0000 7f08ab7129c0 20 remove_watcher() i=1 2024-09-12T00:11:57.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.571+0000 7f08ab7129c0 20 remove_watcher() i=2 2024-09-12T00:11:57.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.571+0000 7f08ab7129c0 20 remove_watcher() i=3 2024-09-12T00:11:57.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.575+0000 7f08ab7129c0 20 remove_watcher() i=4 2024-09-12T00:11:57.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.575+0000 7f08ab7129c0 20 remove_watcher() i=5 2024-09-12T00:11:57.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.579+0000 7f08ab7129c0 20 remove_watcher() i=6 2024-09-12T00:11:57.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.583+0000 7f08ab7129c0 20 remove_watcher() i=7 2024-09-12T00:11:57.602 INFO:teuthology.orchestra.run.smithi078.stdout:[] 2024-09-12T00:11:57.603 DEBUG:tasks.util.rgw: json result: [] 2024-09-12T00:11:57.603 INFO:tasks.rgw:Configuring storage class type = LUKEWARM 2024-09-12T00:11:57.603 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:11:57.603 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM'] 2024-09-12T00:11:57.603 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM 2024-09-12T00:11:57.691 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:57.691 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:57.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.719+0000 7fe0ec79e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:57.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.719+0000 7fe0ec79e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:57.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.723+0000 7fdfad7e2640 20 reqs_thread_entry: start 2024-09-12T00:11:57.745 INFO:teuthology.orchestra.run.smithi078.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["LUKEWARM","STANDARD"]}}] 2024-09-12T00:11:57.745 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['LUKEWARM', 'STANDARD']}}] 2024-09-12T00:11:57.745 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:11:57.745 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'LUKEWARM', '--data-pool', 'default.rgw.buckets.data.lukewarm'] 2024-09-12T00:11:57.745 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class LUKEWARM --data-pool default.rgw.buckets.data.lukewarm 2024-09-12T00:11:57.830 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:57.830 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:57.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.855+0000 7f18472e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:57.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.855+0000 7f18472e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:57.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.859+0000 7f168affd640 20 reqs_thread_entry: start 2024-09-12T00:11:57.885 INFO:teuthology.orchestra.run.smithi078.stdout:{"id":"88185928-eed4-4ed7-91c9-ccae30f6e5e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:11:57.885 DEBUG:tasks.util.rgw: json result: {'id': '88185928-eed4-4ed7-91c9-ccae30f6e5e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:11:57.885 INFO:tasks.rgw:Configuring storage class type = FROZEN 2024-09-12T00:11:57.885 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:11:57.885 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN'] 2024-09-12T00:11:57.886 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN 2024-09-12T00:11:57.964 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:57.965 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.991+0000 7f4c39fab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:57.993 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.991+0000 7f4c39fab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:57.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:57.995+0000 7f4a8dffb640 20 reqs_thread_entry: start 2024-09-12T00:11:58.017 INFO:teuthology.orchestra.run.smithi078.stdout:[{"key":"default-placement","val":{"name":"default-placement","tags":[],"storage_classes":["FROZEN","LUKEWARM","STANDARD"]}}] 2024-09-12T00:11:58.017 DEBUG:tasks.util.rgw: json result: [{'key': 'default-placement', 'val': {'name': 'default-placement', 'tags': [], 'storage_classes': ['FROZEN', 'LUKEWARM', 'STANDARD']}}] 2024-09-12T00:11:58.017 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:11:58.017 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'add', '--rgw-zone', 'default', '--placement-id', 'default-placement', '--storage-class', 'FROZEN', '--data-pool', 'default.rgw.buckets.data.frozen'] 2024-09-12T00:11:58.017 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement add --rgw-zone default --placement-id default-placement --storage-class FROZEN --data-pool default.rgw.buckets.data.frozen 2024-09-12T00:11:58.101 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:11:58.102 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:11:58.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:58.127+0000 7f2dd08269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:11:58.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:58.127+0000 7f2dd08269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:11:58.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:11:58.131+0000 7f2c90fe1640 20 reqs_thread_entry: start 2024-09-12T00:11:58.153 INFO:teuthology.orchestra.run.smithi078.stdout:{"id":"88185928-eed4-4ed7-91c9-ccae30f6e5e2","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"FROZEN":{"data_pool":"default.rgw.buckets.data.frozen"},"LUKEWARM":{"data_pool":"default.rgw.buckets.data.lukewarm"},"STANDARD":{"data_pool":"default.rgw.buckets.data","compression_type":"random"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-12T00:11:58.153 DEBUG:tasks.util.rgw: json result: {'id': '88185928-eed4-4ed7-91c9-ccae30f6e5e2', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'FROZEN': {'data_pool': 'default.rgw.buckets.data.frozen'}, 'LUKEWARM': {'data_pool': 'default.rgw.buckets.data.lukewarm'}, 'STANDARD': {'data_pool': 'default.rgw.buckets.data', 'compression_type': 'random'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-12T00:11:58.153 INFO:tasks.rgw:Starting rgw... 2024-09-12T00:11:58.154 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-12T00:11:58.154 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-12T00:11:58.154 DEBUG:teuthology.orchestra.run.smithi078:> sudo echo -n http://smithi078.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-12T00:11:58.207 INFO:teuthology.orchestra.run.smithi078.stdout:http://smithi078.front.sepia.ceph.com:80 2024-09-12T00:11:58.208 DEBUG:teuthology.orchestra.run.smithi078:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-12T00:11:58.263 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-12T00:11:58.263 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-12T00:11:58.305 INFO:tasks.rgw.client.0:Started 2024-09-12T00:11:58.305 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi078.front.sepia.ceph.com:80/ 2024-09-12T00:11:58.305 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-12T00:11:58.329 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-12T00:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-12T00:11:58.329 INFO:teuthology.orchestra.run.smithi078.stderr:curl: (7) Failed to connect to smithi078.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-09-12T00:11:59.334 DEBUG:teuthology.orchestra.run.smithi078:> curl http://smithi078.front.sepia.ceph.com:80/ 2024-09-12T00:11:59.345 INFO:teuthology.orchestra.run.smithi078.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-12T00:11:59.345 INFO:teuthology.orchestra.run.smithi078.stderr: Dload Upload Total Spent Left Speed 2024-09-12T00:11:59.348 INFO:teuthology.orchestra.run.smithi078.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 51886 0 --:--:-- --:--:-- --:--:-- 62333 2024-09-12T00:11:59.349 INFO:teuthology.orchestra.run.smithi078.stdout:anonymous 2024-09-12T00:11:59.350 INFO:teuthology.run_tasks:Running task tox... 2024-09-12T00:11:59.362 INFO:tasks.tox:Deploying tox from pip... 2024-09-12T00:11:59.362 DEBUG:teuthology.orchestra.run.smithi078:> python3 -m venv /home/ubuntu/cephtest/tox-venv 2024-09-12T00:12:02.290 DEBUG:teuthology.orchestra.run.smithi078:> source /home/ubuntu/cephtest/tox-venv/bin/activate && pip install tox==3.15.0 2024-09-12T00:12:02.938 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting tox==3.15.0 2024-09-12T00:12:03.038 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading tox-3.15.0-py2.py3-none-any.whl (82 kB) 2024-09-12T00:12:03.104 INFO:teuthology.orchestra.run.smithi078.stdout: ---------------------------------------- 82.1/82.1 KB 1.2 MB/s eta 0:00:00 2024-09-12T00:12:03.261 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting py<2,>=1.4.17 2024-09-12T00:12:03.282 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading py-1.11.0-py2.py3-none-any.whl (98 kB) 2024-09-12T00:12:03.333 INFO:teuthology.orchestra.run.smithi078.stdout: ---------------------------------------- 98.7/98.7 KB 1.9 MB/s eta 0:00:00 2024-09-12T00:12:03.507 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting filelock<4,>=3.0.0 2024-09-12T00:12:03.524 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading filelock-3.16.0-py3-none-any.whl (16 kB) 2024-09-12T00:12:03.816 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting virtualenv!=20.0.0,!=20.0.1,!=20.0.2,!=20.0.3,!=20.0.4,!=20.0.5,!=20.0.6,!=20.0.7,>=16.0.0 2024-09-12T00:12:03.840 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading virtualenv-20.26.4-py3-none-any.whl (6.0 MB) 2024-09-12T00:12:04.002 INFO:teuthology.orchestra.run.smithi078.stdout: ---------------------------------------- 6.0/6.0 MB 37.5 MB/s eta 0:00:00 2024-09-12T00:12:04.106 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting toml>=0.9.4 2024-09-12T00:12:04.122 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading toml-0.10.2-py2.py3-none-any.whl (16 kB) 2024-09-12T00:12:04.223 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting pluggy<1,>=0.12.0 2024-09-12T00:12:04.238 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading pluggy-0.13.1-py2.py3-none-any.whl (18 kB) 2024-09-12T00:12:04.374 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting packaging>=14 2024-09-12T00:12:04.389 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading packaging-24.1-py3-none-any.whl (53 kB) 2024-09-12T00:12:04.429 INFO:teuthology.orchestra.run.smithi078.stdout: ---------------------------------------- 54.0/54.0 KB 1.2 MB/s eta 0:00:00 2024-09-12T00:12:04.503 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting six<2,>=1.14.0 2024-09-12T00:12:04.518 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:12:04.708 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting platformdirs<5,>=3.9.1 2024-09-12T00:12:04.722 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading platformdirs-4.3.2-py3-none-any.whl (18 kB) 2024-09-12T00:12:04.825 INFO:teuthology.orchestra.run.smithi078.stdout:Collecting distlib<1,>=0.3.7 2024-09-12T00:12:04.842 INFO:teuthology.orchestra.run.smithi078.stdout: Downloading distlib-0.3.8-py2.py3-none-any.whl (468 kB) 2024-09-12T00:12:04.891 INFO:teuthology.orchestra.run.smithi078.stdout: -------------------------------------- 468.9/468.9 KB 10.3 MB/s eta 0:00:00 2024-09-12T00:12:05.055 INFO:teuthology.orchestra.run.smithi078.stdout:Installing collected packages: distlib, toml, six, py, pluggy, platformdirs, packaging, filelock, virtualenv, tox 2024-09-12T00:12:06.132 INFO:teuthology.orchestra.run.smithi078.stdout:Successfully installed distlib-0.3.8 filelock-3.16.0 packaging-24.1 platformdirs-4.3.2 pluggy-0.13.1 py-1.11.0 six-1.16.0 toml-0.10.2 tox-3.15.0 virtualenv-20.26.4 2024-09-12T00:12:06.212 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:12:06.226 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:12:06.226 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:12:06.226 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:12:06.231 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:12:06.232 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:12:06.232 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:12:06.280 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:12:06.280 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:12:06.328 INFO:tasks.workunit:timeout=3h 2024-09-12T00:12:06.328 INFO:tasks.workunit:cleanup=True 2024-09-12T00:12:06.329 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:12:06.378 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:12:48.717 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:12:48.717 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:12:48.717 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-12T00:12:48.718 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:12:48.719 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:12:48.719 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:12:48.719 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:12:48.723 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:12:48.777 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:12:48.780 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:12:48.780 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:12:49.535 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:12:49.615 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:12:49.665 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:12:49.666 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:12:49.666 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:12:49.714 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:12:49.717 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:12:49.717 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:12:49.764 INFO:tasks.workunit:Running workunits matching rgw/run-bucket-check.sh on client.0... 2024-09-12T00:12:49.765 INFO:tasks.workunit:Running workunit rgw/run-bucket-check.sh... 2024-09-12T00:12:49.765 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/run-bucket-check.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:12:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-bucket-check.sh 2024-09-12T00:12:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:12:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:12:52.706 INFO:tasks.workunit.client.0.smithi078.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ deactivate nondestructive 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV 2024-09-12T00:12:52.707 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PATH 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -z '' ']' 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ PS1='(rgw) ' 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PS1 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-12T00:12:52.708 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install pip --upgrade 2024-09-12T00:12:53.064 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:12:53.301 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-12T00:12:53.396 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:12:53.674 INFO:tasks.workunit.client.0.smithi078.stdout: ---------------------------------------- 1.8/1.8 MB 6.7 MB/s eta 0:00:00 2024-09-12T00:12:53.748 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-12T00:12:53.748 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-12T00:12:53.748 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:12:54.040 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:12:54.046 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:12:54.808 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-12T00:12:54.868 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install boto3 2024-09-12T00:12:56.071 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-12T00:12:56.120 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:12:56.856 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:12:56.873 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:12:56.981 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:12:57.002 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:12:57.150 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:12:57.169 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:12:57.330 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:12:57.347 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:12:57.557 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:12:57.572 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:12:57.886 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:12:57.901 INFO:tasks.workunit.client.0.smithi078.stdout: Downloading six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:12:57.976 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:12:58.085 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:12:58.397 INFO:tasks.workunit.client.0.smithi078.stdout: ---------------------------------------- 12.5/12.5 MB 41.9 MB/s eta 0:00:00 2024-09-12T00:12:58.414 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:12:58.499 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:12:58.556 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:12:58.613 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:12:58.682 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:12:58.860 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:13:00.047 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:13:00.563 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_bucket_check.py 2024-09-12T00:13:00.699 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin user create --uid check-tester --display-name "Check Testing" --access-key OJODXSLNX4LUNHQG99PA --secret 3l6ffld34qaymfomuh832j94738aie2x4p2o8h6n 2024-09-12T00:13:00.737 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:00.737 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:00.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.775+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 realm 2024-09-12T00:13:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:00.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:00.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:00.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:00.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:00.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.779+0000 7fb0741619c0 20 searching for the correct realm 2024-09-12T00:13:00.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.787+0000 7fb071466640 0 -- 172.21.15.78:0/3701300447 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fb0640b9b20 msgr2=0x7fb0640d7940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:01.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:00.999+0000 7fb071c67640 0 -- 172.21.15.78:0/3701300447 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5610301320b0 msgr2=0x561030134540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:01.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:01.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:01.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:01.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:01.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:01.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:01.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:01.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 zone default found 2024-09-12T00:13:01.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 4 Realm: () 2024-09-12T00:13:01.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:01.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:01.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:01.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 zonegroup default 2024-09-12T00:13:01.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.011+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.015+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.015+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.015+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.015+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.015+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.015+0000 7fb0741619c0 20 started sync module instance, tier type = 2024-09-12T00:13:01.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.015+0000 7fb0741619c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:01.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=0 2024-09-12T00:13:01.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=1 2024-09-12T00:13:01.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=2 2024-09-12T00:13:01.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=3 2024-09-12T00:13:01.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=4 2024-09-12T00:13:01.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=5 2024-09-12T00:13:01.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=6 2024-09-12T00:13:01.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 20 add_watcher() i=7 2024-09-12T00:13:01.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.043+0000 7fb0741619c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:01.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7faf237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:01.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:01.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 5 note: GC not initialized 2024-09-12T00:13:01.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7faf227fc640 20 reqs_thread_entry: start 2024-09-12T00:13:01.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:01.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 Filter name: none 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fae93fff640 20 reqs_thread_entry: start 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 cache get: name=default.rgw.meta+users.uid+check-tester : miss 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x0 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 adding default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : miss 2024-09-12T00:13:01.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x0 2024-09-12T00:13:01.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 adding default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:13:01.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:13:01.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.051+0000 7fb0741619c0 10 cache get: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA : hit (negative entry) 2024-09-12T00:13:01.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.055+0000 7fb0741619c0 10 cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:13:01.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.055+0000 7fb0741619c0 10 moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:13:01.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.055+0000 7fb0741619c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:check-tester, ofs0, ns] 2024-09-12T00:13:01.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.055+0000 7faf557fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94627526092736 notifier 4568 bl.length()=593 2024-09-12T00:13:01.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.055+0000 7faf557fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+check-tester info.flags=0x17 2024-09-12T00:13:01.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.055+0000 7faf557fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+check-tester to cache LRU end 2024-09-12T00:13:01.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.059+0000 7fb0741619c0 10 cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:13:01.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.059+0000 7fb0741619c0 10 moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:13:01.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.059+0000 7fb0741619c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:OJODXSLNX4LUNHQG99PA, ofs0, ns] 2024-09-12T00:13:01.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.059+0000 7faf54ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 167503724544 cookie 94627526030080 notifier 4568 bl.length()=186 2024-09-12T00:13:01.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.059+0000 7faf54ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA info.flags=0x7 2024-09-12T00:13:01.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.059+0000 7faf54ff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+OJODXSLNX4LUNHQG99PA to cache LRU end 2024-09-12T00:13:01.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.059+0000 7faf237fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.067+0000 7fb0741619c0 20 remove_watcher() i=0 2024-09-12T00:13:01.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.067+0000 7fb0741619c0 2 removed watcher, disabling cache 2024-09-12T00:13:01.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.067+0000 7fb0741619c0 20 remove_watcher() i=1 2024-09-12T00:13:01.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.071+0000 7fb0741619c0 20 remove_watcher() i=2 2024-09-12T00:13:01.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.075+0000 7fb0741619c0 20 remove_watcher() i=3 2024-09-12T00:13:01.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.075+0000 7fb0741619c0 20 remove_watcher() i=4 2024-09-12T00:13:01.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.079+0000 7fb0741619c0 20 remove_watcher() i=5 2024-09-12T00:13:01.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.079+0000 7fb0741619c0 20 remove_watcher() i=6 2024-09-12T00:13:01.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.083+0000 7fb0741619c0 20 remove_watcher() i=7 2024-09-12T00:13:01.546 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: recalculated bucket check stats are correct 2024-09-12T00:13:01.546 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:01.547 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:13:01.581 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:01.581 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:01.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 realm 2024-09-12T00:13:01.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:01.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.627+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.631+0000 7efcc89489c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:01.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.631+0000 7efcc89489c0 20 searching for the correct realm 2024-09-12T00:13:01.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.635+0000 7efcc6c4f640 0 -- 172.21.15.78:0/1896692287 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7efcb806ec40 msgr2=0x7efcb806c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:01.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.847+0000 7efcc6c4f640 0 -- 172.21.15.78:0/1896692287 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x56324eb9be50 msgr2=0x56324eb9e2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:01.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.859+0000 7efcc89489c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:01.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.859+0000 7efcc89489c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:01.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.859+0000 7efcc89489c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:01.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.859+0000 7efcc89489c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:01.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.859+0000 7efcc89489c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:01.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.859+0000 7efcc89489c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:01.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.859+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:01.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:01.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 zone default found 2024-09-12T00:13:01.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 4 Realm: () 2024-09-12T00:13:01.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:01.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:01.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:01.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 zonegroup default 2024-09-12T00:13:01.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.863+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.867+0000 7efcc89489c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:01.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.867+0000 7efcc89489c0 20 started sync module instance, tier type = 2024-09-12T00:13:01.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.867+0000 7efcc89489c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:01.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.891+0000 7efcc89489c0 20 add_watcher() i=0 2024-09-12T00:13:01.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.891+0000 7efcc89489c0 20 add_watcher() i=1 2024-09-12T00:13:01.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.891+0000 7efcc89489c0 20 add_watcher() i=2 2024-09-12T00:13:01.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.891+0000 7efcc89489c0 20 add_watcher() i=3 2024-09-12T00:13:01.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.891+0000 7efcc89489c0 20 add_watcher() i=4 2024-09-12T00:13:01.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.891+0000 7efcc89489c0 20 add_watcher() i=5 2024-09-12T00:13:01.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.891+0000 7efcc89489c0 20 add_watcher() i=6 2024-09-12T00:13:01.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.895+0000 7efcc89489c0 20 add_watcher() i=7 2024-09-12T00:13:01.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.895+0000 7efcc89489c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:01.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.899+0000 7efb7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.899+0000 7efcc89489c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.899+0000 7efcc89489c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.899+0000 7efcc89489c0 5 note: GC not initialized 2024-09-12T00:13:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.899+0000 7efaf77fe640 20 reqs_thread_entry: start 2024-09-12T00:13:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.899+0000 7efcc89489c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 20 Filter name: none 2024-09-12T00:13:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efaf57fa640 20 reqs_thread_entry: start 2024-09-12T00:13:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:01.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:01.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:01.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:01.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:01.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:01.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:01.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:01.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:01.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:01.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:01.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.903+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:01.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.907+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:01.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.907+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:01.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.907+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:01.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.907+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:01.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.911+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:01.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.911+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:01.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.911+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:01.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.911+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:01.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.915+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:01.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.915+0000 7efcc89489c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:01.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.927+0000 7efb7cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:01.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.935+0000 7efcc89489c0 20 remove_watcher() i=0 2024-09-12T00:13:01.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.935+0000 7efcc89489c0 2 removed watcher, disabling cache 2024-09-12T00:13:01.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.935+0000 7efcc89489c0 20 remove_watcher() i=1 2024-09-12T00:13:01.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.939+0000 7efcc89489c0 20 remove_watcher() i=2 2024-09-12T00:13:01.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.939+0000 7efcc89489c0 20 remove_watcher() i=3 2024-09-12T00:13:01.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.943+0000 7efcc89489c0 20 remove_watcher() i=4 2024-09-12T00:13:01.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.943+0000 7efcc89489c0 20 remove_watcher() i=5 2024-09-12T00:13:01.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.947+0000 7efcc89489c0 20 remove_watcher() i=6 2024-09-12T00:13:01.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:01.951+0000 7efcc89489c0 20 remove_watcher() i=7 2024-09-12T00:13:01.970 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:13:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:02.001 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:02.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.043+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 realm 2024-09-12T00:13:02.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:02.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:02.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.047+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:02.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.051+0000 7fa0eaa369c0 20 searching for the correct realm 2024-09-12T00:13:02.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.055+0000 7fa0e8d3d640 0 -- 172.21.15.78:0/2649138299 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fa0d8064f80 msgr2=0x7fa0d806c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:02.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.267+0000 7fa0e853c640 0 -- 172.21.15.78:0/2649138299 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55db374fcaa0 msgr2=0x55db374fef00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.279+0000 7fa0eaa369c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.279+0000 7fa0eaa369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.279+0000 7fa0eaa369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.279+0000 7fa0eaa369c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.279+0000 7fa0eaa369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:02.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:02.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 zone default found 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 4 Realm: () 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 zonegroup default 2024-09-12T00:13:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.283+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.287+0000 7fa0eaa369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.287+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.287+0000 7fa0eaa369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.287+0000 7fa0eaa369c0 20 started sync module instance, tier type = 2024-09-12T00:13:02.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.287+0000 7fa0eaa369c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:02.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.307+0000 7fa0eaa369c0 20 add_watcher() i=0 2024-09-12T00:13:02.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.307+0000 7fa0eaa369c0 20 add_watcher() i=1 2024-09-12T00:13:02.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.307+0000 7fa0eaa369c0 20 add_watcher() i=2 2024-09-12T00:13:02.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.307+0000 7fa0eaa369c0 20 add_watcher() i=3 2024-09-12T00:13:02.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.307+0000 7fa0eaa369c0 20 add_watcher() i=4 2024-09-12T00:13:02.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.307+0000 7fa0eaa369c0 20 add_watcher() i=5 2024-09-12T00:13:02.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.311+0000 7fa0eaa369c0 20 add_watcher() i=6 2024-09-12T00:13:02.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.311+0000 7fa0eaa369c0 20 add_watcher() i=7 2024-09-12T00:13:02.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.311+0000 7fa0eaa369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:02.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.315+0000 7f9f9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:02.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.315+0000 7fa0eaa369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:02.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.315+0000 7fa0eaa369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:02.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.315+0000 7fa0eaa369c0 5 note: GC not initialized 2024-09-12T00:13:02.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7f9f9dfdb640 20 reqs_thread_entry: start 2024-09-12T00:13:02.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:02.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 Filter name: none 2024-09-12T00:13:02.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7f9f0f7fe640 20 reqs_thread_entry: start 2024-09-12T00:13:02.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:02.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:02.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:02.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:02.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:02.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.319+0000 7fa0eaa369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:02.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.323+0000 7f9f9efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:02.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.327+0000 7fa0eaa369c0 20 remove_watcher() i=0 2024-09-12T00:13:02.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.327+0000 7fa0eaa369c0 2 removed watcher, disabling cache 2024-09-12T00:13:02.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.331+0000 7fa0eaa369c0 20 remove_watcher() i=1 2024-09-12T00:13:02.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.331+0000 7fa0eaa369c0 20 remove_watcher() i=2 2024-09-12T00:13:02.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.335+0000 7fa0eaa369c0 20 remove_watcher() i=3 2024-09-12T00:13:02.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.335+0000 7fa0eaa369c0 20 remove_watcher() i=4 2024-09-12T00:13:02.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.339+0000 7fa0eaa369c0 20 remove_watcher() i=5 2024-09-12T00:13:02.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.343+0000 7fa0eaa369c0 20 remove_watcher() i=6 2024-09-12T00:13:02.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.343+0000 7fa0eaa369c0 20 remove_watcher() i=7 2024-09-12T00:13:02.360 INFO:tasks.workunit.client.0.smithi078.stderr:{'rgw.main': {'size': 54, 'size_actual': 24576, 'size_utilized': 76, 'size_kb': 1, 'size_kb_actual': 24, 'size_kb_utilized': 1, 'num_objects': 6}} 2024-09-12T00:13:02.361 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked does not report normal entries 2024-09-12T00:13:02.361 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:02.361 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:13:02.396 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:02.396 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:02.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.439+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.439+0000 7f811dd789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.439+0000 7f811dd789c0 20 realm 2024-09-12T00:13:02.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.439+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.439+0000 7f811dd789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.439+0000 7f811dd789c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:02.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.439+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.443+0000 7f811dd789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.443+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.443+0000 7f811dd789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:02.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.443+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.443+0000 7f811dd789c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:02.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.443+0000 7f811dd789c0 20 searching for the correct realm 2024-09-12T00:13:02.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.447+0000 7f811b87e640 0 -- 172.21.15.78:0/3445716281 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55cad736e990 msgr2=0x55cad7370e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:02.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.451+0000 7f811b07d640 0 -- 172.21.15.78:0/3445716281 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f81140a4120 msgr2=0x7f81140fa0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.667+0000 7f811dd789c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.667+0000 7f811dd789c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.667+0000 7f811dd789c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.667+0000 7f811dd789c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.667+0000 7f811dd789c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.667+0000 7f811dd789c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.667+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:02.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:02.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 zone default found 2024-09-12T00:13:02.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 4 Realm: () 2024-09-12T00:13:02.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:02.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:02.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:02.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 zonegroup default 2024-09-12T00:13:02.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.671+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.675+0000 7f811dd789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.675+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.675+0000 7f811dd789c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:02.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.675+0000 7f811dd789c0 20 started sync module instance, tier type = 2024-09-12T00:13:02.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.675+0000 7f811dd789c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:02.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.699+0000 7f811dd789c0 20 add_watcher() i=0 2024-09-12T00:13:02.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.699+0000 7f811dd789c0 20 add_watcher() i=1 2024-09-12T00:13:02.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.699+0000 7f811dd789c0 20 add_watcher() i=2 2024-09-12T00:13:02.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.699+0000 7f811dd789c0 20 add_watcher() i=3 2024-09-12T00:13:02.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.699+0000 7f811dd789c0 20 add_watcher() i=4 2024-09-12T00:13:02.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.699+0000 7f811dd789c0 20 add_watcher() i=5 2024-09-12T00:13:02.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.699+0000 7f811dd789c0 20 add_watcher() i=6 2024-09-12T00:13:02.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.703+0000 7f811dd789c0 20 add_watcher() i=7 2024-09-12T00:13:02.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.703+0000 7f811dd789c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:02.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.707+0000 7f7fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:02.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.707+0000 7f811dd789c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:02.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.707+0000 7f811dd789c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:02.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.707+0000 7f811dd789c0 5 note: GC not initialized 2024-09-12T00:13:02.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.707+0000 7f7fd0fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:02.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:02.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 20 Filter name: none 2024-09-12T00:13:02.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f7f4a7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:02.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:02.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:02.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:02.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:02.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:02.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:02.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:02.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:02.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:02.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:02.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:02.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:02.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.711+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:02.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.715+0000 7f811dd789c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:13:02.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.715+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:02.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.715+0000 7f811dd789c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:13:02.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.715+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:02.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.715+0000 7f811dd789c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:13:02.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.715+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:02.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.719+0000 7f811dd789c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:13:02.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.719+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:02.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.719+0000 7f811dd789c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:13:02.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.719+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:02.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.719+0000 7f811dd789c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:13:02.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.719+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:02.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:13:02.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:02.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:13:02.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:13:02.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:02.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:13:02.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.723+0000 7f811dd789c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.727+0000 7f811dd789c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:13:02.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.727+0000 7f811dd789c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:13:02.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.727+0000 7f7fd1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:02.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.731+0000 7f811dd789c0 20 remove_watcher() i=0 2024-09-12T00:13:02.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.731+0000 7f811dd789c0 2 removed watcher, disabling cache 2024-09-12T00:13:02.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.735+0000 7f811dd789c0 20 remove_watcher() i=1 2024-09-12T00:13:02.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.739+0000 7f811dd789c0 20 remove_watcher() i=2 2024-09-12T00:13:02.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.739+0000 7f811dd789c0 20 remove_watcher() i=3 2024-09-12T00:13:02.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.743+0000 7f811dd789c0 20 remove_watcher() i=4 2024-09-12T00:13:02.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.743+0000 7f811dd789c0 20 remove_watcher() i=5 2024-09-12T00:13:02.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.747+0000 7f811dd789c0 20 remove_watcher() i=6 2024-09-12T00:13:02.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:02.751+0000 7f811dd789c0 20 remove_watcher() i=7 2024-09-12T00:13:02.769 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:13:03.205 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:13:04.712 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:04.712 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:13:04.747 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:04.748 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:04.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.791+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:04.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:04.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 realm 2024-09-12T00:13:04.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:04.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:04.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:04.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:04.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:04.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:04.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:04.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:04.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:04.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.795+0000 7f391a6979c0 20 searching for the correct realm 2024-09-12T00:13:04.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:04.803+0000 7f391899e640 0 -- 172.21.15.78:0/539261472 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f39080093d0 msgr2=0x7f3908009850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:05.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.019+0000 7f391819d640 0 -- 172.21.15.78:0/539261472 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55c79afd3fe0 msgr2=0x55c79afd6450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:05.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.027+0000 7f391a6979c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.027+0000 7f391a6979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.027+0000 7f391a6979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.027+0000 7f391a6979c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.027+0000 7f391a6979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.027+0000 7f391a6979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.027+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 zone default found 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 4 Realm: () 2024-09-12T00:13:05.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 zonegroup default 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.031+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.035+0000 7f391a6979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.035+0000 7f391a6979c0 20 started sync module instance, tier type = 2024-09-12T00:13:05.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.035+0000 7f391a6979c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:05.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.063+0000 7f391a6979c0 20 add_watcher() i=0 2024-09-12T00:13:05.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.063+0000 7f391a6979c0 20 add_watcher() i=1 2024-09-12T00:13:05.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.063+0000 7f391a6979c0 20 add_watcher() i=2 2024-09-12T00:13:05.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.063+0000 7f391a6979c0 20 add_watcher() i=3 2024-09-12T00:13:05.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.063+0000 7f391a6979c0 20 add_watcher() i=4 2024-09-12T00:13:05.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.063+0000 7f391a6979c0 20 add_watcher() i=5 2024-09-12T00:13:05.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.063+0000 7f391a6979c0 20 add_watcher() i=6 2024-09-12T00:13:05.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.067+0000 7f391a6979c0 20 add_watcher() i=7 2024-09-12T00:13:05.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.067+0000 7f391a6979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:05.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f37cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:05.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:05.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:05.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 5 note: GC not initialized 2024-09-12T00:13:05.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f37cdfdb640 20 reqs_thread_entry: start 2024-09-12T00:13:05.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:05.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 20 Filter name: none 2024-09-12T00:13:05.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f373f7fe640 20 reqs_thread_entry: start 2024-09-12T00:13:05.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:05.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.071+0000 7f391a6979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:05.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:05.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:05.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: starting shard=0 2024-09-12T00:13:05.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:05.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: starting shard=1 2024-09-12T00:13:05.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:05.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: starting shard=2 2024-09-12T00:13:05.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:05.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 INFO: main: starting shard=3 2024-09-12T00:13:05.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.075+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:05.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 INFO: main: starting shard=4 2024-09-12T00:13:05.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:05.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 INFO: main: starting shard=5 2024-09-12T00:13:05.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:05.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 INFO: main: starting shard=6 2024-09-12T00:13:05.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.079+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:05.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: starting shard=7 2024-09-12T00:13:05.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:05.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: starting shard=8 2024-09-12T00:13:05.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:05.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:13:05.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: starting shard=9 2024-09-12T00:13:05.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:05.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 INFO: main: starting shard=10 2024-09-12T00:13:05.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.083+0000 7f391a6979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:05.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.087+0000 7f391a6979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.087+0000 7f391a6979c0 20 INFO: main: done 2024-09-12T00:13:05.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.087+0000 7f37cefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:05.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.091+0000 7f391a6979c0 20 remove_watcher() i=0 2024-09-12T00:13:05.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.091+0000 7f391a6979c0 2 removed watcher, disabling cache 2024-09-12T00:13:05.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.095+0000 7f391a6979c0 20 remove_watcher() i=1 2024-09-12T00:13:05.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.095+0000 7f391a6979c0 20 remove_watcher() i=2 2024-09-12T00:13:05.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.099+0000 7f391a6979c0 20 remove_watcher() i=3 2024-09-12T00:13:05.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.099+0000 7f391a6979c0 20 remove_watcher() i=4 2024-09-12T00:13:05.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.103+0000 7f391a6979c0 20 remove_watcher() i=5 2024-09-12T00:13:05.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.107+0000 7f391a6979c0 20 remove_watcher() i=6 2024-09-12T00:13:05.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.107+0000 7f391a6979c0 20 remove_watcher() i=7 2024-09-12T00:13:05.191 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:05.192 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:13:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:05.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.275+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.275+0000 7fd9267919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.275+0000 7fd9267919c0 20 realm 2024-09-12T00:13:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.275+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:05.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.279+0000 7fd9267919c0 20 searching for the correct realm 2024-09-12T00:13:05.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.283+0000 7fd924a98640 0 -- 172.21.15.78:0/1511741601 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fd91c0899e0 msgr2=0x7fd91c0421a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:05.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.495+0000 7fd924a98640 0 -- 172.21.15.78:0/1511741601 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x562ec2e8f210 msgr2=0x562ec2e91600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.507+0000 7fd9267919c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.507+0000 7fd9267919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.507+0000 7fd9267919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.507+0000 7fd9267919c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.507+0000 7fd9267919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.507+0000 7fd9267919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.507+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:05.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:05.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 zone default found 2024-09-12T00:13:05.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 4 Realm: () 2024-09-12T00:13:05.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:05.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:05.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:05.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 zonegroup default 2024-09-12T00:13:05.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.511+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.515+0000 7fd9267919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.515+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.515+0000 7fd9267919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.515+0000 7fd9267919c0 20 started sync module instance, tier type = 2024-09-12T00:13:05.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.515+0000 7fd9267919c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:05.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.535+0000 7fd9267919c0 20 add_watcher() i=0 2024-09-12T00:13:05.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.535+0000 7fd9267919c0 20 add_watcher() i=1 2024-09-12T00:13:05.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.535+0000 7fd9267919c0 20 add_watcher() i=2 2024-09-12T00:13:05.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.535+0000 7fd9267919c0 20 add_watcher() i=3 2024-09-12T00:13:05.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.535+0000 7fd9267919c0 20 add_watcher() i=4 2024-09-12T00:13:05.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.535+0000 7fd9267919c0 20 add_watcher() i=5 2024-09-12T00:13:05.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.539+0000 7fd9267919c0 20 add_watcher() i=6 2024-09-12T00:13:05.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.539+0000 7fd9267919c0 20 add_watcher() i=7 2024-09-12T00:13:05.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.539+0000 7fd9267919c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:05.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.543+0000 7fd7dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:05.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.543+0000 7fd9267919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:05.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.543+0000 7fd9267919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:05.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.543+0000 7fd9267919c0 5 note: GC not initialized 2024-09-12T00:13:05.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.543+0000 7fd7d9fdb640 20 reqs_thread_entry: start 2024-09-12T00:13:05.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.543+0000 7fd9267919c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:05.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.543+0000 7fd9267919c0 20 Filter name: none 2024-09-12T00:13:05.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd74b7fe640 20 reqs_thread_entry: start 2024-09-12T00:13:05.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:05.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:05.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:05.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:05.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 INFO: main: starting shard=0 2024-09-12T00:13:05.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:05.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 INFO: main: starting shard=1 2024-09-12T00:13:05.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.547+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:05.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 INFO: main: starting shard=2 2024-09-12T00:13:05.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:05.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 INFO: main: starting shard=3 2024-09-12T00:13:05.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:05.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 INFO: main: starting shard=4 2024-09-12T00:13:05.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.551+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:05.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: starting shard=5 2024-09-12T00:13:05.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:05.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:13:05.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: starting shard=6 2024-09-12T00:13:05.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:05.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: starting shard=7 2024-09-12T00:13:05.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:05.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 INFO: main: starting shard=8 2024-09-12T00:13:05.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.555+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:05.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 INFO: main: starting shard=9 2024-09-12T00:13:05.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:05.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 INFO: main: starting shard=10 2024-09-12T00:13:05.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:05.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:05.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.559+0000 7fd9267919c0 20 INFO: main: done 2024-09-12T00:13:05.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.563+0000 7fd7dafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:05.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.567+0000 7fd9267919c0 20 remove_watcher() i=0 2024-09-12T00:13:05.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.567+0000 7fd9267919c0 2 removed watcher, disabling cache 2024-09-12T00:13:05.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.567+0000 7fd9267919c0 20 remove_watcher() i=1 2024-09-12T00:13:05.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.571+0000 7fd9267919c0 20 remove_watcher() i=2 2024-09-12T00:13:05.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.571+0000 7fd9267919c0 20 remove_watcher() i=3 2024-09-12T00:13:05.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.575+0000 7fd9267919c0 20 remove_watcher() i=4 2024-09-12T00:13:05.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.575+0000 7fd9267919c0 20 remove_watcher() i=5 2024-09-12T00:13:05.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.579+0000 7fd9267919c0 20 remove_watcher() i=6 2024-09-12T00:13:05.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.583+0000 7fd9267919c0 20 remove_watcher() i=7 2024-09-12T00:13:05.667 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:05.668 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:13:05.704 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:05.704 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:05.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.747+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 realm 2024-09-12T00:13:05.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:05.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:05.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:05.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.751+0000 7f80c937e9c0 20 searching for the correct realm 2024-09-12T00:13:05.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.755+0000 7f80c7685640 0 -- 172.21.15.78:0/1940543621 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f80b8008050 msgr2=0x7f80b8025920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:05.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.971+0000 7f80c6683640 0 -- 172.21.15.78:0/1940543621 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f80b80093d0 msgr2=0x7f80b8009830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:05.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.983+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 zone default found 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 4 Realm: () 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:05.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 zonegroup default 2024-09-12T00:13:05.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:05.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:05.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 started sync module instance, tier type = 2024-09-12T00:13:05.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:05.987+0000 7f80c937e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:06.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.011+0000 7f80c937e9c0 20 add_watcher() i=0 2024-09-12T00:13:06.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.011+0000 7f80c937e9c0 20 add_watcher() i=1 2024-09-12T00:13:06.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.011+0000 7f80c937e9c0 20 add_watcher() i=2 2024-09-12T00:13:06.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.011+0000 7f80c937e9c0 20 add_watcher() i=3 2024-09-12T00:13:06.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.011+0000 7f80c937e9c0 20 add_watcher() i=4 2024-09-12T00:13:06.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.011+0000 7f80c937e9c0 20 add_watcher() i=5 2024-09-12T00:13:06.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.011+0000 7f80c937e9c0 20 add_watcher() i=6 2024-09-12T00:13:06.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.015+0000 7f80c937e9c0 20 add_watcher() i=7 2024-09-12T00:13:06.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.015+0000 7f80c937e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:06.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f7f7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:06.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f80c937e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:06.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f80c937e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:06.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f80c937e9c0 5 note: GC not initialized 2024-09-12T00:13:06.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f7ef7fff640 20 reqs_thread_entry: start 2024-09-12T00:13:06.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f80c937e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:06.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f80c937e9c0 20 Filter name: none 2024-09-12T00:13:06.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.019+0000 7f7ef5ffb640 20 reqs_thread_entry: start 2024-09-12T00:13:06.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:06.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:06.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:06.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:06.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:06.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:06.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:06.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.023+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:06.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:13:06.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:06.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:06.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:06.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:06.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:06.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.027+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:06.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:06.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:06.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:06.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:06.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:06.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:06.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:06.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.031+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:06.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:06.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:06.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:06.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:06.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.035+0000 7f80c937e9c0 20 INFO: main: done 2024-09-12T00:13:06.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.039+0000 7f7f7d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:06.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.043+0000 7f80c937e9c0 20 remove_watcher() i=0 2024-09-12T00:13:06.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.043+0000 7f80c937e9c0 2 removed watcher, disabling cache 2024-09-12T00:13:06.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.047+0000 7f80c937e9c0 20 remove_watcher() i=1 2024-09-12T00:13:06.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.047+0000 7f80c937e9c0 20 remove_watcher() i=2 2024-09-12T00:13:06.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.051+0000 7f80c937e9c0 20 remove_watcher() i=3 2024-09-12T00:13:06.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.055+0000 7f80c937e9c0 20 remove_watcher() i=4 2024-09-12T00:13:06.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.055+0000 7f80c937e9c0 20 remove_watcher() i=5 2024-09-12T00:13:06.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.059+0000 7f80c937e9c0 20 remove_watcher() i=6 2024-09-12T00:13:06.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.059+0000 7f80c937e9c0 20 remove_watcher() i=7 2024-09-12T00:13:06.144 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:06.144 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:13:06.179 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:06.179 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:06.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.223+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 realm 2024-09-12T00:13:06.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:06.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:06.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:06.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.227+0000 7f048f48d9c0 20 searching for the correct realm 2024-09-12T00:13:06.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.235+0000 7f048d794640 0 -- 172.21.15.78:0/829020520 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f047c0657f0 msgr2=0x7f047c05ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:06.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.451+0000 7f048cf93640 0 -- 172.21.15.78:0/829020520 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5615f79cd4d0 msgr2=0x5615f79cf940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:06.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.459+0000 7f048f48d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:06.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.459+0000 7f048f48d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:06.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.459+0000 7f048f48d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:06.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.459+0000 7f048f48d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:06.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.459+0000 7f048f48d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:06.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.459+0000 7f048f48d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:06.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.459+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:06.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:06.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 zone default found 2024-09-12T00:13:06.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 4 Realm: () 2024-09-12T00:13:06.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:06.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:06.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:06.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 zonegroup default 2024-09-12T00:13:06.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.463+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.467+0000 7f048f48d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:06.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.467+0000 7f048f48d9c0 20 started sync module instance, tier type = 2024-09-12T00:13:06.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.467+0000 7f048f48d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:06.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.491+0000 7f048f48d9c0 20 add_watcher() i=0 2024-09-12T00:13:06.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.491+0000 7f048f48d9c0 20 add_watcher() i=1 2024-09-12T00:13:06.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.491+0000 7f048f48d9c0 20 add_watcher() i=2 2024-09-12T00:13:06.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.491+0000 7f048f48d9c0 20 add_watcher() i=3 2024-09-12T00:13:06.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.491+0000 7f048f48d9c0 20 add_watcher() i=4 2024-09-12T00:13:06.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.491+0000 7f048f48d9c0 20 add_watcher() i=5 2024-09-12T00:13:06.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.495+0000 7f048f48d9c0 20 add_watcher() i=6 2024-09-12T00:13:06.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.495+0000 7f048f48d9c0 20 add_watcher() i=7 2024-09-12T00:13:06.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.495+0000 7f048f48d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:06.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f0342fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:06.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:06.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:06.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 5 note: GC not initialized 2024-09-12T00:13:06.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f0341fe3640 20 reqs_thread_entry: start 2024-09-12T00:13:06.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:06.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 20 Filter name: none 2024-09-12T00:13:06.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f02b37fe640 20 reqs_thread_entry: start 2024-09-12T00:13:06.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:06.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.503+0000 7f048f48d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:06.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:06.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:06.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:06.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:06.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:06.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:06.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:06.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:06.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:06.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:06.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.507+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:06.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:06.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:06.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:06.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:06.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:06.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:06.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.511+0000 7f048f48d9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:06.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:06.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:06.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:06.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:06.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:06.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:06.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:06.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:06.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:13:06.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.515+0000 7f048f48d9c0 20 INFO: main: done 2024-09-12T00:13:06.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.519+0000 7f0342fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:06.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.523+0000 7f048f48d9c0 20 remove_watcher() i=0 2024-09-12T00:13:06.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.523+0000 7f048f48d9c0 2 removed watcher, disabling cache 2024-09-12T00:13:06.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.527+0000 7f048f48d9c0 20 remove_watcher() i=1 2024-09-12T00:13:06.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.531+0000 7f048f48d9c0 20 remove_watcher() i=2 2024-09-12T00:13:06.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.531+0000 7f048f48d9c0 20 remove_watcher() i=3 2024-09-12T00:13:06.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.535+0000 7f048f48d9c0 20 remove_watcher() i=4 2024-09-12T00:13:06.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.539+0000 7f048f48d9c0 20 remove_watcher() i=5 2024-09-12T00:13:06.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.539+0000 7f048f48d9c0 20 remove_watcher() i=6 2024-09-12T00:13:06.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:06.543+0000 7f048f48d9c0 20 remove_watcher() i=7 2024-09-12T00:13:06.566 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:13:07.008 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:13:07.442 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked finds unlistable entries 2024-09-12T00:13:07.442 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:07.442 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:13:07.476 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:07.476 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:07.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.519+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.519+0000 7fa8721f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.519+0000 7fa8721f59c0 20 realm 2024-09-12T00:13:07.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.519+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:07.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:07.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:07.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.523+0000 7fa8721f59c0 20 searching for the correct realm 2024-09-12T00:13:07.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.527+0000 7fa86f4fa640 0 -- 172.21.15.78:0/3892075806 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fa86012aad0 msgr2=0x7fa8600f6240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:07.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.531+0000 7fa86fcfb640 0 -- 172.21.15.78:0/3892075806 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fa86401dc20 msgr2=0x7fa864007920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:07.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:07.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:07.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:07.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.751+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:07.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 zone default found 2024-09-12T00:13:07.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 4 Realm: () 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 zonegroup default 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:07.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 started sync module instance, tier type = 2024-09-12T00:13:07.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.755+0000 7fa8721f59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:07.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.783+0000 7fa8721f59c0 20 add_watcher() i=0 2024-09-12T00:13:07.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.783+0000 7fa8721f59c0 20 add_watcher() i=1 2024-09-12T00:13:07.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.783+0000 7fa8721f59c0 20 add_watcher() i=2 2024-09-12T00:13:07.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.783+0000 7fa8721f59c0 20 add_watcher() i=3 2024-09-12T00:13:07.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.783+0000 7fa8721f59c0 20 add_watcher() i=4 2024-09-12T00:13:07.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.783+0000 7fa8721f59c0 20 add_watcher() i=5 2024-09-12T00:13:07.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.783+0000 7fa8721f59c0 20 add_watcher() i=6 2024-09-12T00:13:07.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.787+0000 7fa8721f59c0 20 add_watcher() i=7 2024-09-12T00:13:07.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.787+0000 7fa8721f59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:07.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.791+0000 7fa725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:07.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.791+0000 7fa8721f59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:07.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.791+0000 7fa8721f59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:07.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.791+0000 7fa8721f59c0 5 note: GC not initialized 2024-09-12T00:13:07.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa724fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:07.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:07.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 20 Filter name: none 2024-09-12T00:13:07.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa69e7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:07.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:07.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:07.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:07.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:07.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:07.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:07.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:07.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:07.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:07.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:07.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:07.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:07.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.795+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:07.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.799+0000 7fa8721f59c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:13:07.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.799+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:07.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.799+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:07.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.799+0000 7fa8721f59c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:13:07.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.799+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:07.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.799+0000 7fa8721f59c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:13:07.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.799+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:07.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.803+0000 7fa8721f59c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:13:07.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.803+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:07.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.803+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:07.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.803+0000 7fa8721f59c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:13:07.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.803+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:07.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.803+0000 7fa8721f59c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:13:07.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.803+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:07.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.807+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:07.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.807+0000 7fa8721f59c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:13:07.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.807+0000 7fa8721f59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:07.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.807+0000 7fa8721f59c0 1 NOTICE: finished shard 1 (1 entries found) 2024-09-12T00:13:07.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.807+0000 7fa8721f59c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:13:07.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.807+0000 7fa8721f59c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:13:07.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.811+0000 7fa8721f59c0 1 NOTICE: finished shard 10 (1 entries found) 2024-09-12T00:13:07.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.811+0000 7fa8721f59c0 1 NOTICE: finished all shards (4 entries found) 2024-09-12T00:13:07.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.811+0000 7fa725fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:07.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.815+0000 7fa8721f59c0 20 remove_watcher() i=0 2024-09-12T00:13:07.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.815+0000 7fa8721f59c0 2 removed watcher, disabling cache 2024-09-12T00:13:07.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.819+0000 7fa8721f59c0 20 remove_watcher() i=1 2024-09-12T00:13:07.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.819+0000 7fa8721f59c0 20 remove_watcher() i=2 2024-09-12T00:13:07.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.823+0000 7fa8721f59c0 20 remove_watcher() i=3 2024-09-12T00:13:07.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.823+0000 7fa8721f59c0 20 remove_watcher() i=4 2024-09-12T00:13:07.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.827+0000 7fa8721f59c0 20 remove_watcher() i=5 2024-09-12T00:13:07.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.827+0000 7fa8721f59c0 20 remove_watcher() i=6 2024-09-12T00:13:07.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:07.831+0000 7fa8721f59c0 20 remove_watcher() i=7 2024-09-12T00:13:07.848 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: unlinked entries are not listable 2024-09-12T00:13:07.848 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:07.857 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: GET returns 404 for unlinked entry keys that have no other versions 2024-09-12T00:13:07.858 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:07.960 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked fixes unlistable entries 2024-09-12T00:13:07.960 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:07.961 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:13:08.001 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:08.002 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:08.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.043+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 20 realm 2024-09-12T00:13:08.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:08.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.047+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.051+0000 7f47cff649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.051+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.051+0000 7f47cff649c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:08.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.051+0000 7f47cff649c0 20 searching for the correct realm 2024-09-12T00:13:08.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.055+0000 7f47ce26b640 0 -- 172.21.15.78:0/3824250451 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f47c011d9e0 msgr2=0x7f47c00093d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:08.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.063+0000 7f47c5269640 0 -- 172.21.15.78:0/3824250451 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f47c012b3c0 msgr2=0x7f47c00c2940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:08.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:08.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:08.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:08.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:08.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:08.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:08.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:08.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 zone default found 2024-09-12T00:13:08.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 4 Realm: () 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 zonegroup default 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.071+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.075+0000 7f47cff649c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.075+0000 7f47cff649c0 20 started sync module instance, tier type = 2024-09-12T00:13:08.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.075+0000 7f47cff649c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.091+0000 7f47cff649c0 20 add_watcher() i=0 2024-09-12T00:13:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.091+0000 7f47cff649c0 20 add_watcher() i=1 2024-09-12T00:13:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.091+0000 7f47cff649c0 20 add_watcher() i=2 2024-09-12T00:13:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.091+0000 7f47cff649c0 20 add_watcher() i=3 2024-09-12T00:13:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.091+0000 7f47cff649c0 20 add_watcher() i=4 2024-09-12T00:13:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.091+0000 7f47cff649c0 20 add_watcher() i=5 2024-09-12T00:13:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.091+0000 7f47cff649c0 20 add_watcher() i=6 2024-09-12T00:13:08.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.095+0000 7f47cff649c0 20 add_watcher() i=7 2024-09-12T00:13:08.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.095+0000 7f47cff649c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f467f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 5 note: GC not initialized 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f467e7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 Filter name: none 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f45effff640 20 reqs_thread_entry: start 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:08.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.099+0000 7f47cff649c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:08.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:13:08.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:08.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:13:08.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:08.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:13:08.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.103+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:08.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.107+0000 7f47cff649c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:13:08.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.107+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.107+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:08.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.107+0000 7f47cff649c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:13:08.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.107+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:08.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.107+0000 7f47cff649c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:13:08.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.107+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.111+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:08.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.111+0000 7f47cff649c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:13:08.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.111+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdbf87e0 obj=check-bucket:e state=0x5597fdf5c7a8 s->prefetch_data=0 2024-09-12T00:13:08.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdcba540 obj=check-bucket:d state=0x5597fdf28e08 s->prefetch_data=0 2024-09-12T00:13:08.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdf2afc0 obj=check-bucket:c state=0x5597fdf566b8 s->prefetch_data=0 2024-09-12T00:13:08.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdf57540 obj=check-bucket:f state=0x5597fdf29b88 s->prefetch_data=0 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to 5n24i1crkl72phzv8o0f7nyvfzibgfnn 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state_impl: setting s->olh_tag to ihc3gad1mftxo93syluq2yvmbtg691bx 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ihc3gad1mftxo93syluq2yvmbtg691bx 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to yz15oc6ihywl6k8x8ls4xk2rzud0j21w 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state_impl: setting s->olh_tag to fbe0o3xbt5cwiwc31ko5d20kj2yfzvak 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fbe0o3xbt5cwiwc31ko5d20kj2yfzvak 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to w2qvahn9ha9qkh1ftz75s3c88awc61dk 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 get_obj_state_impl: setting s->olh_tag to 7gb02l6vdgsbf515z3ykr5ns35gjafyj 2024-09-12T00:13:08.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.115+0000 7f47cff649c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7gb02l6vdgsbf515z3ykr5ns35gjafyj 2024-09-12T00:13:08.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.119+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to irj2m8dqkn5ee21zvd9h0czmdqhm8bv4 2024-09-12T00:13:08.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.119+0000 7f47cff649c0 20 get_obj_state_impl: setting s->olh_tag to 3gqti6hft89mv6nm9ifgtf2ap18mjxz7 2024-09-12T00:13:08.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.119+0000 7f47cff649c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3gqti6hft89mv6nm9ifgtf2ap18mjxz7 2024-09-12T00:13:08.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.123+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.123+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.123+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 olh_log_entry: epoch=2 op=3 key=f[36RHx9BjZRNWLxytKFKn0IG93U-PdJX] 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdf57540 obj=check-bucket:_:36RHx9BjZRNWLxytKFKn0IG93U-PdJX_f state=0x5597fe0016a8 s->prefetch_data=0 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 10 manifest: total_size = 11 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6760551571024537777 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdf57540 obj=check-bucket:_:36RHx9BjZRNWLxytKFKn0IG93U-PdJX_f state=0x5597fe0016a8 s->prefetch_data=0 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 prepare_atomic_modification: state is not atomic. state=0x5597fe0016a8 2024-09-12T00:13:08.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.127+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:13:08.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 olh_log_entry: epoch=2 op=3 key=e[Uq49QWktvAVI6XbM06Xi5RYKWVZEhS3] 2024-09-12T00:13:08.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdbf87e0 obj=check-bucket:_:Uq49QWktvAVI6XbM06Xi5RYKWVZEhS3_e state=0x5597fdff5238 s->prefetch_data=0 2024-09-12T00:13:08.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 olh_log_entry: epoch=3 op=3 key=c[QePlqQl2LsreScm8V0x3B1cj-Ommtr3] 2024-09-12T00:13:08.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdf2afc0 obj=check-bucket:_:QePlqQl2LsreScm8V0x3B1cj-Ommtr3_c state=0x5597fe00b358 s->prefetch_data=0 2024-09-12T00:13:08.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 10 manifest: total_size = 22 2024-09-12T00:13:08.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12763098350169402151 2024-09-12T00:13:08.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdbf87e0 obj=check-bucket:_:Uq49QWktvAVI6XbM06Xi5RYKWVZEhS3_e state=0x5597fdff5238 s->prefetch_data=0 2024-09-12T00:13:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 prepare_atomic_modification: state is not atomic. state=0x5597fdff5238 2024-09-12T00:13:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 10 manifest: total_size = 9 2024-09-12T00:13:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5540796213913587642 2024-09-12T00:13:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdf2afc0 obj=check-bucket:_:QePlqQl2LsreScm8V0x3B1cj-Ommtr3_c state=0x5597fe00b358 s->prefetch_data=0 2024-09-12T00:13:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 prepare_atomic_modification: state is not atomic. state=0x5597fe00b358 2024-09-12T00:13:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 olh_log_entry: epoch=3 op=3 key=d[ICyD6Qbw5QEsVUAjWhx8UUgkuwGFK1F] 2024-09-12T00:13:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdcba540 obj=check-bucket:_:ICyD6Qbw5QEsVUAjWhx8UUgkuwGFK1F_d state=0x5597fe019ce8 s->prefetch_data=0 2024-09-12T00:13:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 10 manifest: total_size = 22 2024-09-12T00:13:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14463298618293745184 2024-09-12T00:13:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdcba540 obj=check-bucket:_:ICyD6Qbw5QEsVUAjWhx8UUgkuwGFK1F_d state=0x5597fe019ce8 s->prefetch_data=0 2024-09-12T00:13:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 prepare_atomic_modification: state is not atomic. state=0x5597fe019ce8 2024-09-12T00:13:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.131+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.139+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdf57540 obj=check-bucket:f state=0x5597fdf29b88 s->prefetch_data=0 2024-09-12T00:13:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.139+0000 7f47cff649c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=3gqti6hft89mv6nm9ifgtf2ap18mjxz7 2024-09-12T00:13:08.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.143+0000 7f46b0ff9640 20 handle_completion(): completion ok for obj=f[36RHx9BjZRNWLxytKFKn0IG93U-PdJX] 2024-09-12T00:13:08.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.147+0000 7f46b0ff9640 20 handle_completion(): completion ok for obj=e[Uq49QWktvAVI6XbM06Xi5RYKWVZEhS3] 2024-09-12T00:13:08.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.151+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.151+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.151+0000 7f47cff649c0 20 get_obj_state: octx=0x5597fdbf87e0 obj=check-bucket:e state=0x5597fdf5c7a8 s->prefetch_data=0 2024-09-12T00:13:08.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.151+0000 7f47cff649c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ihc3gad1mftxo93syluq2yvmbtg691bx 2024-09-12T00:13:08.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.155+0000 7f46b17fa640 20 handle_completion(): completion ok for obj=c[QePlqQl2LsreScm8V0x3B1cj-Ommtr3] 2024-09-12T00:13:08.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.155+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.155+0000 7f46b0ff9640 20 handle_completion(): completion ok for obj=d[ICyD6Qbw5QEsVUAjWhx8UUgkuwGFK1F] 2024-09-12T00:13:08.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.155+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.155+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.155+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.155+0000 7f47cff649c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:13:08.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.159+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.159+0000 7f47cff649c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:13:08.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.159+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.159+0000 7f47cff649c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:13:08.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.163+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.167+0000 7f47cff649c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.167+0000 7f47cff649c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:13:08.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.167+0000 7f47cff649c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:13:08.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.167+0000 7f467f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:08.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.171+0000 7f47cff649c0 20 remove_watcher() i=0 2024-09-12T00:13:08.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.171+0000 7f47cff649c0 2 removed watcher, disabling cache 2024-09-12T00:13:08.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.175+0000 7f47cff649c0 20 remove_watcher() i=1 2024-09-12T00:13:08.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.175+0000 7f47cff649c0 20 remove_watcher() i=2 2024-09-12T00:13:08.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.179+0000 7f47cff649c0 20 remove_watcher() i=3 2024-09-12T00:13:08.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.179+0000 7f47cff649c0 20 remove_watcher() i=4 2024-09-12T00:13:08.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.183+0000 7f47cff649c0 20 remove_watcher() i=5 2024-09-12T00:13:08.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.183+0000 7f47cff649c0 20 remove_watcher() i=6 2024-09-12T00:13:08.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.187+0000 7f47cff649c0 20 remove_watcher() i=7 2024-09-12T00:13:08.223 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked does not affect normal entries 2024-09-12T00:13:08.223 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check unlinked does not find new unlistable entries after fix 2024-09-12T00:13:08.304 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:08.304 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --min-age-hours 0 --dump-keys 2024-09-12T00:13:08.342 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:08.342 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:08.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 realm 2024-09-12T00:13:08.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:08.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.387+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.391+0000 7fa6111f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.391+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.391+0000 7fa6111f79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:08.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.391+0000 7fa6111f79c0 20 searching for the correct realm 2024-09-12T00:13:08.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.395+0000 7fa60f4fe640 0 -- 172.21.15.78:0/2367047723 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fa600014930 msgr2=0x7fa600004420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:08.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.611+0000 7fa60ecfd640 0 -- 172.21.15.78:0/2367047723 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55cf28533240 msgr2=0x55cf285356e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:08.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:08.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:08.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:08.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:08.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:08.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:08.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 zone default found 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 4 Realm: () 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 zonegroup default 2024-09-12T00:13:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.623+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.627+0000 7fa6111f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.627+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.627+0000 7fa6111f79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.627+0000 7fa6111f79c0 20 started sync module instance, tier type = 2024-09-12T00:13:08.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.627+0000 7fa6111f79c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.651+0000 7fa6111f79c0 20 add_watcher() i=0 2024-09-12T00:13:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.651+0000 7fa6111f79c0 20 add_watcher() i=1 2024-09-12T00:13:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.651+0000 7fa6111f79c0 20 add_watcher() i=2 2024-09-12T00:13:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.651+0000 7fa6111f79c0 20 add_watcher() i=3 2024-09-12T00:13:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.651+0000 7fa6111f79c0 20 add_watcher() i=4 2024-09-12T00:13:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.651+0000 7fa6111f79c0 20 add_watcher() i=5 2024-09-12T00:13:08.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.651+0000 7fa6111f79c0 20 add_watcher() i=6 2024-09-12T00:13:08.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.655+0000 7fa6111f79c0 20 add_watcher() i=7 2024-09-12T00:13:08.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.655+0000 7fa6111f79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:08.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa4c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:08.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 5 note: GC not initialized 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa43ffff640 20 reqs_thread_entry: start 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 20 Filter name: none 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa43dffb640 20 reqs_thread_entry: start 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:08.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:08.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:08.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:08.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.659+0000 7fa6111f79c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:08.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:08.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:08.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:08.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:08.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:08.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:08.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:13:08.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:08.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:13:08.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.663+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:08.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.667+0000 7fa6111f79c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:13:08.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.667+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:08.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.667+0000 7fa6111f79c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:13:08.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.667+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:08.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.667+0000 7fa6111f79c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:13:08.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.667+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:08.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:13:08.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:08.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:13:08.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:08.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:13:08.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:08.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:13:08.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.671+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:08.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.675+0000 7fa6111f79c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:13:08.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.675+0000 7fa6111f79c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:08.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.675+0000 7fa6111f79c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:13:08.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.675+0000 7fa6111f79c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:13:08.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.675+0000 7fa4c57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:08.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.679+0000 7fa6111f79c0 20 remove_watcher() i=0 2024-09-12T00:13:08.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.679+0000 7fa6111f79c0 2 removed watcher, disabling cache 2024-09-12T00:13:08.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.683+0000 7fa6111f79c0 20 remove_watcher() i=1 2024-09-12T00:13:08.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.687+0000 7fa6111f79c0 20 remove_watcher() i=2 2024-09-12T00:13:08.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.687+0000 7fa6111f79c0 20 remove_watcher() i=3 2024-09-12T00:13:08.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.691+0000 7fa6111f79c0 20 remove_watcher() i=4 2024-09-12T00:13:08.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.691+0000 7fa6111f79c0 20 remove_watcher() i=5 2024-09-12T00:13:08.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.695+0000 7fa6111f79c0 20 remove_watcher() i=6 2024-09-12T00:13:08.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.699+0000 7fa6111f79c0 20 remove_watcher() i=7 2024-09-12T00:13:08.780 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:13:08.810 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:08.810 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:08.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.855+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 realm 2024-09-12T00:13:08.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:08.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:08.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:08.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:08.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.859+0000 7f095be979c0 20 searching for the correct realm 2024-09-12T00:13:08.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:08.867+0000 7f095a19e640 0 -- 172.21.15.78:0/3590600037 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f094c008030 msgr2=0x7f094c05d2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:09.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.083+0000 7f095999d640 0 -- 172.21.15.78:0/3590600037 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559794937930 msgr2=0x559794939d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.091+0000 7f095be979c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.091+0000 7f095be979c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.091+0000 7f095be979c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.091+0000 7f095be979c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.091+0000 7f095be979c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.091+0000 7f095be979c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.091+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:09.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 zone default found 2024-09-12T00:13:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 4 Realm: () 2024-09-12T00:13:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 zonegroup default 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.095+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.099+0000 7f095be979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.099+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.099+0000 7f095be979c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.099+0000 7f095be979c0 20 started sync module instance, tier type = 2024-09-12T00:13:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.099+0000 7f095be979c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:09.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.123+0000 7f095be979c0 20 add_watcher() i=0 2024-09-12T00:13:09.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.123+0000 7f095be979c0 20 add_watcher() i=1 2024-09-12T00:13:09.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.123+0000 7f095be979c0 20 add_watcher() i=2 2024-09-12T00:13:09.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.123+0000 7f095be979c0 20 add_watcher() i=3 2024-09-12T00:13:09.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.123+0000 7f095be979c0 20 add_watcher() i=4 2024-09-12T00:13:09.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.123+0000 7f095be979c0 20 add_watcher() i=5 2024-09-12T00:13:09.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.123+0000 7f095be979c0 20 add_watcher() i=6 2024-09-12T00:13:09.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.127+0000 7f095be979c0 20 add_watcher() i=7 2024-09-12T00:13:09.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.127+0000 7f095be979c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:09.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f080b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:09.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f095be979c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:09.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f095be979c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:09.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f095be979c0 5 note: GC not initialized 2024-09-12T00:13:09.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f080a7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:09.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f095be979c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:09.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f095be979c0 20 Filter name: none 2024-09-12T00:13:09.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.131+0000 7f077bfff640 20 reqs_thread_entry: start 2024-09-12T00:13:09.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:09.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:09.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:09.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:09.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 INFO: main: starting shard=0 2024-09-12T00:13:09.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:09.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 INFO: main: starting shard=1 2024-09-12T00:13:09.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.135+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:09.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: starting shard=2 2024-09-12T00:13:09.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:09.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: starting shard=3 2024-09-12T00:13:09.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:09.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: starting shard=4 2024-09-12T00:13:09.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:09.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 INFO: main: starting shard=5 2024-09-12T00:13:09.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.139+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:09.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 INFO: main: starting shard=6 2024-09-12T00:13:09.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:09.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 INFO: main: starting shard=7 2024-09-12T00:13:09.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:09.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 INFO: main: starting shard=8 2024-09-12T00:13:09.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.143+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:09.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:13:09.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 INFO: main: starting shard=9 2024-09-12T00:13:09.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:09.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 INFO: main: starting shard=10 2024-09-12T00:13:09.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:09.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.147+0000 7f095be979c0 20 INFO: main: done 2024-09-12T00:13:09.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.151+0000 7f080b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:09.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.155+0000 7f095be979c0 20 remove_watcher() i=0 2024-09-12T00:13:09.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.155+0000 7f095be979c0 2 removed watcher, disabling cache 2024-09-12T00:13:09.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.155+0000 7f095be979c0 20 remove_watcher() i=1 2024-09-12T00:13:09.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.159+0000 7f095be979c0 20 remove_watcher() i=2 2024-09-12T00:13:09.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.163+0000 7f095be979c0 20 remove_watcher() i=3 2024-09-12T00:13:09.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.163+0000 7f095be979c0 20 remove_watcher() i=4 2024-09-12T00:13:09.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.167+0000 7f095be979c0 20 remove_watcher() i=5 2024-09-12T00:13:09.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.167+0000 7f095be979c0 20 remove_watcher() i=6 2024-09-12T00:13:09.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.171+0000 7f095be979c0 20 remove_watcher() i=7 2024-09-12T00:13:09.189 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:13:09.218 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:09.218 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:09.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.259+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 realm 2024-09-12T00:13:09.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:09.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:09.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:09.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.263+0000 7fcda9b769c0 20 searching for the correct realm 2024-09-12T00:13:09.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.271+0000 7fcda7e7d640 0 -- 172.21.15.78:0/2650189321 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fcd98036040 msgr2=0x7fcd98036930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:09.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.483+0000 7fcda767c640 0 -- 172.21.15.78:0/2650189321 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x561e45720d70 msgr2=0x561e45723190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.495+0000 7fcda9b769c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.495+0000 7fcda9b769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.495+0000 7fcda9b769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.495+0000 7fcda9b769c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.495+0000 7fcda9b769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.495+0000 7fcda9b769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.495+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:09.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 zone default found 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 4 Realm: () 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 zonegroup default 2024-09-12T00:13:09.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.499+0000 7fcda9b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.503+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.503+0000 7fcda9b769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.503+0000 7fcda9b769c0 20 started sync module instance, tier type = 2024-09-12T00:13:09.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.503+0000 7fcda9b769c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:09.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.527+0000 7fcda9b769c0 20 add_watcher() i=0 2024-09-12T00:13:09.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.527+0000 7fcda9b769c0 20 add_watcher() i=1 2024-09-12T00:13:09.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.527+0000 7fcda9b769c0 20 add_watcher() i=2 2024-09-12T00:13:09.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.527+0000 7fcda9b769c0 20 add_watcher() i=3 2024-09-12T00:13:09.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.527+0000 7fcda9b769c0 20 add_watcher() i=4 2024-09-12T00:13:09.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.527+0000 7fcda9b769c0 20 add_watcher() i=5 2024-09-12T00:13:09.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.527+0000 7fcda9b769c0 20 add_watcher() i=6 2024-09-12T00:13:09.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.531+0000 7fcda9b769c0 20 add_watcher() i=7 2024-09-12T00:13:09.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.531+0000 7fcda9b769c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:09.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcc5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:09.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcda9b769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:09.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcda9b769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:09.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcda9b769c0 5 note: GC not initialized 2024-09-12T00:13:09.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcc5cfe1640 20 reqs_thread_entry: start 2024-09-12T00:13:09.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcda9b769c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:09.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcda9b769c0 20 Filter name: none 2024-09-12T00:13:09.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcbd67fc640 20 reqs_thread_entry: start 2024-09-12T00:13:09.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.535+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:09.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:09.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:09.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:09.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 INFO: main: starting shard=0 2024-09-12T00:13:09.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:09.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 INFO: main: starting shard=1 2024-09-12T00:13:09.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.539+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:09.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: starting shard=2 2024-09-12T00:13:09.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:09.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: starting shard=3 2024-09-12T00:13:09.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:09.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: starting shard=4 2024-09-12T00:13:09.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:09.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 INFO: main: starting shard=5 2024-09-12T00:13:09.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.543+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:09.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=2, is_truncated=0, marker= 2024-09-12T00:13:09.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 INFO: main: starting shard=6 2024-09-12T00:13:09.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:09.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 INFO: main: starting shard=7 2024-09-12T00:13:09.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:09.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 INFO: main: starting shard=8 2024-09-12T00:13:09.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.547+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:09.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 INFO: main: starting shard=9 2024-09-12T00:13:09.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:09.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 INFO: main: starting shard=10 2024-09-12T00:13:09.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:09.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:09.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcda9b769c0 20 INFO: main: done 2024-09-12T00:13:09.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.551+0000 7fcc5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:09.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.559+0000 7fcda9b769c0 20 remove_watcher() i=0 2024-09-12T00:13:09.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.559+0000 7fcda9b769c0 2 removed watcher, disabling cache 2024-09-12T00:13:09.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.559+0000 7fcda9b769c0 20 remove_watcher() i=1 2024-09-12T00:13:09.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.563+0000 7fcda9b769c0 20 remove_watcher() i=2 2024-09-12T00:13:09.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.563+0000 7fcda9b769c0 20 remove_watcher() i=3 2024-09-12T00:13:09.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.567+0000 7fcda9b769c0 20 remove_watcher() i=4 2024-09-12T00:13:09.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.567+0000 7fcda9b769c0 20 remove_watcher() i=5 2024-09-12T00:13:09.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.571+0000 7fcda9b769c0 20 remove_watcher() i=6 2024-09-12T00:13:09.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.575+0000 7fcda9b769c0 20 remove_watcher() i=7 2024-09-12T00:13:09.600 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check olh finds leftover OLH entries 2024-09-12T00:13:09.600 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:09.601 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:13:09.634 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:09.635 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:09.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.679+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 realm 2024-09-12T00:13:09.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:09.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:09.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:09.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:09.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:09.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.683+0000 7f354c7879c0 20 searching for the correct realm 2024-09-12T00:13:09.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.687+0000 7f3549a8c640 0 -- 172.21.15.78:0/2542350548 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f353c010040 msgr2=0x7f353c06d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:09.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:09.903+0000 7f354a28d640 0 -- 172.21.15.78:0/2542350548 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f35400c8750 msgr2=0x7f35400f7a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:10.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:10.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:10.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:10.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:10.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:10.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:10.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:10.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 zone default found 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 4 Realm: () 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 zonegroup default 2024-09-12T00:13:10.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.123+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.127+0000 7f354c7879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.127+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.127+0000 7f354c7879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.127+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.127+0000 7f354c7879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.127+0000 7f354c7879c0 20 started sync module instance, tier type = 2024-09-12T00:13:10.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.127+0000 7f354c7879c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:10.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.151+0000 7f354c7879c0 20 add_watcher() i=0 2024-09-12T00:13:10.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.151+0000 7f354c7879c0 20 add_watcher() i=1 2024-09-12T00:13:10.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.151+0000 7f354c7879c0 20 add_watcher() i=2 2024-09-12T00:13:10.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.151+0000 7f354c7879c0 20 add_watcher() i=3 2024-09-12T00:13:10.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.151+0000 7f354c7879c0 20 add_watcher() i=4 2024-09-12T00:13:10.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.151+0000 7f354c7879c0 20 add_watcher() i=5 2024-09-12T00:13:10.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.151+0000 7f354c7879c0 20 add_watcher() i=6 2024-09-12T00:13:10.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.155+0000 7f354c7879c0 20 add_watcher() i=7 2024-09-12T00:13:10.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.155+0000 7f354c7879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:10.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f3400fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:10.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f354c7879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:10.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f354c7879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:10.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f354c7879c0 5 note: GC not initialized 2024-09-12T00:13:10.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f337b7fe640 20 reqs_thread_entry: start 2024-09-12T00:13:10.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f354c7879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:10.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f354c7879c0 20 Filter name: none 2024-09-12T00:13:10.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f33797fa640 20 reqs_thread_entry: start 2024-09-12T00:13:10.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f354c7879c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:10.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.159+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:10.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:10.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:10.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:10.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:10.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:10.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:10.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:10.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:10.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:10.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:10.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:13:10.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.163+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:10.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:13:10.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:10.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:13:10.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:10.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:13:10.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:10.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:13:10.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.167+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:10.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.171+0000 7f354c7879c0 1 NOTICE: finished shard 5 (1 entries found) 2024-09-12T00:13:10.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.171+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:10.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.171+0000 7f354c7879c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:13:10.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.171+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:10.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.171+0000 7f354c7879c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:13:10.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.171+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:10.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.171+0000 7f354c7879c0 1 NOTICE: finished shard 8 (1 entries found) 2024-09-12T00:13:10.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.175+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:10.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.175+0000 7f354c7879c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:13:10.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.175+0000 7f354c7879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:10.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.175+0000 7f354c7879c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:13:10.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.175+0000 7f354c7879c0 1 NOTICE: finished all shards (2 entries found) 2024-09-12T00:13:10.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.175+0000 7f3400fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:10.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.183+0000 7f354c7879c0 20 remove_watcher() i=0 2024-09-12T00:13:10.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.183+0000 7f354c7879c0 2 removed watcher, disabling cache 2024-09-12T00:13:10.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.183+0000 7f354c7879c0 20 remove_watcher() i=1 2024-09-12T00:13:10.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.187+0000 7f354c7879c0 20 remove_watcher() i=2 2024-09-12T00:13:10.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.187+0000 7f354c7879c0 20 remove_watcher() i=3 2024-09-12T00:13:10.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.191+0000 7f354c7879c0 20 remove_watcher() i=4 2024-09-12T00:13:10.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.191+0000 7f354c7879c0 20 remove_watcher() i=5 2024-09-12T00:13:10.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.195+0000 7f354c7879c0 20 remove_watcher() i=6 2024-09-12T00:13:10.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.199+0000 7f354c7879c0 20 remove_watcher() i=7 2024-09-12T00:13:10.217 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check olh fixes leftover OLH entries 2024-09-12T00:13:10.217 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:10.218 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket check-bucket --fix --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:13:10.254 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:10.254 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:10.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.503+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.503+0000 7f44866219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.503+0000 7f44866219c0 20 realm 2024-09-12T00:13:10.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.503+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.503+0000 7f44866219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.503+0000 7f44866219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:10.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.503+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.507+0000 7f44866219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:10.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.507+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.507+0000 7f44866219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:10.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.507+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:10.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.507+0000 7f44866219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:10.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.507+0000 7f44866219c0 20 searching for the correct realm 2024-09-12T00:13:10.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:10.711+0000 7f4484127640 0 -- 172.21.15.78:0/4087202256 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x5606051a4910 msgr2=0x5606051a6dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:11.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.127+0000 7f4484928640 0 -- 172.21.15.78:0/4087202256 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560605198090 msgr2=0x56060519a510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:11.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:11.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 20 zone default found 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.147+0000 7f44866219c0 4 Realm: () 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 zonegroup default 2024-09-12T00:13:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 started sync module instance, tier type = 2024-09-12T00:13:11.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.151+0000 7f44866219c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.175+0000 7f44866219c0 20 add_watcher() i=0 2024-09-12T00:13:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.175+0000 7f44866219c0 20 add_watcher() i=1 2024-09-12T00:13:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.175+0000 7f44866219c0 20 add_watcher() i=2 2024-09-12T00:13:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.175+0000 7f44866219c0 20 add_watcher() i=3 2024-09-12T00:13:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.175+0000 7f44866219c0 20 add_watcher() i=4 2024-09-12T00:13:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.175+0000 7f44866219c0 20 add_watcher() i=5 2024-09-12T00:13:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.175+0000 7f44866219c0 20 add_watcher() i=6 2024-09-12T00:13:11.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.179+0000 7f44866219c0 20 add_watcher() i=7 2024-09-12T00:13:11.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.179+0000 7f44866219c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:11.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.183+0000 7f433a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:11.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:11.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:11.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 5 note: GC not initialized 2024-09-12T00:13:11.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f43397e2640 20 reqs_thread_entry: start 2024-09-12T00:13:11.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:11.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 Filter name: none 2024-09-12T00:13:11.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f42aaffd640 20 reqs_thread_entry: start 2024-09-12T00:13:11.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:11.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:11.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:11.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:11.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:11.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:11.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:11.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:11.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:11.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:11.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:11.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.187+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:11.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:13:11.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:11.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:13:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:13:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:11.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:13:11.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.191+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:11.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:13:11.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 20 get_obj_state: octx=0x560604e737e0 obj=check-bucket:d state=0x5606051dac68 s->prefetch_data=0 2024-09-12T00:13:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:13:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:13:11.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.195+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:11.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 get_obj_state: octx=0x560604f35530 obj=check-bucket:c state=0x5606051d6688 s->prefetch_data=0 2024-09-12T00:13:11.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:11.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:13:11.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:11.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:13:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 get_obj_state: setting s->obj_tag to yz15oc6ihywl6k8x8ls4xk2rzud0j21w 2024-09-12T00:13:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 get_obj_state_impl: setting s->olh_tag to fbe0o3xbt5cwiwc31ko5d20kj2yfzvak 2024-09-12T00:13:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 get_obj_state: setting s->obj_tag to w2qvahn9ha9qkh1ftz75s3c88awc61dk 2024-09-12T00:13:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 get_obj_state_impl: setting s->olh_tag to 7gb02l6vdgsbf515z3ykr5ns35gjafyj 2024-09-12T00:13:11.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.199+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:11.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.203+0000 7f44866219c0 20 olh_log_entry: epoch=4 op=2 key=c[] 2024-09-12T00:13:11.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.203+0000 7f44866219c0 20 olh_log_entry: epoch=4 op=3 key=c[XTwU8bmpVR5Hws10vodw7UZmhUIHFYq] 2024-09-12T00:13:11.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.203+0000 7f44866219c0 20 get_obj_state: octx=0x560605222aa0 obj=check-bucket:_:XTwU8bmpVR5Hws10vodw7UZmhUIHFYq_c state=0x5606051d7d78 s->prefetch_data=0 2024-09-12T00:13:11.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.203+0000 7f44866219c0 20 olh_log_entry: epoch=4 op=2 key=d[] 2024-09-12T00:13:11.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.203+0000 7f44866219c0 20 olh_log_entry: epoch=4 op=3 key=d[DhcUCk2WHeesXt.9WBr7kPVSe4HT4g1] 2024-09-12T00:13:11.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.203+0000 7f44866219c0 20 get_obj_state: octx=0x560605202aa0 obj=check-bucket:_:DhcUCk2WHeesXt.9WBr7kPVSe4HT4g1_d state=0x56060522d568 s->prefetch_data=0 2024-09-12T00:13:11.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 get_obj_state: octx=0x560605202aa0 obj=check-bucket:d state=0x56060522dc58 s->prefetch_data=0 2024-09-12T00:13:11.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 get_obj_state: octx=0x560605222aa0 obj=check-bucket:c state=0x5606052269a8 s->prefetch_data=0 2024-09-12T00:13:11.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 get_obj_state: setting s->obj_tag to yz15oc6ihywl6k8x8ls4xk2rzud0j21w 2024-09-12T00:13:11.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 get_obj_state_impl: setting s->olh_tag to fbe0o3xbt5cwiwc31ko5d20kj2yfzvak 2024-09-12T00:13:11.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fbe0o3xbt5cwiwc31ko5d20kj2yfzvak 2024-09-12T00:13:11.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 get_obj_state: setting s->obj_tag to w2qvahn9ha9qkh1ftz75s3c88awc61dk 2024-09-12T00:13:11.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 get_obj_state_impl: setting s->olh_tag to 7gb02l6vdgsbf515z3ykr5ns35gjafyj 2024-09-12T00:13:11.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.207+0000 7f44866219c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=7gb02l6vdgsbf515z3ykr5ns35gjafyj 2024-09-12T00:13:11.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.215+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:11.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.219+0000 7f44866219c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:11.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.223+0000 7f44866219c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:13:11.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.223+0000 7f44866219c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:13:11.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.223+0000 7f44866219c0 1 NOTICE: finished all shards (2 entries removed) 2024-09-12T00:13:11.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.223+0000 7f433a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:11.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.227+0000 7f44866219c0 20 remove_watcher() i=0 2024-09-12T00:13:11.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.227+0000 7f44866219c0 2 removed watcher, disabling cache 2024-09-12T00:13:11.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.231+0000 7f44866219c0 20 remove_watcher() i=1 2024-09-12T00:13:11.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.235+0000 7f44866219c0 20 remove_watcher() i=2 2024-09-12T00:13:11.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.235+0000 7f44866219c0 20 remove_watcher() i=3 2024-09-12T00:13:11.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.239+0000 7f44866219c0 20 remove_watcher() i=4 2024-09-12T00:13:11.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.239+0000 7f44866219c0 20 remove_watcher() i=5 2024-09-12T00:13:11.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.243+0000 7f44866219c0 20 remove_watcher() i=6 2024-09-12T00:13:11.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.247+0000 7f44866219c0 20 remove_watcher() i=7 2024-09-12T00:13:11.265 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:13:11.299 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:11.299 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:11.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 realm 2024-09-12T00:13:11.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.551+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.555+0000 7f632169f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:11.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.555+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.555+0000 7f632169f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:11.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.555+0000 7f632169f9c0 20 searching for the correct realm 2024-09-12T00:13:11.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.559+0000 7f631e9a4640 0 -- 172.21.15.78:0/4093311885 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x55b3470229f0 msgr2=0x55b347024eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:11.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.567+0000 7f631f1a5640 0 -- 172.21.15.78:0/4093311885 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f63140d0b90 msgr2=0x7f63140ed420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:11.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:11.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:11.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:11.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:11.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:11.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:11.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 zone default found 2024-09-12T00:13:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 4 Realm: () 2024-09-12T00:13:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 zonegroup default 2024-09-12T00:13:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.575+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.579+0000 7f632169f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.579+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.579+0000 7f632169f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.579+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.579+0000 7f632169f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.579+0000 7f632169f9c0 20 started sync module instance, tier type = 2024-09-12T00:13:11.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.579+0000 7f632169f9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:11.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=0 2024-09-12T00:13:11.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=1 2024-09-12T00:13:11.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=2 2024-09-12T00:13:11.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=3 2024-09-12T00:13:11.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=4 2024-09-12T00:13:11.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=5 2024-09-12T00:13:11.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=6 2024-09-12T00:13:11.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 20 add_watcher() i=7 2024-09-12T00:13:11.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.607+0000 7f632169f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:11.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.611+0000 7f61d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:11.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:11.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:11.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 5 note: GC not initialized 2024-09-12T00:13:11.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f61d4fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:11.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:11.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 Filter name: none 2024-09-12T00:13:11.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f614e7fc640 20 reqs_thread_entry: start 2024-09-12T00:13:11.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:11.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:11.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:11.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:11.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:11.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.615+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:11.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:11.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:11.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:11.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:11.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:11.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.619+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:11.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:11.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:11.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:11.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:11.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:11.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:11.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:11.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.623+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:11.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:11.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:11.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:11.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:11.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:11.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.627+0000 7f632169f9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:11.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.631+0000 7f632169f9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:11.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.631+0000 7f632169f9c0 20 INFO: main: done 2024-09-12T00:13:11.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.631+0000 7f61d5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:11.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.635+0000 7f632169f9c0 20 remove_watcher() i=0 2024-09-12T00:13:11.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.635+0000 7f632169f9c0 2 removed watcher, disabling cache 2024-09-12T00:13:11.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.639+0000 7f632169f9c0 20 remove_watcher() i=1 2024-09-12T00:13:11.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.639+0000 7f632169f9c0 20 remove_watcher() i=2 2024-09-12T00:13:11.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.643+0000 7f632169f9c0 20 remove_watcher() i=3 2024-09-12T00:13:11.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.643+0000 7f632169f9c0 20 remove_watcher() i=4 2024-09-12T00:13:11.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.647+0000 7f632169f9c0 20 remove_watcher() i=5 2024-09-12T00:13:11.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.651+0000 7f632169f9c0 20 remove_watcher() i=6 2024-09-12T00:13:11.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.655+0000 7f632169f9c0 20 remove_watcher() i=7 2024-09-12T00:13:11.678 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:13:11.710 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:11.710 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:11.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.751+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 realm 2024-09-12T00:13:11.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:11.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:11.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:11.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.755+0000 7f1a2b4ab9c0 20 searching for the correct realm 2024-09-12T00:13:11.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.763+0000 7f1a297b2640 0 -- 172.21.15.78:0/917659719 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1a1c045790 msgr2=0x7f1a1c067a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:11.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.975+0000 7f1a28fb1640 0 -- 172.21.15.78:0/917659719 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55bb7f29bf80 msgr2=0x55bb7f29e390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:11.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.987+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:11.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:11.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 zone default found 2024-09-12T00:13:11.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 4 Realm: () 2024-09-12T00:13:11.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:11.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:11.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 zonegroup default 2024-09-12T00:13:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:11.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:11.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 started sync module instance, tier type = 2024-09-12T00:13:11.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:11.991+0000 7f1a2b4ab9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.015+0000 7f1a2b4ab9c0 20 add_watcher() i=0 2024-09-12T00:13:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.015+0000 7f1a2b4ab9c0 20 add_watcher() i=1 2024-09-12T00:13:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.015+0000 7f1a2b4ab9c0 20 add_watcher() i=2 2024-09-12T00:13:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.015+0000 7f1a2b4ab9c0 20 add_watcher() i=3 2024-09-12T00:13:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.015+0000 7f1a2b4ab9c0 20 add_watcher() i=4 2024-09-12T00:13:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.015+0000 7f1a2b4ab9c0 20 add_watcher() i=5 2024-09-12T00:13:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.015+0000 7f1a2b4ab9c0 20 add_watcher() i=6 2024-09-12T00:13:12.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.019+0000 7f1a2b4ab9c0 20 add_watcher() i=7 2024-09-12T00:13:12.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.019+0000 7f1a2b4ab9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:12.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f18df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:12.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f1a2b4ab9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:12.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f1a2b4ab9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:12.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f1a2b4ab9c0 5 note: GC not initialized 2024-09-12T00:13:12.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f18de7e4640 20 reqs_thread_entry: start 2024-09-12T00:13:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f1a2b4ab9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f1a2b4ab9c0 20 Filter name: none 2024-09-12T00:13:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f18d77fe640 20 reqs_thread_entry: start 2024-09-12T00:13:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.023+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:12.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:12.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:12.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:12.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:12.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:12.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:12.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:12.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.027+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:12.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:12.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:12.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:12.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:12.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:12.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.031+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:12.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:12.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:12.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:12.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:12.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:12.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:12.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:12.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.035+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:12.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.039+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.039+0000 7f1a2b4ab9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:12.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.039+0000 7f1a2b4ab9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:12.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.039+0000 7f1a2b4ab9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:12.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.039+0000 7f1a2b4ab9c0 20 INFO: main: done 2024-09-12T00:13:12.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.039+0000 7f18df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:12.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.043+0000 7f1a2b4ab9c0 20 remove_watcher() i=0 2024-09-12T00:13:12.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.043+0000 7f1a2b4ab9c0 2 removed watcher, disabling cache 2024-09-12T00:13:12.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.047+0000 7f1a2b4ab9c0 20 remove_watcher() i=1 2024-09-12T00:13:12.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.047+0000 7f1a2b4ab9c0 20 remove_watcher() i=2 2024-09-12T00:13:12.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.051+0000 7f1a2b4ab9c0 20 remove_watcher() i=3 2024-09-12T00:13:12.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.055+0000 7f1a2b4ab9c0 20 remove_watcher() i=4 2024-09-12T00:13:12.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.055+0000 7f1a2b4ab9c0 20 remove_watcher() i=5 2024-09-12T00:13:12.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.059+0000 7f1a2b4ab9c0 20 remove_watcher() i=6 2024-09-12T00:13:12.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.063+0000 7f1a2b4ab9c0 20 remove_watcher() i=7 2024-09-12T00:13:12.078 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check olh does not find new leftover OLH entries after fix 2024-09-12T00:13:12.078 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:12.079 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket check-bucket --dump-keys 2024-09-12T00:13:12.109 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:12.110 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:12.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:12.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 realm 2024-09-12T00:13:12.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.155+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.159+0000 7f220fb809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:12.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.159+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.159+0000 7f220fb809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:12.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.159+0000 7f220fb809c0 20 searching for the correct realm 2024-09-12T00:13:12.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.163+0000 7f220de87640 0 -- 172.21.15.78:0/2471013332 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f220006b840 msgr2=0x7f2200099950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:12.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.375+0000 7f220d686640 0 -- 172.21.15.78:0/2471013332 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55dff99a4ad0 msgr2=0x55dff99a6f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:12.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:12.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.387+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:12.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:12.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 zone default found 2024-09-12T00:13:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 4 Realm: () 2024-09-12T00:13:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 zonegroup default 2024-09-12T00:13:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:12.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:12.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:12.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 started sync module instance, tier type = 2024-09-12T00:13:12.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.391+0000 7f220fb809c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:12.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.415+0000 7f220fb809c0 20 add_watcher() i=0 2024-09-12T00:13:12.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.415+0000 7f220fb809c0 20 add_watcher() i=1 2024-09-12T00:13:12.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.415+0000 7f220fb809c0 20 add_watcher() i=2 2024-09-12T00:13:12.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.415+0000 7f220fb809c0 20 add_watcher() i=3 2024-09-12T00:13:12.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.415+0000 7f220fb809c0 20 add_watcher() i=4 2024-09-12T00:13:12.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.415+0000 7f220fb809c0 20 add_watcher() i=5 2024-09-12T00:13:12.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.415+0000 7f220fb809c0 20 add_watcher() i=6 2024-09-12T00:13:12.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.419+0000 7f220fb809c0 20 add_watcher() i=7 2024-09-12T00:13:12.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.419+0000 7f220fb809c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:12.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.423+0000 7f20c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:12.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.423+0000 7f220fb809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:12.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.423+0000 7f220fb809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:12.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.423+0000 7f220fb809c0 5 note: GC not initialized 2024-09-12T00:13:12.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f20c27e4640 20 reqs_thread_entry: start 2024-09-12T00:13:12.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:12.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 20 Filter name: none 2024-09-12T00:13:12.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f2033fff640 20 reqs_thread_entry: start 2024-09-12T00:13:12.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:12.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:12.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:12.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:12.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:12.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:12.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.427+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:12.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.431+0000 7f220fb809c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:13:12.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.431+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:12.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.431+0000 7f220fb809c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:13:12.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.431+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:12.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.431+0000 7f220fb809c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:13:12.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.431+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:12.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:13:12.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:12.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:13:12.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:12.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:13:12.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:12.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:13:12.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.435+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:12.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:13:12.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:12.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:13:12.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:12.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:13:12.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:12.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:13:12.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.439+0000 7f220fb809c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:13:12.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.443+0000 7f20c37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:12.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.447+0000 7f220fb809c0 20 remove_watcher() i=0 2024-09-12T00:13:12.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.447+0000 7f220fb809c0 2 removed watcher, disabling cache 2024-09-12T00:13:12.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.447+0000 7f220fb809c0 20 remove_watcher() i=1 2024-09-12T00:13:12.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.451+0000 7f220fb809c0 20 remove_watcher() i=2 2024-09-12T00:13:12.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.451+0000 7f220fb809c0 20 remove_watcher() i=3 2024-09-12T00:13:12.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.455+0000 7f220fb809c0 20 remove_watcher() i=4 2024-09-12T00:13:12.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.455+0000 7f220fb809c0 20 remove_watcher() i=5 2024-09-12T00:13:12.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.459+0000 7f220fb809c0 20 remove_watcher() i=6 2024-09-12T00:13:12.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:12.463+0000 7f220fb809c0 20 remove_watcher() i=7 2024-09-12T00:13:12.481 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that bucket check fixes do not affect null version objects 2024-09-12T00:13:12.482 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:12.538 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: bucket check stats are correct in the presence of unlinked entries 2024-09-12T00:13:12.538 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:13:12.905 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:13:13.341 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:13:14.840 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:14.840 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object c 2024-09-12T00:13:14.876 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:14.876 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:14.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:14.919+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 20 realm 2024-09-12T00:13:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.123+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.127+0000 7fe50509d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:15.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.127+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.127+0000 7fe50509d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:15.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.127+0000 7fe50509d9c0 20 searching for the correct realm 2024-09-12T00:13:15.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.135+0000 7fe5033a4640 0 -- 172.21.15.78:0/1074874621 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x55ffe790a010 msgr2=0x7fe4f40f9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:15.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.347+0000 7fe5023a2640 0 -- 172.21.15.78:0/1074874621 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fe4f40f8760 msgr2=0x7fe4f40f68d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:15.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:15.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 zone default found 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 4 Realm: () 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 zonegroup default 2024-09-12T00:13:15.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.363+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.367+0000 7fe50509d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.367+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.367+0000 7fe50509d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.367+0000 7fe50509d9c0 20 started sync module instance, tier type = 2024-09-12T00:13:15.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.367+0000 7fe50509d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:15.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.391+0000 7fe50509d9c0 20 add_watcher() i=0 2024-09-12T00:13:15.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.391+0000 7fe50509d9c0 20 add_watcher() i=1 2024-09-12T00:13:15.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.391+0000 7fe50509d9c0 20 add_watcher() i=2 2024-09-12T00:13:15.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.391+0000 7fe50509d9c0 20 add_watcher() i=3 2024-09-12T00:13:15.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.391+0000 7fe50509d9c0 20 add_watcher() i=4 2024-09-12T00:13:15.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.391+0000 7fe50509d9c0 20 add_watcher() i=5 2024-09-12T00:13:15.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.391+0000 7fe50509d9c0 20 add_watcher() i=6 2024-09-12T00:13:15.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.395+0000 7fe50509d9c0 20 add_watcher() i=7 2024-09-12T00:13:15.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.395+0000 7fe50509d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:15.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.399+0000 7fe3b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:15.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.399+0000 7fe50509d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:15.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.399+0000 7fe50509d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:15.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.399+0000 7fe50509d9c0 5 note: GC not initialized 2024-09-12T00:13:15.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.399+0000 7fe333fff640 20 reqs_thread_entry: start 2024-09-12T00:13:15.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.399+0000 7fe50509d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:15.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.399+0000 7fe50509d9c0 20 Filter name: none 2024-09-12T00:13:15.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe331ffb640 20 reqs_thread_entry: start 2024-09-12T00:13:15.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:15.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:15.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:15.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:15.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:15.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:15.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:15.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.403+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:15.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:15.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:15.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:15.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:15.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:15.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.407+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:15.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:15.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:15.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:15.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:15.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:15.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.411+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:15.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:15.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:15.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:13:15.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:15.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:15.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:15.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.415+0000 7fe50509d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:15.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.419+0000 7fe50509d9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:15.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.419+0000 7fe50509d9c0 20 INFO: main: done 2024-09-12T00:13:15.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.419+0000 7fe3b97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:15.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.423+0000 7fe50509d9c0 20 remove_watcher() i=0 2024-09-12T00:13:15.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.423+0000 7fe50509d9c0 2 removed watcher, disabling cache 2024-09-12T00:13:15.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.427+0000 7fe50509d9c0 20 remove_watcher() i=1 2024-09-12T00:13:15.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.427+0000 7fe50509d9c0 20 remove_watcher() i=2 2024-09-12T00:13:15.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.431+0000 7fe50509d9c0 20 remove_watcher() i=3 2024-09-12T00:13:15.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.431+0000 7fe50509d9c0 20 remove_watcher() i=4 2024-09-12T00:13:15.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.435+0000 7fe50509d9c0 20 remove_watcher() i=5 2024-09-12T00:13:15.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.439+0000 7fe50509d9c0 20 remove_watcher() i=6 2024-09-12T00:13:15.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.443+0000 7fe50509d9c0 20 remove_watcher() i=7 2024-09-12T00:13:15.528 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:15.528 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object d 2024-09-12T00:13:15.563 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:15.563 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:15.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.607+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 realm 2024-09-12T00:13:15.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:15.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:15.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:15.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:15.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:15.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.611+0000 7fa222ddf9c0 20 searching for the correct realm 2024-09-12T00:13:15.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.819+0000 7fa2180e4640 0 -- 172.21.15.78:0/3908847052 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fa2100fe8b0 msgr2=0x7fa2100fd320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:15.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:15.827+0000 7fa2208e5640 0 -- 172.21.15.78:0/3908847052 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fa208040030 msgr2=0x7fa208070a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:16.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.047+0000 7fa222ddf9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:16.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.047+0000 7fa222ddf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:16.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.047+0000 7fa222ddf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:16.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.047+0000 7fa222ddf9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:16.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.047+0000 7fa222ddf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:16.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.047+0000 7fa222ddf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:16.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.047+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:16.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 zone default found 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 4 Realm: () 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 zonegroup default 2024-09-12T00:13:16.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.051+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.055+0000 7fa222ddf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.055+0000 7fa222ddf9c0 20 started sync module instance, tier type = 2024-09-12T00:13:16.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.055+0000 7fa222ddf9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:16.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=0 2024-09-12T00:13:16.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=1 2024-09-12T00:13:16.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=2 2024-09-12T00:13:16.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=3 2024-09-12T00:13:16.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=4 2024-09-12T00:13:16.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=5 2024-09-12T00:13:16.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=6 2024-09-12T00:13:16.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 20 add_watcher() i=7 2024-09-12T00:13:16.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.079+0000 7fa222ddf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:16.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa0d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:16.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:16.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:16.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 5 note: GC not initialized 2024-09-12T00:13:16.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa0d67e4640 20 reqs_thread_entry: start 2024-09-12T00:13:16.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:16.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 20 Filter name: none 2024-09-12T00:13:16.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa0cf7fe640 20 reqs_thread_entry: start 2024-09-12T00:13:16.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:16.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.087+0000 7fa222ddf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:16.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:16.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:16.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:16.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:16.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:16.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:16.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:16.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:16.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:16.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.091+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:16.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:16.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:16.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:16.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:16.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=5, is_truncated=0, marker= 2024-09-12T00:13:16.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:16.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:16.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:16.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.095+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:16.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:16.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:16.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:16.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:16.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:16.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.099+0000 7fa222ddf9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:16.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.103+0000 7fa222ddf9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.103+0000 7fa222ddf9c0 20 INFO: main: done 2024-09-12T00:13:16.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.103+0000 7fa0d77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:16.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.107+0000 7fa222ddf9c0 20 remove_watcher() i=0 2024-09-12T00:13:16.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.107+0000 7fa222ddf9c0 2 removed watcher, disabling cache 2024-09-12T00:13:16.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.111+0000 7fa222ddf9c0 20 remove_watcher() i=1 2024-09-12T00:13:16.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.115+0000 7fa222ddf9c0 20 remove_watcher() i=2 2024-09-12T00:13:16.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.119+0000 7fa222ddf9c0 20 remove_watcher() i=3 2024-09-12T00:13:16.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.119+0000 7fa222ddf9c0 20 remove_watcher() i=4 2024-09-12T00:13:16.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.123+0000 7fa222ddf9c0 20 remove_watcher() i=5 2024-09-12T00:13:16.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.123+0000 7fa222ddf9c0 20 remove_watcher() i=6 2024-09-12T00:13:16.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.127+0000 7fa222ddf9c0 20 remove_watcher() i=7 2024-09-12T00:13:16.207 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:16.208 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object e 2024-09-12T00:13:16.242 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:16.242 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:16.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.283+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 20 realm 2024-09-12T00:13:16.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:16.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.287+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.291+0000 7f2512fea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:16.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.291+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.291+0000 7f2512fea9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:16.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.291+0000 7f2512fea9c0 20 searching for the correct realm 2024-09-12T00:13:16.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.295+0000 7f25112f1640 0 -- 172.21.15.78:0/3762519 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f25000b8900 msgr2=0x7f25000db3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:16.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.507+0000 7f2510af0640 0 -- 172.21.15.78:0/3762519 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ece68555f0 msgr2=0x55ece6857a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:16.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.519+0000 7f2512fea9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:16.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.519+0000 7f2512fea9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:16.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.519+0000 7f2512fea9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:16.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.519+0000 7f2512fea9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:16.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.519+0000 7f2512fea9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:16.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.519+0000 7f2512fea9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:16.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.519+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:16.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 zone default found 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 4 Realm: () 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 zonegroup default 2024-09-12T00:13:16.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.523+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.527+0000 7f2512fea9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:16.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.527+0000 7f2512fea9c0 20 started sync module instance, tier type = 2024-09-12T00:13:16.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.527+0000 7f2512fea9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.551+0000 7f2512fea9c0 20 add_watcher() i=0 2024-09-12T00:13:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.551+0000 7f2512fea9c0 20 add_watcher() i=1 2024-09-12T00:13:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.551+0000 7f2512fea9c0 20 add_watcher() i=2 2024-09-12T00:13:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.551+0000 7f2512fea9c0 20 add_watcher() i=3 2024-09-12T00:13:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.551+0000 7f2512fea9c0 20 add_watcher() i=4 2024-09-12T00:13:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.551+0000 7f2512fea9c0 20 add_watcher() i=5 2024-09-12T00:13:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.551+0000 7f2512fea9c0 20 add_watcher() i=6 2024-09-12T00:13:16.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.555+0000 7f2512fea9c0 20 add_watcher() i=7 2024-09-12T00:13:16.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.555+0000 7f2512fea9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:16.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f23c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:16.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f2512fea9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:16.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f2512fea9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:16.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f2512fea9c0 5 note: GC not initialized 2024-09-12T00:13:16.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f23c5fe3640 20 reqs_thread_entry: start 2024-09-12T00:13:16.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f2512fea9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:16.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f2512fea9c0 20 Filter name: none 2024-09-12T00:13:16.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f23377fe640 20 reqs_thread_entry: start 2024-09-12T00:13:16.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.559+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:16.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:16.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:16.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.563+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:13:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:16.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:16.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:16.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:16.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:16.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.567+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:16.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:16.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:16.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:16.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:16.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:16.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:16.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:16.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.571+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:16.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:16.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:16.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:16.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:16.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:16.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f2512fea9c0 20 INFO: main: done 2024-09-12T00:13:16.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.575+0000 7f23c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:16.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.583+0000 7f2512fea9c0 20 remove_watcher() i=0 2024-09-12T00:13:16.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.583+0000 7f2512fea9c0 2 removed watcher, disabling cache 2024-09-12T00:13:16.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.583+0000 7f2512fea9c0 20 remove_watcher() i=1 2024-09-12T00:13:16.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.587+0000 7f2512fea9c0 20 remove_watcher() i=2 2024-09-12T00:13:16.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.587+0000 7f2512fea9c0 20 remove_watcher() i=3 2024-09-12T00:13:16.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.591+0000 7f2512fea9c0 20 remove_watcher() i=4 2024-09-12T00:13:16.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.591+0000 7f2512fea9c0 20 remove_watcher() i=5 2024-09-12T00:13:16.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.595+0000 7f2512fea9c0 20 remove_watcher() i=6 2024-09-12T00:13:16.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.599+0000 7f2512fea9c0 20 remove_watcher() i=7 2024-09-12T00:13:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:13:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket check-bucket --object f 2024-09-12T00:13:16.715 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:16.716 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:16.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.943+0000 7fa1db044640 0 --2- 172.21.15.78:0/2248324627 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5651115b5410 0x5651115e2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:13:17.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.971+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 20 realm 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:16.975+0000 7fa1da843640 0 -- 172.21.15.78:0/2547086211 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x56511169aed0 msgr2=0x56511169d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.179+0000 7fa1dd53e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.179+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.183+0000 7fa1dd53e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.183+0000 7fa1dd53e9c0 20 searching for the correct realm 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.187+0000 7fa1da843640 0 -- 172.21.15.78:0/2547086211 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x56511169aed0 msgr2=0x56511169d2e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:17.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.211+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:17.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 zone default found 2024-09-12T00:13:17.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 4 Realm: () 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 zonegroup default 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 started sync module instance, tier type = 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.215+0000 7fa1dd53e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.239+0000 7fa1dd53e9c0 20 add_watcher() i=0 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.239+0000 7fa1dd53e9c0 20 add_watcher() i=1 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.239+0000 7fa1dd53e9c0 20 add_watcher() i=2 2024-09-12T00:13:17.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.239+0000 7fa1dd53e9c0 20 add_watcher() i=3 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.239+0000 7fa1dd53e9c0 20 add_watcher() i=4 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.239+0000 7fa1dd53e9c0 20 add_watcher() i=5 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.239+0000 7fa1dd53e9c0 20 add_watcher() i=6 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.243+0000 7fa1dd53e9c0 20 add_watcher() i=7 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.243+0000 7fa1dd53e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa08dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa1dd53e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa1dd53e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa1dd53e9c0 5 note: GC not initialized 2024-09-12T00:13:17.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa08cfe1640 20 reqs_thread_entry: start 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa1dd53e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa1dd53e9c0 20 Filter name: none 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa0067fc640 20 reqs_thread_entry: start 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.247+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:17.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 INFO: main: starting shard=0 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 INFO: main: starting shard=1 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 INFO: main: starting shard=2 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.251+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: starting shard=3 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:17.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: starting shard=4 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: starting shard=5 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 INFO: main: starting shard=6 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.255+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: starting shard=7 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: starting shard=8 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: starting shard=9 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 INFO: main: starting shard=10 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.259+0000 7fa1dd53e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.263+0000 7fa1dd53e9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.263+0000 7fa1dd53e9c0 20 INFO: main: done 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.263+0000 7fa08dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.267+0000 7fa1dd53e9c0 20 remove_watcher() i=0 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.267+0000 7fa1dd53e9c0 2 removed watcher, disabling cache 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.271+0000 7fa1dd53e9c0 20 remove_watcher() i=1 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.271+0000 7fa1dd53e9c0 20 remove_watcher() i=2 2024-09-12T00:13:17.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.275+0000 7fa1dd53e9c0 20 remove_watcher() i=3 2024-09-12T00:13:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.275+0000 7fa1dd53e9c0 20 remove_watcher() i=4 2024-09-12T00:13:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.279+0000 7fa1dd53e9c0 20 remove_watcher() i=5 2024-09-12T00:13:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.283+0000 7fa1dd53e9c0 20 remove_watcher() i=6 2024-09-12T00:13:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:17.283+0000 7fa1dd53e9c0 20 remove_watcher() i=7 2024-09-12T00:13:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:13:17.737 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:13:18.164 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check --fix --bucket check-bucket 2024-09-12T00:13:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:18.191 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:18.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 realm 2024-09-12T00:13:18.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:18.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.231+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.235+0000 7f2d28b919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:18.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.235+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.235+0000 7f2d28b919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:18.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.235+0000 7f2d28b919c0 20 searching for the correct realm 2024-09-12T00:13:18.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.239+0000 7f2d26e98640 0 -- 172.21.15.78:0/3350125220 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f2d18008070 msgr2=0x7f2d18017910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:18.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.451+0000 7f2d26e98640 0 -- 172.21.15.78:0/3350125220 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x564c299fbf90 msgr2=0x564c299fe410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:18.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.463+0000 7f2d28b919c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:18.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.463+0000 7f2d28b919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:18.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.463+0000 7f2d28b919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.463+0000 7f2d28b919c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.463+0000 7f2d28b919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.463+0000 7f2d28b919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.463+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:18.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 zone default found 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 4 Realm: () 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 zonegroup default 2024-09-12T00:13:18.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.467+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.471+0000 7f2d28b919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.471+0000 7f2d28b919c0 20 started sync module instance, tier type = 2024-09-12T00:13:18.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.471+0000 7f2d28b919c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.495+0000 7f2d28b919c0 20 add_watcher() i=0 2024-09-12T00:13:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.495+0000 7f2d28b919c0 20 add_watcher() i=1 2024-09-12T00:13:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.495+0000 7f2d28b919c0 20 add_watcher() i=2 2024-09-12T00:13:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.495+0000 7f2d28b919c0 20 add_watcher() i=3 2024-09-12T00:13:18.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.495+0000 7f2d28b919c0 20 add_watcher() i=4 2024-09-12T00:13:18.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.495+0000 7f2d28b919c0 20 add_watcher() i=5 2024-09-12T00:13:18.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.495+0000 7f2d28b919c0 20 add_watcher() i=6 2024-09-12T00:13:18.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.499+0000 7f2d28b919c0 20 add_watcher() i=7 2024-09-12T00:13:18.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.499+0000 7f2d28b919c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:18.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2bdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:18.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2d28b919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:18.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2d28b919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:18.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2d28b919c0 5 note: GC not initialized 2024-09-12T00:13:18.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2b577fe640 20 reqs_thread_entry: start 2024-09-12T00:13:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2d28b919c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2d28b919c0 20 Filter name: none 2024-09-12T00:13:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2b557fa640 20 reqs_thread_entry: start 2024-09-12T00:13:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2d28b919c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:18.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.503+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:18.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:18.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:18.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:18.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:18.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:18.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.507+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:18.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.511+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:18.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.511+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:18.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.511+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:18.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.515+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:18.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.515+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:18.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.519+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:18.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.519+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:18.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.519+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:18.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.519+0000 7f2d28b919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:18.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.531+0000 7f2bdcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:18.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.535+0000 7f2d28b919c0 20 remove_watcher() i=0 2024-09-12T00:13:18.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.535+0000 7f2d28b919c0 2 removed watcher, disabling cache 2024-09-12T00:13:18.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.539+0000 7f2d28b919c0 20 remove_watcher() i=1 2024-09-12T00:13:18.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.539+0000 7f2d28b919c0 20 remove_watcher() i=2 2024-09-12T00:13:18.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.543+0000 7f2d28b919c0 20 remove_watcher() i=3 2024-09-12T00:13:18.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.543+0000 7f2d28b919c0 20 remove_watcher() i=4 2024-09-12T00:13:18.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.547+0000 7f2d28b919c0 20 remove_watcher() i=5 2024-09-12T00:13:18.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.551+0000 7f2d28b919c0 20 remove_watcher() i=6 2024-09-12T00:13:18.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.551+0000 7f2d28b919c0 20 remove_watcher() i=7 2024-09-12T00:13:18.569 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket check-bucket --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:13:18.607 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:18.607 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:18.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.647+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 realm 2024-09-12T00:13:18.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:18.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:18.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.651+0000 7fc9560999c0 20 searching for the correct realm 2024-09-12T00:13:18.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:18.655+0000 7fc9543a0640 0 -- 172.21.15.78:0/1342720676 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fc9440d3070 msgr2=0x7fc944100140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:19.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.267+0000 7fc95339e640 0 -- 172.21.15.78:0/1342720676 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fc944100680 msgr2=0x7fc944106780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:19.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:19.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.283+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 zone default found 2024-09-12T00:13:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 4 Realm: () 2024-09-12T00:13:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:19.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:19.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:19.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 zonegroup default 2024-09-12T00:13:19.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 started sync module instance, tier type = 2024-09-12T00:13:19.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.287+0000 7fc9560999c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:19.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=0 2024-09-12T00:13:19.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=1 2024-09-12T00:13:19.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=2 2024-09-12T00:13:19.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=3 2024-09-12T00:13:19.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=4 2024-09-12T00:13:19.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=5 2024-09-12T00:13:19.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=6 2024-09-12T00:13:19.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 20 add_watcher() i=7 2024-09-12T00:13:19.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.323+0000 7fc9560999c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:19.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.327+0000 7fc809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:19.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:19.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:19.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 5 note: GC not initialized 2024-09-12T00:13:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc808fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 Filter name: none 2024-09-12T00:13:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 cache get: name=default.rgw.meta+root+check-bucket : miss 2024-09-12T00:13:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc7827fc640 20 reqs_thread_entry: start 2024-09-12T00:13:19.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 cache put: name=default.rgw.meta+root+check-bucket info.flags=0x11 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 adding default.rgw.meta+root+check-bucket to cache LRU end 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 : miss 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 info.flags=0x17 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 adding default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 to cache LRU end 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 updating xattr: name=user.rgw.acl bl.length()=179 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.check-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1 2024-09-12T00:13:19.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.331+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.0 2024-09-12T00:13:19.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.335+0000 7fc9560999c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:13:19.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.335+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:19.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.335+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.2 2024-09-12T00:13:19.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.335+0000 7fc9560999c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:13:19.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.335+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.3 2024-09-12T00:13:19.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:13:19.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.4 2024-09-12T00:13:19.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:13:19.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.6 2024-09-12T00:13:19.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:13:19.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.7 2024-09-12T00:13:19.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:13:19.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.339+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.343+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.9 2024-09-12T00:13:19.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.343+0000 7fc9560999c0 1 NOTICE: finished shard 9 (0 entries removed) 2024-09-12T00:13:19.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.343+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:19.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.347+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:19.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.347+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa45ed7e0 obj=check-bucket:e state=0x558aa4957808 s->prefetch_data=0 2024-09-12T00:13:19.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.347+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.347+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa46af540 obj=check-bucket:d state=0x558aa494d088 s->prefetch_data=0 2024-09-12T00:13:19.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.347+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa494e160 obj=check-bucket:c state=0x558aa494e498 s->prefetch_data=0 2024-09-12T00:13:19.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:19.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa4955a20 obj=check-bucket:f state=0x558aa4952278 s->prefetch_data=0 2024-09-12T00:13:19.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to 8wcsibrvxfxhwm5bmvw0idrw6pll0f8u 2024-09-12T00:13:19.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state_impl: setting s->olh_tag to ddwmu4bq9ptiowzeclt1otuprlfoe5uz 2024-09-12T00:13:19.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ddwmu4bq9ptiowzeclt1otuprlfoe5uz 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to heyr8j541l7b3iv86cd93dtqz9c13na2 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state_impl: setting s->olh_tag to t4ihv047hldrmsxdzehx3n861fwin5z0 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=t4ihv047hldrmsxdzehx3n861fwin5z0 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to gnt8oh6acio1jrpaxaxf0xdw57cbtcbl 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state_impl: setting s->olh_tag to 2mtuybt45m7vgjpyoml73lrdhtlyksmx 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=2mtuybt45m7vgjpyoml73lrdhtlyksmx 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to 0wjldvwwyf89hdnwqp1jbj83ybjvqbyo 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 get_obj_state_impl: setting s->olh_tag to kdneztpbhgjbrkarh531w1xfy2jekk7u 2024-09-12T00:13:19.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.351+0000 7fc9560999c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kdneztpbhgjbrkarh531w1xfy2jekk7u 2024-09-12T00:13:19.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.355+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:19.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.355+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.355+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.359+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:19.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:19.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:19.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 olh_log_entry: epoch=2 op=2 key=f[] 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 olh_log_entry: epoch=2 op=3 key=f[qEgN02SUGBHezyZ4TPQf.4WdvjdUYKx] 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa4955a20 obj=check-bucket:_:qEgN02SUGBHezyZ4TPQf.4WdvjdUYKx_f state=0x558aa49e9b78 s->prefetch_data=0 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 olh_log_entry: epoch=2 op=2 key=e[] 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 olh_log_entry: epoch=2 op=3 key=e[YVFs54CBN4igEAgu-qk4EqoWDGP2tu8] 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa45ed7e0 obj=check-bucket:_:YVFs54CBN4igEAgu-qk4EqoWDGP2tu8_e state=0x558aa49fd4a8 s->prefetch_data=0 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 10 manifest: total_size = 22 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13201154224336006425 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa4955a20 obj=check-bucket:_:qEgN02SUGBHezyZ4TPQf.4WdvjdUYKx_f state=0x558aa49e9b78 s->prefetch_data=0 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 prepare_atomic_modification: state is not atomic. state=0x558aa49e9b78 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 olh_log_entry: epoch=3 op=3 key=c[AwOVImnV2Q7QzPTbHy5OeFcg7yM1.Ci] 2024-09-12T00:13:19.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa494e160 obj=check-bucket:_:AwOVImnV2Q7QzPTbHy5OeFcg7yM1.Ci_c state=0x558aa4a07db8 s->prefetch_data=0 2024-09-12T00:13:19.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 10 manifest: total_size = 12 2024-09-12T00:13:19.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9224713844530539105 2024-09-12T00:13:19.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa45ed7e0 obj=check-bucket:_:YVFs54CBN4igEAgu-qk4EqoWDGP2tu8_e state=0x558aa49fd4a8 s->prefetch_data=0 2024-09-12T00:13:19.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 prepare_atomic_modification: state is not atomic. state=0x558aa49fd4a8 2024-09-12T00:13:19.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 10 manifest: total_size = 11 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4143981924804937239 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa494e160 obj=check-bucket:_:AwOVImnV2Q7QzPTbHy5OeFcg7yM1.Ci_c state=0x558aa4a07db8 s->prefetch_data=0 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 prepare_atomic_modification: state is not atomic. state=0x558aa4a07db8 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.363+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.367+0000 7fc9560999c0 20 olh_log_entry: epoch=3 op=3 key=d[eqGnmWzeX9HPdLBpA8Ivu.oQNfjwKKX] 2024-09-12T00:13:19.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.367+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa46af540 obj=check-bucket:_:eqGnmWzeX9HPdLBpA8Ivu.oQNfjwKKX_d state=0x558aa49e4d48 s->prefetch_data=0 2024-09-12T00:13:19.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.367+0000 7fc9560999c0 10 manifest: total_size = 22 2024-09-12T00:13:19.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.367+0000 7fc9560999c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2225790530668567241 2024-09-12T00:13:19.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.367+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa46af540 obj=check-bucket:_:eqGnmWzeX9HPdLBpA8Ivu.oQNfjwKKX_d state=0x558aa49e4d48 s->prefetch_data=0 2024-09-12T00:13:19.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.367+0000 7fc9560999c0 20 prepare_atomic_modification: state is not atomic. state=0x558aa49e4d48 2024-09-12T00:13:19.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.367+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.371+0000 7fc8327fc640 20 handle_completion(): completion ok for obj=f[qEgN02SUGBHezyZ4TPQf.4WdvjdUYKx] 2024-09-12T00:13:19.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.375+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa4955a20 obj=check-bucket:f state=0x558aa4952278 s->prefetch_data=0 2024-09-12T00:13:19.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.375+0000 7fc9560999c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=kdneztpbhgjbrkarh531w1xfy2jekk7u 2024-09-12T00:13:19.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.379+0000 7fc8327fc640 20 handle_completion(): completion ok for obj=e[YVFs54CBN4igEAgu-qk4EqoWDGP2tu8] 2024-09-12T00:13:19.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.379+0000 7fc9560999c0 20 get_obj_state: octx=0x558aa45ed7e0 obj=check-bucket:e state=0x558aa4957808 s->prefetch_data=0 2024-09-12T00:13:19.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.379+0000 7fc9560999c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ddwmu4bq9ptiowzeclt1otuprlfoe5uz 2024-09-12T00:13:19.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.383+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.383+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.383+0000 7fc832ffd640 20 handle_completion(): completion ok for obj=d[eqGnmWzeX9HPdLBpA8Ivu.oQNfjwKKX] 2024-09-12T00:13:19.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.387+0000 7fc8327fc640 20 handle_completion(): completion ok for obj=c[AwOVImnV2Q7QzPTbHy5OeFcg7yM1.Ci] 2024-09-12T00:13:19.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.387+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.387+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.387+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:19.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.391+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.8 2024-09-12T00:13:19.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.391+0000 7fc9560999c0 1 NOTICE: finished shard 8 (1 entries removed) 2024-09-12T00:13:19.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.391+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.10 2024-09-12T00:13:19.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.391+0000 7fc9560999c0 1 NOTICE: finished shard 10 (1 entries removed) 2024-09-12T00:13:19.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.391+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:19.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.391+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.5 2024-09-12T00:13:19.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.391+0000 7fc9560999c0 1 NOTICE: finished shard 5 (1 entries removed) 2024-09-12T00:13:19.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.395+0000 7fc9560999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1.1 2024-09-12T00:13:19.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.395+0000 7fc9560999c0 1 NOTICE: finished shard 1 (1 entries removed) 2024-09-12T00:13:19.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.395+0000 7fc9560999c0 1 NOTICE: finished all shards (4 entries removed) 2024-09-12T00:13:19.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.395+0000 7fc809fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:19.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.399+0000 7fc9560999c0 20 remove_watcher() i=0 2024-09-12T00:13:19.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.399+0000 7fc9560999c0 2 removed watcher, disabling cache 2024-09-12T00:13:19.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.403+0000 7fc9560999c0 20 remove_watcher() i=1 2024-09-12T00:13:19.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.403+0000 7fc9560999c0 20 remove_watcher() i=2 2024-09-12T00:13:19.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.407+0000 7fc9560999c0 20 remove_watcher() i=3 2024-09-12T00:13:19.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.411+0000 7fc9560999c0 20 remove_watcher() i=4 2024-09-12T00:13:19.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.411+0000 7fc9560999c0 20 remove_watcher() i=5 2024-09-12T00:13:19.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.415+0000 7fc9560999c0 20 remove_watcher() i=6 2024-09-12T00:13:19.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.415+0000 7fc9560999c0 20 remove_watcher() i=7 2024-09-12T00:13:19.512 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket check-bucket 2024-09-12T00:13:19.543 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:13:19.543 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:13:19.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.587+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.587+0000 7f29f77e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.587+0000 7f29f77e39c0 20 realm 2024-09-12T00:13:19.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.587+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:13:19.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:19.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:13:19.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.591+0000 7f29f77e39c0 20 searching for the correct realm 2024-09-12T00:13:19.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.595+0000 7f29f52e9640 0 -- 172.21.15.78:0/890776946 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55d3e2a9c050 msgr2=0x55d3e2a9e510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:13:19.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.603+0000 7f29f4ae8640 0 -- 172.21.15.78:0/890776946 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f29e8088730 msgr2=0x7f29e805a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:13:19.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:13:19.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:13:19.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:13:19.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:13:19.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:13:19.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:13:19.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:13:19.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.823+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:13:19.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 zone default found 2024-09-12T00:13:19.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 4 Realm: () 2024-09-12T00:13:19.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:13:19.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:13:19.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:13:19.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 zonegroup default 2024-09-12T00:13:19.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:13:19.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 started sync module instance, tier type = 2024-09-12T00:13:19.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.827+0000 7f29f77e39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:13:19.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.851+0000 7f29f77e39c0 20 add_watcher() i=0 2024-09-12T00:13:19.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.851+0000 7f29f77e39c0 20 add_watcher() i=1 2024-09-12T00:13:19.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.851+0000 7f29f77e39c0 20 add_watcher() i=2 2024-09-12T00:13:19.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.851+0000 7f29f77e39c0 20 add_watcher() i=3 2024-09-12T00:13:19.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.851+0000 7f29f77e39c0 20 add_watcher() i=4 2024-09-12T00:13:19.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.851+0000 7f29f77e39c0 20 add_watcher() i=5 2024-09-12T00:13:19.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.855+0000 7f29f77e39c0 20 add_watcher() i=6 2024-09-12T00:13:19.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.855+0000 7f29f77e39c0 20 add_watcher() i=7 2024-09-12T00:13:19.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.855+0000 7f29f77e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:13:19.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.859+0000 7f28abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:19.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.859+0000 7f29f77e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:13:19.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.859+0000 7f29f77e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:13:19.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.859+0000 7f29f77e39c0 5 note: GC not initialized 2024-09-12T00:13:19.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f28aafe5640 20 reqs_thread_entry: start 2024-09-12T00:13:19.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:13:19.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 Filter name: none 2024-09-12T00:13:19.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f28a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:13:19.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:19.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:19.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:19.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.863+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.867+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=190 2024-09-12T00:13:19.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.867+0000 7f29f77e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:13:19.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.867+0000 7f29f77e39c0 20 rados_obj.operate() r=0 bl.length=412 2024-09-12T00:13:19.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.867+0000 7f29f77e39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:13:19.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.871+0000 7f28abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:13:19.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.875+0000 7f29f77e39c0 20 remove_watcher() i=0 2024-09-12T00:13:19.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.875+0000 7f29f77e39c0 2 removed watcher, disabling cache 2024-09-12T00:13:19.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.879+0000 7f29f77e39c0 20 remove_watcher() i=1 2024-09-12T00:13:19.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.879+0000 7f29f77e39c0 20 remove_watcher() i=2 2024-09-12T00:13:19.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.883+0000 7f29f77e39c0 20 remove_watcher() i=3 2024-09-12T00:13:19.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.887+0000 7f29f77e39c0 20 remove_watcher() i=4 2024-09-12T00:13:19.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.887+0000 7f29f77e39c0 20 remove_watcher() i=5 2024-09-12T00:13:19.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.891+0000 7f29f77e39c0 20 remove_watcher() i=6 2024-09-12T00:13:19.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:13:19.895+0000 7f29f77e39c0 20 remove_watcher() i=7 2024-09-12T00:13:19.918 INFO:tasks.workunit.client.0.smithi078.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:13:19.918 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket check-bucket 2024-09-12T00:13:19.993 INFO:tasks.workunit.client.0.smithi078.stderr:Completed bucket check tests 2024-09-12T00:13:19.993 INFO:tasks.workunit.client.0.smithi078.stdout:connected to http://localhost:80 2024-09-12T00:13:20.087 INFO:tasks.workunit.client.0.smithi078.stderr:+ deactivate 2024-09-12T00:13:20.087 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:13:20.087 INFO:tasks.workunit.client.0.smithi078.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ export PATH 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ hash -r 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:13:20.088 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset -f deactivate 2024-09-12T00:13:20.089 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK. 2024-09-12T00:13:20.090 INFO:tasks.workunit.client.0.smithi078.stdout:OK. 2024-09-12T00:13:20.090 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:13:20.090 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:13:20.149 INFO:tasks.workunit:Stopping ['rgw/run-bucket-check.sh'] on client.0... 2024-09-12T00:13:20.149 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:13:20.558 DEBUG:teuthology.parallel:result is None 2024-09-12T00:13:20.559 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:13:20.577 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:13:20.577 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:20.639 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:13:20.639 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:13:21.552 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:13:21.552 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:13:21.552 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:21.559 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:13:21.559 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:13:21.560 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:21.612 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:13:21.612 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:13:21.663 INFO:tasks.workunit:timeout=3h 2024-09-12T00:13:21.664 INFO:tasks.workunit:cleanup=True 2024-09-12T00:13:21.664 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:13:21.714 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:14:04.595 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:14:04.595 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:14:04.595 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:14:04.595 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:14:04.595 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:14:04.595 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:14:04.596 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:14:04.601 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:14:04.649 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:14:04.652 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:14:04.652 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:14:04.712 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:14:04.762 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:14:04.804 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:14:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:14:04.805 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:14:04.846 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:14:04.849 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:14:04.849 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:14:04.896 INFO:tasks.workunit:Running workunits matching cls/test_cls_lock.sh on client.0... 2024-09-12T00:14:04.897 INFO:tasks.workunit:Running workunit cls/test_cls_lock.sh... 2024-09-12T00:14:04.898 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_lock.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh 2024-09-12T00:14:04.960 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:14:04.960 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:14:04.960 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:14:04.960 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from ClsLock 2024-09-12T00:14:04.960 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestMultiLocking 2024-09-12T00:14:07.032 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-12T00:14:07.032 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: exclusive 2024-09-12T00:14:07.032 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-12T00:14:07.032 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-12T00:14:07.032 INFO:tasks.workunit.client.0.smithi078.stdout: client.5009 expiration=2024-09-12T00:16:07.029798+0000 addr=v1:172.21.15.78:0/980895107 cookie= 2024-09-12T00:14:07.037 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-12T00:14:07.037 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-12T00:14:07.038 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-12T00:14:07.038 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-12T00:14:07.038 INFO:tasks.workunit.client.0.smithi078.stdout: client.5009 expiration=2024-09-12T00:16:07.039221+0000 addr=v1:172.21.15.78:0/980895107 cookie= 2024-09-12T00:14:07.038 INFO:tasks.workunit.client.0.smithi078.stdout: client.5012 expiration=0.000000 addr=v1:172.21.15.78:0/1574846374 cookie= 2024-09-12T00:14:07.039 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-12T00:14:07.039 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-12T00:14:07.039 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-12T00:14:07.039 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-12T00:14:07.040 INFO:tasks.workunit.client.0.smithi078.stdout: client.5012 expiration=0.000000 addr=v1:172.21.15.78:0/1574846374 cookie= 2024-09-12T00:14:07.973 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestMultiLocking (3013 ms) 2024-09-12T00:14:07.973 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestMeta 2024-09-12T00:14:10.288 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-12T00:14:10.289 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-12T00:14:10.289 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-12T00:14:10.289 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-12T00:14:10.289 INFO:tasks.workunit.client.0.smithi078.stdout: client.5024 expiration=0.000000 addr=v1:172.21.15.78:0/1326946840 cookie= 2024-09-12T00:14:10.294 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-12T00:14:10.295 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: exclusive 2024-09-12T00:14:10.295 INFO:tasks.workunit.client.0.smithi078.stdout: tag: new_tag 2024-09-12T00:14:10.295 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-12T00:14:10.295 INFO:tasks.workunit.client.0.smithi078.stdout: client.5018 expiration=0.000000 addr=v1:172.21.15.78:0/3412789633 cookie= 2024-09-12T00:14:11.028 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestMeta (3054 ms) 2024-09-12T00:14:11.028 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestCookie 2024-09-12T00:14:13.132 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-12T00:14:13.132 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: exclusive 2024-09-12T00:14:13.132 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-12T00:14:13.132 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-12T00:14:13.138 INFO:tasks.workunit.client.0.smithi078.stdout:lock: mylock 2024-09-12T00:14:13.139 INFO:tasks.workunit.client.0.smithi078.stdout: lock_type: shared 2024-09-12T00:14:13.139 INFO:tasks.workunit.client.0.smithi078.stdout: tag: 2024-09-12T00:14:13.139 INFO:tasks.workunit.client.0.smithi078.stdout: lockers: 2024-09-12T00:14:13.139 INFO:tasks.workunit.client.0.smithi078.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.78:0/1512767253 cookie= 2024-09-12T00:14:13.139 INFO:tasks.workunit.client.0.smithi078.stdout: client.5199 expiration=0.000000 addr=v1:172.21.15.78:0/1512767253 cookie=new cookie 2024-09-12T00:14:14.102 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestCookie (3075 ms) 2024-09-12T00:14:14.103 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestMultipleLocks 2024-09-12T00:14:17.134 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestMultipleLocks (3032 ms) 2024-09-12T00:14:17.134 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestLockDuration 2024-09-12T00:14:24.899 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestLockDuration (7760 ms) 2024-09-12T00:14:24.899 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestAssertLocked 2024-09-12T00:14:27.951 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestAssertLocked (3057 ms) 2024-09-12T00:14:27.951 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestSetCookie 2024-09-12T00:14:30.963 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestSetCookie (3012 ms) 2024-09-12T00:14:30.963 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestRenew 2024-09-12T00:14:51.937 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestRenew (20971 ms) 2024-09-12T00:14:51.937 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralBasic 2024-09-12T00:14:58.040 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestExclusiveEphemeralBasic (6106 ms) 2024-09-12T00:14:58.040 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealEphemeral 2024-09-12T00:15:05.190 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealEphemeral (7139 ms) 2024-09-12T00:15:05.191 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsLock.TestExclusiveEphemeralStealExclusive 2024-09-12T00:15:12.923 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsLock.TestExclusiveEphemeralStealExclusive (7744 ms) 2024-09-12T00:15:12.924 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from ClsLock (67963 ms total) 2024-09-12T00:15:12.924 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:15:12.924 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:15:12.924 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 11 tests from 1 test suite ran. (67963 ms total) 2024-09-12T00:15:12.925 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 11 tests. 2024-09-12T00:15:12.932 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:15:12.932 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:15:12.991 INFO:tasks.workunit:Running workunits matching cls/test_cls_log.sh on client.0... 2024-09-12T00:15:13.001 INFO:tasks.workunit:Running workunit cls/test_cls_log.sh... 2024-09-12T00:15:13.001 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_log.sh 2024-09-12T00:15:13.073 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:15:13.073 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:15:13.073 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:15:13.073 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from cls_log 2024-09-12T00:15:13.073 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.test_log_add_same_time 2024-09-12T00:15:15.987 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.test_log_add_same_time (2916 ms) 2024-09-12T00:15:15.987 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.test_log_add_different_time 2024-09-12T00:15:19.004 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.test_log_add_different_time (3017 ms) 2024-09-12T00:15:19.004 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.trim_by_time 2024-09-12T00:15:22.025 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.trim_by_time (3021 ms) 2024-09-12T00:15:22.025 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_log.trim_by_marker 2024-09-12T00:15:25.084 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_log.trim_by_marker (3059 ms) 2024-09-12T00:15:25.084 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from cls_log (12013 ms total) 2024-09-12T00:15:25.084 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:15:25.084 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:15:25.084 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 4 tests from 1 test suite ran. (12013 ms total) 2024-09-12T00:15:25.084 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 4 tests. 2024-09-12T00:15:25.088 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:15:25.088 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:15:25.144 INFO:tasks.workunit:Running workunits matching cls/test_cls_refcount.sh on client.0... 2024-09-12T00:15:25.145 INFO:tasks.workunit:Running workunit cls/test_cls_refcount.sh... 2024-09-12T00:15:25.145 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_refcount.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_refcount.sh 2024-09-12T00:15:25.210 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:15:25.210 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:15:25.210 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:15:25.210 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from cls_refcount 2024-09-12T00:15:25.210 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit 2024-09-12T00:15:28.140 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit (2930 ms) 2024-09-12T00:15:28.140 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit_idempotent 2024-09-12T00:15:31.153 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit_idempotent (3013 ms) 2024-09-12T00:15:31.153 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_put_snap 2024-09-12T00:15:40.254 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_put_snap (9096 ms) 2024-09-12T00:15:40.254 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_explicit 2024-09-12T00:15:43.255 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_explicit (3006 ms) 2024-09-12T00:15:43.255 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.set 2024-09-12T00:15:46.322 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.set (3067 ms) 2024-09-12T00:15:46.323 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit_ec 2024-09-12T00:15:53.365 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit_ec (7044 ms) 2024-09-12T00:15:53.365 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_implicit_idempotent_ec 2024-09-12T00:16:00.441 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_implicit_idempotent_ec (7075 ms) 2024-09-12T00:16:00.441 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_put_snap_ec 2024-09-12T00:16:12.616 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_put_snap_ec (12176 ms) 2024-09-12T00:16:12.617 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.test_explicit_ec 2024-09-12T00:16:19.668 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.test_explicit_ec (7052 ms) 2024-09-12T00:16:19.669 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_refcount.set_ec 2024-09-12T00:16:26.759 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_refcount.set_ec (7090 ms) 2024-09-12T00:16:26.759 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from cls_refcount (61550 ms total) 2024-09-12T00:16:26.759 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:16:26.759 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:16:26.759 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 10 tests from 1 test suite ran. (61550 ms total) 2024-09-12T00:16:26.759 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 10 tests. 2024-09-12T00:16:26.764 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:16:26.764 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:16:26.819 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw.sh on client.0... 2024-09-12T00:16:26.820 INFO:tasks.workunit:Running workunit cls/test_cls_rgw.sh... 2024-09-12T00:16:26.821 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_rgw.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw.sh 2024-09-12T00:16:26.884 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:16:26.884 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:16:26.885 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:16:26.885 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from cls_rgw 2024-09-12T00:16:28.760 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_basic 2024-09-12T00:16:28.850 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_basic (90 ms) 2024-09-12T00:16:28.850 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_multiple_obj_writers 2024-09-12T00:16:28.920 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_multiple_obj_writers (70 ms) 2024-09-12T00:16:28.920 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_remove_object 2024-09-12T00:16:29.005 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_remove_object (85 ms) 2024-09-12T00:16:29.005 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_suggest 2024-09-12T00:16:31.385 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_suggest (2379 ms) 2024-09-12T00:16:31.719 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_suggest_complete 2024-09-12T00:16:31.720 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_suggest_complete (15 ms) 2024-09-12T00:16:31.720 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_list 2024-09-12T00:16:31.720 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_list (55 ms) 2024-09-12T00:16:31.720 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_list_delimited 2024-09-12T00:17:29.898 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_list_delimited (58443 ms) 2024-09-12T00:17:29.899 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.bi_list 2024-09-12T00:17:30.092 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.bi_list (195 ms) 2024-09-12T00:17:30.092 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.gc_set 2024-09-12T00:17:30.120 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.gc_set (28 ms) 2024-09-12T00:17:30.120 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.gc_list 2024-09-12T00:17:30.150 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.gc_list (30 ms) 2024-09-12T00:17:30.150 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.gc_defer 2024-09-12T00:17:38.019 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.gc_defer (7869 ms) 2024-09-12T00:17:38.019 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.usage_basic 2024-09-12T00:17:38.219 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.usage_basic (201 ms) 2024-09-12T00:17:38.220 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.usage_clear_no_obj 2024-09-12T00:17:38.232 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.usage_clear_no_obj (13 ms) 2024-09-12T00:17:38.232 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.usage_clear 2024-09-12T00:17:38.421 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.usage_clear (188 ms) 2024-09-12T00:17:38.421 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.bi_log_trim 2024-09-12T00:17:38.545 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.bi_log_trim (124 ms) 2024-09-12T00:17:38.545 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.index_racing_removes 2024-09-12T00:17:38.585 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.index_racing_removes (40 ms) 2024-09-12T00:17:38.585 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.reshardlog_list 2024-09-12T00:17:38.621 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.reshardlog_list (36 ms) 2024-09-12T00:17:38.621 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.reshardlog_num 2024-09-12T00:17:38.650 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.reshardlog_num (29 ms) 2024-09-12T00:17:38.650 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw.bi_put_entries 2024-09-12T00:17:38.704 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw.bi_put_entries (55 ms) 2024-09-12T00:17:39.019 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from cls_rgw (69945 ms total) 2024-09-12T00:17:39.019 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:17:39.019 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:39.019 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 19 tests from 1 test suite ran. (72135 ms total) 2024-09-12T00:17:39.019 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 19 tests. 2024-09-12T00:17:39.029 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:39.030 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:39.091 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_gc.sh on client.0... 2024-09-12T00:17:39.092 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_gc.sh... 2024-09-12T00:17:39.092 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_rgw_gc.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_gc.sh 2024-09-12T00:17:39.158 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:17:39.158 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:17:39.159 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:39.159 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from cls_rgw_gc 2024-09-12T00:17:39.159 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.init 2024-09-12T00:17:41.033 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.init (1874 ms) 2024-09-12T00:17:41.033 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops1 2024-09-12T00:17:41.081 INFO:tasks.workunit.client.0.smithi078.stderr:[ ] list info tag = chain-0 2024-09-12T00:17:41.081 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops1 (48 ms) 2024-09-12T00:17:41.081 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops2 2024-09-12T00:17:41.095 INFO:tasks.workunit.client.0.smithi078.stderr:[ ] next_marker is: = 0/4263 2024-09-12T00:17:41.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops2 (16 ms) 2024-09-12T00:17:41.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops5 2024-09-12T00:17:41.111 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops5 (15 ms) 2024-09-12T00:17:41.111 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops6 2024-09-12T00:17:41.124 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops6 (13 ms) 2024-09-12T00:17:41.125 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops7 2024-09-12T00:17:41.140 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops7 (16 ms) 2024-09-12T00:17:41.140 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops8 2024-09-12T00:17:41.155 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops8 (15 ms) 2024-09-12T00:17:41.155 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.gc_queue_ops9 2024-09-12T00:17:41.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.gc_queue_ops9 (18 ms) 2024-09-12T00:17:41.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_gc.finalize 2024-09-12T00:17:42.048 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_gc.finalize (874 ms) 2024-09-12T00:17:42.048 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from cls_rgw_gc (2889 ms total) 2024-09-12T00:17:42.048 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:17:42.048 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:17:42.048 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 9 tests from 1 test suite ran. (2889 ms total) 2024-09-12T00:17:42.048 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 9 tests. 2024-09-12T00:17:42.053 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:17:42.053 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:17:42.110 INFO:tasks.workunit:Running workunits matching cls/test_cls_rgw_stats.sh on client.0... 2024-09-12T00:17:42.111 INFO:tasks.workunit:Running workunit cls/test_cls_rgw_stats.sh... 2024-09-12T00:17:42.112 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_rgw_stats.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_rgw_stats.sh 2024-09-12T00:17:42.189 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:17:42.190 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:17:42.190 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 1 test from 1 test suite. 2024-09-12T00:17:42.190 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:17:44.079 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 1 test from cls_rgw_stats 2024-09-12T00:17:44.079 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] cls_rgw_stats.simulate 2024-09-12T00:17:44.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.104+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=DTXRIBF9U1SE type=del size=148072 2024-09-12T00:17:44.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~3B50G1TJY23Z.0 size=1048576 2024-09-12T00:17:44.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.112+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~3B50G1TJY23Z.1 size=1048576 2024-09-12T00:17:44.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.116+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~3B50G1TJY23Z.2 size=359009 2024-09-12T00:17:44.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.116+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=3B50G1TJY23Z tag=WI8G205ZVUXU type=write size=3504737 2024-09-12T00:17:44.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~839MN52ZF4S8.0 size=1048576 2024-09-12T00:17:44.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.124+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~839MN52ZF4S8.1 size=955602 2024-09-12T00:17:44.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.124+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=839MN52ZF4S8 tag=PETWYZIEHW0S type=write size=3052754 2024-09-12T00:17:44.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~EAVC93I9FSE5.0 size=1048576 2024-09-12T00:17:44.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~EAVC93I9FSE5.1 size=1045771 2024-09-12T00:17:44.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.132+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=EAVC93I9FSE5 tag=13LMALN2X7LO type=write size=3142923 2024-09-12T00:17:44.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~W0622MZWQGZV.0 size=1048576 2024-09-12T00:17:44.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~W0622MZWQGZV.1 size=1048576 2024-09-12T00:17:44.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~W0622MZWQGZV.2 size=432036 2024-09-12T00:17:44.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.144+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=W0622MZWQGZV tag=CETWN6WR8Q6R type=write size=3577764 2024-09-12T00:17:44.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.148+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=911MUF5V6MA8 type=write size=1022416 2024-09-12T00:17:44.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.152+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=S5HJQK6LR1E9 type=del size=1337219 2024-09-12T00:17:44.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.156+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=TXTKMIBTNUN9 type=del size=2120298 2024-09-12T00:17:44.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.164+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~2JX457QAX2CW.0 size=1048576 2024-09-12T00:17:44.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~2JX457QAX2CW.1 size=1048576 2024-09-12T00:17:44.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~2JX457QAX2CW.2 size=1015160 2024-09-12T00:17:44.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.168+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=2JX457QAX2CW tag=U3ZLHI2GU29H type=write size=4160888 2024-09-12T00:17:44.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.176+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~KXA6AC6X58RU.0 size=519578 2024-09-12T00:17:44.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.176+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=KXA6AC6X58RU tag=G2OELC93BWKD type=write size=1568154 2024-09-12T00:17:44.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.184+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~SR6OS3OGBC0J.0 size=292306 2024-09-12T00:17:44.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.184+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=SR6OS3OGBC0J tag=Y3A1FQ9ZMQEH type=write size=1340882 2024-09-12T00:17:44.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.188+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~WE7RR0GDW9TA.0 size=589003 2024-09-12T00:17:44.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.188+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=WE7RR0GDW9TA tag=17ATM84UVHBF type=write size=1637579 2024-09-12T00:17:44.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.192+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=LMAVJ4PWNFMS type=del size=2791339 2024-09-12T00:17:44.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.200+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~VBBPR9MKSZ9L.0 size=486570 2024-09-12T00:17:44.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.200+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=VBBPR9MKSZ9L tag=16OZU888K9IF type=write size=1535146 2024-09-12T00:17:44.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.204+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=0QXNKDHG8Q9R type=del size=1431566 2024-09-12T00:17:44.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.208+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=72EKI0ZZVWPT type=del size=1602071 2024-09-12T00:17:44.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.216+0000 7f69cdea98c0 1 < suggested update operation key=RDGRKQQH4B8C tag=DTXRIBF9U1SE type=del size=148072 2024-09-12T00:17:44.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.220+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=Q0QTROT1U2T9 type=del size=32398 2024-09-12T00:17:44.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.224+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~3B50G1TJY23Z.0 size=1048576 2024-09-12T00:17:44.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.228+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~3B50G1TJY23Z.1 size=1048576 2024-09-12T00:17:44.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.232+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~3B50G1TJY23Z.2 size=359009 2024-09-12T00:17:44.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.240+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=3B50G1TJY23Z tag=WI8G205ZVUXU type=write size=3504737 2024-09-12T00:17:44.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~IM9WI50QCM5Q.0 size=1048576 2024-09-12T00:17:44.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~IM9WI50QCM5Q.1 size=909911 2024-09-12T00:17:44.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.248+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=IM9WI50QCM5Q tag=ZMH1NQ52G32T type=write size=3007063 2024-09-12T00:17:44.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.252+0000 7f69cdea98c0 1 < canceled part key=_multipart_0EALARW4O3OB.2~839MN52ZF4S8.0 size=1048576 2024-09-12T00:17:44.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.252+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~839MN52ZF4S8.1 size=955602 2024-09-12T00:17:44.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.260+0000 7f69cdea98c0 1 < canceled multipart upload key=0EALARW4O3OB upload=839MN52ZF4S8 tag=PETWYZIEHW0S type=write size=3052754 2024-09-12T00:17:44.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.264+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~C442F289D1QL.0 size=1048576 2024-09-12T00:17:44.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.268+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~C442F289D1QL.1 size=1048576 2024-09-12T00:17:44.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~C442F289D1QL.2 size=363171 2024-09-12T00:17:44.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.272+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=C442F289D1QL tag=KHZIV78C3IRW type=write size=3508899 2024-09-12T00:17:44.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.272+0000 7f69cdea98c0 1 < canceled part key=_multipart_AKWTTXH2P254.2~EAVC93I9FSE5.0 size=1048576 2024-09-12T00:17:44.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.276+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~EAVC93I9FSE5.1 size=1045771 2024-09-12T00:17:44.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.280+0000 7f69cdea98c0 1 < canceled multipart upload key=AKWTTXH2P254 upload=EAVC93I9FSE5 tag=13LMALN2X7LO type=write size=3142923 2024-09-12T00:17:44.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.292+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=ZH704FBPJ0KQ type=write size=1029926 2024-09-12T00:17:44.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.296+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~W0622MZWQGZV.0 size=1048576 2024-09-12T00:17:44.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.300+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~W0622MZWQGZV.1 size=1048576 2024-09-12T00:17:44.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.300+0000 7f69cdea98c0 1 < canceled part key=_multipart_HSQZYI0SNZP1.2~W0622MZWQGZV.2 size=432036 2024-09-12T00:17:44.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.304+0000 7f69cdea98c0 1 < canceled multipart upload key=HSQZYI0SNZP1 upload=W0622MZWQGZV tag=CETWN6WR8Q6R type=write size=3577764 2024-09-12T00:17:44.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~Y1VAWSIU4JDI.0 size=1048576 2024-09-12T00:17:44.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.316+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~Y1VAWSIU4JDI.1 size=1048576 2024-09-12T00:17:44.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.316+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~Y1VAWSIU4JDI.2 size=910995 2024-09-12T00:17:44.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.316+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=Y1VAWSIU4JDI tag=BF1QZQDMZXF0 type=write size=4056723 2024-09-12T00:17:44.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.320+0000 7f69cdea98c0 1 < completed write operation key=Q0L8J0BYRFDQ tag=911MUF5V6MA8 type=write size=1022416 2024-09-12T00:17:44.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.324+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=B4BD09DIHNJU type=del size=1316376 2024-09-12T00:17:44.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.328+0000 7f69cdea98c0 -1 < failed to complete operation key=RDGRKQQH4B8C tag=S5HJQK6LR1E9 type=del size=1337219: (22) Invalid argument 2024-09-12T00:17:44.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.332+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=9WE0VHLH7EWE type=del size=3164246 2024-09-12T00:17:44.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.336+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=TXTKMIBTNUN9 type=del 2024-09-12T00:17:44.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.340+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=8606HBD50QSG type=del size=2070095 2024-09-12T00:17:44.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.344+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~2JX457QAX2CW.0 size=1048576 2024-09-12T00:17:44.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.344+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~2JX457QAX2CW.1 size=1048576 2024-09-12T00:17:44.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.348+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~2JX457QAX2CW.2 size=1015160 2024-09-12T00:17:44.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.356+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=2JX457QAX2CW tag=U3ZLHI2GU29H type=write size=4160888 2024-09-12T00:17:44.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.360+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~4VD73E6HM42T.0 size=1048576 2024-09-12T00:17:44.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.364+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~4VD73E6HM42T.1 size=808775 2024-09-12T00:17:44.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.364+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=4VD73E6HM42T tag=BVAG2UU43D2W type=write size=2905927 2024-09-12T00:17:44.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.368+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~KXA6AC6X58RU.0 size=519578 2024-09-12T00:17:44.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.376+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=KXA6AC6X58RU tag=G2OELC93BWKD type=write size=1568154 2024-09-12T00:17:44.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.380+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=7RUJVFXXWKQE type=del size=95239 2024-09-12T00:17:44.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.384+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~SR6OS3OGBC0J.0 size=292306 2024-09-12T00:17:44.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.388+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=SR6OS3OGBC0J tag=Y3A1FQ9ZMQEH type=write size=1340882 2024-09-12T00:17:44.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.392+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=DU52M17GCFRR type=del size=2178316 2024-09-12T00:17:44.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.396+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~WE7RR0GDW9TA.0 size=589003 2024-09-12T00:17:44.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.404+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=WE7RR0GDW9TA tag=17ATM84UVHBF type=write size=1637579 2024-09-12T00:17:44.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.408+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=WCTGIR4O5T8Y type=del size=889690 2024-09-12T00:17:44.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.412+0000 7f69cdea98c0 1 < suggested update operation key=2X78JWLK876H tag=LMAVJ4PWNFMS type=del size=2791339 2024-09-12T00:17:44.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.424+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~LU6XFZS6UAFQ.0 size=469593 2024-09-12T00:17:44.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.424+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=LU6XFZS6UAFQ tag=LQOKHH9IZGJ9 type=write size=1518169 2024-09-12T00:17:44.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.428+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~VBBPR9MKSZ9L.0 size=486570 2024-09-12T00:17:44.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.436+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=VBBPR9MKSZ9L tag=16OZU888K9IF type=write size=1535146 2024-09-12T00:17:44.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~BEAO5QGL1GMQ.0 size=1048576 2024-09-12T00:17:44.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~BEAO5QGL1GMQ.1 size=390296 2024-09-12T00:17:44.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.444+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=BEAO5QGL1GMQ tag=6Z542QWJO24A type=write size=2487448 2024-09-12T00:17:44.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.448+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=0QXNKDHG8Q9R type=del 2024-09-12T00:17:44.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~VOS893JLIU3K.0 size=1048576 2024-09-12T00:17:44.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.460+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~VOS893JLIU3K.1 size=1048576 2024-09-12T00:17:44.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.464+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~VOS893JLIU3K.2 size=765349 2024-09-12T00:17:44.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.464+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=VOS893JLIU3K tag=9UV7FRU4BFRU type=write size=3911077 2024-09-12T00:17:44.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.468+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=72EKI0ZZVWPT type=del 2024-09-12T00:17:44.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~NODK8RFQY8R8.0 size=1048576 2024-09-12T00:17:44.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~NODK8RFQY8R8.1 size=1048576 2024-09-12T00:17:44.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.480+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~NODK8RFQY8R8.2 size=186237 2024-09-12T00:17:44.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.480+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=NODK8RFQY8R8 tag=J5XOFTS6WZ03 type=write size=3331965 2024-09-12T00:17:44.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.488+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=Q0QTROT1U2T9 type=del 2024-09-12T00:17:44.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.492+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=TXXVZ2E5DYB6 type=del size=991333 2024-09-12T00:17:44.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.496+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~IM9WI50QCM5Q.0 size=1048576 2024-09-12T00:17:44.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.496+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~IM9WI50QCM5Q.1 size=909911 2024-09-12T00:17:44.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.504+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=IM9WI50QCM5Q tag=ZMH1NQ52G32T type=write size=3007063 2024-09-12T00:17:44.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.508+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=70O63CEE7W9H type=del size=279790 2024-09-12T00:17:44.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.512+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~C442F289D1QL.0 size=1048576 2024-09-12T00:17:44.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.512+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~C442F289D1QL.1 size=1048576 2024-09-12T00:17:44.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.516+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~C442F289D1QL.2 size=363171 2024-09-12T00:17:44.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.524+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=C442F289D1QL tag=KHZIV78C3IRW type=write size=3508899 2024-09-12T00:17:44.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~B12ETZ8DO9FI.0 size=1048576 2024-09-12T00:17:44.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.532+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~B12ETZ8DO9FI.1 size=507148 2024-09-12T00:17:44.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.532+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=B12ETZ8DO9FI tag=5BVRG7P5AUA6 type=write size=2604300 2024-09-12T00:17:44.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.536+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=ZH704FBPJ0KQ type=write size=1029926 2024-09-12T00:17:44.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.540+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=1CBU7HDM0HRT type=write size=496179 2024-09-12T00:17:44.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.544+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~Y1VAWSIU4JDI.0 size=1048576 2024-09-12T00:17:44.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.548+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~Y1VAWSIU4JDI.1 size=1048576 2024-09-12T00:17:44.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.548+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~Y1VAWSIU4JDI.2 size=910995 2024-09-12T00:17:44.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.556+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=Y1VAWSIU4JDI tag=BF1QZQDMZXF0 type=write size=4056723 2024-09-12T00:17:44.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.560+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=99X23I4MD78O type=del size=2874479 2024-09-12T00:17:44.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.564+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=B4BD09DIHNJU type=del 2024-09-12T00:17:44.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.568+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=G5UH6EX5U1E3 type=del size=2457045 2024-09-12T00:17:44.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.572+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=9WE0VHLH7EWE type=del 2024-09-12T00:17:44.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.576+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~M382660UVQ4Z.0 size=24461 2024-09-12T00:17:44.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.576+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=M382660UVQ4Z tag=CPUKULHD30WS type=write size=1073037 2024-09-12T00:17:44.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.580+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=8606HBD50QSG type=del 2024-09-12T00:17:44.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.584+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=LMV3N38M8JJ1 type=write size=899443 2024-09-12T00:17:44.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.588+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~4VD73E6HM42T.0 size=1048576 2024-09-12T00:17:44.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.592+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~4VD73E6HM42T.1 size=808775 2024-09-12T00:17:44.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.600+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=4VD73E6HM42T tag=BVAG2UU43D2W type=write size=2905927 2024-09-12T00:17:44.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.604+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=XZKK4B9O30T5 type=del size=1225988 2024-09-12T00:17:44.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.604+0000 7f69cdea98c0 1 < canceled operation key=Z6MH459BTZ6K tag=7RUJVFXXWKQE type=del size=95239 2024-09-12T00:17:44.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.612+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~EB53L44X6OU1.0 size=306048 2024-09-12T00:17:44.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.612+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=EB53L44X6OU1 tag=OD32RKKZC9ZG type=write size=1354624 2024-09-12T00:17:44.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.616+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=DU52M17GCFRR type=del 2024-09-12T00:17:44.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.620+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=P7UF04UVEA73 type=del size=1644469 2024-09-12T00:17:44.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.624+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=WCTGIR4O5T8Y type=del 2024-09-12T00:17:44.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.628+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=6129CH1GBDBO type=del size=272937 2024-09-12T00:17:44.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.632+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~LU6XFZS6UAFQ.0 size=469593 2024-09-12T00:17:44.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.636+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=LU6XFZS6UAFQ tag=LQOKHH9IZGJ9 type=write size=1518169 2024-09-12T00:17:44.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.644+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~TBXQ1W41DTYO.0 size=88271 2024-09-12T00:17:44.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.644+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=TBXQ1W41DTYO tag=3UV1VCVB5LPJ type=write size=1136847 2024-09-12T00:17:44.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.648+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~BEAO5QGL1GMQ.0 size=1048576 2024-09-12T00:17:44.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.648+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~BEAO5QGL1GMQ.1 size=390296 2024-09-12T00:17:44.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.656+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=BEAO5QGL1GMQ tag=6Z542QWJO24A type=write size=2487448 2024-09-12T00:17:44.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.660+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=NCSOODP99COV type=del size=2249772 2024-09-12T00:17:44.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.664+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~VOS893JLIU3K.0 size=1048576 2024-09-12T00:17:44.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.668+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~VOS893JLIU3K.1 size=1048576 2024-09-12T00:17:44.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.668+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~VOS893JLIU3K.2 size=765349 2024-09-12T00:17:44.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.676+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=VOS893JLIU3K tag=9UV7FRU4BFRU type=write size=3911077 2024-09-12T00:17:44.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~P8Q2KQCSYOKA.0 size=1048576 2024-09-12T00:17:44.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~P8Q2KQCSYOKA.1 size=1048576 2024-09-12T00:17:44.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~P8Q2KQCSYOKA.2 size=129502 2024-09-12T00:17:44.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.688+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=P8Q2KQCSYOKA tag=KPZHMA066DI8 type=write size=3275230 2024-09-12T00:17:44.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.692+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~NODK8RFQY8R8.0 size=1048576 2024-09-12T00:17:44.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.692+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~NODK8RFQY8R8.1 size=1048576 2024-09-12T00:17:44.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.692+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~NODK8RFQY8R8.2 size=186237 2024-09-12T00:17:44.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.696+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=NODK8RFQY8R8 tag=J5XOFTS6WZ03 type=write size=3331965 2024-09-12T00:17:44.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.700+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=J47QEB5NRO6N type=del size=1026390 2024-09-12T00:17:44.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.704+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=TXXVZ2E5DYB6 type=del 2024-09-12T00:17:44.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.708+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=XFTTQVAOH814 type=del size=2903535 2024-09-12T00:17:44.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.712+0000 7f69cdea98c0 1 < canceled operation key=1CZXUEJLQ8FM tag=70O63CEE7W9H type=del size=279790 2024-09-12T00:17:44.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.716+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=WGBJHY3JWH04 type=del size=2233664 2024-09-12T00:17:44.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.716+0000 7f69cdea98c0 1 < canceled part key=_multipart_Q0L8J0BYRFDQ.2~B12ETZ8DO9FI.0 size=1048576 2024-09-12T00:17:44.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.720+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~B12ETZ8DO9FI.1 size=507148 2024-09-12T00:17:44.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.728+0000 7f69cdea98c0 1 < canceled multipart upload key=Q0L8J0BYRFDQ upload=B12ETZ8DO9FI tag=5BVRG7P5AUA6 type=write size=2604300 2024-09-12T00:17:44.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.732+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=X0KI5NNO86RC type=del size=2549808 2024-09-12T00:17:44.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.736+0000 7f69cdea98c0 1 < completed write operation key=HSQZYI0SNZP1 tag=1CBU7HDM0HRT type=write size=496179 2024-09-12T00:17:44.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.736+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=1Z9ZN9E4KN3H type=del size=868207 2024-09-12T00:17:44.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.744+0000 7f69cdea98c0 1 < suggested update operation key=O5WBNND16BFN tag=99X23I4MD78O type=del size=2874479 2024-09-12T00:17:44.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.752+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~UK4II05GJI9T.0 size=1048576 2024-09-12T00:17:44.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.756+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~UK4II05GJI9T.1 size=1048576 2024-09-12T00:17:44.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.756+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~UK4II05GJI9T.2 size=467829 2024-09-12T00:17:44.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.756+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=UK4II05GJI9T tag=LZMALXF2C1S2 type=write size=3613557 2024-09-12T00:17:44.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.760+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=G5UH6EX5U1E3 type=del 2024-09-12T00:17:44.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.764+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=WRSLOH8S8RCX type=del size=2402915 2024-09-12T00:17:44.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.768+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~M382660UVQ4Z.0 size=24461 2024-09-12T00:17:44.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.772+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=M382660UVQ4Z tag=CPUKULHD30WS type=write size=1073037 2024-09-12T00:17:44.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.776+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=6OWG6VGO4NS6 type=del size=3520948 2024-09-12T00:17:44.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.784+0000 7f69cdea98c0 1 < suggested remove operation key=9K3HLTD6DMSC tag=LMV3N38M8JJ1 type=write 2024-09-12T00:17:44.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.792+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~6ZGOFA84V0I5.0 size=1048576 2024-09-12T00:17:44.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.796+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~6ZGOFA84V0I5.1 size=507274 2024-09-12T00:17:44.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.796+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=6ZGOFA84V0I5 tag=HP0Y4806Y566 type=write size=2604426 2024-09-12T00:17:44.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.800+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=XZKK4B9O30T5 type=del 2024-09-12T00:17:44.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~3HW302X9CU45.0 size=1048576 2024-09-12T00:17:44.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.808+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~3HW302X9CU45.1 size=1048576 2024-09-12T00:17:44.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.812+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~3HW302X9CU45.2 size=67203 2024-09-12T00:17:44.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.812+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=3HW302X9CU45 tag=8X0ABLRJ9ML0 type=write size=3212931 2024-09-12T00:17:44.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.816+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~EB53L44X6OU1.0 size=306048 2024-09-12T00:17:44.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.820+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=EB53L44X6OU1 tag=OD32RKKZC9ZG type=write size=1354624 2024-09-12T00:17:44.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.828+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=EGT3DMPKMHV5 type=del size=606192 2024-09-12T00:17:44.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.832+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=P7UF04UVEA73 type=del 2024-09-12T00:17:44.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.836+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=OIRB1OM14B0W type=del size=312861 2024-09-12T00:17:44.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.844+0000 7f69cdea98c0 1 < suggested remove operation key=7UFADFUXL28I tag=6129CH1GBDBO type=del 2024-09-12T00:17:44.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.852+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~T7WP4606XGUR.0 size=1048576 2024-09-12T00:17:44.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.852+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~T7WP4606XGUR.1 size=1048576 2024-09-12T00:17:44.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.856+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~T7WP4606XGUR.2 size=312540 2024-09-12T00:17:44.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.856+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=T7WP4606XGUR tag=T8EHULSGMGKI type=write size=3458268 2024-09-12T00:17:44.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.860+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~TBXQ1W41DTYO.0 size=88271 2024-09-12T00:17:44.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.868+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=TBXQ1W41DTYO tag=3UV1VCVB5LPJ type=write size=1136847 2024-09-12T00:17:44.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.872+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=HA6O2VZQDGQQ type=del size=2813164 2024-09-12T00:17:44.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.876+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=NCSOODP99COV type=del 2024-09-12T00:17:44.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.880+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=QDN92IR5D5DP type=write size=519806 2024-09-12T00:17:44.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.880+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~P8Q2KQCSYOKA.0 size=1048576 2024-09-12T00:17:44.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.884+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~P8Q2KQCSYOKA.1 size=1048576 2024-09-12T00:17:44.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.884+0000 7f69cdea98c0 1 < canceled part key=_multipart_0HAUC4BDL9VR.2~P8Q2KQCSYOKA.2 size=129502 2024-09-12T00:17:44.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.892+0000 7f69cdea98c0 1 < canceled multipart upload key=0HAUC4BDL9VR upload=P8Q2KQCSYOKA tag=KPZHMA066DI8 type=write size=3275230 2024-09-12T00:17:44.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.896+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=QNIEQTI9U0DS type=del size=3307374 2024-09-12T00:17:44.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.896+0000 7f69cdea98c0 -1 < failed to complete operation key=9K3HLTD6DMSC tag=J47QEB5NRO6N type=del size=1026390: (22) Invalid argument 2024-09-12T00:17:44.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.900+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=IPNTKOFKXMVI type=write size=287293 2024-09-12T00:17:44.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.904+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=XFTTQVAOH814 type=del 2024-09-12T00:17:44.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.908+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=I3LEOI4Z0Y6X type=del size=3341702 2024-09-12T00:17:44.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.912+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=WGBJHY3JWH04 type=del 2024-09-12T00:17:44.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.916+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=QI9HJSO1X168 type=del size=2169458 2024-09-12T00:17:44.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.920+0000 7f69cdea98c0 1 < suggested remove operation key=K4LNDJJUA1RZ tag=X0KI5NNO86RC type=del 2024-09-12T00:17:44.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.928+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~H7DKEAXEUGMV.0 size=1048576 2024-09-12T00:17:44.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.932+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~H7DKEAXEUGMV.1 size=1048576 2024-09-12T00:17:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.936+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~H7DKEAXEUGMV.2 size=199118 2024-09-12T00:17:44.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.936+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=H7DKEAXEUGMV tag=FIOUI1MZ6GTU type=write size=3344846 2024-09-12T00:17:44.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.936+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=1Z9ZN9E4KN3H type=del 2024-09-12T00:17:44.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.940+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=NKWLOF75H4NC type=del size=1798488 2024-09-12T00:17:44.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.944+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~UK4II05GJI9T.0 size=1048576 2024-09-12T00:17:44.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.948+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~UK4II05GJI9T.1 size=1048576 2024-09-12T00:17:44.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.952+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~UK4II05GJI9T.2 size=467829 2024-09-12T00:17:44.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.956+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=UK4II05GJI9T tag=LZMALXF2C1S2 type=write size=3613557 2024-09-12T00:17:44.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.964+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=J02HQ0YQO2Y0 type=del size=2193775 2024-09-12T00:17:44.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.964+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=WRSLOH8S8RCX type=del 2024-09-12T00:17:44.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.972+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~2M8U6VPVY5QM.0 size=1048576 2024-09-12T00:17:44.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.976+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~2M8U6VPVY5QM.1 size=545871 2024-09-12T00:17:44.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.976+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=2M8U6VPVY5QM tag=C07D80IBJGBZ type=write size=2643023 2024-09-12T00:17:44.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.984+0000 7f69cdea98c0 1 < suggested update operation key=1CZXUEJLQ8FM tag=6OWG6VGO4NS6 type=del size=3520948 2024-09-12T00:17:44.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.988+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=UVCAL4ZP2PCG type=del size=349195 2024-09-12T00:17:44.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.992+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~6ZGOFA84V0I5.0 size=1048576 2024-09-12T00:17:44.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:44.992+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~6ZGOFA84V0I5.1 size=507274 2024-09-12T00:17:44.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.000+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=6ZGOFA84V0I5 tag=HP0Y4806Y566 type=write size=2604426 2024-09-12T00:17:45.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.004+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~07KAWR7L0HA3.0 size=1048576 2024-09-12T00:17:45.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.008+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~07KAWR7L0HA3.1 size=743698 2024-09-12T00:17:45.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.008+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=07KAWR7L0HA3 tag=APWUJEINJ396 type=write size=2840850 2024-09-12T00:17:45.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.012+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~3HW302X9CU45.0 size=1048576 2024-09-12T00:17:45.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.016+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~3HW302X9CU45.1 size=1048576 2024-09-12T00:17:45.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.020+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~3HW302X9CU45.2 size=67203 2024-09-12T00:17:45.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.024+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=3HW302X9CU45 tag=8X0ABLRJ9ML0 type=write size=3212931 2024-09-12T00:17:45.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.032+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~GXHMHSA2SAE8.0 size=1048576 2024-09-12T00:17:45.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.036+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~GXHMHSA2SAE8.1 size=1048576 2024-09-12T00:17:45.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.040+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~GXHMHSA2SAE8.2 size=885476 2024-09-12T00:17:45.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.040+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=GXHMHSA2SAE8 tag=7LJPBW6OXJHI type=write size=4031204 2024-09-12T00:17:45.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.044+0000 7f69cdea98c0 -1 < failed to complete operation key=K4LNDJJUA1RZ tag=EGT3DMPKMHV5 type=del size=606192: (22) Invalid argument 2024-09-12T00:17:45.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.048+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=DJDS5Z356SJ3 type=del size=2390144 2024-09-12T00:17:45.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.052+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=OIRB1OM14B0W type=del 2024-09-12T00:17:45.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.056+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=GKIGC91S0RBH type=write size=418978 2024-09-12T00:17:45.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.064+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~T7WP4606XGUR.0 size=1048576 2024-09-12T00:17:45.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.076+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~T7WP4606XGUR.1 size=1048576 2024-09-12T00:17:45.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.080+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~T7WP4606XGUR.2 size=312540 2024-09-12T00:17:45.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.084+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=T7WP4606XGUR tag=T8EHULSGMGKI type=write size=3458268 2024-09-12T00:17:45.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.088+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=6PQGBI2660Z6 type=write size=323681 2024-09-12T00:17:45.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.092+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=HA6O2VZQDGQQ type=del 2024-09-12T00:17:45.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.096+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~4ID5SKYTJVGJ.0 size=1048576 2024-09-12T00:17:45.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~4ID5SKYTJVGJ.1 size=917876 2024-09-12T00:17:45.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.100+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=4ID5SKYTJVGJ tag=CQJ9QMJN60YN type=write size=3015028 2024-09-12T00:17:45.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.104+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=QDN92IR5D5DP type=write size=519806 2024-09-12T00:17:45.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.104+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=CIBTRL1FSRT1 type=del size=1611806 2024-09-12T00:17:45.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.108+0000 7f69cdea98c0 1 < canceled operation key=VYYY8MF0P3Q7 tag=QNIEQTI9U0DS type=del size=3307374 2024-09-12T00:17:45.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.112+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=N050QJF6WN9C type=del size=315855 2024-09-12T00:17:45.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.120+0000 7f69cdea98c0 1 < suggested update operation key=1CZXUEJLQ8FM tag=IPNTKOFKXMVI type=write size=287293 2024-09-12T00:17:45.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.124+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~RMQN41NI6RDP.0 size=1048576 2024-09-12T00:17:45.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~RMQN41NI6RDP.1 size=421736 2024-09-12T00:17:45.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.128+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=RMQN41NI6RDP tag=5JY3HO35UJC1 type=write size=2518888 2024-09-12T00:17:45.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.132+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=I3LEOI4Z0Y6X type=del 2024-09-12T00:17:45.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.132+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=I2SQCL7P04IV type=del size=3138096 2024-09-12T00:17:45.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.140+0000 7f69cdea98c0 1 < suggested update operation key=Z6MH459BTZ6K tag=QI9HJSO1X168 type=del size=2169458 2024-09-12T00:17:45.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.144+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=J0K277F3G3IL type=del size=2461622 2024-09-12T00:17:45.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.148+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~H7DKEAXEUGMV.0 size=1048576 2024-09-12T00:17:45.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.152+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~H7DKEAXEUGMV.1 size=1048576 2024-09-12T00:17:45.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.156+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~H7DKEAXEUGMV.2 size=199118 2024-09-12T00:17:45.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.160+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=H7DKEAXEUGMV tag=FIOUI1MZ6GTU type=write size=3344846 2024-09-12T00:17:45.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~EGVMHT76D1CQ.0 size=1048576 2024-09-12T00:17:45.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~EGVMHT76D1CQ.1 size=1048576 2024-09-12T00:17:45.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~EGVMHT76D1CQ.2 size=165392 2024-09-12T00:17:45.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.172+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=EGVMHT76D1CQ tag=87FTGI21YF3Z type=write size=3311120 2024-09-12T00:17:45.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.180+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=NKWLOF75H4NC type=del size=1798488 2024-09-12T00:17:45.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.184+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=ICBO134GBOUL type=write size=510238 2024-09-12T00:17:45.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.188+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=J02HQ0YQO2Y0 type=del 2024-09-12T00:17:45.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.192+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=7QB3V4F913JG type=del size=181544 2024-09-12T00:17:45.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.192+0000 7f69cdea98c0 1 < canceled part key=_multipart_Q0L8J0BYRFDQ.2~2M8U6VPVY5QM.0 size=1048576 2024-09-12T00:17:45.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.196+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~2M8U6VPVY5QM.1 size=545871 2024-09-12T00:17:45.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.200+0000 7f69cdea98c0 1 < canceled multipart upload key=Q0L8J0BYRFDQ upload=2M8U6VPVY5QM tag=C07D80IBJGBZ type=write size=2643023 2024-09-12T00:17:45.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.204+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=1VEUVA6MSVI3 type=del size=1618181 2024-09-12T00:17:45.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.208+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=UVCAL4ZP2PCG type=del 2024-09-12T00:17:45.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.212+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=T3PDXQ9E5JIH type=del size=857439 2024-09-12T00:17:45.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.216+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~07KAWR7L0HA3.0 size=1048576 2024-09-12T00:17:45.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.216+0000 7f69cdea98c0 1 < canceled part key=_multipart_IXWX7S5NWJS3.2~07KAWR7L0HA3.1 size=743698 2024-09-12T00:17:45.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.220+0000 7f69cdea98c0 1 < canceled multipart upload key=IXWX7S5NWJS3 upload=07KAWR7L0HA3 tag=APWUJEINJ396 type=write size=2840850 2024-09-12T00:17:45.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~LO7QK9SKX2SF.0 size=1048576 2024-09-12T00:17:45.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~LO7QK9SKX2SF.1 size=930755 2024-09-12T00:17:45.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.228+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=LO7QK9SKX2SF tag=J7L5E8ECASE0 type=write size=3027907 2024-09-12T00:17:45.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.232+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~GXHMHSA2SAE8.0 size=1048576 2024-09-12T00:17:45.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.236+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~GXHMHSA2SAE8.1 size=1048576 2024-09-12T00:17:45.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.240+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~GXHMHSA2SAE8.2 size=885476 2024-09-12T00:17:45.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.244+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=GXHMHSA2SAE8 tag=7LJPBW6OXJHI type=write size=4031204 2024-09-12T00:17:45.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.252+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~MCUZ56E0QRV0.0 size=168874 2024-09-12T00:17:45.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.252+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=MCUZ56E0QRV0 tag=62LOPRIKAQPZ type=write size=1217450 2024-09-12T00:17:45.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.252+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=DJDS5Z356SJ3 type=del 2024-09-12T00:17:45.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.256+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=2HGB2KGFBHM8 type=write size=350226 2024-09-12T00:17:45.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.260+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=GKIGC91S0RBH type=write size=418978 2024-09-12T00:17:45.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.264+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=2D8NPLOUGOYQ type=del size=1307800 2024-09-12T00:17:45.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.272+0000 7f69cdea98c0 1 < suggested remove operation key=VYYY8MF0P3Q7 tag=6PQGBI2660Z6 type=write 2024-09-12T00:17:45.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.276+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=F7E8872T0QHQ type=del size=3065555 2024-09-12T00:17:45.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.280+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~4ID5SKYTJVGJ.0 size=1048576 2024-09-12T00:17:45.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.280+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~4ID5SKYTJVGJ.1 size=917876 2024-09-12T00:17:45.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.288+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=4ID5SKYTJVGJ tag=CQJ9QMJN60YN type=write size=3015028 2024-09-12T00:17:45.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~X67LVUIK4V1Z.0 size=1048576 2024-09-12T00:17:45.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~X67LVUIK4V1Z.1 size=311676 2024-09-12T00:17:45.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.296+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=X67LVUIK4V1Z tag=4M2KUDBOO5HH type=write size=2408828 2024-09-12T00:17:45.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.300+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=CIBTRL1FSRT1 type=del 2024-09-12T00:17:45.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~89WLUY04YZLK.0 size=413125 2024-09-12T00:17:45.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.308+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=89WLUY04YZLK tag=MGHF21Y1XZEL type=write size=1461701 2024-09-12T00:17:45.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.312+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=N050QJF6WN9C type=del 2024-09-12T00:17:45.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.316+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~60BCI4GF1V28.0 size=389938 2024-09-12T00:17:45.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.316+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=60BCI4GF1V28 tag=DG8G0KV7BEZ7 type=write size=1438514 2024-09-12T00:17:45.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.320+0000 7f69cdea98c0 1 < canceled part key=_multipart_AWZ03VE7D86K.2~RMQN41NI6RDP.0 size=1048576 2024-09-12T00:17:45.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.320+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~RMQN41NI6RDP.1 size=421736 2024-09-12T00:17:45.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.328+0000 7f69cdea98c0 1 < canceled multipart upload key=AWZ03VE7D86K upload=RMQN41NI6RDP tag=5JY3HO35UJC1 type=write size=2518888 2024-09-12T00:17:45.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.332+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=APIINZ8GNE0U type=del size=2701688 2024-09-12T00:17:45.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.336+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=I2SQCL7P04IV type=del 2024-09-12T00:17:45.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.340+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=7XUI8HH162XL type=del size=3638301 2024-09-12T00:17:45.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.344+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=J0K277F3G3IL type=del 2024-09-12T00:17:45.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.348+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=QKZXTIYFGGGF type=del size=3852810 2024-09-12T00:17:45.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.352+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~EGVMHT76D1CQ.0 size=1048576 2024-09-12T00:17:45.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.356+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~EGVMHT76D1CQ.1 size=1048576 2024-09-12T00:17:45.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.356+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~EGVMHT76D1CQ.2 size=165392 2024-09-12T00:17:45.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.364+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=EGVMHT76D1CQ tag=87FTGI21YF3Z type=write size=3311120 2024-09-12T00:17:45.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.368+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=9DE8MG3O1215 type=del size=1654384 2024-09-12T00:17:45.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.372+0000 7f69cdea98c0 1 < completed write operation key=1CZXUEJLQ8FM tag=ICBO134GBOUL type=write size=510238 2024-09-12T00:17:45.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~I39JMTSBGLZR.0 size=1048576 2024-09-12T00:17:45.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.380+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~I39JMTSBGLZR.1 size=1048576 2024-09-12T00:17:45.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~I39JMTSBGLZR.2 size=540040 2024-09-12T00:17:45.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.384+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=I39JMTSBGLZR tag=LW05632IBKP6 type=write size=3685768 2024-09-12T00:17:45.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.388+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=7QB3V4F913JG type=del 2024-09-12T00:17:45.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.388+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=RJ141OGK1RA3 type=del size=2451245 2024-09-12T00:17:45.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.396+0000 7f69cdea98c0 1 < suggested remove operation key=0J667VAQGMTX tag=1VEUVA6MSVI3 type=del 2024-09-12T00:17:45.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~5C6633FGYWID.0 size=1048576 2024-09-12T00:17:45.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~5C6633FGYWID.1 size=1048576 2024-09-12T00:17:45.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~5C6633FGYWID.2 size=529609 2024-09-12T00:17:45.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.408+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=5C6633FGYWID tag=4YWRN9X6WSC3 type=write size=3675337 2024-09-12T00:17:45.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.416+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=T3PDXQ9E5JIH type=del 2024-09-12T00:17:45.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.416+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=CO6BG8HGAF0G type=del size=1841326 2024-09-12T00:17:45.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.420+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~LO7QK9SKX2SF.0 size=1048576 2024-09-12T00:17:45.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.420+0000 7f69cdea98c0 1 < canceled part key=_multipart_K0HNNMX7CDGC.2~LO7QK9SKX2SF.1 size=930755 2024-09-12T00:17:45.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.428+0000 7f69cdea98c0 1 < canceled multipart upload key=K0HNNMX7CDGC upload=LO7QK9SKX2SF tag=J7L5E8ECASE0 type=write size=3027907 2024-09-12T00:17:45.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.432+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=QWIWB5DVFR8Z type=del size=763978 2024-09-12T00:17:45.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.436+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~MCUZ56E0QRV0.0 size=168874 2024-09-12T00:17:45.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.444+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=MCUZ56E0QRV0 tag=62LOPRIKAQPZ type=write size=1217450 2024-09-12T00:17:45.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.444+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=5UCLNGX1ZFDT type=write size=453524 2024-09-12T00:17:45.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.448+0000 7f69cdea98c0 1 < completed write operation key=LRHZKCU22AIX tag=2HGB2KGFBHM8 type=write size=350226 2024-09-12T00:17:45.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.452+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=SR37VUYQX6EI type=del size=1042779 2024-09-12T00:17:45.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.456+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=2D8NPLOUGOYQ type=del 2024-09-12T00:17:45.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.460+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=QXZH3IJJ9HVH type=del size=3645918 2024-09-12T00:17:45.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.464+0000 7f69cdea98c0 1 < canceled operation key=LRHZKCU22AIX tag=F7E8872T0QHQ type=del size=3065555 2024-09-12T00:17:45.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~GHBI5ICWXKEX.0 size=1048576 2024-09-12T00:17:45.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~GHBI5ICWXKEX.1 size=1048576 2024-09-12T00:17:45.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~GHBI5ICWXKEX.2 size=823906 2024-09-12T00:17:45.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.476+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=GHBI5ICWXKEX tag=M134CBSVATBB type=write size=3969634 2024-09-12T00:17:45.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.480+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~X67LVUIK4V1Z.0 size=1048576 2024-09-12T00:17:45.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.484+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~X67LVUIK4V1Z.1 size=311676 2024-09-12T00:17:45.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.492+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=X67LVUIK4V1Z tag=4M2KUDBOO5HH type=write size=2408828 2024-09-12T00:17:45.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.496+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=9YW0298YAOV4 type=write size=984905 2024-09-12T00:17:45.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.500+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~89WLUY04YZLK.0 size=413125 2024-09-12T00:17:45.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.504+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=89WLUY04YZLK tag=MGHF21Y1XZEL type=write size=1461701 2024-09-12T00:17:45.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.508+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=ZM2BMESYYG3I type=write size=138073 2024-09-12T00:17:45.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.512+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~60BCI4GF1V28.0 size=389938 2024-09-12T00:17:45.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.520+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=60BCI4GF1V28 tag=DG8G0KV7BEZ7 type=write size=1438514 2024-09-12T00:17:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~YGDMOPWITAUS.0 size=1048576 2024-09-12T00:17:45.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~YGDMOPWITAUS.1 size=1048576 2024-09-12T00:17:45.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.532+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~YGDMOPWITAUS.2 size=886521 2024-09-12T00:17:45.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.532+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=YGDMOPWITAUS tag=CWLS77ZHC2ZY type=write size=4032249 2024-09-12T00:17:45.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.536+0000 7f69cdea98c0 1 < canceled operation key=1CZXUEJLQ8FM tag=APIINZ8GNE0U type=del size=2701688 2024-09-12T00:17:45.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.544+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~GMR45351V92K.0 size=1048576 2024-09-12T00:17:45.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.544+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~GMR45351V92K.1 size=348122 2024-09-12T00:17:45.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.544+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=GMR45351V92K tag=78Q4CR8UNLOX type=write size=2445274 2024-09-12T00:17:45.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.548+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=7XUI8HH162XL type=del 2024-09-12T00:17:45.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.552+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=T3514QKAHISW type=write size=654432 2024-09-12T00:17:45.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.560+0000 7f69cdea98c0 1 < suggested remove operation key=4O5U4WX3N4SA tag=QKZXTIYFGGGF type=del 2024-09-12T00:17:45.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.564+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~6RQEEQ0WBX7S.0 size=314836 2024-09-12T00:17:45.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.564+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=6RQEEQ0WBX7S tag=4L1TATK25ERL type=write size=1363412 2024-09-12T00:17:45.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.568+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=9DE8MG3O1215 type=del 2024-09-12T00:17:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.572+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=01CRHSJ8QF9K type=del size=434379 2024-09-12T00:17:45.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.576+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~I39JMTSBGLZR.0 size=1048576 2024-09-12T00:17:45.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.580+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~I39JMTSBGLZR.1 size=1048576 2024-09-12T00:17:45.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.584+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~I39JMTSBGLZR.2 size=540040 2024-09-12T00:17:45.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.588+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=I39JMTSBGLZR tag=LW05632IBKP6 type=write size=3685768 2024-09-12T00:17:45.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~N4X4SAP0Z3BF.0 size=1048576 2024-09-12T00:17:45.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.600+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~N4X4SAP0Z3BF.1 size=350144 2024-09-12T00:17:45.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.600+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=N4X4SAP0Z3BF tag=W7L1JH4Z0QPD type=write size=2447296 2024-09-12T00:17:45.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.604+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=RJ141OGK1RA3 type=del 2024-09-12T00:17:45.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.608+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~6DLS3GPQONCW.0 size=1048576 2024-09-12T00:17:45.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.612+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~6DLS3GPQONCW.1 size=1048576 2024-09-12T00:17:45.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.616+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~6DLS3GPQONCW.2 size=543753 2024-09-12T00:17:45.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.616+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=6DLS3GPQONCW tag=I8OTVYJTX7PC type=write size=3689481 2024-09-12T00:17:45.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.620+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~5C6633FGYWID.0 size=1048576 2024-09-12T00:17:45.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.620+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~5C6633FGYWID.1 size=1048576 2024-09-12T00:17:45.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.624+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~5C6633FGYWID.2 size=529609 2024-09-12T00:17:45.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.632+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=5C6633FGYWID tag=4YWRN9X6WSC3 type=write size=3675337 2024-09-12T00:17:45.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.636+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=UXC3Y08N48AO type=del size=297033 2024-09-12T00:17:45.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.640+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=CO6BG8HGAF0G type=del 2024-09-12T00:17:45.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.644+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~YM4N8LLR85BV.0 size=1048576 2024-09-12T00:17:45.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.648+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~YM4N8LLR85BV.1 size=77331 2024-09-12T00:17:45.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.648+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=YM4N8LLR85BV tag=YZX75AG3JX81 type=write size=2174483 2024-09-12T00:17:45.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.652+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=QWIWB5DVFR8Z type=del 2024-09-12T00:17:45.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.656+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=F2AS1072SABO type=write size=363921 2024-09-12T00:17:45.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.660+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=5UCLNGX1ZFDT type=write size=453524 2024-09-12T00:17:45.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.664+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=TXL0LM1JZYZ2 type=write size=395295 2024-09-12T00:17:45.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.668+0000 7f69cdea98c0 -1 < failed to complete operation key=4O5U4WX3N4SA tag=SR37VUYQX6EI type=del size=1042779: (22) Invalid argument 2024-09-12T00:17:45.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.672+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=5J5DFI3Q22CE type=del size=697279 2024-09-12T00:17:45.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.676+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=QXZH3IJJ9HVH type=del 2024-09-12T00:17:45.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.680+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~V43M9CMW1LA8.0 size=1048576 2024-09-12T00:17:45.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~V43M9CMW1LA8.1 size=930866 2024-09-12T00:17:45.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.684+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=V43M9CMW1LA8 tag=ZZM1T7D71WH0 type=write size=3028018 2024-09-12T00:17:45.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.688+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~GHBI5ICWXKEX.0 size=1048576 2024-09-12T00:17:45.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.692+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~GHBI5ICWXKEX.1 size=1048576 2024-09-12T00:17:45.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.696+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~GHBI5ICWXKEX.2 size=823906 2024-09-12T00:17:45.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.700+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=GHBI5ICWXKEX tag=M134CBSVATBB type=write size=3969634 2024-09-12T00:17:45.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.704+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=UO67XQQ1WOZB type=del size=2223423 2024-09-12T00:17:45.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.708+0000 7f69cdea98c0 1 < canceled operation key=HSQZYI0SNZP1 tag=9YW0298YAOV4 type=write size=984905 2024-09-12T00:17:45.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.712+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=NG89JL2UBDA6 type=del size=2467465 2024-09-12T00:17:45.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.716+0000 7f69cdea98c0 1 < canceled operation key=YS23U9GQS7SJ tag=ZM2BMESYYG3I type=write size=138073 2024-09-12T00:17:45.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.724+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~UN5R21OKB3EZ.0 size=1048576 2024-09-12T00:17:45.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~UN5R21OKB3EZ.1 size=1048576 2024-09-12T00:17:45.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~UN5R21OKB3EZ.2 size=218494 2024-09-12T00:17:45.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.728+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=UN5R21OKB3EZ tag=TT08TVMH8F2V type=write size=3364222 2024-09-12T00:17:45.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.732+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~YGDMOPWITAUS.0 size=1048576 2024-09-12T00:17:45.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.736+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~YGDMOPWITAUS.1 size=1048576 2024-09-12T00:17:45.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.740+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~YGDMOPWITAUS.2 size=886521 2024-09-12T00:17:45.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.748+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=YGDMOPWITAUS tag=CWLS77ZHC2ZY type=write size=4032249 2024-09-12T00:17:45.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.752+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=AEKAS1WOBPGV type=del size=183335 2024-09-12T00:17:45.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.756+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~GMR45351V92K.0 size=1048576 2024-09-12T00:17:45.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.756+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~GMR45351V92K.1 size=348122 2024-09-12T00:17:45.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.764+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=GMR45351V92K tag=78Q4CR8UNLOX type=write size=2445274 2024-09-12T00:17:45.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.768+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=8XRBJOI0QKQG type=del size=1849745 2024-09-12T00:17:45.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.772+0000 7f69cdea98c0 1 < completed write operation key=IXWX7S5NWJS3 tag=T3514QKAHISW type=write size=654432 2024-09-12T00:17:45.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.776+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=H14OEIIN8KXW type=del size=4054526 2024-09-12T00:17:45.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.780+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~6RQEEQ0WBX7S.0 size=314836 2024-09-12T00:17:45.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.788+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=6RQEEQ0WBX7S tag=4L1TATK25ERL type=write size=1363412 2024-09-12T00:17:45.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.792+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=UF7UGL2H30Y3 type=del size=3148941 2024-09-12T00:17:45.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.796+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=01CRHSJ8QF9K type=del 2024-09-12T00:17:45.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.800+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=0O9L9S631J43 type=del size=4174304 2024-09-12T00:17:45.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.804+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~N4X4SAP0Z3BF.0 size=1048576 2024-09-12T00:17:45.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.804+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~N4X4SAP0Z3BF.1 size=350144 2024-09-12T00:17:45.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.808+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=N4X4SAP0Z3BF tag=W7L1JH4Z0QPD type=write size=2447296 2024-09-12T00:17:45.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.816+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~AMLAJRGJXZAZ.0 size=1048576 2024-09-12T00:17:45.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.816+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~AMLAJRGJXZAZ.1 size=155991 2024-09-12T00:17:45.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.816+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=AMLAJRGJXZAZ tag=BK4AGET6XHAU type=write size=2253143 2024-09-12T00:17:45.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.820+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~6DLS3GPQONCW.0 size=1048576 2024-09-12T00:17:45.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.824+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~6DLS3GPQONCW.1 size=1048576 2024-09-12T00:17:45.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.828+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~6DLS3GPQONCW.2 size=543753 2024-09-12T00:17:45.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.836+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=6DLS3GPQONCW tag=I8OTVYJTX7PC type=write size=3689481 2024-09-12T00:17:45.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.836+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=WXK78YFT5P0H type=write size=967543 2024-09-12T00:17:45.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.840+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=UXC3Y08N48AO type=del 2024-09-12T00:17:45.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~XE4T4Z3H4RA1.0 size=1048576 2024-09-12T00:17:45.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.852+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~XE4T4Z3H4RA1.1 size=943619 2024-09-12T00:17:45.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.852+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=XE4T4Z3H4RA1 tag=P4T84WLTK2YI type=write size=3040771 2024-09-12T00:17:45.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.856+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~YM4N8LLR85BV.0 size=1048576 2024-09-12T00:17:45.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.860+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~YM4N8LLR85BV.1 size=77331 2024-09-12T00:17:45.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.868+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=YM4N8LLR85BV tag=YZX75AG3JX81 type=write size=2174483 2024-09-12T00:17:45.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.872+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=VWIP2I5RH48G type=write size=598998 2024-09-12T00:17:45.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.876+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=F2AS1072SABO type=write size=363921 2024-09-12T00:17:45.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~UTRPVC4F0GQP.0 size=1048576 2024-09-12T00:17:45.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~UTRPVC4F0GQP.1 size=1048576 2024-09-12T00:17:45.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.888+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~UTRPVC4F0GQP.2 size=868512 2024-09-12T00:17:45.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.888+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=UTRPVC4F0GQP tag=YDZXI7QCP1E8 type=write size=4014240 2024-09-12T00:17:45.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.892+0000 7f69cdea98c0 1 < canceled operation key=Q0L8J0BYRFDQ tag=TXL0LM1JZYZ2 type=write size=395295 2024-09-12T00:17:45.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.900+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~N42GYO3U2SXL.0 size=1048576 2024-09-12T00:17:45.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.904+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~N42GYO3U2SXL.1 size=1048576 2024-09-12T00:17:45.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.908+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~N42GYO3U2SXL.2 size=701124 2024-09-12T00:17:45.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.908+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=N42GYO3U2SXL tag=DUIQKCHTLSIB type=write size=3846852 2024-09-12T00:17:45.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.912+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=5J5DFI3Q22CE type=del 2024-09-12T00:17:45.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.916+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~CIH0GGL0IN60.0 size=1048576 2024-09-12T00:17:45.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.920+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~CIH0GGL0IN60.1 size=1048576 2024-09-12T00:17:45.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.924+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~CIH0GGL0IN60.2 size=582028 2024-09-12T00:17:45.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.924+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=CIH0GGL0IN60 tag=93H6M00J5EYI type=write size=3727756 2024-09-12T00:17:45.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.928+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~V43M9CMW1LA8.0 size=1048576 2024-09-12T00:17:45.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.928+0000 7f69cdea98c0 1 < canceled part key=_multipart_RDGRKQQH4B8C.2~V43M9CMW1LA8.1 size=930866 2024-09-12T00:17:45.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.936+0000 7f69cdea98c0 1 < canceled multipart upload key=RDGRKQQH4B8C upload=V43M9CMW1LA8 tag=ZZM1T7D71WH0 type=write size=3028018 2024-09-12T00:17:45.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.940+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=TDVFW2CDBU30 type=write size=677222 2024-09-12T00:17:45.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.944+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=UO67XQQ1WOZB type=del 2024-09-12T00:17:45.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.948+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=GANWHDALI21Q type=write size=634706 2024-09-12T00:17:45.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.952+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=NG89JL2UBDA6 type=del 2024-09-12T00:17:45.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.956+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~763L0VFFK9W9.0 size=1048576 2024-09-12T00:17:45.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.960+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~763L0VFFK9W9.1 size=592859 2024-09-12T00:17:45.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.960+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=763L0VFFK9W9 tag=MPIZ7X9CS5JZ type=write size=2690011 2024-09-12T00:17:45.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.960+0000 7f69cdea98c0 1 < canceled part key=_multipart_SP2KVAO82MQ0.2~UN5R21OKB3EZ.0 size=1048576 2024-09-12T00:17:45.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.964+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~UN5R21OKB3EZ.1 size=1048576 2024-09-12T00:17:45.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.968+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~UN5R21OKB3EZ.2 size=218494 2024-09-12T00:17:45.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.972+0000 7f69cdea98c0 1 < canceled multipart upload key=SP2KVAO82MQ0 upload=UN5R21OKB3EZ tag=TT08TVMH8F2V type=write size=3364222 2024-09-12T00:17:45.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.980+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~Z55HB14H20DM.0 size=1048576 2024-09-12T00:17:45.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~Z55HB14H20DM.1 size=1048576 2024-09-12T00:17:45.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~Z55HB14H20DM.2 size=840524 2024-09-12T00:17:45.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.984+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=Z55HB14H20DM tag=H8NFDSAHJENW type=write size=3986252 2024-09-12T00:17:45.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.992+0000 7f69cdea98c0 1 < suggested update operation key=AQY7MM3OX3GW tag=AEKAS1WOBPGV type=del size=183335 2024-09-12T00:17:45.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.992+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=IZJ5MF1GYS1F type=del size=1258349 2024-09-12T00:17:45.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:45.996+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=8XRBJOI0QKQG type=del 2024-09-12T00:17:45.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.000+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=61ADLVD9L5D3 type=del size=2607714 2024-09-12T00:17:46.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.004+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=H14OEIIN8KXW type=del 2024-09-12T00:17:46.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.004+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=4VFHP38Z5E9Y type=del size=2911950 2024-09-12T00:17:46.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.008+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=UF7UGL2H30Y3 type=del 2024-09-12T00:17:46.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.016+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~I6ZQ91J5VMS5.0 size=944509 2024-09-12T00:17:46.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.016+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=I6ZQ91J5VMS5 tag=X4XSZUEW7STU type=write size=1993085 2024-09-12T00:17:46.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.016+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=0O9L9S631J43 type=del 2024-09-12T00:17:46.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.020+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=0D2J11JB898H type=del size=4128710 2024-09-12T00:17:46.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.024+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~AMLAJRGJXZAZ.0 size=1048576 2024-09-12T00:17:46.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.028+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~AMLAJRGJXZAZ.1 size=155991 2024-09-12T00:17:46.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.032+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=AMLAJRGJXZAZ tag=BK4AGET6XHAU type=write size=2253143 2024-09-12T00:17:46.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.032+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=NOR9ITGJNGNA type=write size=711824 2024-09-12T00:17:46.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.036+0000 7f69cdea98c0 1 < completed write operation key=SP2KVAO82MQ0 tag=WXK78YFT5P0H type=write size=967543 2024-09-12T00:17:46.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~JZRLMZ7FL5QO.0 size=1048576 2024-09-12T00:17:46.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~JZRLMZ7FL5QO.1 size=1048576 2024-09-12T00:17:46.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~JZRLMZ7FL5QO.2 size=896956 2024-09-12T00:17:46.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.048+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=JZRLMZ7FL5QO tag=ZYID1V3P26L7 type=write size=4042684 2024-09-12T00:17:46.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.052+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~XE4T4Z3H4RA1.0 size=1048576 2024-09-12T00:17:46.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.052+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~XE4T4Z3H4RA1.1 size=943619 2024-09-12T00:17:46.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.060+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=XE4T4Z3H4RA1 tag=P4T84WLTK2YI type=write size=3040771 2024-09-12T00:17:46.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.064+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=1ZDUL2AKC5ZC type=del size=1245886 2024-09-12T00:17:46.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.064+0000 7f69cdea98c0 1 < completed write operation key=HSQZYI0SNZP1 tag=VWIP2I5RH48G type=write size=598998 2024-09-12T00:17:46.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~KJHTQPCJ5S5C.0 size=967424 2024-09-12T00:17:46.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.072+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=KJHTQPCJ5S5C tag=AAE4IM15LWU6 type=write size=2016000 2024-09-12T00:17:46.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.076+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~UTRPVC4F0GQP.0 size=1048576 2024-09-12T00:17:46.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.076+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~UTRPVC4F0GQP.1 size=1048576 2024-09-12T00:17:46.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.080+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~UTRPVC4F0GQP.2 size=868512 2024-09-12T00:17:46.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.084+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=UTRPVC4F0GQP tag=YDZXI7QCP1E8 type=write size=4014240 2024-09-12T00:17:46.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.088+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=TBLKT891MDI2 type=del size=3856329 2024-09-12T00:17:46.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.096+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~N42GYO3U2SXL.0 size=1048576 2024-09-12T00:17:46.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.100+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~N42GYO3U2SXL.1 size=1048576 2024-09-12T00:17:46.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.104+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~N42GYO3U2SXL.2 size=701124 2024-09-12T00:17:46.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.108+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=N42GYO3U2SXL tag=DUIQKCHTLSIB type=write size=3846852 2024-09-12T00:17:46.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.112+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=0H1DHASHET4X type=del size=354344 2024-09-12T00:17:46.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.116+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~CIH0GGL0IN60.0 size=1048576 2024-09-12T00:17:46.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.116+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~CIH0GGL0IN60.1 size=1048576 2024-09-12T00:17:46.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.120+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~CIH0GGL0IN60.2 size=582028 2024-09-12T00:17:46.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.124+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=CIH0GGL0IN60 tag=93H6M00J5EYI type=write size=3727756 2024-09-12T00:17:46.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~EHI36K8EF8CK.0 size=1048576 2024-09-12T00:17:46.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~EHI36K8EF8CK.1 size=41486 2024-09-12T00:17:46.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.132+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=EHI36K8EF8CK tag=LL52MY9UKIZ3 type=write size=2138638 2024-09-12T00:17:46.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.136+0000 7f69cdea98c0 1 < completed write operation key=SCFIVX3IHERR tag=TDVFW2CDBU30 type=write size=677222 2024-09-12T00:17:46.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~MPBAFAMIFG6S.0 size=1048576 2024-09-12T00:17:46.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~MPBAFAMIFG6S.1 size=507089 2024-09-12T00:17:46.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.144+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=MPBAFAMIFG6S tag=SRLRD6MK4B9Z type=write size=2604241 2024-09-12T00:17:46.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.148+0000 7f69cdea98c0 1 < canceled operation key=LRHZKCU22AIX tag=GANWHDALI21Q type=write size=634706 2024-09-12T00:17:46.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.148+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=AOZ5FM3NP3F9 type=del size=3303919 2024-09-12T00:17:46.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.152+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~763L0VFFK9W9.0 size=1048576 2024-09-12T00:17:46.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.156+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~763L0VFFK9W9.1 size=592859 2024-09-12T00:17:46.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.160+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=763L0VFFK9W9 tag=MPIZ7X9CS5JZ type=write size=2690011 2024-09-12T00:17:46.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.164+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~DTQKG6J6O8EO.0 size=1048576 2024-09-12T00:17:46.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~DTQKG6J6O8EO.1 size=1048576 2024-09-12T00:17:46.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~DTQKG6J6O8EO.2 size=398906 2024-09-12T00:17:46.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.172+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=DTQKG6J6O8EO tag=J8QROZTPCIMR type=write size=3544634 2024-09-12T00:17:46.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.176+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~Z55HB14H20DM.0 size=1048576 2024-09-12T00:17:46.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.176+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~Z55HB14H20DM.1 size=1048576 2024-09-12T00:17:46.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.180+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~Z55HB14H20DM.2 size=840524 2024-09-12T00:17:46.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.184+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=Z55HB14H20DM tag=H8NFDSAHJENW type=write size=3986252 2024-09-12T00:17:46.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.188+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=OM9QA3SGWRHC type=del size=1656084 2024-09-12T00:17:46.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.196+0000 7f69cdea98c0 1 < suggested update operation key=SCFIVX3IHERR tag=IZJ5MF1GYS1F type=del size=1258349 2024-09-12T00:17:46.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.204+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~RK41F1B491MY.0 size=1048576 2024-09-12T00:17:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.204+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~RK41F1B491MY.1 size=329547 2024-09-12T00:17:46.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.204+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=RK41F1B491MY tag=QTBYBSHQRCEL type=write size=2426699 2024-09-12T00:17:46.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.208+0000 7f69cdea98c0 1 < canceled operation key=T9OJXTZNRQJB tag=61ADLVD9L5D3 type=del size=2607714 2024-09-12T00:17:46.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.216+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~G9VZ907M1S3E.0 size=1048576 2024-09-12T00:17:46.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.216+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~G9VZ907M1S3E.1 size=1048576 2024-09-12T00:17:46.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.220+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~G9VZ907M1S3E.2 size=770621 2024-09-12T00:17:46.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.220+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=G9VZ907M1S3E tag=GJI3WG8P3YBE type=write size=3916349 2024-09-12T00:17:46.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.224+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=4VFHP38Z5E9Y type=del 2024-09-12T00:17:46.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.232+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~596N7P4Q6Q6N.0 size=1048576 2024-09-12T00:17:46.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.232+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~596N7P4Q6Q6N.1 size=935555 2024-09-12T00:17:46.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.232+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=596N7P4Q6Q6N tag=TP0KPUL7GYYM type=write size=3032707 2024-09-12T00:17:46.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.236+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~I6ZQ91J5VMS5.0 size=944509 2024-09-12T00:17:46.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.244+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=I6ZQ91J5VMS5 tag=X4XSZUEW7STU type=write size=1993085 2024-09-12T00:17:46.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.252+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~DVXYLNHS063W.0 size=1048576 2024-09-12T00:17:46.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.252+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~DVXYLNHS063W.1 size=1048576 2024-09-12T00:17:46.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.256+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~DVXYLNHS063W.2 size=41868 2024-09-12T00:17:46.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.256+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=DVXYLNHS063W tag=TF1SGC1H4AW2 type=write size=3187596 2024-09-12T00:17:46.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.260+0000 7f69cdea98c0 1 < canceled operation key=T9OJXTZNRQJB tag=0D2J11JB898H type=del size=4128710 2024-09-12T00:17:46.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.268+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~50DMK9ZCADH0.0 size=1048576 2024-09-12T00:17:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.268+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~50DMK9ZCADH0.1 size=1048576 2024-09-12T00:17:46.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~50DMK9ZCADH0.2 size=462654 2024-09-12T00:17:46.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.272+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=50DMK9ZCADH0 tag=6S6U33Y4VLAC type=write size=3608382 2024-09-12T00:17:46.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.276+0000 7f69cdea98c0 1 < completed write operation key=1CZXUEJLQ8FM tag=NOR9ITGJNGNA type=write size=711824 2024-09-12T00:17:46.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.280+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=SU4VL5JVXXCW type=write size=622743 2024-09-12T00:17:46.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.284+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~JZRLMZ7FL5QO.0 size=1048576 2024-09-12T00:17:46.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.288+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~JZRLMZ7FL5QO.1 size=1048576 2024-09-12T00:17:46.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.288+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~JZRLMZ7FL5QO.2 size=896956 2024-09-12T00:17:46.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.296+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=JZRLMZ7FL5QO tag=ZYID1V3P26L7 type=write size=4042684 2024-09-12T00:17:46.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.300+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=I5ZW6IYAQJSY type=del size=74194 2024-09-12T00:17:46.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.304+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=1ZDUL2AKC5ZC type=del 2024-09-12T00:17:46.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.308+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=LPTAVONCXG95 type=del size=284059 2024-09-12T00:17:46.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.308+0000 7f69cdea98c0 1 < canceled part key=_multipart_RDGRKQQH4B8C.2~KJHTQPCJ5S5C.0 size=967424 2024-09-12T00:17:46.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.316+0000 7f69cdea98c0 1 < canceled multipart upload key=RDGRKQQH4B8C upload=KJHTQPCJ5S5C tag=AAE4IM15LWU6 type=write size=2016000 2024-09-12T00:17:46.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.320+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~X062ED6S8I84.0 size=599960 2024-09-12T00:17:46.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.320+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=X062ED6S8I84 tag=2XRGGHEZB6JU type=write size=1648536 2024-09-12T00:17:46.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.328+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=TBLKT891MDI2 type=del 2024-09-12T00:17:46.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.332+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=6K5BMB7TNNY6 type=del size=3393919 2024-09-12T00:17:46.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.340+0000 7f69cdea98c0 1 < suggested remove operation key=K0HNNMX7CDGC tag=0H1DHASHET4X type=del 2024-09-12T00:17:46.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.348+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~08TLS7M8J9RG.0 size=1048576 2024-09-12T00:17:46.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.348+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~08TLS7M8J9RG.1 size=751669 2024-09-12T00:17:46.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.348+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=08TLS7M8J9RG tag=NTTV7GQUZKLB type=write size=2848821 2024-09-12T00:17:46.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.352+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~EHI36K8EF8CK.0 size=1048576 2024-09-12T00:17:46.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.356+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~EHI36K8EF8CK.1 size=41486 2024-09-12T00:17:46.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.360+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=EHI36K8EF8CK tag=LL52MY9UKIZ3 type=write size=2138638 2024-09-12T00:17:46.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.368+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~9NNW4HLZNNAX.0 size=1048576 2024-09-12T00:17:46.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~9NNW4HLZNNAX.1 size=1048576 2024-09-12T00:17:46.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~9NNW4HLZNNAX.2 size=854488 2024-09-12T00:17:46.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.372+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=9NNW4HLZNNAX tag=4UVX5WHC0J8O type=write size=4000216 2024-09-12T00:17:46.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.376+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~MPBAFAMIFG6S.0 size=1048576 2024-09-12T00:17:46.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.380+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~MPBAFAMIFG6S.1 size=507089 2024-09-12T00:17:46.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.388+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=MPBAFAMIFG6S tag=SRLRD6MK4B9Z type=write size=2604241 2024-09-12T00:17:46.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.388+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=JDFRW6TFY7H1 type=del size=1832380 2024-09-12T00:17:46.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.396+0000 7f69cdea98c0 1 < suggested update operation key=RDGRKQQH4B8C tag=AOZ5FM3NP3F9 type=del size=3303919 2024-09-12T00:17:46.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~NC8SENCNSTCK.0 size=1048576 2024-09-12T00:17:46.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~NC8SENCNSTCK.1 size=1048576 2024-09-12T00:17:46.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~NC8SENCNSTCK.2 size=286394 2024-09-12T00:17:46.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.408+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=NC8SENCNSTCK tag=WK1ZH0FT3WOU type=write size=3432122 2024-09-12T00:17:46.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.412+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~DTQKG6J6O8EO.0 size=1048576 2024-09-12T00:17:46.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.416+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~DTQKG6J6O8EO.1 size=1048576 2024-09-12T00:17:46.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.420+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~DTQKG6J6O8EO.2 size=398906 2024-09-12T00:17:46.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.424+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=DTQKG6J6O8EO tag=J8QROZTPCIMR type=write size=3544634 2024-09-12T00:17:46.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.428+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=08J0ER18UHWK type=del size=2932483 2024-09-12T00:17:46.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.432+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=OM9QA3SGWRHC type=del 2024-09-12T00:17:46.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.436+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=UHUAEEAUAGJI type=del size=2391370 2024-09-12T00:17:46.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.440+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~RK41F1B491MY.0 size=1048576 2024-09-12T00:17:46.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.444+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~RK41F1B491MY.1 size=329547 2024-09-12T00:17:46.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.448+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=RK41F1B491MY tag=QTBYBSHQRCEL type=write size=2426699 2024-09-12T00:17:46.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~77N3X0QRK2C9.0 size=975604 2024-09-12T00:17:46.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.456+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=77N3X0QRK2C9 tag=71QGISOXRJB4 type=write size=2024180 2024-09-12T00:17:46.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.460+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~G9VZ907M1S3E.0 size=1048576 2024-09-12T00:17:46.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.460+0000 7f69cdea98c0 1 < canceled part key=_multipart_2X78JWLK876H.2~G9VZ907M1S3E.1 size=1048576 2024-09-12T00:17:46.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.464+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~G9VZ907M1S3E.2 size=770621 2024-09-12T00:17:46.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.468+0000 7f69cdea98c0 1 < canceled multipart upload key=2X78JWLK876H upload=G9VZ907M1S3E tag=GJI3WG8P3YBE type=write size=3916349 2024-09-12T00:17:46.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.472+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=ESBLLLRXM88N type=del size=3674909 2024-09-12T00:17:46.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.476+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~596N7P4Q6Q6N.0 size=1048576 2024-09-12T00:17:46.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.476+0000 7f69cdea98c0 1 < canceled part key=_multipart_Q0L8J0BYRFDQ.2~596N7P4Q6Q6N.1 size=935555 2024-09-12T00:17:46.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.484+0000 7f69cdea98c0 1 < canceled multipart upload key=Q0L8J0BYRFDQ upload=596N7P4Q6Q6N tag=TP0KPUL7GYYM type=write size=3032707 2024-09-12T00:17:46.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.488+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=FR8X3VLKH8DQ type=del size=3564572 2024-09-12T00:17:46.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.492+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~DVXYLNHS063W.0 size=1048576 2024-09-12T00:17:46.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.496+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~DVXYLNHS063W.1 size=1048576 2024-09-12T00:17:46.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.500+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~DVXYLNHS063W.2 size=41868 2024-09-12T00:17:46.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.504+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=DVXYLNHS063W tag=TF1SGC1H4AW2 type=write size=3187596 2024-09-12T00:17:46.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.512+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=RWMQBC8DMQ7Z type=del size=3298001 2024-09-12T00:17:46.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.516+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~50DMK9ZCADH0.0 size=1048576 2024-09-12T00:17:46.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.520+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~50DMK9ZCADH0.1 size=1048576 2024-09-12T00:17:46.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.520+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~50DMK9ZCADH0.2 size=462654 2024-09-12T00:17:46.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.528+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=50DMK9ZCADH0 tag=6S6U33Y4VLAC type=write size=3608382 2024-09-12T00:17:46.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~D9MZYR7UEOZ7.0 size=1048576 2024-09-12T00:17:46.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~D9MZYR7UEOZ7.1 size=955244 2024-09-12T00:17:46.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.536+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=D9MZYR7UEOZ7 tag=682OHFC29L9Y type=write size=3052396 2024-09-12T00:17:46.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.540+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=SU4VL5JVXXCW type=write size=622743 2024-09-12T00:17:46.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.544+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=OMNIECJESR41 type=del size=3341847 2024-09-12T00:17:46.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.548+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=I5ZW6IYAQJSY type=del 2024-09-12T00:17:46.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.556+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~2AJ64361NDG4.0 size=2223 2024-09-12T00:17:46.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.556+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=2AJ64361NDG4 tag=MAVQRTIPEV80 type=write size=1050799 2024-09-12T00:17:46.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.560+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=LPTAVONCXG95 type=del 2024-09-12T00:17:46.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.568+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~B5XSKXLAJJX0.0 size=1048576 2024-09-12T00:17:46.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.572+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~B5XSKXLAJJX0.1 size=1047882 2024-09-12T00:17:46.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.572+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=B5XSKXLAJJX0 tag=Y52I912LJVN2 type=write size=3145034 2024-09-12T00:17:46.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.576+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~X062ED6S8I84.0 size=599960 2024-09-12T00:17:46.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.584+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=X062ED6S8I84 tag=2XRGGHEZB6JU type=write size=1648536 2024-09-12T00:17:46.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.588+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=J0NBQKLR544D type=del size=2862916 2024-09-12T00:17:46.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.592+0000 7f69cdea98c0 -1 < failed to complete operation key=K0HNNMX7CDGC tag=6K5BMB7TNNY6 type=del size=3393919: (22) Invalid argument 2024-09-12T00:17:46.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.596+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=360PBZR0RBEX type=write size=130937 2024-09-12T00:17:46.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.600+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~08TLS7M8J9RG.0 size=1048576 2024-09-12T00:17:46.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.600+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~08TLS7M8J9RG.1 size=751669 2024-09-12T00:17:46.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.608+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=08TLS7M8J9RG tag=NTTV7GQUZKLB type=write size=2848821 2024-09-12T00:17:46.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.612+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=KHT0DXROAK7S type=del size=3934651 2024-09-12T00:17:46.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.616+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~9NNW4HLZNNAX.0 size=1048576 2024-09-12T00:17:46.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.620+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~9NNW4HLZNNAX.1 size=1048576 2024-09-12T00:17:46.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.620+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~9NNW4HLZNNAX.2 size=854488 2024-09-12T00:17:46.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.628+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=9NNW4HLZNNAX tag=4UVX5WHC0J8O type=write size=4000216 2024-09-12T00:17:46.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.636+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~23M8EJSPU6MP.0 size=1048576 2024-09-12T00:17:46.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.640+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~23M8EJSPU6MP.1 size=642245 2024-09-12T00:17:46.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.640+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=23M8EJSPU6MP tag=9NUZX1JW3JNO type=write size=2739397 2024-09-12T00:17:46.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.644+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=JDFRW6TFY7H1 type=del 2024-09-12T00:17:46.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~BDKVT121AZMK.0 size=1048576 2024-09-12T00:17:46.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~BDKVT121AZMK.1 size=787798 2024-09-12T00:17:46.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.656+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=BDKVT121AZMK tag=4JLNGT8SBFNB type=write size=2884950 2024-09-12T00:17:46.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.660+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~NC8SENCNSTCK.0 size=1048576 2024-09-12T00:17:46.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.664+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~NC8SENCNSTCK.1 size=1048576 2024-09-12T00:17:46.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.668+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~NC8SENCNSTCK.2 size=286394 2024-09-12T00:17:46.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.672+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=NC8SENCNSTCK tag=WK1ZH0FT3WOU type=write size=3432122 2024-09-12T00:17:46.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.676+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=7N7GX2ENDRQ6 type=del size=1325240 2024-09-12T00:17:46.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.680+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=08J0ER18UHWK type=del 2024-09-12T00:17:46.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.684+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=I5XT9R5XNVXV type=del size=2963441 2024-09-12T00:17:46.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.688+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=UHUAEEAUAGJI type=del 2024-09-12T00:17:46.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.696+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~8UHJOHANV2B3.0 size=1048576 2024-09-12T00:17:46.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.700+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~8UHJOHANV2B3.1 size=86780 2024-09-12T00:17:46.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.700+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=8UHJOHANV2B3 tag=JY1RR621F11D type=write size=2183932 2024-09-12T00:17:46.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.704+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~77N3X0QRK2C9.0 size=975604 2024-09-12T00:17:46.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.712+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=77N3X0QRK2C9 tag=71QGISOXRJB4 type=write size=2024180 2024-09-12T00:17:46.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.716+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=R17XMQT08T6D type=del size=315686 2024-09-12T00:17:46.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.720+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=ESBLLLRXM88N type=del 2024-09-12T00:17:46.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.724+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~FLPX7DULTGRZ.0 size=1048576 2024-09-12T00:17:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~FLPX7DULTGRZ.1 size=59403 2024-09-12T00:17:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.728+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=FLPX7DULTGRZ tag=FYQGEZ249KVH type=write size=2156555 2024-09-12T00:17:46.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.732+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=FR8X3VLKH8DQ type=del 2024-09-12T00:17:46.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.736+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=E4KKQE8PF0SO type=del size=2722155 2024-09-12T00:17:46.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.748+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=RWMQBC8DMQ7Z type=del 2024-09-12T00:17:46.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.752+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=6BQKXAU5P6ZK type=del size=251793 2024-09-12T00:17:46.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.756+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~D9MZYR7UEOZ7.0 size=1048576 2024-09-12T00:17:46.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.760+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~D9MZYR7UEOZ7.1 size=955244 2024-09-12T00:17:46.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.768+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=D9MZYR7UEOZ7 tag=682OHFC29L9Y type=write size=3052396 2024-09-12T00:17:46.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.772+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=4JBULQEX2LMX type=del size=626988 2024-09-12T00:17:46.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.776+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=OMNIECJESR41 type=del 2024-09-12T00:17:46.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.784+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~NQVO3F2PH6LP.0 size=1048576 2024-09-12T00:17:46.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.788+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~NQVO3F2PH6LP.1 size=1048576 2024-09-12T00:17:46.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.792+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~NQVO3F2PH6LP.2 size=938155 2024-09-12T00:17:46.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.792+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=NQVO3F2PH6LP tag=73D9C9V2AX9V type=write size=4083883 2024-09-12T00:17:46.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.796+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~2AJ64361NDG4.0 size=2223 2024-09-12T00:17:46.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.804+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=2AJ64361NDG4 tag=MAVQRTIPEV80 type=write size=1050799 2024-09-12T00:17:46.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.808+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=UNCW435D2OD5 type=del size=1062269 2024-09-12T00:17:46.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.812+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~B5XSKXLAJJX0.0 size=1048576 2024-09-12T00:17:46.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.816+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~B5XSKXLAJJX0.1 size=1047882 2024-09-12T00:17:46.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.820+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=B5XSKXLAJJX0 tag=Y52I912LJVN2 type=write size=3145034 2024-09-12T00:17:46.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.824+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=GGNX0WKF3WGT type=del size=790468 2024-09-12T00:17:46.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.832+0000 7f69cdea98c0 1 < suggested remove operation key=HSQZYI0SNZP1 tag=J0NBQKLR544D type=del 2024-09-12T00:17:46.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.836+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=QLZZ2F2D4F41 type=del size=3389076 2024-09-12T00:17:46.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.844+0000 7f69cdea98c0 1 < completed write operation key=SCFIVX3IHERR tag=360PBZR0RBEX type=write size=130937 2024-09-12T00:17:46.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.848+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=40KD2RU4SMQB type=del size=1520526 2024-09-12T00:17:46.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.852+0000 7f69cdea98c0 1 < canceled operation key=7UFADFUXL28I tag=KHT0DXROAK7S type=del size=3934651 2024-09-12T00:17:46.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.852+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=0PCC5W743603 type=del size=3471235 2024-09-12T00:17:46.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.856+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~23M8EJSPU6MP.0 size=1048576 2024-09-12T00:17:46.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.860+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~23M8EJSPU6MP.1 size=642245 2024-09-12T00:17:46.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.868+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=23M8EJSPU6MP tag=9NUZX1JW3JNO type=write size=2739397 2024-09-12T00:17:46.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~9PWJ94YQXOT9.0 size=1048576 2024-09-12T00:17:46.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~9PWJ94YQXOT9.1 size=707031 2024-09-12T00:17:46.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.876+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=9PWJ94YQXOT9 tag=59BLUZS25BM4 type=write size=2804183 2024-09-12T00:17:46.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.880+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~BDKVT121AZMK.0 size=1048576 2024-09-12T00:17:46.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.884+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~BDKVT121AZMK.1 size=787798 2024-09-12T00:17:46.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.892+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=BDKVT121AZMK tag=4JLNGT8SBFNB type=write size=2884950 2024-09-12T00:17:46.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.900+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=QE55UII913MC type=del size=355002 2024-09-12T00:17:46.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.904+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=7N7GX2ENDRQ6 type=del 2024-09-12T00:17:46.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.908+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~61OM4NRQSBP1.0 size=361396 2024-09-12T00:17:46.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.908+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=61OM4NRQSBP1 tag=N3IXK91X1IL8 type=write size=1409972 2024-09-12T00:17:46.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.912+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=I5XT9R5XNVXV type=del 2024-09-12T00:17:46.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.920+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~501N4S3EZQFA.0 size=1048576 2024-09-12T00:17:46.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.924+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~501N4S3EZQFA.1 size=1048576 2024-09-12T00:17:46.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.928+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~501N4S3EZQFA.2 size=950002 2024-09-12T00:17:46.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.928+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=501N4S3EZQFA tag=GVCIZMQ3BQ8D type=write size=4095730 2024-09-12T00:17:46.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.932+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~8UHJOHANV2B3.0 size=1048576 2024-09-12T00:17:46.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.932+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~8UHJOHANV2B3.1 size=86780 2024-09-12T00:17:46.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.940+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=8UHJOHANV2B3 tag=JY1RR621F11D type=write size=2183932 2024-09-12T00:17:46.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.944+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=710AJ02N5GJL type=del size=2304843 2024-09-12T00:17:46.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.948+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=R17XMQT08T6D type=del 2024-09-12T00:17:46.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.952+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=SFC7C12KZ3O1 type=del size=931734 2024-09-12T00:17:46.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.956+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~FLPX7DULTGRZ.0 size=1048576 2024-09-12T00:17:46.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.960+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~FLPX7DULTGRZ.1 size=59403 2024-09-12T00:17:46.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.964+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=FLPX7DULTGRZ tag=FYQGEZ249KVH type=write size=2156555 2024-09-12T00:17:46.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.968+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=Q6RJNH9GP45F type=del size=3781172 2024-09-12T00:17:46.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.972+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=E4KKQE8PF0SO type=del 2024-09-12T00:17:46.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.976+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=0QF82CYL9P2D type=write size=630134 2024-09-12T00:17:46.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.980+0000 7f69cdea98c0 1 < canceled operation key=AQY7MM3OX3GW tag=6BQKXAU5P6ZK type=del size=251793 2024-09-12T00:17:46.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~M32HVL3YSLW6.0 size=590847 2024-09-12T00:17:46.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.988+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=M32HVL3YSLW6 tag=OMFX39SCEXF9 type=write size=1639423 2024-09-12T00:17:46.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.992+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=4JBULQEX2LMX type=del 2024-09-12T00:17:46.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:46.996+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=6WA1T7F1I73Z type=del size=601907 2024-09-12T00:17:47.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.000+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~NQVO3F2PH6LP.0 size=1048576 2024-09-12T00:17:47.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.004+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~NQVO3F2PH6LP.1 size=1048576 2024-09-12T00:17:47.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.008+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~NQVO3F2PH6LP.2 size=938155 2024-09-12T00:17:47.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.012+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=NQVO3F2PH6LP tag=73D9C9V2AX9V type=write size=4083883 2024-09-12T00:17:47.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.020+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=41I9E5I7MMSQ type=del size=1200730 2024-09-12T00:17:47.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.024+0000 7f69cdea98c0 1 < canceled operation key=0HAUC4BDL9VR tag=UNCW435D2OD5 type=del size=1062269 2024-09-12T00:17:47.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.032+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~D4T3N1N8P0AT.0 size=1048576 2024-09-12T00:17:47.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.032+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~D4T3N1N8P0AT.1 size=598185 2024-09-12T00:17:47.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.032+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=D4T3N1N8P0AT tag=1CVPYQF58YKZ type=write size=2695337 2024-09-12T00:17:47.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.036+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=GGNX0WKF3WGT type=del 2024-09-12T00:17:47.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~DR7XMTZ1BAPE.0 size=1048576 2024-09-12T00:17:47.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~DR7XMTZ1BAPE.1 size=1048576 2024-09-12T00:17:47.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.052+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~DR7XMTZ1BAPE.2 size=984647 2024-09-12T00:17:47.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.052+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=DR7XMTZ1BAPE tag=FU90D7HBK7WR type=write size=4130375 2024-09-12T00:17:47.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.056+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=QLZZ2F2D4F41 type=del 2024-09-12T00:17:47.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.060+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=5SI7YC32SGIC type=del size=1240668 2024-09-12T00:17:47.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.064+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=40KD2RU4SMQB type=del 2024-09-12T00:17:47.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.068+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=YDNDV1KIC83H type=write size=826456 2024-09-12T00:17:47.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.076+0000 7f69cdea98c0 1 < suggested remove operation key=RDGRKQQH4B8C tag=0PCC5W743603 type=del 2024-09-12T00:17:47.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.080+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=HC06NQDOW2VM type=del size=545781 2024-09-12T00:17:47.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.084+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~9PWJ94YQXOT9.0 size=1048576 2024-09-12T00:17:47.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.088+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~9PWJ94YQXOT9.1 size=707031 2024-09-12T00:17:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.092+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=9PWJ94YQXOT9 tag=59BLUZS25BM4 type=write size=2804183 2024-09-12T00:17:47.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.096+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=R5HJUWEBT7DX type=del size=3414231 2024-09-12T00:17:47.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.100+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=QE55UII913MC type=del 2024-09-12T00:17:47.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.104+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=OYBLJTJY15V2 type=del size=3788093 2024-09-12T00:17:47.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.108+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~61OM4NRQSBP1.0 size=361396 2024-09-12T00:17:47.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.116+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=61OM4NRQSBP1 tag=N3IXK91X1IL8 type=write size=1409972 2024-09-12T00:17:47.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~72SF091XAVLR.0 size=582182 2024-09-12T00:17:47.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.120+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=72SF091XAVLR tag=IR02AZS0OEOP type=write size=1630758 2024-09-12T00:17:47.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.124+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~501N4S3EZQFA.0 size=1048576 2024-09-12T00:17:47.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.128+0000 7f69cdea98c0 1 < canceled part key=_multipart_AKWTTXH2P254.2~501N4S3EZQFA.1 size=1048576 2024-09-12T00:17:47.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.128+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~501N4S3EZQFA.2 size=950002 2024-09-12T00:17:47.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.136+0000 7f69cdea98c0 1 < canceled multipart upload key=AKWTTXH2P254 upload=501N4S3EZQFA tag=GVCIZMQ3BQ8D type=write size=4095730 2024-09-12T00:17:47.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.136+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=M9VNBB4T0HCJ type=del size=1614356 2024-09-12T00:17:47.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.144+0000 7f69cdea98c0 1 < suggested remove operation key=0HAUC4BDL9VR tag=710AJ02N5GJL type=del 2024-09-12T00:17:47.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.148+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=VB1P5DGT30L1 type=del size=1712968 2024-09-12T00:17:47.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.152+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=SFC7C12KZ3O1 type=del 2024-09-12T00:17:47.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.156+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=4J2ALSZGU6FV type=del size=325733 2024-09-12T00:17:47.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.160+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=Q6RJNH9GP45F type=del 2024-09-12T00:17:47.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.160+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=4K57AZG1RQMH type=del size=3847140 2024-09-12T00:17:47.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.164+0000 7f69cdea98c0 -1 < failed to complete operation key=RDGRKQQH4B8C tag=0QF82CYL9P2D type=write size=630134: (22) Invalid argument 2024-09-12T00:17:47.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~OEL2OIW81D8C.0 size=1048576 2024-09-12T00:17:47.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.176+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~OEL2OIW81D8C.1 size=615852 2024-09-12T00:17:47.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.176+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=OEL2OIW81D8C tag=K5MKGJTXUROE type=write size=2713004 2024-09-12T00:17:47.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.176+0000 7f69cdea98c0 1 < canceled part key=_multipart_7UFADFUXL28I.2~M32HVL3YSLW6.0 size=590847 2024-09-12T00:17:47.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.180+0000 7f69cdea98c0 1 < canceled multipart upload key=7UFADFUXL28I upload=M32HVL3YSLW6 tag=OMFX39SCEXF9 type=write size=1639423 2024-09-12T00:17:47.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.188+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~PQVV0V16AAHH.0 size=298823 2024-09-12T00:17:47.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.188+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=PQVV0V16AAHH tag=BJHHIXTXMXLZ type=write size=1347399 2024-09-12T00:17:47.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.192+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=6WA1T7F1I73Z type=del 2024-09-12T00:17:47.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.196+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=JSK2LUVIH1XR type=del size=3823594 2024-09-12T00:17:47.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.200+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=41I9E5I7MMSQ type=del 2024-09-12T00:17:47.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.204+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~WWPH2DRNWVUF.0 size=1048576 2024-09-12T00:17:47.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~WWPH2DRNWVUF.1 size=1048576 2024-09-12T00:17:47.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~WWPH2DRNWVUF.2 size=811931 2024-09-12T00:17:47.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.208+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=WWPH2DRNWVUF tag=IBSWYVFSV7AY type=write size=3957659 2024-09-12T00:17:47.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.212+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~D4T3N1N8P0AT.0 size=1048576 2024-09-12T00:17:47.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.216+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~D4T3N1N8P0AT.1 size=598185 2024-09-12T00:17:47.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.224+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=D4T3N1N8P0AT tag=1CVPYQF58YKZ type=write size=2695337 2024-09-12T00:17:47.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~HEQTPCZFCN4Z.0 size=1048576 2024-09-12T00:17:47.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.232+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~HEQTPCZFCN4Z.1 size=468621 2024-09-12T00:17:47.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.232+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=HEQTPCZFCN4Z tag=X4CVR1A8CVR5 type=write size=2565773 2024-09-12T00:17:47.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.236+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~DR7XMTZ1BAPE.0 size=1048576 2024-09-12T00:17:47.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.240+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~DR7XMTZ1BAPE.1 size=1048576 2024-09-12T00:17:47.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.240+0000 7f69cdea98c0 1 < canceled part key=_multipart_2X78JWLK876H.2~DR7XMTZ1BAPE.2 size=984647 2024-09-12T00:17:47.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.248+0000 7f69cdea98c0 1 < canceled multipart upload key=2X78JWLK876H upload=DR7XMTZ1BAPE tag=FU90D7HBK7WR type=write size=4130375 2024-09-12T00:17:47.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.256+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~Z1AAJ1GPU3BE.0 size=1048576 2024-09-12T00:17:47.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.256+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~Z1AAJ1GPU3BE.1 size=1048576 2024-09-12T00:17:47.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~Z1AAJ1GPU3BE.2 size=445918 2024-09-12T00:17:47.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.260+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=Z1AAJ1GPU3BE tag=BVX5HZZ6DCOR type=write size=3591646 2024-09-12T00:17:47.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.264+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=5SI7YC32SGIC type=del 2024-09-12T00:17:47.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.268+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~CK71J9HTLYWH.0 size=1048576 2024-09-12T00:17:47.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~CK71J9HTLYWH.1 size=1048576 2024-09-12T00:17:47.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~CK71J9HTLYWH.2 size=341317 2024-09-12T00:17:47.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.276+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=CK71J9HTLYWH tag=0YW13SN4VUE6 type=write size=3487045 2024-09-12T00:17:47.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.276+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=YDNDV1KIC83H type=write size=826456 2024-09-12T00:17:47.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.280+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=V9A3ETEAMHT1 type=del size=2442880 2024-09-12T00:17:47.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.284+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=HC06NQDOW2VM type=del 2024-09-12T00:17:47.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.292+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~DBZ75Q84383B.0 size=1048576 2024-09-12T00:17:47.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~DBZ75Q84383B.1 size=1048576 2024-09-12T00:17:47.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~DBZ75Q84383B.2 size=957692 2024-09-12T00:17:47.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.296+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=DBZ75Q84383B tag=YDMR319T31KJ type=write size=4103420 2024-09-12T00:17:47.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.300+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=R5HJUWEBT7DX type=del 2024-09-12T00:17:47.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.304+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=7PRASHBM8LGX type=del size=1806771 2024-09-12T00:17:47.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.308+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=OYBLJTJY15V2 type=del 2024-09-12T00:17:47.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.316+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=UHXV3J92ZD73 type=del size=3230739 2024-09-12T00:17:47.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.320+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~72SF091XAVLR.0 size=582182 2024-09-12T00:17:47.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.324+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=72SF091XAVLR tag=IR02AZS0OEOP type=write size=1630758 2024-09-12T00:17:47.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.328+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=Z9YONF2KPQM7 type=del size=150551 2024-09-12T00:17:47.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.332+0000 7f69cdea98c0 1 < canceled operation key=AKWTTXH2P254 tag=M9VNBB4T0HCJ type=del size=1614356 2024-09-12T00:17:47.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.340+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~W2EWAW2L44MO.0 size=1048576 2024-09-12T00:17:47.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.344+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~W2EWAW2L44MO.1 size=966944 2024-09-12T00:17:47.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.344+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=W2EWAW2L44MO tag=R0YG2818V0RI type=write size=3064096 2024-09-12T00:17:47.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.352+0000 7f69cdea98c0 1 < suggested update operation key=7UFADFUXL28I tag=VB1P5DGT30L1 type=del size=1712968 2024-09-12T00:17:47.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.356+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=NB8YU7ZRYEI5 type=del size=829063 2024-09-12T00:17:47.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.360+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=4J2ALSZGU6FV type=del 2024-09-12T00:17:47.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.364+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=AEC2C8KYWCHE type=del size=3801233 2024-09-12T00:17:47.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.372+0000 7f69cdea98c0 1 < suggested update operation key=2YYP9NOUAJD0 tag=4K57AZG1RQMH type=del size=3847140 2024-09-12T00:17:47.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.376+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=CYC5Y0MDU1UN type=write size=220430 2024-09-12T00:17:47.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.380+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~OEL2OIW81D8C.0 size=1048576 2024-09-12T00:17:47.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.384+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~OEL2OIW81D8C.1 size=615852 2024-09-12T00:17:47.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.388+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=OEL2OIW81D8C tag=K5MKGJTXUROE type=write size=2713004 2024-09-12T00:17:47.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~6FYBJVVJ0RIX.0 size=1048576 2024-09-12T00:17:47.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.400+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~6FYBJVVJ0RIX.1 size=1048576 2024-09-12T00:17:47.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~6FYBJVVJ0RIX.2 size=814654 2024-09-12T00:17:47.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.404+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=6FYBJVVJ0RIX tag=6LP4QC2U8E33 type=write size=3960382 2024-09-12T00:17:47.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.408+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~PQVV0V16AAHH.0 size=298823 2024-09-12T00:17:47.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.412+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=PQVV0V16AAHH tag=BJHHIXTXMXLZ type=write size=1347399 2024-09-12T00:17:47.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.416+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=XZFX7TYQ1XRV type=del size=3482396 2024-09-12T00:17:47.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.420+0000 7f69cdea98c0 1 < canceled operation key=Q0L8J0BYRFDQ tag=JSK2LUVIH1XR type=del size=3823594 2024-09-12T00:17:47.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.428+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~ZLJOI5Z94J5W.0 size=269424 2024-09-12T00:17:47.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.428+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=ZLJOI5Z94J5W tag=NC74WV21JHHX type=write size=1318000 2024-09-12T00:17:47.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.428+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~WWPH2DRNWVUF.0 size=1048576 2024-09-12T00:17:47.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.432+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~WWPH2DRNWVUF.1 size=1048576 2024-09-12T00:17:47.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.432+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~WWPH2DRNWVUF.2 size=811931 2024-09-12T00:17:47.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.440+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=WWPH2DRNWVUF tag=IBSWYVFSV7AY type=write size=3957659 2024-09-12T00:17:47.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.444+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=SI5J0QPZL2N6 type=write size=549772 2024-09-12T00:17:47.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.448+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~HEQTPCZFCN4Z.0 size=1048576 2024-09-12T00:17:47.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.452+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~HEQTPCZFCN4Z.1 size=468621 2024-09-12T00:17:47.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.456+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=HEQTPCZFCN4Z tag=X4CVR1A8CVR5 type=write size=2565773 2024-09-12T00:17:47.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.464+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~DVWW90ZD68RV.0 size=1048576 2024-09-12T00:17:47.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.468+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~DVWW90ZD68RV.1 size=1048576 2024-09-12T00:17:47.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~DVWW90ZD68RV.2 size=765098 2024-09-12T00:17:47.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.472+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=DVWW90ZD68RV tag=PSKOGF90DQQF type=write size=3910826 2024-09-12T00:17:47.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.476+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~Z1AAJ1GPU3BE.0 size=1048576 2024-09-12T00:17:47.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.480+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~Z1AAJ1GPU3BE.1 size=1048576 2024-09-12T00:17:47.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.480+0000 7f69cdea98c0 1 < canceled part key=_multipart_AQY7MM3OX3GW.2~Z1AAJ1GPU3BE.2 size=445918 2024-09-12T00:17:47.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.484+0000 7f69cdea98c0 1 < canceled multipart upload key=AQY7MM3OX3GW upload=Z1AAJ1GPU3BE tag=BVX5HZZ6DCOR type=write size=3591646 2024-09-12T00:17:47.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.492+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~16OZGB8ZKL7O.0 size=736879 2024-09-12T00:17:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.492+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=16OZGB8ZKL7O tag=FU9KOONFTVVZ type=write size=1785455 2024-09-12T00:17:47.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.496+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~CK71J9HTLYWH.0 size=1048576 2024-09-12T00:17:47.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.500+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~CK71J9HTLYWH.1 size=1048576 2024-09-12T00:17:47.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.504+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~CK71J9HTLYWH.2 size=341317 2024-09-12T00:17:47.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.512+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=CK71J9HTLYWH tag=0YW13SN4VUE6 type=write size=3487045 2024-09-12T00:17:47.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.516+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=8D7J43JYJYNL type=del size=766356 2024-09-12T00:17:47.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.520+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=V9A3ETEAMHT1 type=del 2024-09-12T00:17:47.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.524+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=634T30O1C9C6 type=write size=835502 2024-09-12T00:17:47.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.528+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~DBZ75Q84383B.0 size=1048576 2024-09-12T00:17:47.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.528+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~DBZ75Q84383B.1 size=1048576 2024-09-12T00:17:47.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.532+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~DBZ75Q84383B.2 size=957692 2024-09-12T00:17:47.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.536+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=DBZ75Q84383B tag=YDMR319T31KJ type=write size=4103420 2024-09-12T00:17:47.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.544+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~ASZ6ZH3KLB02.0 size=178816 2024-09-12T00:17:47.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.544+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=ASZ6ZH3KLB02 tag=819VQ83QBLBW type=write size=1227392 2024-09-12T00:17:47.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.552+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=7PRASHBM8LGX type=del 2024-09-12T00:17:47.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.556+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=PI0LVULQJ89C type=write size=925516 2024-09-12T00:17:47.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.560+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=UHXV3J92ZD73 type=del 2024-09-12T00:17:47.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.564+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=0N92WX6A2QBI type=del size=1401584 2024-09-12T00:17:47.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.568+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=Z9YONF2KPQM7 type=del 2024-09-12T00:17:47.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.576+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~YXE4XR7EI55P.0 size=1048576 2024-09-12T00:17:47.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~YXE4XR7EI55P.1 size=1048576 2024-09-12T00:17:47.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~YXE4XR7EI55P.2 size=919571 2024-09-12T00:17:47.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.580+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=YXE4XR7EI55P tag=188RVFCBTRM2 type=write size=4065299 2024-09-12T00:17:47.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.584+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~W2EWAW2L44MO.0 size=1048576 2024-09-12T00:17:47.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.588+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~W2EWAW2L44MO.1 size=966944 2024-09-12T00:17:47.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.596+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=W2EWAW2L44MO tag=R0YG2818V0RI type=write size=3064096 2024-09-12T00:17:47.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.600+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=IHS1M8GGSSP2 type=del size=2042012 2024-09-12T00:17:47.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.608+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=NB8YU7ZRYEI5 type=del 2024-09-12T00:17:47.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.612+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=5RI834I211E1 type=write size=255705 2024-09-12T00:17:47.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.616+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=AEC2C8KYWCHE type=del 2024-09-12T00:17:47.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.620+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=2F279SYM8FXE type=del size=3532005 2024-09-12T00:17:47.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.624+0000 7f69cdea98c0 1 < completed write operation key=2X78JWLK876H tag=CYC5Y0MDU1UN type=write size=220430 2024-09-12T00:17:47.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.628+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=LIHV844M777L type=write size=415739 2024-09-12T00:17:47.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.632+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~6FYBJVVJ0RIX.0 size=1048576 2024-09-12T00:17:47.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.636+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~6FYBJVVJ0RIX.1 size=1048576 2024-09-12T00:17:47.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.636+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~6FYBJVVJ0RIX.2 size=814654 2024-09-12T00:17:47.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.644+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=6FYBJVVJ0RIX tag=6LP4QC2U8E33 type=write size=3960382 2024-09-12T00:17:47.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~K9IM7PFFN5XB.0 size=1048576 2024-09-12T00:17:47.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~K9IM7PFFN5XB.1 size=1048576 2024-09-12T00:17:47.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~K9IM7PFFN5XB.2 size=378097 2024-09-12T00:17:47.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.656+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=K9IM7PFFN5XB tag=96Z19AZO94A7 type=write size=3523825 2024-09-12T00:17:47.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.664+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=XZFX7TYQ1XRV type=del 2024-09-12T00:17:47.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.668+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=ES2V8X22YFES type=del size=3976611 2024-09-12T00:17:47.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.672+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~ZLJOI5Z94J5W.0 size=269424 2024-09-12T00:17:47.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.680+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=ZLJOI5Z94J5W tag=NC74WV21JHHX type=write size=1318000 2024-09-12T00:17:47.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.684+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=E7L5J4U7PCSP type=del size=3078325 2024-09-12T00:17:47.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.684+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=SI5J0QPZL2N6 type=write size=549772 2024-09-12T00:17:47.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.688+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=EZBEVFGX4RUM type=del size=1192185 2024-09-12T00:17:47.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.692+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~DVWW90ZD68RV.0 size=1048576 2024-09-12T00:17:47.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.696+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~DVWW90ZD68RV.1 size=1048576 2024-09-12T00:17:47.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.700+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~DVWW90ZD68RV.2 size=765098 2024-09-12T00:17:47.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.704+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=DVWW90ZD68RV tag=PSKOGF90DQQF type=write size=3910826 2024-09-12T00:17:47.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.712+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~AM3K2D3W3UP6.0 size=1048576 2024-09-12T00:17:47.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.716+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~AM3K2D3W3UP6.1 size=1048576 2024-09-12T00:17:47.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.716+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~AM3K2D3W3UP6.2 size=600802 2024-09-12T00:17:47.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.716+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=AM3K2D3W3UP6 tag=Y1IELJZMDH9N type=write size=3746530 2024-09-12T00:17:47.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.720+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~16OZGB8ZKL7O.0 size=736879 2024-09-12T00:17:47.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.728+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=16OZGB8ZKL7O tag=FU9KOONFTVVZ type=write size=1785455 2024-09-12T00:17:47.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.728+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=ZGK4XOLPIVMP type=del size=3588821 2024-09-12T00:17:47.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.732+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=8D7J43JYJYNL type=del 2024-09-12T00:17:47.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.736+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=Z5VAARS3117T type=del size=2571738 2024-09-12T00:17:47.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.740+0000 7f69cdea98c0 1 < canceled operation key=UTZNJQJQMXJS tag=634T30O1C9C6 type=write size=835502 2024-09-12T00:17:47.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.744+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=5R3M31OVYOPC type=write size=1242 2024-09-12T00:17:47.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.748+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~ASZ6ZH3KLB02.0 size=178816 2024-09-12T00:17:47.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.752+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=ASZ6ZH3KLB02 tag=819VQ83QBLBW type=write size=1227392 2024-09-12T00:17:47.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.756+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=P1AJCBEK6C5F type=del size=1027367 2024-09-12T00:17:47.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.760+0000 7f69cdea98c0 1 < completed write operation key=H91UXKWAJ3K8 tag=PI0LVULQJ89C type=write size=925516 2024-09-12T00:17:47.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.768+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~628EJ1KWJDKE.0 size=1048576 2024-09-12T00:17:47.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.772+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~628EJ1KWJDKE.1 size=308871 2024-09-12T00:17:47.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.772+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=628EJ1KWJDKE tag=BWN9JFO04R8E type=write size=2406023 2024-09-12T00:17:47.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.776+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=0N92WX6A2QBI type=del 2024-09-12T00:17:47.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.780+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=I72DGJGXY6PN type=del size=2974684 2024-09-12T00:17:47.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.780+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~YXE4XR7EI55P.0 size=1048576 2024-09-12T00:17:47.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.784+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~YXE4XR7EI55P.1 size=1048576 2024-09-12T00:17:47.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.788+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~YXE4XR7EI55P.2 size=919571 2024-09-12T00:17:47.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.792+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=YXE4XR7EI55P tag=188RVFCBTRM2 type=write size=4065299 2024-09-12T00:17:47.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.796+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=BFCIZG9JXZM3 type=del size=538383 2024-09-12T00:17:47.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.804+0000 7f69cdea98c0 1 < suggested update operation key=AQY7MM3OX3GW tag=IHS1M8GGSSP2 type=del size=2042012 2024-09-12T00:17:47.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.812+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~Z5DVLLZJCIZT.0 size=1048576 2024-09-12T00:17:47.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.816+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~Z5DVLLZJCIZT.1 size=1048576 2024-09-12T00:17:47.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.816+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~Z5DVLLZJCIZT.2 size=48170 2024-09-12T00:17:47.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.816+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=Z5DVLLZJCIZT tag=SP4IXXVBIU5L type=write size=3193898 2024-09-12T00:17:47.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.824+0000 7f69cdea98c0 1 < suggested remove operation key=0HAUC4BDL9VR tag=5RI834I211E1 type=write 2024-09-12T00:17:47.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.828+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=C21HHY005IV9 type=write size=64362 2024-09-12T00:17:47.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.832+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=2F279SYM8FXE type=del 2024-09-12T00:17:47.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~C8YU1BE0YLUY.0 size=907576 2024-09-12T00:17:47.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.840+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=C8YU1BE0YLUY tag=JQWHHL8JIGPO type=write size=1956152 2024-09-12T00:17:47.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.848+0000 7f69cdea98c0 1 < suggested update operation key=LRHZKCU22AIX tag=LIHV844M777L type=write size=415739 2024-09-12T00:17:47.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.852+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=904VTY8FPUEC type=del size=2584030 2024-09-12T00:17:47.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.856+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~K9IM7PFFN5XB.0 size=1048576 2024-09-12T00:17:47.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.860+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~K9IM7PFFN5XB.1 size=1048576 2024-09-12T00:17:47.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.864+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~K9IM7PFFN5XB.2 size=378097 2024-09-12T00:17:47.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.868+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=K9IM7PFFN5XB tag=96Z19AZO94A7 type=write size=3523825 2024-09-12T00:17:47.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.872+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=7BNGK915UYRO type=del size=3623679 2024-09-12T00:17:47.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.876+0000 7f69cdea98c0 1 < canceled operation key=I23GNCI98JHU tag=ES2V8X22YFES type=del size=3976611 2024-09-12T00:17:47.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.880+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=0D3012S6BURL type=write size=1024153 2024-09-12T00:17:47.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.884+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=E7L5J4U7PCSP type=del 2024-09-12T00:17:47.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.888+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=9L1MU6Z2OHHL type=del size=770260 2024-09-12T00:17:47.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.892+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=EZBEVFGX4RUM type=del 2024-09-12T00:17:47.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.896+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=VVZ4FQRHAGFE type=del size=2788417 2024-09-12T00:17:47.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.900+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~AM3K2D3W3UP6.0 size=1048576 2024-09-12T00:17:47.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.904+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~AM3K2D3W3UP6.1 size=1048576 2024-09-12T00:17:47.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.908+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~AM3K2D3W3UP6.2 size=600802 2024-09-12T00:17:47.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.912+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=AM3K2D3W3UP6 tag=Y1IELJZMDH9N type=write size=3746530 2024-09-12T00:17:47.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.920+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~8RE185GWP3PC.0 size=782383 2024-09-12T00:17:47.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.920+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=8RE185GWP3PC tag=K0SAHCX5BACP type=write size=1830959 2024-09-12T00:17:47.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.924+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=ZGK4XOLPIVMP type=del 2024-09-12T00:17:47.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.928+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=8KSG516JKU3W type=del size=1612351 2024-09-12T00:17:47.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.936+0000 7f69cdea98c0 1 < suggested remove operation key=VYYY8MF0P3Q7 tag=Z5VAARS3117T type=del 2024-09-12T00:17:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.936+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=IY7TNEBX9X60 type=del size=259727 2024-09-12T00:17:47.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.944+0000 7f69cdea98c0 1 < completed write operation key=IXB6WLN5M81C tag=5R3M31OVYOPC type=write size=1242 2024-09-12T00:17:47.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.948+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=OC4OLP2F0THC type=del size=308915 2024-09-12T00:17:47.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.952+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=P1AJCBEK6C5F type=del 2024-09-12T00:17:47.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.956+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~UPZ5SJVEUVRS.0 size=1048576 2024-09-12T00:17:47.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~UPZ5SJVEUVRS.1 size=891530 2024-09-12T00:17:47.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.964+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=UPZ5SJVEUVRS tag=DH6NZCLCFIFX type=write size=2988682 2024-09-12T00:17:47.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.964+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~628EJ1KWJDKE.0 size=1048576 2024-09-12T00:17:47.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.968+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~628EJ1KWJDKE.1 size=308871 2024-09-12T00:17:47.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.972+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=628EJ1KWJDKE tag=BWN9JFO04R8E type=write size=2406023 2024-09-12T00:17:47.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.976+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=Q0G5YADPTZIA type=del size=1063084 2024-09-12T00:17:47.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.980+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=I72DGJGXY6PN type=del 2024-09-12T00:17:47.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.984+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=BK628KOQYSAX type=del size=711091 2024-09-12T00:17:47.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.988+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=BFCIZG9JXZM3 type=del 2024-09-12T00:17:47.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.992+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~VFH2575QNX1B.0 size=1048576 2024-09-12T00:17:47.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.996+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~VFH2575QNX1B.1 size=832751 2024-09-12T00:17:47.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:47.996+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=VFH2575QNX1B tag=P83DNR51LKK4 type=write size=2929903 2024-09-12T00:17:47.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.000+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~Z5DVLLZJCIZT.0 size=1048576 2024-09-12T00:17:48.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.000+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~Z5DVLLZJCIZT.1 size=1048576 2024-09-12T00:17:48.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.004+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~Z5DVLLZJCIZT.2 size=48170 2024-09-12T00:17:48.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.008+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=Z5DVLLZJCIZT tag=SP4IXXVBIU5L type=write size=3193898 2024-09-12T00:17:48.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.012+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=6H9N5VNJMXOK type=del size=261317 2024-09-12T00:17:48.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.016+0000 7f69cdea98c0 1 < canceled operation key=0EALARW4O3OB tag=C21HHY005IV9 type=write size=64362 2024-09-12T00:17:48.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.016+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=QUGH3PGBOOS0 type=del size=1378579 2024-09-12T00:17:48.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.020+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~C8YU1BE0YLUY.0 size=907576 2024-09-12T00:17:48.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.028+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=C8YU1BE0YLUY tag=JQWHHL8JIGPO type=write size=1956152 2024-09-12T00:17:48.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.028+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=TE00ZCROLONT type=del size=3710286 2024-09-12T00:17:48.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.032+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=904VTY8FPUEC type=del 2024-09-12T00:17:48.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.040+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~MRW8J1V5L4Z3.0 size=1048576 2024-09-12T00:17:48.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~MRW8J1V5L4Z3.1 size=1048576 2024-09-12T00:17:48.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~MRW8J1V5L4Z3.2 size=971496 2024-09-12T00:17:48.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.044+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=MRW8J1V5L4Z3 tag=W78AJCD1G36P type=write size=4117224 2024-09-12T00:17:48.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.048+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=7BNGK915UYRO type=del 2024-09-12T00:17:48.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.056+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~O0EVC6XK8S6Y.0 size=1048576 2024-09-12T00:17:48.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.056+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~O0EVC6XK8S6Y.1 size=1048576 2024-09-12T00:17:48.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.060+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~O0EVC6XK8S6Y.2 size=273668 2024-09-12T00:17:48.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.060+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=O0EVC6XK8S6Y tag=90ASUA0ZZMGL type=write size=3419396 2024-09-12T00:17:48.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.068+0000 7f69cdea98c0 1 < suggested update operation key=0J667VAQGMTX tag=0D3012S6BURL type=write size=1024153 2024-09-12T00:17:48.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~YCQUDOV40SX1.0 size=1048576 2024-09-12T00:17:48.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.076+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~YCQUDOV40SX1.1 size=591982 2024-09-12T00:17:48.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.076+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=YCQUDOV40SX1 tag=FOO67JT57VHM type=write size=2689134 2024-09-12T00:17:48.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.076+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=9L1MU6Z2OHHL type=del 2024-09-12T00:17:48.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.080+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=1QJ029MM9L5S type=del size=1196295 2024-09-12T00:17:48.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.084+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=VVZ4FQRHAGFE type=del 2024-09-12T00:17:48.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.088+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=PKAH3MJU5FVR type=del size=1443914 2024-09-12T00:17:48.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.088+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~8RE185GWP3PC.0 size=782383 2024-09-12T00:17:48.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.096+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=8RE185GWP3PC tag=K0SAHCX5BACP type=write size=1830959 2024-09-12T00:17:48.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~XRINYU5OPAMR.0 size=1048576 2024-09-12T00:17:48.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.104+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~XRINYU5OPAMR.1 size=964881 2024-09-12T00:17:48.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.104+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=XRINYU5OPAMR tag=IHJHQSDHOF58 type=write size=3062033 2024-09-12T00:17:48.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.108+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=8KSG516JKU3W type=del 2024-09-12T00:17:48.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.112+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=Y0261CJQ4NOA type=del size=3102321 2024-09-12T00:17:48.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.112+0000 7f69cdea98c0 1 < canceled operation key=2X78JWLK876H tag=IY7TNEBX9X60 type=del size=259727 2024-09-12T00:17:48.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~V31H3NVYP86J.0 size=178977 2024-09-12T00:17:48.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.120+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=V31H3NVYP86J tag=RPD56K3KXRKX type=write size=1227553 2024-09-12T00:17:48.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.124+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=OC4OLP2F0THC type=del 2024-09-12T00:17:48.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~4XFSNPHQCU1B.0 size=1048576 2024-09-12T00:17:48.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~4XFSNPHQCU1B.1 size=1048576 2024-09-12T00:17:48.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~4XFSNPHQCU1B.2 size=68668 2024-09-12T00:17:48.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.132+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=4XFSNPHQCU1B tag=JH6CK50L5K08 type=write size=3214396 2024-09-12T00:17:48.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.136+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~UPZ5SJVEUVRS.0 size=1048576 2024-09-12T00:17:48.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.136+0000 7f69cdea98c0 1 < canceled part key=_multipart_SCFIVX3IHERR.2~UPZ5SJVEUVRS.1 size=891530 2024-09-12T00:17:48.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.144+0000 7f69cdea98c0 1 < canceled multipart upload key=SCFIVX3IHERR upload=UPZ5SJVEUVRS tag=DH6NZCLCFIFX type=write size=2988682 2024-09-12T00:17:48.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.148+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~NYEBCCFS6Y6S.0 size=1048576 2024-09-12T00:17:48.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.152+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~NYEBCCFS6Y6S.1 size=569190 2024-09-12T00:17:48.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.152+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=NYEBCCFS6Y6S tag=B93ZV0YX7G5A type=write size=2666342 2024-09-12T00:17:48.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.156+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=Q0G5YADPTZIA type=del 2024-09-12T00:17:48.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~ERBAFR2ITKDG.0 size=1048576 2024-09-12T00:17:48.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.164+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~ERBAFR2ITKDG.1 size=285522 2024-09-12T00:17:48.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.164+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=ERBAFR2ITKDG tag=72XUF44BC6QF type=write size=2382674 2024-09-12T00:17:48.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.168+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=BK628KOQYSAX type=del 2024-09-12T00:17:48.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.172+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=UBEV2X8BA0C1 type=del size=80127 2024-09-12T00:17:48.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.176+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~VFH2575QNX1B.0 size=1048576 2024-09-12T00:17:48.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.176+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~VFH2575QNX1B.1 size=832751 2024-09-12T00:17:48.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.184+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=VFH2575QNX1B tag=P83DNR51LKK4 type=write size=2929903 2024-09-12T00:17:48.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.188+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~X78EOWPK7HU5.0 size=1048576 2024-09-12T00:17:48.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.192+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~X78EOWPK7HU5.1 size=378914 2024-09-12T00:17:48.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.192+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=X78EOWPK7HU5 tag=ZBD5HMBWAQ3W type=write size=2476066 2024-09-12T00:17:48.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.196+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=6H9N5VNJMXOK type=del 2024-09-12T00:17:48.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.196+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=2148P7VM525H type=del size=1370616 2024-09-12T00:17:48.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.200+0000 7f69cdea98c0 -1 < failed to complete operation key=0J667VAQGMTX tag=QUGH3PGBOOS0 type=del size=1378579: (22) Invalid argument 2024-09-12T00:17:48.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~MQ81PMA520Y1.0 size=1048576 2024-09-12T00:17:48.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~MQ81PMA520Y1.1 size=1048576 2024-09-12T00:17:48.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~MQ81PMA520Y1.2 size=770667 2024-09-12T00:17:48.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.212+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=MQ81PMA520Y1 tag=MMMXYKESE35Q type=write size=3916395 2024-09-12T00:17:48.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.216+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=TE00ZCROLONT type=del 2024-09-12T00:17:48.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.220+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=LHWV9042V7XJ type=write size=1039590 2024-09-12T00:17:48.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.224+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~MRW8J1V5L4Z3.0 size=1048576 2024-09-12T00:17:48.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.228+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~MRW8J1V5L4Z3.1 size=1048576 2024-09-12T00:17:48.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.228+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~MRW8J1V5L4Z3.2 size=971496 2024-09-12T00:17:48.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.236+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=MRW8J1V5L4Z3 tag=W78AJCD1G36P type=write size=4117224 2024-09-12T00:17:48.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~D4B0ZU1Y0ZEG.0 size=1048576 2024-09-12T00:17:48.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~D4B0ZU1Y0ZEG.1 size=1048576 2024-09-12T00:17:48.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~D4B0ZU1Y0ZEG.2 size=126872 2024-09-12T00:17:48.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.248+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=D4B0ZU1Y0ZEG tag=1Y5CHRM4EKX4 type=write size=3272600 2024-09-12T00:17:48.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.248+0000 7f69cdea98c0 1 < canceled part key=_multipart_2ENKC4QT2BFS.2~O0EVC6XK8S6Y.0 size=1048576 2024-09-12T00:17:48.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.252+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~O0EVC6XK8S6Y.1 size=1048576 2024-09-12T00:17:48.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.252+0000 7f69cdea98c0 1 < canceled part key=_multipart_2ENKC4QT2BFS.2~O0EVC6XK8S6Y.2 size=273668 2024-09-12T00:17:48.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.256+0000 7f69cdea98c0 1 < canceled multipart upload key=2ENKC4QT2BFS upload=O0EVC6XK8S6Y tag=90ASUA0ZZMGL type=write size=3419396 2024-09-12T00:17:48.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.264+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~1RTASL74I3JJ.0 size=945095 2024-09-12T00:17:48.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.264+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=1RTASL74I3JJ tag=HLFZF5LVG0F0 type=write size=1993671 2024-09-12T00:17:48.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.268+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~YCQUDOV40SX1.0 size=1048576 2024-09-12T00:17:48.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.272+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~YCQUDOV40SX1.1 size=591982 2024-09-12T00:17:48.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.280+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=YCQUDOV40SX1 tag=FOO67JT57VHM type=write size=2689134 2024-09-12T00:17:48.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.284+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~CN7II2GPWHR0.0 size=847947 2024-09-12T00:17:48.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.284+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=CN7II2GPWHR0 tag=M8J8D0F9GQ40 type=write size=1896523 2024-09-12T00:17:48.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.288+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=1QJ029MM9L5S type=del 2024-09-12T00:17:48.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~ED53UUVPHO0T.0 size=1048576 2024-09-12T00:17:48.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.300+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~ED53UUVPHO0T.1 size=1048576 2024-09-12T00:17:48.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.300+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~ED53UUVPHO0T.2 size=1007438 2024-09-12T00:17:48.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.300+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=ED53UUVPHO0T tag=K5MQKJDKEPW1 type=write size=4153166 2024-09-12T00:17:48.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.304+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=PKAH3MJU5FVR type=del 2024-09-12T00:17:48.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.308+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=06DUNAHDF2YD type=del size=707605 2024-09-12T00:17:48.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.312+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~XRINYU5OPAMR.0 size=1048576 2024-09-12T00:17:48.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.316+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~XRINYU5OPAMR.1 size=964881 2024-09-12T00:17:48.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.320+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=XRINYU5OPAMR tag=IHJHQSDHOF58 type=write size=3062033 2024-09-12T00:17:48.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~DN4020IO2A7W.0 size=1048576 2024-09-12T00:17:48.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~DN4020IO2A7W.1 size=534031 2024-09-12T00:17:48.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.328+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=DN4020IO2A7W tag=LL1JLNWZ8S1N type=write size=2631183 2024-09-12T00:17:48.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.332+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=Y0261CJQ4NOA type=del 2024-09-12T00:17:48.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.336+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=J7ANTPW0N48Z type=write size=770100 2024-09-12T00:17:48.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.340+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~V31H3NVYP86J.0 size=178977 2024-09-12T00:17:48.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.348+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=V31H3NVYP86J tag=RPD56K3KXRKX type=write size=1227553 2024-09-12T00:17:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.352+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~D7YWSKUU8BQB.0 size=689245 2024-09-12T00:17:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.352+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=D7YWSKUU8BQB tag=MOMXS3JYO0KA type=write size=1737821 2024-09-12T00:17:48.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.356+0000 7f69cdea98c0 1 < canceled part key=_multipart_H91UXKWAJ3K8.2~4XFSNPHQCU1B.0 size=1048576 2024-09-12T00:17:48.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.356+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~4XFSNPHQCU1B.1 size=1048576 2024-09-12T00:17:48.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.360+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~4XFSNPHQCU1B.2 size=68668 2024-09-12T00:17:48.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.368+0000 7f69cdea98c0 1 < canceled multipart upload key=H91UXKWAJ3K8 upload=4XFSNPHQCU1B tag=JH6CK50L5K08 type=write size=3214396 2024-09-12T00:17:48.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.372+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=J46XJ7YFY0HA type=del size=333053 2024-09-12T00:17:48.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.372+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~NYEBCCFS6Y6S.0 size=1048576 2024-09-12T00:17:48.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.376+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~NYEBCCFS6Y6S.1 size=569190 2024-09-12T00:17:48.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.384+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=NYEBCCFS6Y6S tag=B93ZV0YX7G5A type=write size=2666342 2024-09-12T00:17:48.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.392+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~A59ONMZ4601C.0 size=1048576 2024-09-12T00:17:48.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.392+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~A59ONMZ4601C.1 size=607445 2024-09-12T00:17:48.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.392+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=A59ONMZ4601C tag=AUQ7NQ2CRTAK type=write size=2704597 2024-09-12T00:17:48.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.396+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~ERBAFR2ITKDG.0 size=1048576 2024-09-12T00:17:48.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.400+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~ERBAFR2ITKDG.1 size=285522 2024-09-12T00:17:48.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.404+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=ERBAFR2ITKDG tag=72XUF44BC6QF type=write size=2382674 2024-09-12T00:17:48.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~DY2KT2IZ4JRZ.0 size=1048576 2024-09-12T00:17:48.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.416+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~DY2KT2IZ4JRZ.1 size=1048576 2024-09-12T00:17:48.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.420+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~DY2KT2IZ4JRZ.2 size=410871 2024-09-12T00:17:48.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.420+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=DY2KT2IZ4JRZ tag=TLOJWJ6Y2D6C type=write size=3556599 2024-09-12T00:17:48.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.424+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=UBEV2X8BA0C1 type=del 2024-09-12T00:17:48.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.428+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~04T4Q64WIDVV.0 size=1048576 2024-09-12T00:17:48.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~04T4Q64WIDVV.1 size=963864 2024-09-12T00:17:48.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.432+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=04T4Q64WIDVV tag=16XJB9J5PGH8 type=write size=3061016 2024-09-12T00:17:48.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.436+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~X78EOWPK7HU5.0 size=1048576 2024-09-12T00:17:48.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.440+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~X78EOWPK7HU5.1 size=378914 2024-09-12T00:17:48.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.444+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=X78EOWPK7HU5 tag=ZBD5HMBWAQ3W type=write size=2476066 2024-09-12T00:17:48.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~PKRR4LWVOBQ3.0 size=1048576 2024-09-12T00:17:48.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~PKRR4LWVOBQ3.1 size=1048576 2024-09-12T00:17:48.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.460+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~PKRR4LWVOBQ3.2 size=567161 2024-09-12T00:17:48.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.460+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=PKRR4LWVOBQ3 tag=JWMUG2OWTJET type=write size=3712889 2024-09-12T00:17:48.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.464+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=2148P7VM525H type=del 2024-09-12T00:17:48.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.468+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=K9VFOS73P9SQ type=del size=1490956 2024-09-12T00:17:48.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.472+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~MQ81PMA520Y1.0 size=1048576 2024-09-12T00:17:48.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.472+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~MQ81PMA520Y1.1 size=1048576 2024-09-12T00:17:48.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.476+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~MQ81PMA520Y1.2 size=770667 2024-09-12T00:17:48.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.484+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=MQ81PMA520Y1 tag=MMMXYKESE35Q type=write size=3916395 2024-09-12T00:17:48.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.488+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=HTIX06A1UX63 type=del size=3827410 2024-09-12T00:17:48.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.492+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=LHWV9042V7XJ type=write size=1039590 2024-09-12T00:17:48.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.496+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=X20J5IB4ZLUG type=del size=3884285 2024-09-12T00:17:48.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.500+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~D4B0ZU1Y0ZEG.0 size=1048576 2024-09-12T00:17:48.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.500+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~D4B0ZU1Y0ZEG.1 size=1048576 2024-09-12T00:17:48.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.504+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~D4B0ZU1Y0ZEG.2 size=126872 2024-09-12T00:17:48.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.512+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=D4B0ZU1Y0ZEG tag=1Y5CHRM4EKX4 type=write size=3272600 2024-09-12T00:17:48.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.516+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=R2R8Y14YDMJJ type=del size=1979702 2024-09-12T00:17:48.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.520+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~1RTASL74I3JJ.0 size=945095 2024-09-12T00:17:48.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.524+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=1RTASL74I3JJ tag=HLFZF5LVG0F0 type=write size=1993671 2024-09-12T00:17:48.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.528+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=MTJV6O4R9EDB type=del size=134493 2024-09-12T00:17:48.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.532+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~CN7II2GPWHR0.0 size=847947 2024-09-12T00:17:48.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.536+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=CN7II2GPWHR0 tag=M8J8D0F9GQ40 type=write size=1896523 2024-09-12T00:17:48.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.544+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~IBO6Q2Z7J0OO.0 size=1048576 2024-09-12T00:17:48.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.548+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~IBO6Q2Z7J0OO.1 size=1048576 2024-09-12T00:17:48.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~IBO6Q2Z7J0OO.2 size=912369 2024-09-12T00:17:48.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.552+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=IBO6Q2Z7J0OO tag=ANAZQBDB0ZK6 type=write size=4058097 2024-09-12T00:17:48.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.556+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~ED53UUVPHO0T.0 size=1048576 2024-09-12T00:17:48.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.556+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~ED53UUVPHO0T.1 size=1048576 2024-09-12T00:17:48.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.560+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~ED53UUVPHO0T.2 size=1007438 2024-09-12T00:17:48.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.568+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=ED53UUVPHO0T tag=K5MQKJDKEPW1 type=write size=4153166 2024-09-12T00:17:48.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.572+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~EQEYUZDS01BN.0 size=372374 2024-09-12T00:17:48.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.572+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=EQEYUZDS01BN tag=PGDV953A0LKR type=write size=1420950 2024-09-12T00:17:48.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.576+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=06DUNAHDF2YD type=del 2024-09-12T00:17:48.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~SY2RF88HIMIP.0 size=1048576 2024-09-12T00:17:48.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.588+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~SY2RF88HIMIP.1 size=726638 2024-09-12T00:17:48.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.588+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=SY2RF88HIMIP tag=5SOXVFIJOFA8 type=write size=2823790 2024-09-12T00:17:48.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.592+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~DN4020IO2A7W.0 size=1048576 2024-09-12T00:17:48.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.592+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~DN4020IO2A7W.1 size=534031 2024-09-12T00:17:48.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.604+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=DN4020IO2A7W tag=LL1JLNWZ8S1N type=write size=2631183 2024-09-12T00:17:48.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.608+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=1ADZ4MLCLSTR type=write size=105979 2024-09-12T00:17:48.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.612+0000 7f69cdea98c0 1 < completed write operation key=I23GNCI98JHU tag=J7ANTPW0N48Z type=write size=770100 2024-09-12T00:17:48.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.616+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=LPOJE9SLHDMN type=del size=374829 2024-09-12T00:17:48.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.616+0000 7f69cdea98c0 1 < canceled part key=_multipart_I23GNCI98JHU.2~D7YWSKUU8BQB.0 size=689245 2024-09-12T00:17:48.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.620+0000 7f69cdea98c0 1 < canceled multipart upload key=I23GNCI98JHU upload=D7YWSKUU8BQB tag=MOMXS3JYO0KA type=write size=1737821 2024-09-12T00:17:48.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.628+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~LKZ5PZKQHK0P.0 size=1048576 2024-09-12T00:17:48.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.632+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~LKZ5PZKQHK0P.1 size=506486 2024-09-12T00:17:48.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.632+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=LKZ5PZKQHK0P tag=I2D46BF3SCUH type=write size=2603638 2024-09-12T00:17:48.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.636+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=J46XJ7YFY0HA type=del 2024-09-12T00:17:48.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.644+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~GNGL2SNV850G.0 size=5798 2024-09-12T00:17:48.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.644+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=GNGL2SNV850G tag=WQX6HKWKV0WT type=write size=1054374 2024-09-12T00:17:48.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.648+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~A59ONMZ4601C.0 size=1048576 2024-09-12T00:17:48.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.648+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~A59ONMZ4601C.1 size=607445 2024-09-12T00:17:48.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.656+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=A59ONMZ4601C tag=AUQ7NQ2CRTAK type=write size=2704597 2024-09-12T00:17:48.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.660+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=3EUWKSBXPY35 type=del size=482072 2024-09-12T00:17:48.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.664+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~DY2KT2IZ4JRZ.0 size=1048576 2024-09-12T00:17:48.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.664+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~DY2KT2IZ4JRZ.1 size=1048576 2024-09-12T00:17:48.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.668+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~DY2KT2IZ4JRZ.2 size=410871 2024-09-12T00:17:48.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.676+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=DY2KT2IZ4JRZ tag=TLOJWJ6Y2D6C type=write size=3556599 2024-09-12T00:17:48.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.680+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=VXHCF13T0CEL type=del size=2571836 2024-09-12T00:17:48.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.684+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~04T4Q64WIDVV.0 size=1048576 2024-09-12T00:17:48.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.688+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~04T4Q64WIDVV.1 size=963864 2024-09-12T00:17:48.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.692+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=04T4Q64WIDVV tag=16XJB9J5PGH8 type=write size=3061016 2024-09-12T00:17:48.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.696+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=KRSA59H4GDJ2 type=del size=2611421 2024-09-12T00:17:48.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.700+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~PKRR4LWVOBQ3.0 size=1048576 2024-09-12T00:17:48.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.704+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~PKRR4LWVOBQ3.1 size=1048576 2024-09-12T00:17:48.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.704+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~PKRR4LWVOBQ3.2 size=567161 2024-09-12T00:17:48.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.712+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=PKRR4LWVOBQ3 tag=JWMUG2OWTJET type=write size=3712889 2024-09-12T00:17:48.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.720+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~6BQJCD5SFBJU.0 size=972886 2024-09-12T00:17:48.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.720+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=6BQJCD5SFBJU tag=THM8N4VGJQ9X type=write size=2021462 2024-09-12T00:17:48.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.724+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=K9VFOS73P9SQ type=del 2024-09-12T00:17:48.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.732+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=XSSDKXDDJ665 type=del size=1055985 2024-09-12T00:17:48.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.740+0000 7f69cdea98c0 1 < suggested update operation key=0HAUC4BDL9VR tag=HTIX06A1UX63 type=del size=3827410 2024-09-12T00:17:48.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.744+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=P1GHYYTST8KZ type=del size=3303915 2024-09-12T00:17:48.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.752+0000 7f69cdea98c0 1 < suggested remove operation key=HSQZYI0SNZP1 tag=X20J5IB4ZLUG type=del 2024-09-12T00:17:48.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.756+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~8W2WNPVCTAU6.0 size=396000 2024-09-12T00:17:48.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.756+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=8W2WNPVCTAU6 tag=MXXBNH44RMA4 type=write size=1444576 2024-09-12T00:17:48.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.764+0000 7f69cdea98c0 1 < suggested remove operation key=9K3HLTD6DMSC tag=R2R8Y14YDMJJ type=del 2024-09-12T00:17:48.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.768+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=TO6QVLZJ1MJM type=del size=3099144 2024-09-12T00:17:48.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.772+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=MTJV6O4R9EDB type=del 2024-09-12T00:17:48.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.780+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=UGFRPAVLEHJG type=write size=432189 2024-09-12T00:17:48.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.784+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~IBO6Q2Z7J0OO.0 size=1048576 2024-09-12T00:17:48.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.788+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~IBO6Q2Z7J0OO.1 size=1048576 2024-09-12T00:17:48.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.792+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~IBO6Q2Z7J0OO.2 size=912369 2024-09-12T00:17:48.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.796+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=IBO6Q2Z7J0OO tag=ANAZQBDB0ZK6 type=write size=4058097 2024-09-12T00:17:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.800+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=RB0P0TN6C1SX type=del size=2606175 2024-09-12T00:17:48.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.804+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~EQEYUZDS01BN.0 size=372374 2024-09-12T00:17:48.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.812+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=EQEYUZDS01BN tag=PGDV953A0LKR type=write size=1420950 2024-09-12T00:17:48.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~JABZ4JHHB343.0 size=703467 2024-09-12T00:17:48.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.820+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=JABZ4JHHB343 tag=QQ91VM1SKSWY type=write size=1752043 2024-09-12T00:17:48.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.824+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~SY2RF88HIMIP.0 size=1048576 2024-09-12T00:17:48.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.824+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~SY2RF88HIMIP.1 size=726638 2024-09-12T00:17:48.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.832+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=SY2RF88HIMIP tag=5SOXVFIJOFA8 type=write size=2823790 2024-09-12T00:17:48.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.836+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=BYGLXQSERF67 type=write size=191619 2024-09-12T00:17:48.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.840+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=1ADZ4MLCLSTR type=write size=105979 2024-09-12T00:17:48.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~6HBNFPDY8ZZB.0 size=1048576 2024-09-12T00:17:48.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~6HBNFPDY8ZZB.1 size=770510 2024-09-12T00:17:48.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.848+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=6HBNFPDY8ZZB tag=FCWJ2ZGREP0N type=write size=2867662 2024-09-12T00:17:48.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.852+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=LPOJE9SLHDMN type=del 2024-09-12T00:17:48.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.856+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=XWDFB8PULX66 type=del size=2811616 2024-09-12T00:17:48.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.860+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~LKZ5PZKQHK0P.0 size=1048576 2024-09-12T00:17:48.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.864+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~LKZ5PZKQHK0P.1 size=506486 2024-09-12T00:17:48.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.872+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=LKZ5PZKQHK0P tag=I2D46BF3SCUH type=write size=2603638 2024-09-12T00:17:48.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.876+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=CYZKQMRSKJQ7 type=del size=428729 2024-09-12T00:17:48.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.880+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~GNGL2SNV850G.0 size=5798 2024-09-12T00:17:48.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.884+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=GNGL2SNV850G tag=WQX6HKWKV0WT type=write size=1054374 2024-09-12T00:17:48.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.892+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~HSY1DVDZIA8A.0 size=24736 2024-09-12T00:17:48.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.892+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=HSY1DVDZIA8A tag=0YI2P0PBMDKL type=write size=1073312 2024-09-12T00:17:48.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.896+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=3EUWKSBXPY35 type=del 2024-09-12T00:17:48.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.904+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=GTAOF2ZJ0USH type=del size=2600738 2024-09-12T00:17:48.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.908+0000 7f69cdea98c0 1 < canceled operation key=2ENKC4QT2BFS tag=VXHCF13T0CEL type=del size=2571836 2024-09-12T00:17:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.912+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=E1CPXC1CDWG1 type=del size=148329 2024-09-12T00:17:48.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.920+0000 7f69cdea98c0 1 < suggested remove operation key=UTZNJQJQMXJS tag=KRSA59H4GDJ2 type=del 2024-09-12T00:17:48.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.928+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~ZW37PMTY5JLD.0 size=30124 2024-09-12T00:17:48.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.928+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=ZW37PMTY5JLD tag=RZ6UAEWJRBQP type=write size=1078700 2024-09-12T00:17:48.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.928+0000 7f69cdea98c0 1 < canceled part key=_multipart_K0HNNMX7CDGC.2~6BQJCD5SFBJU.0 size=972886 2024-09-12T00:17:48.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.936+0000 7f69cdea98c0 1 < canceled multipart upload key=K0HNNMX7CDGC upload=6BQJCD5SFBJU tag=THM8N4VGJQ9X type=write size=2021462 2024-09-12T00:17:48.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.940+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~0IF4YO6UU00E.0 size=1048576 2024-09-12T00:17:48.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.944+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~0IF4YO6UU00E.1 size=733113 2024-09-12T00:17:48.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.944+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=0IF4YO6UU00E tag=YK107L9G4QVD type=write size=2830265 2024-09-12T00:17:48.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.948+0000 7f69cdea98c0 1 < canceled operation key=0EALARW4O3OB tag=XSSDKXDDJ665 type=del size=1055985 2024-09-12T00:17:48.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.952+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=CWDUV2DZXCSV type=del size=3416252 2024-09-12T00:17:48.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.956+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=P1GHYYTST8KZ type=del 2024-09-12T00:17:48.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.960+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=KQNLQ8CBELAN type=write size=467516 2024-09-12T00:17:48.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.964+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~8W2WNPVCTAU6.0 size=396000 2024-09-12T00:17:48.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.972+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=8W2WNPVCTAU6 tag=MXXBNH44RMA4 type=write size=1444576 2024-09-12T00:17:48.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.976+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=HKCDLVCR9G9T type=del size=1323653 2024-09-12T00:17:48.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.980+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=TO6QVLZJ1MJM type=del 2024-09-12T00:17:48.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~EPJW0J09PNOO.0 size=75864 2024-09-12T00:17:48.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.988+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=EPJW0J09PNOO tag=XBHPWAIEGGI4 type=write size=1124440 2024-09-12T00:17:48.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.992+0000 7f69cdea98c0 1 < completed write operation key=H91UXKWAJ3K8 tag=UGFRPAVLEHJG type=write size=432189 2024-09-12T00:17:48.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:48.996+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=0Z63DFS5P66U type=del size=1530745 2024-09-12T00:17:48.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.000+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=RB0P0TN6C1SX type=del 2024-09-12T00:17:49.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.004+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=X6A6N4JVPOUT type=del size=2282178 2024-09-12T00:17:49.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.008+0000 7f69cdea98c0 1 < canceled part key=_multipart_T9OJXTZNRQJB.2~JABZ4JHHB343.0 size=703467 2024-09-12T00:17:49.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.012+0000 7f69cdea98c0 1 < canceled multipart upload key=T9OJXTZNRQJB upload=JABZ4JHHB343 tag=QQ91VM1SKSWY type=write size=1752043 2024-09-12T00:17:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.020+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~F0A2EK690AFT.0 size=420434 2024-09-12T00:17:49.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.020+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=F0A2EK690AFT tag=P214OBC3S227 type=write size=1469010 2024-09-12T00:17:49.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.024+0000 7f69cdea98c0 1 < completed write operation key=0HAUC4BDL9VR tag=BYGLXQSERF67 type=write size=191619 2024-09-12T00:17:49.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.028+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=NT8GC6O4MB0C type=del size=2740284 2024-09-12T00:17:49.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.032+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~6HBNFPDY8ZZB.0 size=1048576 2024-09-12T00:17:49.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.036+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~6HBNFPDY8ZZB.1 size=770510 2024-09-12T00:17:49.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.040+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=6HBNFPDY8ZZB tag=FCWJ2ZGREP0N type=write size=2867662 2024-09-12T00:17:49.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~6H6JXQ6MQ12Y.0 size=663662 2024-09-12T00:17:49.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.048+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=6H6JXQ6MQ12Y tag=4L9KDOWENN1O type=write size=1712238 2024-09-12T00:17:49.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.052+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=XWDFB8PULX66 type=del 2024-09-12T00:17:49.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.056+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=9XWVTP3YU0CQ type=del size=1541548 2024-09-12T00:17:49.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.060+0000 7f69cdea98c0 1 < canceled operation key=K0HNNMX7CDGC tag=CYZKQMRSKJQ7 type=del size=428729 2024-09-12T00:17:49.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.064+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=DV14X1FO9RFW type=write size=193226 2024-09-12T00:17:49.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.068+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~HSY1DVDZIA8A.0 size=24736 2024-09-12T00:17:49.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.076+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=HSY1DVDZIA8A tag=0YI2P0PBMDKL type=write size=1073312 2024-09-12T00:17:49.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.080+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~CNE1UB56JGR4.0 size=1048576 2024-09-12T00:17:49.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.084+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~CNE1UB56JGR4.1 size=164288 2024-09-12T00:17:49.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.084+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=CNE1UB56JGR4 tag=IOR7KWRFLBC1 type=write size=2261440 2024-09-12T00:17:49.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.092+0000 7f69cdea98c0 1 < suggested update operation key=5453GP1H3OFQ tag=GTAOF2ZJ0USH type=del size=2600738 2024-09-12T00:17:49.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~68F85BBQ7X60.0 size=1048576 2024-09-12T00:17:49.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.104+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~68F85BBQ7X60.1 size=173679 2024-09-12T00:17:49.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.104+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=68F85BBQ7X60 tag=J3M7U9WUKA2A type=write size=2270831 2024-09-12T00:17:49.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.108+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=E1CPXC1CDWG1 type=del 2024-09-12T00:17:49.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.112+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~0XU2NXZKCJA3.0 size=1048576 2024-09-12T00:17:49.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.116+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~0XU2NXZKCJA3.1 size=34824 2024-09-12T00:17:49.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.116+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=0XU2NXZKCJA3 tag=8CVPMWJJNKL9 type=write size=2131976 2024-09-12T00:17:49.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.120+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~ZW37PMTY5JLD.0 size=30124 2024-09-12T00:17:49.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.128+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=ZW37PMTY5JLD tag=RZ6UAEWJRBQP type=write size=1078700 2024-09-12T00:17:49.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.132+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=R6TA9N2OSBUK type=write size=504469 2024-09-12T00:17:49.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.136+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~0IF4YO6UU00E.0 size=1048576 2024-09-12T00:17:49.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.136+0000 7f69cdea98c0 1 < canceled part key=_multipart_2X78JWLK876H.2~0IF4YO6UU00E.1 size=733113 2024-09-12T00:17:49.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.140+0000 7f69cdea98c0 1 < canceled multipart upload key=2X78JWLK876H upload=0IF4YO6UU00E tag=YK107L9G4QVD type=write size=2830265 2024-09-12T00:17:49.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.148+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~RYC3EZB1K6S3.0 size=139068 2024-09-12T00:17:49.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.148+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=RYC3EZB1K6S3 tag=9PRKJ3VWKAFW type=write size=1187644 2024-09-12T00:17:49.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.152+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=CWDUV2DZXCSV type=del 2024-09-12T00:17:49.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~TO8RF6FYRV09.0 size=783230 2024-09-12T00:17:49.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.160+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=TO8RF6FYRV09 tag=9MQULC0QEJ21 type=write size=1831806 2024-09-12T00:17:49.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.164+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=KQNLQ8CBELAN type=write size=467516 2024-09-12T00:17:49.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~QKPH5K40R9YC.0 size=1048576 2024-09-12T00:17:49.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~QKPH5K40R9YC.1 size=158380 2024-09-12T00:17:49.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.172+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=QKPH5K40R9YC tag=1V7IVKO6W3NJ type=write size=2255532 2024-09-12T00:17:49.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.176+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=HKCDLVCR9G9T type=del 2024-09-12T00:17:49.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.180+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=LWT5M214G9DZ type=del size=3142880 2024-09-12T00:17:49.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.184+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~EPJW0J09PNOO.0 size=75864 2024-09-12T00:17:49.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.188+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=EPJW0J09PNOO tag=XBHPWAIEGGI4 type=write size=1124440 2024-09-12T00:17:49.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.192+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=FP8DZFLVCDWL type=write size=157961 2024-09-12T00:17:49.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.196+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=0Z63DFS5P66U type=del 2024-09-12T00:17:49.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.204+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~80D99FFNM3AM.0 size=1048576 2024-09-12T00:17:49.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~80D99FFNM3AM.1 size=188769 2024-09-12T00:17:49.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.208+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=80D99FFNM3AM tag=0XY2FJF77NM3 type=write size=2285921 2024-09-12T00:17:49.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.212+0000 7f69cdea98c0 1 < canceled operation key=T9OJXTZNRQJB tag=X6A6N4JVPOUT type=del size=2282178 2024-09-12T00:17:49.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.220+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~7MLPPJMZS5HX.0 size=559825 2024-09-12T00:17:49.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.220+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=7MLPPJMZS5HX tag=34TLKOMJGMCA type=write size=1608401 2024-09-12T00:17:49.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.224+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~F0A2EK690AFT.0 size=420434 2024-09-12T00:17:49.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.228+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=F0A2EK690AFT tag=P214OBC3S227 type=write size=1469010 2024-09-12T00:17:49.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.232+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=V1E0M3239FCC type=del size=1784008 2024-09-12T00:17:49.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.236+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=NT8GC6O4MB0C type=del 2024-09-12T00:17:49.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~C067W11210FH.0 size=1001913 2024-09-12T00:17:49.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.244+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=C067W11210FH tag=26OABDV6QHDC type=write size=2050489 2024-09-12T00:17:49.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.248+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~6H6JXQ6MQ12Y.0 size=663662 2024-09-12T00:17:49.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.252+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=6H6JXQ6MQ12Y tag=4L9KDOWENN1O type=write size=1712238 2024-09-12T00:17:49.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.256+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=5008KNFATRD2 type=del size=4149945 2024-09-12T00:17:49.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.260+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=9XWVTP3YU0CQ type=del 2024-09-12T00:17:49.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.264+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=JSD99QEN9QIO type=del size=3502979 2024-09-12T00:17:49.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.268+0000 7f69cdea98c0 1 < completed write operation key=Q0L8J0BYRFDQ tag=DV14X1FO9RFW type=write size=193226 2024-09-12T00:17:49.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~HWLCK8I8EBOS.0 size=1048576 2024-09-12T00:17:49.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~HWLCK8I8EBOS.1 size=1048576 2024-09-12T00:17:49.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.280+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~HWLCK8I8EBOS.2 size=1007033 2024-09-12T00:17:49.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.280+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=HWLCK8I8EBOS tag=YNPYAJBBZZGW type=write size=4152761 2024-09-12T00:17:49.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.280+0000 7f69cdea98c0 1 < canceled part key=_multipart_IXB6WLN5M81C.2~CNE1UB56JGR4.0 size=1048576 2024-09-12T00:17:49.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.284+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~CNE1UB56JGR4.1 size=164288 2024-09-12T00:17:49.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.288+0000 7f69cdea98c0 1 < canceled multipart upload key=IXB6WLN5M81C upload=CNE1UB56JGR4 tag=IOR7KWRFLBC1 type=write size=2261440 2024-09-12T00:17:49.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~AGRXGKLYRKMB.0 size=1048576 2024-09-12T00:17:49.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~AGRXGKLYRKMB.1 size=1048576 2024-09-12T00:17:49.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.300+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~AGRXGKLYRKMB.2 size=981189 2024-09-12T00:17:49.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.300+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=AGRXGKLYRKMB tag=X9LQG2665BA3 type=write size=4126917 2024-09-12T00:17:49.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.304+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~68F85BBQ7X60.0 size=1048576 2024-09-12T00:17:49.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.308+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~68F85BBQ7X60.1 size=173679 2024-09-12T00:17:49.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.312+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=68F85BBQ7X60 tag=J3M7U9WUKA2A type=write size=2270831 2024-09-12T00:17:49.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.316+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=3SB9P21IBPEO type=del size=2488715 2024-09-12T00:17:49.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.316+0000 7f69cdea98c0 1 < canceled part key=_multipart_RDGRKQQH4B8C.2~0XU2NXZKCJA3.0 size=1048576 2024-09-12T00:17:49.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.324+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~0XU2NXZKCJA3.1 size=34824 2024-09-12T00:17:49.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.328+0000 7f69cdea98c0 1 < canceled multipart upload key=RDGRKQQH4B8C upload=0XU2NXZKCJA3 tag=8CVPMWJJNKL9 type=write size=2131976 2024-09-12T00:17:49.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.332+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=P78P3B50N5VV type=del size=2524558 2024-09-12T00:17:49.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.336+0000 7f69cdea98c0 1 < completed write operation key=2ENKC4QT2BFS tag=R6TA9N2OSBUK type=write size=504469 2024-09-12T00:17:49.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.344+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~8PHKP1OF3L6Q.0 size=122570 2024-09-12T00:17:49.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.344+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=8PHKP1OF3L6Q tag=NLW91VA3IXLX type=write size=1171146 2024-09-12T00:17:49.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.348+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~RYC3EZB1K6S3.0 size=139068 2024-09-12T00:17:49.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.356+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=RYC3EZB1K6S3 tag=9PRKJ3VWKAFW type=write size=1187644 2024-09-12T00:17:49.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.360+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=3JUKD5Y6BFB3 type=del size=228297 2024-09-12T00:17:49.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.360+0000 7f69cdea98c0 1 < canceled part key=_multipart_AQY7MM3OX3GW.2~TO8RF6FYRV09.0 size=783230 2024-09-12T00:17:49.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.368+0000 7f69cdea98c0 1 < canceled multipart upload key=AQY7MM3OX3GW upload=TO8RF6FYRV09 tag=9MQULC0QEJ21 type=write size=1831806 2024-09-12T00:17:49.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~PFN02A7VB04L.0 size=1048576 2024-09-12T00:17:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~PFN02A7VB04L.1 size=1048576 2024-09-12T00:17:49.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.380+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~PFN02A7VB04L.2 size=509529 2024-09-12T00:17:49.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.380+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=PFN02A7VB04L tag=PMZWAMXPMTXU type=write size=3655257 2024-09-12T00:17:49.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.384+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~QKPH5K40R9YC.0 size=1048576 2024-09-12T00:17:49.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.388+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~QKPH5K40R9YC.1 size=158380 2024-09-12T00:17:49.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.392+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=QKPH5K40R9YC tag=1V7IVKO6W3NJ type=write size=2255532 2024-09-12T00:17:49.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.400+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~9R3Y1HYDIODX.0 size=1048576 2024-09-12T00:17:49.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~9R3Y1HYDIODX.1 size=1048576 2024-09-12T00:17:49.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~9R3Y1HYDIODX.2 size=669518 2024-09-12T00:17:49.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.404+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=9R3Y1HYDIODX tag=5UL1D1NY27CW type=write size=3815246 2024-09-12T00:17:49.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.412+0000 7f69cdea98c0 1 < suggested remove operation key=O5WBNND16BFN tag=LWT5M214G9DZ type=del 2024-09-12T00:17:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.416+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=1J1IICS8PNI8 type=del size=3632546 2024-09-12T00:17:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.420+0000 7f69cdea98c0 1 < completed write operation key=IXWX7S5NWJS3 tag=FP8DZFLVCDWL type=write size=157961 2024-09-12T00:17:49.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.424+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=MOTMIBHAEPBS type=write size=373536 2024-09-12T00:17:49.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.428+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~80D99FFNM3AM.0 size=1048576 2024-09-12T00:17:49.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.432+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~80D99FFNM3AM.1 size=188769 2024-09-12T00:17:49.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.440+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=80D99FFNM3AM tag=0XY2FJF77NM3 type=write size=2285921 2024-09-12T00:17:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~JQSJN7QQZON1.0 size=612680 2024-09-12T00:17:49.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.444+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=JQSJN7QQZON1 tag=48VZLZS7WY10 type=write size=1661256 2024-09-12T00:17:49.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.448+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~7MLPPJMZS5HX.0 size=559825 2024-09-12T00:17:49.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.456+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=7MLPPJMZS5HX tag=34TLKOMJGMCA type=write size=1608401 2024-09-12T00:17:49.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.460+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~3FZ3M3YKTN0U.0 size=350414 2024-09-12T00:17:49.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.460+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=3FZ3M3YKTN0U tag=X37NJ31M5N35 type=write size=1398990 2024-09-12T00:17:49.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.464+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=V1E0M3239FCC type=del 2024-09-12T00:17:49.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~70DCUDQNUBW5.0 size=1048576 2024-09-12T00:17:49.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~70DCUDQNUBW5.1 size=1048576 2024-09-12T00:17:49.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~70DCUDQNUBW5.2 size=642521 2024-09-12T00:17:49.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.476+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=70DCUDQNUBW5 tag=8W91N5SQU8NR type=write size=3788249 2024-09-12T00:17:49.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.480+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~C067W11210FH.0 size=1001913 2024-09-12T00:17:49.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.488+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=C067W11210FH tag=26OABDV6QHDC type=write size=2050489 2024-09-12T00:17:49.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.492+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=K8OIPFOIT0WD type=del size=1609241 2024-09-12T00:17:49.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.496+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=5008KNFATRD2 type=del 2024-09-12T00:17:49.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.500+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=C4Q6FWOMTG43 type=del size=414703 2024-09-12T00:17:49.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.504+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=JSD99QEN9QIO type=del 2024-09-12T00:17:49.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.512+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~A5SVKT661A9W.0 size=628892 2024-09-12T00:17:49.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.512+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=A5SVKT661A9W tag=ROFUK2K2GR4Q type=write size=1677468 2024-09-12T00:17:49.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.516+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~HWLCK8I8EBOS.0 size=1048576 2024-09-12T00:17:49.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.516+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~HWLCK8I8EBOS.1 size=1048576 2024-09-12T00:17:49.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.520+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~HWLCK8I8EBOS.2 size=1007033 2024-09-12T00:17:49.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.524+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=HWLCK8I8EBOS tag=YNPYAJBBZZGW type=write size=4152761 2024-09-12T00:17:49.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.532+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~3MZFO95I2JCP.0 size=1048576 2024-09-12T00:17:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~3MZFO95I2JCP.1 size=168146 2024-09-12T00:17:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.536+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=3MZFO95I2JCP tag=GMRNMRAAJ376 type=write size=2265298 2024-09-12T00:17:49.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.540+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~AGRXGKLYRKMB.0 size=1048576 2024-09-12T00:17:49.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.540+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~AGRXGKLYRKMB.1 size=1048576 2024-09-12T00:17:49.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.544+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~AGRXGKLYRKMB.2 size=981189 2024-09-12T00:17:49.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.548+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=AGRXGKLYRKMB tag=X9LQG2665BA3 type=write size=4126917 2024-09-12T00:17:49.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.556+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~6980RKFDN5NM.0 size=1048576 2024-09-12T00:17:49.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.560+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~6980RKFDN5NM.1 size=1048576 2024-09-12T00:17:49.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.564+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~6980RKFDN5NM.2 size=248034 2024-09-12T00:17:49.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.564+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=6980RKFDN5NM tag=GQ1WDE4XR43H type=write size=3393762 2024-09-12T00:17:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.568+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=3SB9P21IBPEO type=del 2024-09-12T00:17:49.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.572+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=U9U8LXVRC1TM type=del size=1534232 2024-09-12T00:17:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.576+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=P78P3B50N5VV type=del 2024-09-12T00:17:49.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.580+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=MRRWUQBUO1JB type=del size=1365123 2024-09-12T00:17:49.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.584+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~8PHKP1OF3L6Q.0 size=122570 2024-09-12T00:17:49.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.588+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=8PHKP1OF3L6Q tag=NLW91VA3IXLX type=write size=1171146 2024-09-12T00:17:49.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.592+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=MBB4KO3H3HI6 type=del size=1407019 2024-09-12T00:17:49.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.596+0000 7f69cdea98c0 1 < canceled operation key=RDGRKQQH4B8C tag=3JUKD5Y6BFB3 type=del size=228297 2024-09-12T00:17:49.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.604+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~ZE06OC7ZAP4V.0 size=58589 2024-09-12T00:17:49.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.604+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=ZE06OC7ZAP4V tag=1CKIQA5TREJF type=write size=1107165 2024-09-12T00:17:49.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.608+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~PFN02A7VB04L.0 size=1048576 2024-09-12T00:17:49.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.612+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~PFN02A7VB04L.1 size=1048576 2024-09-12T00:17:49.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.612+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~PFN02A7VB04L.2 size=509529 2024-09-12T00:17:49.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.620+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=PFN02A7VB04L tag=PMZWAMXPMTXU type=write size=3655257 2024-09-12T00:17:49.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.624+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=B7U20FI6DH0E type=del size=3186204 2024-09-12T00:17:49.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.628+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~9R3Y1HYDIODX.0 size=1048576 2024-09-12T00:17:49.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.632+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~9R3Y1HYDIODX.1 size=1048576 2024-09-12T00:17:49.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.632+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~9R3Y1HYDIODX.2 size=669518 2024-09-12T00:17:49.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.640+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=9R3Y1HYDIODX tag=5UL1D1NY27CW type=write size=3815246 2024-09-12T00:17:49.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.644+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=37V4LHOYOMRS type=write size=734320 2024-09-12T00:17:49.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.652+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=1J1IICS8PNI8 type=del 2024-09-12T00:17:49.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.656+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=SARNUYTL9N6S type=del size=718109 2024-09-12T00:17:49.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.660+0000 7f69cdea98c0 1 < completed write operation key=AKWTTXH2P254 tag=MOTMIBHAEPBS type=write size=373536 2024-09-12T00:17:49.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~T5ZM31QIOZTK.0 size=1048576 2024-09-12T00:17:49.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.676+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~T5ZM31QIOZTK.1 size=383169 2024-09-12T00:17:49.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.676+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=T5ZM31QIOZTK tag=BRVO87J4M1VB type=write size=2480321 2024-09-12T00:17:49.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.680+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~JQSJN7QQZON1.0 size=612680 2024-09-12T00:17:49.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.688+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=JQSJN7QQZON1 tag=48VZLZS7WY10 type=write size=1661256 2024-09-12T00:17:49.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.692+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=EPI3HXYTN0NR type=del size=2147194 2024-09-12T00:17:49.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.696+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~3FZ3M3YKTN0U.0 size=350414 2024-09-12T00:17:49.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.700+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=3FZ3M3YKTN0U tag=X37NJ31M5N35 type=write size=1398990 2024-09-12T00:17:49.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.704+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=DGGEY79ZKVNY type=del size=3971812 2024-09-12T00:17:49.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.708+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~70DCUDQNUBW5.0 size=1048576 2024-09-12T00:17:49.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.712+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~70DCUDQNUBW5.1 size=1048576 2024-09-12T00:17:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.716+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~70DCUDQNUBW5.2 size=642521 2024-09-12T00:17:49.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.720+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=70DCUDQNUBW5 tag=8W91N5SQU8NR type=write size=3788249 2024-09-12T00:17:49.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.724+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=F83R4NGGWJ8O type=write size=370810 2024-09-12T00:17:49.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.728+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=K8OIPFOIT0WD type=del 2024-09-12T00:17:49.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.732+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=6LQ03Z5S6S5U type=del size=3421410 2024-09-12T00:17:49.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.740+0000 7f69cdea98c0 1 < suggested update operation key=SP2KVAO82MQ0 tag=C4Q6FWOMTG43 type=del size=414703 2024-09-12T00:17:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.744+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=DW6JDEZ73A0B type=del size=793690 2024-09-12T00:17:49.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.748+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~A5SVKT661A9W.0 size=628892 2024-09-12T00:17:49.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.752+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=A5SVKT661A9W tag=ROFUK2K2GR4Q type=write size=1677468 2024-09-12T00:17:49.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.756+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=ZRPOL8EHCF78 type=del size=2940496 2024-09-12T00:17:49.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.760+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~3MZFO95I2JCP.0 size=1048576 2024-09-12T00:17:49.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.760+0000 7f69cdea98c0 1 < canceled part key=_multipart_9K3HLTD6DMSC.2~3MZFO95I2JCP.1 size=168146 2024-09-12T00:17:49.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.768+0000 7f69cdea98c0 1 < canceled multipart upload key=9K3HLTD6DMSC upload=3MZFO95I2JCP tag=GMRNMRAAJ376 type=write size=2265298 2024-09-12T00:17:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.772+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=QIJECDPYROMR type=del size=3822264 2024-09-12T00:17:49.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.776+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~6980RKFDN5NM.0 size=1048576 2024-09-12T00:17:49.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.776+0000 7f69cdea98c0 1 < canceled part key=_multipart_HSQZYI0SNZP1.2~6980RKFDN5NM.1 size=1048576 2024-09-12T00:17:49.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.776+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~6980RKFDN5NM.2 size=248034 2024-09-12T00:17:49.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.784+0000 7f69cdea98c0 1 < canceled multipart upload key=HSQZYI0SNZP1 upload=6980RKFDN5NM tag=GQ1WDE4XR43H type=write size=3393762 2024-09-12T00:17:49.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.788+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=TAARAEQWR0US type=del size=1898186 2024-09-12T00:17:49.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.792+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=U9U8LXVRC1TM type=del 2024-09-12T00:17:49.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.796+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=8X8YIJX2VUE2 type=del size=2173647 2024-09-12T00:17:49.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.800+0000 7f69cdea98c0 1 < canceled operation key=1CZXUEJLQ8FM tag=MRRWUQBUO1JB type=del size=1365123 2024-09-12T00:17:49.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.804+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=UDOFZ9U1ACJE type=del size=1035654 2024-09-12T00:17:49.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.808+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=MBB4KO3H3HI6 type=del 2024-09-12T00:17:49.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.812+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~N666CTX1C9ET.0 size=1048576 2024-09-12T00:17:49.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.816+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~N666CTX1C9ET.1 size=1048576 2024-09-12T00:17:49.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~N666CTX1C9ET.2 size=807318 2024-09-12T00:17:49.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.820+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=N666CTX1C9ET tag=G00IIPJ1TMPC type=write size=3953046 2024-09-12T00:17:49.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.824+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~ZE06OC7ZAP4V.0 size=58589 2024-09-12T00:17:49.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.828+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=ZE06OC7ZAP4V tag=1CKIQA5TREJF type=write size=1107165 2024-09-12T00:17:49.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.836+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~D4JJ2QPQNJFM.0 size=38931 2024-09-12T00:17:49.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.836+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=D4JJ2QPQNJFM tag=NE1M11ULYEEA type=write size=1087507 2024-09-12T00:17:49.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.844+0000 7f69cdea98c0 1 < suggested remove operation key=O5WBNND16BFN tag=B7U20FI6DH0E type=del 2024-09-12T00:17:49.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.844+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=BKFWW9YO1K04 type=del size=1855537 2024-09-12T00:17:49.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.852+0000 7f69cdea98c0 1 < completed write operation key=SCFIVX3IHERR tag=37V4LHOYOMRS type=write size=734320 2024-09-12T00:17:49.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.856+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~TESU8XOYTGJF.0 size=981787 2024-09-12T00:17:49.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.856+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=TESU8XOYTGJF tag=QOJOF2N1R5ZL type=write size=2030363 2024-09-12T00:17:49.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.860+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=SARNUYTL9N6S type=del 2024-09-12T00:17:49.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~58EUPLE76QI2.0 size=720734 2024-09-12T00:17:49.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.868+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=58EUPLE76QI2 tag=9OHKITSMP3TU type=write size=1769310 2024-09-12T00:17:49.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.872+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~T5ZM31QIOZTK.0 size=1048576 2024-09-12T00:17:49.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.876+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~T5ZM31QIOZTK.1 size=383169 2024-09-12T00:17:49.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.880+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=T5ZM31QIOZTK tag=BRVO87J4M1VB type=write size=2480321 2024-09-12T00:17:49.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.884+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=UJEDPPRGE75T type=write size=373509 2024-09-12T00:17:49.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.888+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=EPI3HXYTN0NR type=del 2024-09-12T00:17:49.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~30VJISZQAQEC.0 size=1048576 2024-09-12T00:17:49.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~30VJISZQAQEC.1 size=1048576 2024-09-12T00:17:49.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.900+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~30VJISZQAQEC.2 size=20256 2024-09-12T00:17:49.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.900+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=30VJISZQAQEC tag=RREGWYNQVTAW type=write size=3165984 2024-09-12T00:17:49.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.904+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=DGGEY79ZKVNY type=del 2024-09-12T00:17:49.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.912+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~LQ8TQSA1E1B3.0 size=712461 2024-09-12T00:17:49.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.912+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=LQ8TQSA1E1B3 tag=134T97ZYMKHD type=write size=1761037 2024-09-12T00:17:49.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.916+0000 7f69cdea98c0 1 < completed write operation key=HSQZYI0SNZP1 tag=F83R4NGGWJ8O type=write size=370810 2024-09-12T00:17:49.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.924+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=2BZF0WQEB1DZ type=del size=1948944 2024-09-12T00:17:49.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.928+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=6LQ03Z5S6S5U type=del 2024-09-12T00:17:49.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.928+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=QRPID23J4GWF type=del size=1729034 2024-09-12T00:17:49.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.932+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=DW6JDEZ73A0B type=del 2024-09-12T00:17:49.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.940+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~9N6RAYQQ4J2V.0 size=1048576 2024-09-12T00:17:49.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.944+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~9N6RAYQQ4J2V.1 size=1048576 2024-09-12T00:17:49.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~9N6RAYQQ4J2V.2 size=127939 2024-09-12T00:17:49.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.948+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=9N6RAYQQ4J2V tag=WQV5OHOQGKO0 type=write size=3273667 2024-09-12T00:17:49.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.952+0000 7f69cdea98c0 1 < suggested remove operation key=9K3HLTD6DMSC tag=ZRPOL8EHCF78 type=del 2024-09-12T00:17:49.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.960+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~W0PSSQ11O1CI.0 size=1048576 2024-09-12T00:17:49.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~W0PSSQ11O1CI.1 size=1048576 2024-09-12T00:17:49.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.968+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~W0PSSQ11O1CI.2 size=644631 2024-09-12T00:17:49.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.968+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=W0PSSQ11O1CI tag=R54GFB0VQ38H type=write size=3790359 2024-09-12T00:17:49.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.968+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=QIJECDPYROMR type=del 2024-09-12T00:17:49.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.972+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=UYPB23048V8U type=del size=3948216 2024-09-12T00:17:49.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.976+0000 7f69cdea98c0 -1 < failed to complete operation key=9K3HLTD6DMSC tag=TAARAEQWR0US type=del size=1898186: (22) Invalid argument 2024-09-12T00:17:49.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.980+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=Q08WJJ60RQ2K type=del size=680359 2024-09-12T00:17:49.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.984+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=8X8YIJX2VUE2 type=del 2024-09-12T00:17:49.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.988+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=IZRA3RMWQ63W type=del size=492361 2024-09-12T00:17:49.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.992+0000 7f69cdea98c0 1 < canceled operation key=AQY7MM3OX3GW tag=UDOFZ9U1ACJE type=del size=1035654 2024-09-12T00:17:49.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.996+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=LVGUFJ76S6BE type=del size=2583239 2024-09-12T00:17:49.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:49.996+0000 7f69cdea98c0 1 < canceled part key=_multipart_0HAUC4BDL9VR.2~N666CTX1C9ET.0 size=1048576 2024-09-12T00:17:49.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.000+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~N666CTX1C9ET.1 size=1048576 2024-09-12T00:17:50.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.004+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~N666CTX1C9ET.2 size=807318 2024-09-12T00:17:50.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.008+0000 7f69cdea98c0 1 < canceled multipart upload key=0HAUC4BDL9VR upload=N666CTX1C9ET tag=G00IIPJ1TMPC type=write size=3953046 2024-09-12T00:17:50.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.012+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=9NI1N1Y10Q7V type=del size=1929677 2024-09-12T00:17:50.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.016+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~D4JJ2QPQNJFM.0 size=38931 2024-09-12T00:17:50.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.020+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=D4JJ2QPQNJFM tag=NE1M11ULYEEA type=write size=1087507 2024-09-12T00:17:50.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.028+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=U08PTMNYV1B9 type=del size=3393738 2024-09-12T00:17:50.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.032+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=BKFWW9YO1K04 type=del 2024-09-12T00:17:50.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.040+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~BBMZHI2O4GED.0 size=784174 2024-09-12T00:17:50.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.040+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=BBMZHI2O4GED tag=2S5WFTQPW15F type=write size=1832750 2024-09-12T00:17:50.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.044+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~TESU8XOYTGJF.0 size=981787 2024-09-12T00:17:50.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.052+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=TESU8XOYTGJF tag=QOJOF2N1R5ZL type=write size=2030363 2024-09-12T00:17:50.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.056+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=J2OJVHHAR0WY type=del size=535642 2024-09-12T00:17:50.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.060+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~58EUPLE76QI2.0 size=720734 2024-09-12T00:17:50.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.064+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=58EUPLE76QI2 tag=9OHKITSMP3TU type=write size=1769310 2024-09-12T00:17:50.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~XJZFG9YFVK5V.0 size=1048576 2024-09-12T00:17:50.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~XJZFG9YFVK5V.1 size=1037794 2024-09-12T00:17:50.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.072+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=XJZFG9YFVK5V tag=53N2B0FA6IOQ type=write size=3134946 2024-09-12T00:17:50.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.076+0000 7f69cdea98c0 1 < completed write operation key=5453GP1H3OFQ tag=UJEDPPRGE75T type=write size=373509 2024-09-12T00:17:50.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.084+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~AU9F0F9W2WTY.0 size=1048576 2024-09-12T00:17:50.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.088+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~AU9F0F9W2WTY.1 size=188834 2024-09-12T00:17:50.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.088+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=AU9F0F9W2WTY tag=JIMUMN0SII09 type=write size=2285986 2024-09-12T00:17:50.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.092+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~30VJISZQAQEC.0 size=1048576 2024-09-12T00:17:50.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.096+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~30VJISZQAQEC.1 size=1048576 2024-09-12T00:17:50.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.096+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~30VJISZQAQEC.2 size=20256 2024-09-12T00:17:50.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.104+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=30VJISZQAQEC tag=RREGWYNQVTAW type=write size=3165984 2024-09-12T00:17:50.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.108+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=4H1D6D0LKUZC type=del size=2712447 2024-09-12T00:17:50.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.112+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~LQ8TQSA1E1B3.0 size=712461 2024-09-12T00:17:50.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.116+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=LQ8TQSA1E1B3 tag=134T97ZYMKHD type=write size=1761037 2024-09-12T00:17:50.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.120+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=786Z71DRVMZU type=write size=396348 2024-09-12T00:17:50.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.128+0000 7f69cdea98c0 1 < suggested update operation key=0EALARW4O3OB tag=2BZF0WQEB1DZ type=del size=1948944 2024-09-12T00:17:50.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.132+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=HA23GUD0JLJV type=write size=405798 2024-09-12T00:17:50.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.136+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=QRPID23J4GWF type=del 2024-09-12T00:17:50.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.140+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=RYN8UJEWBEP6 type=write size=361492 2024-09-12T00:17:50.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.144+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~9N6RAYQQ4J2V.0 size=1048576 2024-09-12T00:17:50.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.144+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~9N6RAYQQ4J2V.1 size=1048576 2024-09-12T00:17:50.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.148+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~9N6RAYQQ4J2V.2 size=127939 2024-09-12T00:17:50.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.156+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=9N6RAYQQ4J2V tag=WQV5OHOQGKO0 type=write size=3273667 2024-09-12T00:17:50.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~ZXB7Q90VW1F6.0 size=1048576 2024-09-12T00:17:50.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.164+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~ZXB7Q90VW1F6.1 size=1048576 2024-09-12T00:17:50.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~ZXB7Q90VW1F6.2 size=1439 2024-09-12T00:17:50.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.168+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=ZXB7Q90VW1F6 tag=CA44F1JMES2Y type=write size=3147167 2024-09-12T00:17:50.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.168+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~W0PSSQ11O1CI.0 size=1048576 2024-09-12T00:17:50.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.172+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~W0PSSQ11O1CI.1 size=1048576 2024-09-12T00:17:50.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.176+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~W0PSSQ11O1CI.2 size=644631 2024-09-12T00:17:50.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.184+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=W0PSSQ11O1CI tag=R54GFB0VQ38H type=write size=3790359 2024-09-12T00:17:50.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.188+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=T5JKM6AGD533 type=del size=4073707 2024-09-12T00:17:50.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.192+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=UYPB23048V8U type=del 2024-09-12T00:17:50.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.196+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=O0NS2ATQYEF9 type=del size=1119473 2024-09-12T00:17:50.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.200+0000 7f69cdea98c0 1 < canceled operation key=O5WBNND16BFN tag=Q08WJJ60RQ2K type=del size=680359 2024-09-12T00:17:50.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.204+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=UJ24CEF6YV7Q type=del size=86147 2024-09-12T00:17:50.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.208+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=IZRA3RMWQ63W type=del 2024-09-12T00:17:50.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.212+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=DWXXRP3R3TDY type=del size=2617332 2024-09-12T00:17:50.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.216+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=LVGUFJ76S6BE type=del 2024-09-12T00:17:50.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.220+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=4ZFNBFJ299SQ type=del size=4142843 2024-09-12T00:17:50.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.224+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=9NI1N1Y10Q7V type=del 2024-09-12T00:17:50.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.224+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=GNEU5OP471LA type=write size=156073 2024-09-12T00:17:50.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.232+0000 7f69cdea98c0 1 < suggested update operation key=4O5U4WX3N4SA tag=U08PTMNYV1B9 type=del size=3393738 2024-09-12T00:17:50.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.236+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=UZ9EBPEOIJYG type=write size=386659 2024-09-12T00:17:50.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.240+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~BBMZHI2O4GED.0 size=784174 2024-09-12T00:17:50.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.248+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=BBMZHI2O4GED tag=2S5WFTQPW15F type=write size=1832750 2024-09-12T00:17:50.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.248+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=AE6TY71VNW80 type=del size=3658017 2024-09-12T00:17:50.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.252+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=J2OJVHHAR0WY type=del 2024-09-12T00:17:50.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.256+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=JYADQYMKVKH9 type=write size=893738 2024-09-12T00:17:50.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.260+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~XJZFG9YFVK5V.0 size=1048576 2024-09-12T00:17:50.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.264+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~XJZFG9YFVK5V.1 size=1037794 2024-09-12T00:17:50.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.272+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=XJZFG9YFVK5V tag=53N2B0FA6IOQ type=write size=3134946 2024-09-12T00:17:50.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.272+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=T9CS3O20EXYW type=write size=100607 2024-09-12T00:17:50.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.280+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~AU9F0F9W2WTY.0 size=1048576 2024-09-12T00:17:50.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.280+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~AU9F0F9W2WTY.1 size=188834 2024-09-12T00:17:50.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.288+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=AU9F0F9W2WTY tag=JIMUMN0SII09 type=write size=2285986 2024-09-12T00:17:50.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.292+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=BHA0UL1CC8HC type=write size=706303 2024-09-12T00:17:50.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.296+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=4H1D6D0LKUZC type=del 2024-09-12T00:17:50.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.300+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=9ZSE75VBS7VL type=del size=4103441 2024-09-12T00:17:50.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.304+0000 7f69cdea98c0 1 < completed write operation key=YS23U9GQS7SJ tag=786Z71DRVMZU type=write size=396348 2024-09-12T00:17:50.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.308+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=0UBBUFFPKTQ9 type=del size=921321 2024-09-12T00:17:50.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.312+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=HA23GUD0JLJV type=write size=405798 2024-09-12T00:17:50.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.316+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=3ZI0HNFTPDQ9 type=del size=4045084 2024-09-12T00:17:50.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.320+0000 7f69cdea98c0 1 < completed write operation key=2ENKC4QT2BFS tag=RYN8UJEWBEP6 type=write size=361492 2024-09-12T00:17:50.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.324+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~20K3IPFZ4KWF.0 size=1048576 2024-09-12T00:17:50.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~20K3IPFZ4KWF.1 size=1023302 2024-09-12T00:17:50.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.328+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=20K3IPFZ4KWF tag=T4B7ASDUETGP type=write size=3120454 2024-09-12T00:17:50.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.332+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~ZXB7Q90VW1F6.0 size=1048576 2024-09-12T00:17:50.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.336+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~ZXB7Q90VW1F6.1 size=1048576 2024-09-12T00:17:50.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.336+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~ZXB7Q90VW1F6.2 size=1439 2024-09-12T00:17:50.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.344+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=ZXB7Q90VW1F6 tag=CA44F1JMES2Y type=write size=3147167 2024-09-12T00:17:50.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.348+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~68N8DCTKN82T.0 size=1048576 2024-09-12T00:17:50.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.352+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~68N8DCTKN82T.1 size=1048576 2024-09-12T00:17:50.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~68N8DCTKN82T.2 size=230828 2024-09-12T00:17:50.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.356+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=68N8DCTKN82T tag=IECF5TRY50PQ type=write size=3376556 2024-09-12T00:17:50.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.360+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=T5JKM6AGD533 type=del 2024-09-12T00:17:50.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.364+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=86DOR071AKCZ type=write size=87056 2024-09-12T00:17:50.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.368+0000 7f69cdea98c0 1 < suggested update operation key=1CZXUEJLQ8FM tag=O0NS2ATQYEF9 type=del size=1119473 2024-09-12T00:17:50.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.380+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~WWODS8F2UHIL.0 size=1048576 2024-09-12T00:17:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~WWODS8F2UHIL.1 size=1048576 2024-09-12T00:17:50.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~WWODS8F2UHIL.2 size=328769 2024-09-12T00:17:50.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.384+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=WWODS8F2UHIL tag=1AS7XZBFJ5LW type=write size=3474497 2024-09-12T00:17:50.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.388+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=UJ24CEF6YV7Q type=del 2024-09-12T00:17:50.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~KSTNW9ABJCQJ.0 size=643295 2024-09-12T00:17:50.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.396+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=KSTNW9ABJCQJ tag=WHN0ZSXM3M3I type=write size=1691871 2024-09-12T00:17:50.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.404+0000 7f69cdea98c0 1 < suggested remove operation key=Q0L8J0BYRFDQ tag=DWXXRP3R3TDY type=del 2024-09-12T00:17:50.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~N9W9DZEEM7KD.0 size=1048576 2024-09-12T00:17:50.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~N9W9DZEEM7KD.1 size=1048576 2024-09-12T00:17:50.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.416+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~N9W9DZEEM7KD.2 size=894961 2024-09-12T00:17:50.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.416+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=N9W9DZEEM7KD tag=BJ3D0L45A858 type=write size=4040689 2024-09-12T00:17:50.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.420+0000 7f69cdea98c0 -1 < failed to complete operation key=Q0L8J0BYRFDQ tag=4ZFNBFJ299SQ type=del size=4142843: (22) Invalid argument 2024-09-12T00:17:50.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.424+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=N09HMT7JAIAF type=del size=3372058 2024-09-12T00:17:50.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.428+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=GNEU5OP471LA type=write size=156073 2024-09-12T00:17:50.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~GFPK65GN8RXE.0 size=93897 2024-09-12T00:17:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.432+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=GFPK65GN8RXE tag=0QF0Y3CFR4YS type=write size=1142473 2024-09-12T00:17:50.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.436+0000 7f69cdea98c0 1 < canceled operation key=9K3HLTD6DMSC tag=UZ9EBPEOIJYG type=write size=386659 2024-09-12T00:17:50.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.440+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=XT1NR020FD0T type=write size=251925 2024-09-12T00:17:50.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.444+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=AE6TY71VNW80 type=del 2024-09-12T00:17:50.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~5JJXHG5BXM9O.0 size=1048576 2024-09-12T00:17:50.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~5JJXHG5BXM9O.1 size=768691 2024-09-12T00:17:50.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.452+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=5JJXHG5BXM9O tag=JDS2D8KYTX3I type=write size=2865843 2024-09-12T00:17:50.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.460+0000 7f69cdea98c0 1 < suggested remove operation key=K4LNDJJUA1RZ tag=JYADQYMKVKH9 type=write 2024-09-12T00:17:50.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.464+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=BO5LXRILJ4OG type=del size=426285 2024-09-12T00:17:50.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.468+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=T9CS3O20EXYW type=write size=100607 2024-09-12T00:17:50.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.472+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=84HORJ6VAAFR type=del size=3671654 2024-09-12T00:17:50.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.476+0000 7f69cdea98c0 1 < completed write operation key=LRHZKCU22AIX tag=BHA0UL1CC8HC type=write size=706303 2024-09-12T00:17:50.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.480+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=D5ZE6515A59Q type=del size=2986582 2024-09-12T00:17:50.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.488+0000 7f69cdea98c0 1 < suggested update operation key=5453GP1H3OFQ tag=9ZSE75VBS7VL type=del size=4103441 2024-09-12T00:17:50.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.492+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=JPMFKVUTVEHA type=del size=594482 2024-09-12T00:17:50.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.500+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=0UBBUFFPKTQ9 type=del 2024-09-12T00:17:50.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.504+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=VBLLH0CWCG8W type=write size=795475 2024-09-12T00:17:50.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.508+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=3ZI0HNFTPDQ9 type=del 2024-09-12T00:17:50.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.516+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~1KTPA1YK8QTB.0 size=1048576 2024-09-12T00:17:50.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.520+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~1KTPA1YK8QTB.1 size=1048576 2024-09-12T00:17:50.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.520+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~1KTPA1YK8QTB.2 size=184968 2024-09-12T00:17:50.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.524+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=1KTPA1YK8QTB tag=GCX6HOQOA4L1 type=write size=3330696 2024-09-12T00:17:50.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.524+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~20K3IPFZ4KWF.0 size=1048576 2024-09-12T00:17:50.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.528+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~20K3IPFZ4KWF.1 size=1023302 2024-09-12T00:17:50.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.536+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=20K3IPFZ4KWF tag=T4B7ASDUETGP type=write size=3120454 2024-09-12T00:17:50.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.540+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~RLQ6XUX9FQCN.0 size=931430 2024-09-12T00:17:50.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.540+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=RLQ6XUX9FQCN tag=9V2OQ26TQGT0 type=write size=1980006 2024-09-12T00:17:50.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.548+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~68N8DCTKN82T.0 size=1048576 2024-09-12T00:17:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.548+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~68N8DCTKN82T.1 size=1048576 2024-09-12T00:17:50.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.552+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~68N8DCTKN82T.2 size=230828 2024-09-12T00:17:50.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.560+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=68N8DCTKN82T tag=IECF5TRY50PQ type=write size=3376556 2024-09-12T00:17:50.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.564+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=N314SN66513T type=del size=1772093 2024-09-12T00:17:50.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.568+0000 7f69cdea98c0 1 < canceled operation key=AKWTTXH2P254 tag=86DOR071AKCZ type=write size=87056 2024-09-12T00:17:50.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.576+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~EVYODXZU3S3M.0 size=64021 2024-09-12T00:17:50.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.576+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=EVYODXZU3S3M tag=AV629ZG7A40O type=write size=1112597 2024-09-12T00:17:50.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.580+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~WWODS8F2UHIL.0 size=1048576 2024-09-12T00:17:50.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.580+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~WWODS8F2UHIL.1 size=1048576 2024-09-12T00:17:50.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.580+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~WWODS8F2UHIL.2 size=328769 2024-09-12T00:17:50.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.588+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=WWODS8F2UHIL tag=1AS7XZBFJ5LW type=write size=3474497 2024-09-12T00:17:50.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.592+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=SN19UBJW67OV type=del size=235531 2024-09-12T00:17:50.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.596+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~KSTNW9ABJCQJ.0 size=643295 2024-09-12T00:17:50.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.600+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=KSTNW9ABJCQJ tag=WHN0ZSXM3M3I type=write size=1691871 2024-09-12T00:17:50.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.604+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=930E1UPNFD08 type=del size=4169444 2024-09-12T00:17:50.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.608+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~N9W9DZEEM7KD.0 size=1048576 2024-09-12T00:17:50.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.612+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~N9W9DZEEM7KD.1 size=1048576 2024-09-12T00:17:50.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.616+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~N9W9DZEEM7KD.2 size=894961 2024-09-12T00:17:50.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.620+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=N9W9DZEEM7KD tag=BJ3D0L45A858 type=write size=4040689 2024-09-12T00:17:50.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.628+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~335X25T210IY.0 size=1048576 2024-09-12T00:17:50.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.632+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~335X25T210IY.1 size=1048576 2024-09-12T00:17:50.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.632+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~335X25T210IY.2 size=817322 2024-09-12T00:17:50.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.632+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=335X25T210IY tag=A0LZLIMLD57Z type=write size=3963050 2024-09-12T00:17:50.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.636+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=N09HMT7JAIAF type=del 2024-09-12T00:17:50.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.640+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=ALW431RESVS6 type=del size=2485842 2024-09-12T00:17:50.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.644+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~GFPK65GN8RXE.0 size=93897 2024-09-12T00:17:50.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.652+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=GFPK65GN8RXE tag=0QF0Y3CFR4YS type=write size=1142473 2024-09-12T00:17:50.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.656+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=9L64HQDDBCAP type=write size=192872 2024-09-12T00:17:50.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.660+0000 7f69cdea98c0 1 < completed write operation key=YS23U9GQS7SJ tag=XT1NR020FD0T type=write size=251925 2024-09-12T00:17:50.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.664+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=4GDBDNT7LVG8 type=del size=2595226 2024-09-12T00:17:50.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.664+0000 7f69cdea98c0 1 < canceled part key=_multipart_UTZNJQJQMXJS.2~5JJXHG5BXM9O.0 size=1048576 2024-09-12T00:17:50.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.668+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~5JJXHG5BXM9O.1 size=768691 2024-09-12T00:17:50.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.672+0000 7f69cdea98c0 1 < canceled multipart upload key=UTZNJQJQMXJS upload=5JJXHG5BXM9O tag=JDS2D8KYTX3I type=write size=2865843 2024-09-12T00:17:50.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.676+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=Z7AJSQY0SCW6 type=del size=585619 2024-09-12T00:17:50.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.680+0000 7f69cdea98c0 1 < canceled operation key=LRHZKCU22AIX tag=BO5LXRILJ4OG type=del size=426285 2024-09-12T00:17:50.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.684+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=CY5VCUJI5W9Z type=del size=716567 2024-09-12T00:17:50.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.688+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=84HORJ6VAAFR type=del 2024-09-12T00:17:50.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.692+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=T4G9RNA55RH5 type=del size=1204908 2024-09-12T00:17:50.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.696+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=D5ZE6515A59Q type=del 2024-09-12T00:17:50.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.704+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=Q3ZJJQCKZ8NL type=del size=1693806 2024-09-12T00:17:50.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.708+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=JPMFKVUTVEHA type=del 2024-09-12T00:17:50.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.712+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=WMBSOVY9EXTR type=del size=3892754 2024-09-12T00:17:50.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.720+0000 7f69cdea98c0 1 < suggested update operation key=2X78JWLK876H tag=VBLLH0CWCG8W type=write size=795475 2024-09-12T00:17:50.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.724+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=3GLSO9T1CINE type=del size=558346 2024-09-12T00:17:50.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.724+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~1KTPA1YK8QTB.0 size=1048576 2024-09-12T00:17:50.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.728+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~1KTPA1YK8QTB.1 size=1048576 2024-09-12T00:17:50.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.732+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~1KTPA1YK8QTB.2 size=184968 2024-09-12T00:17:50.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.740+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=1KTPA1YK8QTB tag=GCX6HOQOA4L1 type=write size=3330696 2024-09-12T00:17:50.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~X5IL97F3B7TD.0 size=33844 2024-09-12T00:17:50.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.748+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=X5IL97F3B7TD tag=TLV8M9ENO2ML type=write size=1082420 2024-09-12T00:17:50.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.752+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~RLQ6XUX9FQCN.0 size=931430 2024-09-12T00:17:50.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.756+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=RLQ6XUX9FQCN tag=9V2OQ26TQGT0 type=write size=1980006 2024-09-12T00:17:50.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.764+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=M7LOKBADYWQR type=del size=1654320 2024-09-12T00:17:50.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.768+0000 7f69cdea98c0 1 < canceled operation key=AWZ03VE7D86K tag=N314SN66513T type=del size=1772093 2024-09-12T00:17:50.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.776+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~DWSLNNIAM338.0 size=1048576 2024-09-12T00:17:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.776+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~DWSLNNIAM338.1 size=1048576 2024-09-12T00:17:50.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.780+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~DWSLNNIAM338.2 size=88635 2024-09-12T00:17:50.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.780+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=DWSLNNIAM338 tag=2FJFUNMCK0LA type=write size=3234363 2024-09-12T00:17:50.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.784+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~EVYODXZU3S3M.0 size=64021 2024-09-12T00:17:50.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.788+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=EVYODXZU3S3M tag=AV629ZG7A40O type=write size=1112597 2024-09-12T00:17:50.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.792+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=NETEXOOJY9QH type=del size=3278916 2024-09-12T00:17:50.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.800+0000 7f69cdea98c0 1 < suggested remove operation key=0EALARW4O3OB tag=SN19UBJW67OV type=del 2024-09-12T00:17:50.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.804+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=HYFTJK3GA4J6 type=write size=318083 2024-09-12T00:17:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.808+0000 7f69cdea98c0 1 < canceled operation key=0J667VAQGMTX tag=930E1UPNFD08 type=del size=4169444 2024-09-12T00:17:50.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.812+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=YC19MDK4Q1FT type=del size=1765173 2024-09-12T00:17:50.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.816+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~335X25T210IY.0 size=1048576 2024-09-12T00:17:50.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.820+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~335X25T210IY.1 size=1048576 2024-09-12T00:17:50.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.824+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~335X25T210IY.2 size=817322 2024-09-12T00:17:50.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.828+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=335X25T210IY tag=A0LZLIMLD57Z type=write size=3963050 2024-09-12T00:17:50.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.832+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=21E5LDD6HH46 type=del size=35023 2024-09-12T00:17:50.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.836+0000 7f69cdea98c0 1 < canceled operation key=9K3HLTD6DMSC tag=ALW431RESVS6 type=del size=2485842 2024-09-12T00:17:50.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.840+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=L7JJ2Z9K0ADM type=del size=1495849 2024-09-12T00:17:50.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.844+0000 7f69cdea98c0 1 < completed write operation key=5453GP1H3OFQ tag=9L64HQDDBCAP type=write size=192872 2024-09-12T00:17:50.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.848+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=T5SEVWXNZYKF type=del size=2658049 2024-09-12T00:17:50.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.856+0000 7f69cdea98c0 1 < suggested remove operation key=H91UXKWAJ3K8 tag=4GDBDNT7LVG8 type=del 2024-09-12T00:17:50.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.860+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=MY2KB36G68MB type=write size=922199 2024-09-12T00:17:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.868+0000 7f69cdea98c0 1 < suggested update operation key=VYYY8MF0P3Q7 tag=Z7AJSQY0SCW6 type=del size=585619 2024-09-12T00:17:50.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~JDDTQ3H8FYJZ.0 size=1048576 2024-09-12T00:17:50.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~JDDTQ3H8FYJZ.1 size=298213 2024-09-12T00:17:50.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.880+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=JDDTQ3H8FYJZ tag=D1MO87W0W5A8 type=write size=2395365 2024-09-12T00:17:50.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.880+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=CY5VCUJI5W9Z type=del 2024-09-12T00:17:50.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.884+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=PVEM4FNYC2VH type=del size=3090122 2024-09-12T00:17:50.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.892+0000 7f69cdea98c0 1 < suggested remove operation key=0HAUC4BDL9VR tag=T4G9RNA55RH5 type=del 2024-09-12T00:17:50.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.896+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=P9X8GKL174GO type=del size=2692119 2024-09-12T00:17:50.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.900+0000 7f69cdea98c0 -1 < failed to complete operation key=0HAUC4BDL9VR tag=Q3ZJJQCKZ8NL type=del size=1693806: (22) Invalid argument 2024-09-12T00:17:50.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.908+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~3UG32NDCX8NZ.0 size=1048576 2024-09-12T00:17:50.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.912+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~3UG32NDCX8NZ.1 size=1048576 2024-09-12T00:17:50.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.912+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~3UG32NDCX8NZ.2 size=741550 2024-09-12T00:17:50.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.912+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=3UG32NDCX8NZ tag=GM6VAOJAGOVJ type=write size=3887278 2024-09-12T00:17:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.920+0000 7f69cdea98c0 1 < suggested remove operation key=AKWTTXH2P254 tag=WMBSOVY9EXTR type=del 2024-09-12T00:17:50.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.924+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=V10GJONQXCJY type=del size=3267971 2024-09-12T00:17:50.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.928+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=3GLSO9T1CINE type=del 2024-09-12T00:17:50.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.932+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=WRSUIUD3O9CX type=write size=761039 2024-09-12T00:17:50.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.936+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~X5IL97F3B7TD.0 size=33844 2024-09-12T00:17:50.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.940+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=X5IL97F3B7TD tag=TLV8M9ENO2ML type=write size=1082420 2024-09-12T00:17:50.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~S9VGK59563GV.0 size=854772 2024-09-12T00:17:50.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.948+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=S9VGK59563GV tag=2TOAHKNKU4PD type=write size=1903348 2024-09-12T00:17:50.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.952+0000 7f69cdea98c0 1 < canceled operation key=IXB6WLN5M81C tag=M7LOKBADYWQR type=del size=1654320 2024-09-12T00:17:50.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.956+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=RGWC5R80M7OU type=write size=124490 2024-09-12T00:17:50.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.960+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~DWSLNNIAM338.0 size=1048576 2024-09-12T00:17:50.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.964+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~DWSLNNIAM338.1 size=1048576 2024-09-12T00:17:50.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.964+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~DWSLNNIAM338.2 size=88635 2024-09-12T00:17:50.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.972+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=DWSLNNIAM338 tag=2FJFUNMCK0LA type=write size=3234363 2024-09-12T00:17:50.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.976+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~5NFNPSFB3AT1.0 size=796132 2024-09-12T00:17:50.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.976+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=5NFNPSFB3AT1 tag=ENMJELF34UEP type=write size=1844708 2024-09-12T00:17:50.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.980+0000 7f69cdea98c0 -1 < failed to complete operation key=0EALARW4O3OB tag=NETEXOOJY9QH type=del size=3278916: (22) Invalid argument 2024-09-12T00:17:50.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.984+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=IO3GBTZLK7RG type=del size=1202431 2024-09-12T00:17:50.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.988+0000 7f69cdea98c0 -1 < failed to complete operation key=VYYY8MF0P3Q7 tag=HYFTJK3GA4J6 type=write size=318083: (22) Invalid argument 2024-09-12T00:17:50.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.992+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=LRX2WRX3H2OA type=write size=844891 2024-09-12T00:17:50.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:50.996+0000 7f69cdea98c0 -1 < failed to complete operation key=H91UXKWAJ3K8 tag=YC19MDK4Q1FT type=del size=1765173: (22) Invalid argument 2024-09-12T00:17:50.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.000+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=YOQKFVYQXVTM type=write size=341280 2024-09-12T00:17:51.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.004+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=21E5LDD6HH46 type=del 2024-09-12T00:17:51.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~TJ10M3BLDPFU.0 size=1048576 2024-09-12T00:17:51.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~TJ10M3BLDPFU.1 size=1048576 2024-09-12T00:17:51.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.016+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~TJ10M3BLDPFU.2 size=835981 2024-09-12T00:17:51.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.016+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=TJ10M3BLDPFU tag=LL7B24XGCMU3 type=write size=3981709 2024-09-12T00:17:51.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.020+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=L7JJ2Z9K0ADM type=del 2024-09-12T00:17:51.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.028+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~70KFR4N61BZD.0 size=1048576 2024-09-12T00:17:51.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.028+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~70KFR4N61BZD.1 size=318132 2024-09-12T00:17:51.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.028+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=70KFR4N61BZD tag=BS5SEIPYS9QX type=write size=2415284 2024-09-12T00:17:51.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.036+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=T5SEVWXNZYKF type=del 2024-09-12T00:17:51.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.040+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=WXS25BA1CZKL type=write size=365387 2024-09-12T00:17:51.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.044+0000 7f69cdea98c0 1 < suggested remove operation key=0HAUC4BDL9VR tag=MY2KB36G68MB type=write 2024-09-12T00:17:51.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.048+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=JHJ275CFUAYQ type=del size=4192933 2024-09-12T00:17:51.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.052+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~JDDTQ3H8FYJZ.0 size=1048576 2024-09-12T00:17:51.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.056+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~JDDTQ3H8FYJZ.1 size=298213 2024-09-12T00:17:51.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.060+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=JDDTQ3H8FYJZ tag=D1MO87W0W5A8 type=write size=2395365 2024-09-12T00:17:51.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.064+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=U68E6H6URXNP type=write size=598011 2024-09-12T00:17:51.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.068+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=PVEM4FNYC2VH type=del 2024-09-12T00:17:51.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.072+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=K3KM6QIT9KFC type=del size=3258778 2024-09-12T00:17:51.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.076+0000 7f69cdea98c0 -1 < failed to complete operation key=0HAUC4BDL9VR tag=P9X8GKL174GO type=del size=2692119: (22) Invalid argument 2024-09-12T00:17:51.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.080+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=7QEYM3JEQRG0 type=del size=2113480 2024-09-12T00:17:51.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.084+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~3UG32NDCX8NZ.0 size=1048576 2024-09-12T00:17:51.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.088+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~3UG32NDCX8NZ.1 size=1048576 2024-09-12T00:17:51.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.092+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~3UG32NDCX8NZ.2 size=741550 2024-09-12T00:17:51.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.100+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=3UG32NDCX8NZ tag=GM6VAOJAGOVJ type=write size=3887278 2024-09-12T00:17:51.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.104+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=14PRDOMDP7B7 type=del size=395036 2024-09-12T00:17:51.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.108+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=V10GJONQXCJY type=del 2024-09-12T00:17:51.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.116+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=MPIP2J3ORJZX type=del size=579756 2024-09-12T00:17:51.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.116+0000 7f69cdea98c0 1 < completed write operation key=SP2KVAO82MQ0 tag=WRSUIUD3O9CX type=write size=761039 2024-09-12T00:17:51.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.124+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~E4LH9UYCOHRL.0 size=1048576 2024-09-12T00:17:51.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~E4LH9UYCOHRL.1 size=1048576 2024-09-12T00:17:51.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~E4LH9UYCOHRL.2 size=324900 2024-09-12T00:17:51.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.128+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=E4LH9UYCOHRL tag=41UZR8LQIUL2 type=write size=3470628 2024-09-12T00:17:51.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.136+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~S9VGK59563GV.0 size=854772 2024-09-12T00:17:51.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.140+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=S9VGK59563GV tag=2TOAHKNKU4PD type=write size=1903348 2024-09-12T00:17:51.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.144+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=Z5NPUDQ47LYS type=del size=2908466 2024-09-12T00:17:51.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.148+0000 7f69cdea98c0 1 < completed write operation key=IXB6WLN5M81C tag=RGWC5R80M7OU type=write size=124490 2024-09-12T00:17:51.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.152+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=NASX9PQH5P2A type=del size=3880501 2024-09-12T00:17:51.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.156+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~5NFNPSFB3AT1.0 size=796132 2024-09-12T00:17:51.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.164+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=5NFNPSFB3AT1 tag=ENMJELF34UEP type=write size=1844708 2024-09-12T00:17:51.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.168+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=229JWDWMZ08U type=del size=2159376 2024-09-12T00:17:51.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.172+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=IO3GBTZLK7RG type=del 2024-09-12T00:17:51.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.180+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~7Q76437IRLW2.0 size=472167 2024-09-12T00:17:51.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.180+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=7Q76437IRLW2 tag=JHE45RUD3YZJ type=write size=1520743 2024-09-12T00:17:51.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.184+0000 7f69cdea98c0 1 < completed write operation key=AKWTTXH2P254 tag=LRX2WRX3H2OA type=write size=844891 2024-09-12T00:17:51.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.188+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=I7M6LSY7YSE3 type=del size=685720 2024-09-12T00:17:51.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.192+0000 7f69cdea98c0 1 < completed write operation key=0EALARW4O3OB tag=YOQKFVYQXVTM type=write size=341280 2024-09-12T00:17:51.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.196+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=XSHMYUX8S9E5 type=del size=1903798 2024-09-12T00:17:51.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.200+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~TJ10M3BLDPFU.0 size=1048576 2024-09-12T00:17:51.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.200+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~TJ10M3BLDPFU.1 size=1048576 2024-09-12T00:17:51.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.204+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~TJ10M3BLDPFU.2 size=835981 2024-09-12T00:17:51.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.212+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=TJ10M3BLDPFU tag=LL7B24XGCMU3 type=write size=3981709 2024-09-12T00:17:51.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.216+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~SAG713C2V13H.0 size=1048576 2024-09-12T00:17:51.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.220+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~SAG713C2V13H.1 size=769356 2024-09-12T00:17:51.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.220+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=SAG713C2V13H tag=UUBJ9BSNUGEY type=write size=2866508 2024-09-12T00:17:51.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.224+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~70KFR4N61BZD.0 size=1048576 2024-09-12T00:17:51.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.228+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~70KFR4N61BZD.1 size=318132 2024-09-12T00:17:51.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.232+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=70KFR4N61BZD tag=BS5SEIPYS9QX type=write size=2415284 2024-09-12T00:17:51.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.236+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=76HP0Q8RP63Y type=del size=2834444 2024-09-12T00:17:51.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.240+0000 7f69cdea98c0 1 < completed write operation key=7UFADFUXL28I tag=WXS25BA1CZKL type=write size=365387 2024-09-12T00:17:51.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~43G5YJX31A7E.0 size=1048576 2024-09-12T00:17:51.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.252+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~43G5YJX31A7E.1 size=1048576 2024-09-12T00:17:51.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.256+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~43G5YJX31A7E.2 size=223636 2024-09-12T00:17:51.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.256+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=43G5YJX31A7E tag=AO4MOE9SODL1 type=write size=3369364 2024-09-12T00:17:51.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.260+0000 7f69cdea98c0 1 < canceled operation key=K4LNDJJUA1RZ tag=JHJ275CFUAYQ type=del size=4192933 2024-09-12T00:17:51.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.264+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~B4GZ3VU53SR3.0 size=41074 2024-09-12T00:17:51.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.264+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=B4GZ3VU53SR3 tag=HJAZE6TN5OUQ type=write size=1089650 2024-09-12T00:17:51.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.268+0000 7f69cdea98c0 1 < completed write operation key=I23GNCI98JHU tag=U68E6H6URXNP type=write size=598011 2024-09-12T00:17:51.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.276+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=OCRU0C1WRS8P type=del size=4066516 2024-09-12T00:17:51.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.284+0000 7f69cdea98c0 1 < suggested update operation key=2X78JWLK876H tag=K3KM6QIT9KFC type=del size=3258778 2024-09-12T00:17:51.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.288+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=W951Y2JUA2EX type=del size=2539413 2024-09-12T00:17:51.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.292+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=7QEYM3JEQRG0 type=del 2024-09-12T00:17:51.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~P6NPOHIP6WN6.0 size=27984 2024-09-12T00:17:51.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.296+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=P6NPOHIP6WN6 tag=GVRP6U562OTP type=write size=1076560 2024-09-12T00:17:51.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.300+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=14PRDOMDP7B7 type=del 2024-09-12T00:17:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~0NN65IPYQVQ9.0 size=1048576 2024-09-12T00:17:51.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~0NN65IPYQVQ9.1 size=1048576 2024-09-12T00:17:51.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~0NN65IPYQVQ9.2 size=908697 2024-09-12T00:17:51.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.312+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=0NN65IPYQVQ9 tag=8VZKABUN6CCR type=write size=4054425 2024-09-12T00:17:51.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.316+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=MPIP2J3ORJZX type=del 2024-09-12T00:17:51.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.320+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=FJAM63EIV1H9 type=del size=4190176 2024-09-12T00:17:51.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.324+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~E4LH9UYCOHRL.0 size=1048576 2024-09-12T00:17:51.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.328+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~E4LH9UYCOHRL.1 size=1048576 2024-09-12T00:17:51.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.332+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~E4LH9UYCOHRL.2 size=324900 2024-09-12T00:17:51.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.340+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=E4LH9UYCOHRL tag=41UZR8LQIUL2 type=write size=3470628 2024-09-12T00:17:51.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.344+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=9CD11CXCQC2C type=del size=3976692 2024-09-12T00:17:51.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.348+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=Z5NPUDQ47LYS type=del 2024-09-12T00:17:51.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.352+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~J0RNTEXCR8W5.0 size=1048576 2024-09-12T00:17:51.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~J0RNTEXCR8W5.1 size=1048576 2024-09-12T00:17:51.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.360+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~J0RNTEXCR8W5.2 size=166137 2024-09-12T00:17:51.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.360+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=J0RNTEXCR8W5 tag=OAVKXUG08VQ2 type=write size=3311865 2024-09-12T00:17:51.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.364+0000 7f69cdea98c0 1 < canceled operation key=I23GNCI98JHU tag=NASX9PQH5P2A type=del size=3880501 2024-09-12T00:17:51.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.368+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=E804ITVAOTA4 type=del size=2180899 2024-09-12T00:17:51.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.376+0000 7f69cdea98c0 1 < canceled operation key=VYYY8MF0P3Q7 tag=229JWDWMZ08U type=del size=2159376 2024-09-12T00:17:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.380+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~5VEEL45G5LIC.0 size=1048576 2024-09-12T00:17:51.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~5VEEL45G5LIC.1 size=664821 2024-09-12T00:17:51.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.384+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=5VEEL45G5LIC tag=8AWO6Y26EEXQ type=write size=2761973 2024-09-12T00:17:51.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.388+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~7Q76437IRLW2.0 size=472167 2024-09-12T00:17:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.396+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=7Q76437IRLW2 tag=JHE45RUD3YZJ type=write size=1520743 2024-09-12T00:17:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.400+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=U3W0OORTI0IE type=del size=3704925 2024-09-12T00:17:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.400+0000 7f69cdea98c0 1 < canceled operation key=I23GNCI98JHU tag=I7M6LSY7YSE3 type=del size=685720 2024-09-12T00:17:51.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~PNPCDD59PMXA.0 size=1048576 2024-09-12T00:17:51.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~PNPCDD59PMXA.1 size=285182 2024-09-12T00:17:51.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.412+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=PNPCDD59PMXA tag=7B873SD7U25Q type=write size=2382334 2024-09-12T00:17:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.416+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=XSHMYUX8S9E5 type=del 2024-09-12T00:17:51.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.424+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~UKD4D3HLFJUD.0 size=1048576 2024-09-12T00:17:51.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.424+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~UKD4D3HLFJUD.1 size=408357 2024-09-12T00:17:51.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.424+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=UKD4D3HLFJUD tag=YBUK47EPP4T7 type=write size=2505509 2024-09-12T00:17:51.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.428+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~SAG713C2V13H.0 size=1048576 2024-09-12T00:17:51.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.432+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~SAG713C2V13H.1 size=769356 2024-09-12T00:17:51.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.436+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=SAG713C2V13H tag=UUBJ9BSNUGEY type=write size=2866508 2024-09-12T00:17:51.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.440+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=47855TNVT27V type=del size=32862 2024-09-12T00:17:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.444+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=76HP0Q8RP63Y type=del 2024-09-12T00:17:51.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.448+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=EZ4KWBRO52JP type=del size=1238504 2024-09-12T00:17:51.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.456+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~43G5YJX31A7E.0 size=1048576 2024-09-12T00:17:51.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.460+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~43G5YJX31A7E.1 size=1048576 2024-09-12T00:17:51.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.460+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~43G5YJX31A7E.2 size=223636 2024-09-12T00:17:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.468+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=43G5YJX31A7E tag=AO4MOE9SODL1 type=write size=3369364 2024-09-12T00:17:51.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~B010EBN6SAE4.0 size=1048576 2024-09-12T00:17:51.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~B010EBN6SAE4.1 size=1048576 2024-09-12T00:17:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.480+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~B010EBN6SAE4.2 size=465530 2024-09-12T00:17:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.480+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=B010EBN6SAE4 tag=GNED68PBS55P type=write size=3611258 2024-09-12T00:17:51.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.484+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~B4GZ3VU53SR3.0 size=41074 2024-09-12T00:17:51.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.488+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=B4GZ3VU53SR3 tag=HJAZE6TN5OUQ type=write size=1089650 2024-09-12T00:17:51.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.492+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=IAILHH98A53X type=del size=788595 2024-09-12T00:17:51.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.496+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=OCRU0C1WRS8P type=del 2024-09-12T00:17:51.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.504+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~MZ1OJ95B24C2.0 size=1048576 2024-09-12T00:17:51.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.508+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~MZ1OJ95B24C2.1 size=774895 2024-09-12T00:17:51.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.508+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=MZ1OJ95B24C2 tag=36FY65DQ226N type=write size=2872047 2024-09-12T00:17:51.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.516+0000 7f69cdea98c0 1 < suggested update operation key=I23GNCI98JHU tag=W951Y2JUA2EX type=del size=2539413 2024-09-12T00:17:51.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.524+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~HAZDVAXO8385.0 size=1048576 2024-09-12T00:17:51.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.524+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~HAZDVAXO8385.1 size=1048576 2024-09-12T00:17:51.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~HAZDVAXO8385.2 size=540056 2024-09-12T00:17:51.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.528+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=HAZDVAXO8385 tag=PH345M5WMY5O type=write size=3685784 2024-09-12T00:17:51.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.532+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~P6NPOHIP6WN6.0 size=27984 2024-09-12T00:17:51.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.540+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=P6NPOHIP6WN6 tag=GVRP6U562OTP type=write size=1076560 2024-09-12T00:17:51.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.540+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=967VK04YUNPH type=del size=2605019 2024-09-12T00:17:51.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.544+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~0NN65IPYQVQ9.0 size=1048576 2024-09-12T00:17:51.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.544+0000 7f69cdea98c0 1 < canceled part key=_multipart_0HAUC4BDL9VR.2~0NN65IPYQVQ9.1 size=1048576 2024-09-12T00:17:51.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.548+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~0NN65IPYQVQ9.2 size=908697 2024-09-12T00:17:51.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.556+0000 7f69cdea98c0 1 < canceled multipart upload key=0HAUC4BDL9VR upload=0NN65IPYQVQ9 tag=8VZKABUN6CCR type=write size=4054425 2024-09-12T00:17:51.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.560+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~02VW0A57618D.0 size=1048576 2024-09-12T00:17:51.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.564+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~02VW0A57618D.1 size=1048576 2024-09-12T00:17:51.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.568+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~02VW0A57618D.2 size=320927 2024-09-12T00:17:51.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.568+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=02VW0A57618D tag=5QBG6MM4F416 type=write size=3466655 2024-09-12T00:17:51.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.576+0000 7f69cdea98c0 1 < suggested update operation key=Q0L8J0BYRFDQ tag=FJAM63EIV1H9 type=del size=4190176 2024-09-12T00:17:51.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~FGRKBDF8TR93.0 size=1048576 2024-09-12T00:17:51.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~FGRKBDF8TR93.1 size=1048576 2024-09-12T00:17:51.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.588+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~FGRKBDF8TR93.2 size=958279 2024-09-12T00:17:51.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.588+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=FGRKBDF8TR93 tag=DAF1XNT2QKD4 type=write size=4104007 2024-09-12T00:17:51.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.592+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=9CD11CXCQC2C type=del size=3976692 2024-09-12T00:17:51.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.592+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=13Z4VYR3E1PY type=del size=81493 2024-09-12T00:17:51.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.596+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~J0RNTEXCR8W5.0 size=1048576 2024-09-12T00:17:51.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.600+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~J0RNTEXCR8W5.1 size=1048576 2024-09-12T00:17:51.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.604+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~J0RNTEXCR8W5.2 size=166137 2024-09-12T00:17:51.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.608+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=J0RNTEXCR8W5 tag=OAVKXUG08VQ2 type=write size=3311865 2024-09-12T00:17:51.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.612+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=FXL3504NTYRV type=del size=935682 2024-09-12T00:17:51.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.616+0000 7f69cdea98c0 1 < canceled operation key=9K3HLTD6DMSC tag=E804ITVAOTA4 type=del size=2180899 2024-09-12T00:17:51.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.620+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=QNY4E77TTZ5N type=del size=2883569 2024-09-12T00:17:51.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.624+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~5VEEL45G5LIC.0 size=1048576 2024-09-12T00:17:51.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.628+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~5VEEL45G5LIC.1 size=664821 2024-09-12T00:17:51.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.636+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=5VEEL45G5LIC tag=8AWO6Y26EEXQ type=write size=2761973 2024-09-12T00:17:51.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.640+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=RZ0BTDFU7R5H type=del size=1810625 2024-09-12T00:17:51.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.644+0000 7f69cdea98c0 1 < suggested update operation key=9K3HLTD6DMSC tag=U3W0OORTI0IE type=del size=3704925 2024-09-12T00:17:51.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.648+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=71CO3UO9K9CS type=del size=508030 2024-09-12T00:17:51.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.652+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~PNPCDD59PMXA.0 size=1048576 2024-09-12T00:17:51.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.656+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~PNPCDD59PMXA.1 size=285182 2024-09-12T00:17:51.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.660+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=PNPCDD59PMXA tag=7B873SD7U25Q type=write size=2382334 2024-09-12T00:17:51.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~NZGO4D4EVC0D.0 size=1048576 2024-09-12T00:17:51.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~NZGO4D4EVC0D.1 size=944297 2024-09-12T00:17:51.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.668+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=NZGO4D4EVC0D tag=FBBABRF6B6JV type=write size=3041449 2024-09-12T00:17:51.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.672+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~UKD4D3HLFJUD.0 size=1048576 2024-09-12T00:17:51.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.676+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~UKD4D3HLFJUD.1 size=408357 2024-09-12T00:17:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.684+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=UKD4D3HLFJUD tag=YBUK47EPP4T7 type=write size=2505509 2024-09-12T00:17:51.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~UEYJ5S5RXOPT.0 size=1048576 2024-09-12T00:17:51.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.692+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~UEYJ5S5RXOPT.1 size=800055 2024-09-12T00:17:51.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.692+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=UEYJ5S5RXOPT tag=NK1TAZ028KW3 type=write size=2897207 2024-09-12T00:17:51.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.696+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=47855TNVT27V type=del 2024-09-12T00:17:51.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.700+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=TLFMTA5NVTT7 type=del size=973128 2024-09-12T00:17:51.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.704+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=EZ4KWBRO52JP type=del 2024-09-12T00:17:51.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.708+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=8O1B7985Q1F6 type=del size=1569806 2024-09-12T00:17:51.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.708+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~B010EBN6SAE4.0 size=1048576 2024-09-12T00:17:51.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.712+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~B010EBN6SAE4.1 size=1048576 2024-09-12T00:17:51.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.716+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~B010EBN6SAE4.2 size=465530 2024-09-12T00:17:51.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.720+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=B010EBN6SAE4 tag=GNED68PBS55P type=write size=3611258 2024-09-12T00:17:51.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.724+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=G3DRHDGL3SIL type=write size=372695 2024-09-12T00:17:51.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.728+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=IAILHH98A53X type=del 2024-09-12T00:17:51.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.732+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=I2P8PK3OOUEI type=write size=589238 2024-09-12T00:17:51.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.736+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~MZ1OJ95B24C2.0 size=1048576 2024-09-12T00:17:51.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.740+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~MZ1OJ95B24C2.1 size=774895 2024-09-12T00:17:51.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.748+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=MZ1OJ95B24C2 tag=36FY65DQ226N type=write size=2872047 2024-09-12T00:17:51.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.752+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=0FUFC4FPVHHO type=write size=1001684 2024-09-12T00:17:51.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.752+0000 7f69cdea98c0 1 < canceled part key=_multipart_1CZXUEJLQ8FM.2~HAZDVAXO8385.0 size=1048576 2024-09-12T00:17:51.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.756+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~HAZDVAXO8385.1 size=1048576 2024-09-12T00:17:51.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.756+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~HAZDVAXO8385.2 size=540056 2024-09-12T00:17:51.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.764+0000 7f69cdea98c0 1 < canceled multipart upload key=1CZXUEJLQ8FM upload=HAZDVAXO8385 tag=PH345M5WMY5O type=write size=3685784 2024-09-12T00:17:51.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.768+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=ACDSASZH3BUU type=del size=989558 2024-09-12T00:17:51.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.772+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=967VK04YUNPH type=del 2024-09-12T00:17:51.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.776+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=G7VFYO227FH1 type=del size=127871 2024-09-12T00:17:51.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.780+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~02VW0A57618D.0 size=1048576 2024-09-12T00:17:51.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.780+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~02VW0A57618D.1 size=1048576 2024-09-12T00:17:51.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.784+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~02VW0A57618D.2 size=320927 2024-09-12T00:17:51.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.792+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=02VW0A57618D tag=5QBG6MM4F416 type=write size=3466655 2024-09-12T00:17:51.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.796+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=TW12ATAW964E type=del size=1725813 2024-09-12T00:17:51.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.800+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~FGRKBDF8TR93.0 size=1048576 2024-09-12T00:17:51.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.804+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~FGRKBDF8TR93.1 size=1048576 2024-09-12T00:17:51.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.808+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~FGRKBDF8TR93.2 size=958279 2024-09-12T00:17:51.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.812+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=FGRKBDF8TR93 tag=DAF1XNT2QKD4 type=write size=4104007 2024-09-12T00:17:51.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~RYD7Q3W8A9YW.0 size=1048576 2024-09-12T00:17:51.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.824+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~RYD7Q3W8A9YW.1 size=1048576 2024-09-12T00:17:51.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.824+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~RYD7Q3W8A9YW.2 size=592887 2024-09-12T00:17:51.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.824+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=RYD7Q3W8A9YW tag=6UXLQL6KIGE0 type=write size=3738615 2024-09-12T00:17:51.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.828+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=13Z4VYR3E1PY type=del 2024-09-12T00:17:51.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.832+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=EDNY5T9QO0XK type=write size=742939 2024-09-12T00:17:51.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.840+0000 7f69cdea98c0 1 < suggested remove operation key=0EALARW4O3OB tag=FXL3504NTYRV type=del 2024-09-12T00:17:51.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~CL6OAXY3DBE9.0 size=1048576 2024-09-12T00:17:51.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~CL6OAXY3DBE9.1 size=1048576 2024-09-12T00:17:51.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.852+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~CL6OAXY3DBE9.2 size=765824 2024-09-12T00:17:51.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.852+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=CL6OAXY3DBE9 tag=24C9PGB7IA8O type=write size=3911552 2024-09-12T00:17:51.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.856+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=QNY4E77TTZ5N type=del 2024-09-12T00:17:51.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.864+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~12RYVTII0FTX.0 size=208738 2024-09-12T00:17:51.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.864+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=12RYVTII0FTX tag=FP6ZRVNI28M1 type=write size=1257314 2024-09-12T00:17:51.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.868+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=RZ0BTDFU7R5H type=del 2024-09-12T00:17:51.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~WO7H6S9UGG3R.0 size=1048576 2024-09-12T00:17:51.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~WO7H6S9UGG3R.1 size=1048576 2024-09-12T00:17:51.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~WO7H6S9UGG3R.2 size=811732 2024-09-12T00:17:51.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.884+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=WO7H6S9UGG3R tag=F2BNG3U8VG07 type=write size=3957460 2024-09-12T00:17:51.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.888+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=71CO3UO9K9CS type=del 2024-09-12T00:17:51.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.892+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=UWBQ2EDBOC8G type=del size=759602 2024-09-12T00:17:51.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.896+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~NZGO4D4EVC0D.0 size=1048576 2024-09-12T00:17:51.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.900+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~NZGO4D4EVC0D.1 size=944297 2024-09-12T00:17:51.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.904+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=NZGO4D4EVC0D tag=FBBABRF6B6JV type=write size=3041449 2024-09-12T00:17:51.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.908+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=MSM28UY8TUXH type=del size=3423996 2024-09-12T00:17:51.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.912+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~UEYJ5S5RXOPT.0 size=1048576 2024-09-12T00:17:51.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.916+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~UEYJ5S5RXOPT.1 size=800055 2024-09-12T00:17:51.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.920+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=UEYJ5S5RXOPT tag=NK1TAZ028KW3 type=write size=2897207 2024-09-12T00:17:51.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.928+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=HYLYG97TS6RD type=del size=3251152 2024-09-12T00:17:51.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.936+0000 7f69cdea98c0 1 < suggested remove operation key=AKWTTXH2P254 tag=TLFMTA5NVTT7 type=del 2024-09-12T00:17:51.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.940+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~1VDLEB4M71KM.0 size=1048576 2024-09-12T00:17:51.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.944+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~1VDLEB4M71KM.1 size=1048576 2024-09-12T00:17:51.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~1VDLEB4M71KM.2 size=6688 2024-09-12T00:17:51.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.948+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=1VDLEB4M71KM tag=QHPFM8X4X891 type=write size=3152416 2024-09-12T00:17:51.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.952+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=8O1B7985Q1F6 type=del 2024-09-12T00:17:51.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.956+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=UGSZ4CXUQMN0 type=del size=3166865 2024-09-12T00:17:51.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.956+0000 7f69cdea98c0 -1 < no bi entry to suggest for operation key=AKWTTXH2P254 tag=G3DRHDGL3SIL type=write size=372695: (2) No such file or directory 2024-09-12T00:17:51.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~1E5U464TA39I.0 size=1048576 2024-09-12T00:17:51.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~1E5U464TA39I.1 size=822048 2024-09-12T00:17:51.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.964+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=1E5U464TA39I tag=35PI01GUFJK2 type=write size=2919200 2024-09-12T00:17:51.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.968+0000 7f69cdea98c0 1 < completed write operation key=RDGRKQQH4B8C tag=I2P8PK3OOUEI type=write size=589238 2024-09-12T00:17:51.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.972+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=2ZKB2JKHPMDX type=del size=2692998 2024-09-12T00:17:51.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.976+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=0FUFC4FPVHHO type=write size=1001684 2024-09-12T00:17:51.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.980+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~KGGFHK4RTF22.0 size=1048576 2024-09-12T00:17:51.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~KGGFHK4RTF22.1 size=1048576 2024-09-12T00:17:51.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~KGGFHK4RTF22.2 size=961304 2024-09-12T00:17:51.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.984+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=KGGFHK4RTF22 tag=12PKS26DE8B5 type=write size=4107032 2024-09-12T00:17:51.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:51.992+0000 7f69cdea98c0 1 < suggested update operation key=0J667VAQGMTX tag=ACDSASZH3BUU type=del size=989558 2024-09-12T00:17:51.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.000+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~FM8SF9VS61DI.0 size=1048576 2024-09-12T00:17:52.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.000+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~FM8SF9VS61DI.1 size=973985 2024-09-12T00:17:52.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.000+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=FM8SF9VS61DI tag=LJPNIRP8SASQ type=write size=3071137 2024-09-12T00:17:52.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.004+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=G7VFYO227FH1 type=del 2024-09-12T00:17:52.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.008+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=FU51WGKPU10Z type=del size=3105166 2024-09-12T00:17:52.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.012+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=TW12ATAW964E type=del 2024-09-12T00:17:52.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.016+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=4OA646VZI2Z1 type=del size=137110 2024-09-12T00:17:52.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.016+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~RYD7Q3W8A9YW.0 size=1048576 2024-09-12T00:17:52.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.020+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~RYD7Q3W8A9YW.1 size=1048576 2024-09-12T00:17:52.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.024+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~RYD7Q3W8A9YW.2 size=592887 2024-09-12T00:17:52.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.028+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=RYD7Q3W8A9YW tag=6UXLQL6KIGE0 type=write size=3738615 2024-09-12T00:17:52.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.032+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=HN1X3DM5MRVK type=del size=1936974 2024-09-12T00:17:52.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.032+0000 7f69cdea98c0 1 < completed write operation key=IXWX7S5NWJS3 tag=EDNY5T9QO0XK type=write size=742939 2024-09-12T00:17:52.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.036+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=GDHE25S71M5T type=del size=2080371 2024-09-12T00:17:52.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.040+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~CL6OAXY3DBE9.0 size=1048576 2024-09-12T00:17:52.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.044+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~CL6OAXY3DBE9.1 size=1048576 2024-09-12T00:17:52.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.044+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~CL6OAXY3DBE9.2 size=765824 2024-09-12T00:17:52.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.048+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=CL6OAXY3DBE9 tag=24C9PGB7IA8O type=write size=3911552 2024-09-12T00:17:52.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.052+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=3220OZAVC7VZ type=del size=739233 2024-09-12T00:17:52.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.056+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~12RYVTII0FTX.0 size=208738 2024-09-12T00:17:52.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.064+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=12RYVTII0FTX tag=FP6ZRVNI28M1 type=write size=1257314 2024-09-12T00:17:52.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.068+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=9WXT4SMXVSA1 type=del size=1058921 2024-09-12T00:17:52.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.072+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~WO7H6S9UGG3R.0 size=1048576 2024-09-12T00:17:52.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.072+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~WO7H6S9UGG3R.1 size=1048576 2024-09-12T00:17:52.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.076+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~WO7H6S9UGG3R.2 size=811732 2024-09-12T00:17:52.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.080+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=WO7H6S9UGG3R tag=F2BNG3U8VG07 type=write size=3957460 2024-09-12T00:17:52.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.084+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=G7BDNPGEB5ZO type=del size=131688 2024-09-12T00:17:52.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.088+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=UWBQ2EDBOC8G type=del 2024-09-12T00:17:52.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.096+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~7W7988KLVBYI.0 size=1048576 2024-09-12T00:17:52.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.096+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~7W7988KLVBYI.1 size=757459 2024-09-12T00:17:52.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.096+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=7W7988KLVBYI tag=GBP1E9302GXF type=write size=2854611 2024-09-12T00:17:52.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.100+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=MSM28UY8TUXH type=del 2024-09-12T00:17:52.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.104+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~HK7QDM0QQ2SA.0 size=1048576 2024-09-12T00:17:52.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~HK7QDM0QQ2SA.1 size=775401 2024-09-12T00:17:52.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.108+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=HK7QDM0QQ2SA tag=7MCUAX3YNRL9 type=write size=2872553 2024-09-12T00:17:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.112+0000 7f69cdea98c0 1 < suggested update operation key=2X78JWLK876H tag=HYLYG97TS6RD type=del size=3251152 2024-09-12T00:17:52.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.116+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=UI82C971LC26 type=del size=3524676 2024-09-12T00:17:52.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.124+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~1VDLEB4M71KM.0 size=1048576 2024-09-12T00:17:52.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.124+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~1VDLEB4M71KM.1 size=1048576 2024-09-12T00:17:52.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.128+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~1VDLEB4M71KM.2 size=6688 2024-09-12T00:17:52.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.132+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=1VDLEB4M71KM tag=QHPFM8X4X891 type=write size=3152416 2024-09-12T00:17:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~QPUKI17JWV9A.0 size=808748 2024-09-12T00:17:52.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.140+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=QPUKI17JWV9A tag=7ABVWIQ9HR3Z type=write size=1857324 2024-09-12T00:17:52.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.144+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=UGSZ4CXUQMN0 type=del 2024-09-12T00:17:52.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.148+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~SKC8A53AQK6R.0 size=1048576 2024-09-12T00:17:52.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.152+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~SKC8A53AQK6R.1 size=942296 2024-09-12T00:17:52.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.152+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=SKC8A53AQK6R tag=SO90HJPJXY3Z type=write size=3039448 2024-09-12T00:17:52.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.156+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~1E5U464TA39I.0 size=1048576 2024-09-12T00:17:52.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.156+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~1E5U464TA39I.1 size=822048 2024-09-12T00:17:52.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.164+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=1E5U464TA39I tag=35PI01GUFJK2 type=write size=2919200 2024-09-12T00:17:52.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.168+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=EG6Q4NQV2Z1N type=del size=1488444 2024-09-12T00:17:52.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.172+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=2ZKB2JKHPMDX type=del 2024-09-12T00:17:52.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.176+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=57SEJTWQOM0Y type=del size=2588714 2024-09-12T00:17:52.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.180+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~KGGFHK4RTF22.0 size=1048576 2024-09-12T00:17:52.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.180+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~KGGFHK4RTF22.1 size=1048576 2024-09-12T00:17:52.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.184+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~KGGFHK4RTF22.2 size=961304 2024-09-12T00:17:52.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.192+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=KGGFHK4RTF22 tag=12PKS26DE8B5 type=write size=4107032 2024-09-12T00:17:52.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.192+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=FHX8DE7WI926 type=write size=311015 2024-09-12T00:17:52.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.196+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~FM8SF9VS61DI.0 size=1048576 2024-09-12T00:17:52.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.200+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~FM8SF9VS61DI.1 size=973985 2024-09-12T00:17:52.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.204+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=FM8SF9VS61DI tag=LJPNIRP8SASQ type=write size=3071137 2024-09-12T00:17:52.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~ON2VFN5JPS8Y.0 size=1048576 2024-09-12T00:17:52.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~ON2VFN5JPS8Y.1 size=326324 2024-09-12T00:17:52.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.212+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=ON2VFN5JPS8Y tag=CK3C2QR5JHJC type=write size=2423476 2024-09-12T00:17:52.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.220+0000 7f69cdea98c0 1 < suggested update operation key=T9OJXTZNRQJB tag=FU51WGKPU10Z type=del size=3105166 2024-09-12T00:17:52.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.224+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=92XXY0CKYY2D type=del size=438200 2024-09-12T00:17:52.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.228+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=4OA646VZI2Z1 type=del 2024-09-12T00:17:52.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.232+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~BONGMNB4J7UN.0 size=968382 2024-09-12T00:17:52.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.232+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=BONGMNB4J7UN tag=SY586SLTY8MJ type=write size=2016958 2024-09-12T00:17:52.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.236+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=HN1X3DM5MRVK type=del 2024-09-12T00:17:52.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.240+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=VQITK0GQ3TEF type=del size=1463045 2024-09-12T00:17:52.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.248+0000 7f69cdea98c0 1 < suggested update operation key=K0HNNMX7CDGC tag=GDHE25S71M5T type=del size=2080371 2024-09-12T00:17:52.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.252+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=L4R1ID9TFAWE type=del size=1630115 2024-09-12T00:17:52.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.264+0000 7f69cdea98c0 1 < suggested remove operation key=K4LNDJJUA1RZ tag=3220OZAVC7VZ type=del 2024-09-12T00:17:52.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.268+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=R1WJO2AUYE0O type=write size=165152 2024-09-12T00:17:52.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.272+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=9WXT4SMXVSA1 type=del 2024-09-12T00:17:52.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.276+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=A4FQ10L60W2G type=del size=3704364 2024-09-12T00:17:52.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.280+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=G7BDNPGEB5ZO type=del 2024-09-12T00:17:52.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.284+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=GNEQFWH4ZFZQ type=write size=15553 2024-09-12T00:17:52.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.288+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~7W7988KLVBYI.0 size=1048576 2024-09-12T00:17:52.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.292+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~7W7988KLVBYI.1 size=757459 2024-09-12T00:17:52.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.296+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=7W7988KLVBYI tag=GBP1E9302GXF type=write size=2854611 2024-09-12T00:17:52.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.304+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~YSD379755IHK.0 size=809396 2024-09-12T00:17:52.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.304+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=YSD379755IHK tag=NDTKD4CY1OI3 type=write size=1857972 2024-09-12T00:17:52.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.308+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~HK7QDM0QQ2SA.0 size=1048576 2024-09-12T00:17:52.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.308+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~HK7QDM0QQ2SA.1 size=775401 2024-09-12T00:17:52.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.316+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=HK7QDM0QQ2SA tag=7MCUAX3YNRL9 type=write size=2872553 2024-09-12T00:17:52.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.320+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=2GK214ROVAIA type=del size=458125 2024-09-12T00:17:52.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.328+0000 7f69cdea98c0 1 < suggested update operation key=H91UXKWAJ3K8 tag=UI82C971LC26 type=del size=3524676 2024-09-12T00:17:52.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.332+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=2T2OYZ92WG4E type=del size=1622269 2024-09-12T00:17:52.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.336+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~QPUKI17JWV9A.0 size=808748 2024-09-12T00:17:52.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.340+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=QPUKI17JWV9A tag=7ABVWIQ9HR3Z type=write size=1857324 2024-09-12T00:17:52.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.344+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=BGV5O9WO4MQ6 type=del size=498417 2024-09-12T00:17:52.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.348+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~SKC8A53AQK6R.0 size=1048576 2024-09-12T00:17:52.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.352+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~SKC8A53AQK6R.1 size=942296 2024-09-12T00:17:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.356+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=SKC8A53AQK6R tag=SO90HJPJXY3Z type=write size=3039448 2024-09-12T00:17:52.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.360+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=NXG8170OCKN0 type=del size=3407377 2024-09-12T00:17:52.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.364+0000 7f69cdea98c0 1 < canceled operation key=5453GP1H3OFQ tag=EG6Q4NQV2Z1N type=del size=1488444 2024-09-12T00:17:52.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~I6FS4V3YLOQZ.0 size=795667 2024-09-12T00:17:52.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.372+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=I6FS4V3YLOQZ tag=OLL6RF4XOBUT type=write size=1844243 2024-09-12T00:17:52.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.376+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=57SEJTWQOM0Y type=del 2024-09-12T00:17:52.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.380+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~VI4JGONQ44PK.0 size=1048576 2024-09-12T00:17:52.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~VI4JGONQ44PK.1 size=1048576 2024-09-12T00:17:52.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.388+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~VI4JGONQ44PK.2 size=929135 2024-09-12T00:17:52.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.388+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=VI4JGONQ44PK tag=VCY4QB7H0L74 type=write size=4074863 2024-09-12T00:17:52.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.392+0000 7f69cdea98c0 1 < completed write operation key=I23GNCI98JHU tag=FHX8DE7WI926 type=write size=311015 2024-09-12T00:17:52.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.396+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=EL7YQ9EYTUCP type=del size=2003777 2024-09-12T00:17:52.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.400+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~ON2VFN5JPS8Y.0 size=1048576 2024-09-12T00:17:52.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.400+0000 7f69cdea98c0 1 < canceled part key=_multipart_K0HNNMX7CDGC.2~ON2VFN5JPS8Y.1 size=326324 2024-09-12T00:17:52.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.408+0000 7f69cdea98c0 1 < canceled multipart upload key=K0HNNMX7CDGC upload=ON2VFN5JPS8Y tag=CK3C2QR5JHJC type=write size=2423476 2024-09-12T00:17:52.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~JJLOP8352WHT.0 size=473078 2024-09-12T00:17:52.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.412+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=JJLOP8352WHT tag=08Z1AS7BML3O type=write size=1521654 2024-09-12T00:17:52.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.416+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=92XXY0CKYY2D type=del 2024-09-12T00:17:52.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.424+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~B5OG419ECPFU.0 size=919515 2024-09-12T00:17:52.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.424+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=B5OG419ECPFU tag=FV2YZF35BYAZ type=write size=1968091 2024-09-12T00:17:52.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.428+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~BONGMNB4J7UN.0 size=968382 2024-09-12T00:17:52.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.436+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=BONGMNB4J7UN tag=SY586SLTY8MJ type=write size=2016958 2024-09-12T00:17:52.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.440+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=B1RNOAF06AFG type=write size=506936 2024-09-12T00:17:52.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.444+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=VQITK0GQ3TEF type=del 2024-09-12T00:17:52.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~PDGHHYA49Q04.0 size=1048576 2024-09-12T00:17:52.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~PDGHHYA49Q04.1 size=931834 2024-09-12T00:17:52.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.456+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=PDGHHYA49Q04 tag=BLDFW11U4CU0 type=write size=3028986 2024-09-12T00:17:52.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.460+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=L4R1ID9TFAWE type=del 2024-09-12T00:17:52.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.460+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=080ZEF1CPF7D type=del size=2803767 2024-09-12T00:17:52.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.468+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=R1WJO2AUYE0O type=write size=165152 2024-09-12T00:17:52.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.472+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=06TR9Z003EHI type=del size=1781953 2024-09-12T00:17:52.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.476+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=A4FQ10L60W2G type=del 2024-09-12T00:17:52.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.480+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=B8S516HRQ7CZ type=del size=3751505 2024-09-12T00:17:52.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.488+0000 7f69cdea98c0 1 < suggested remove operation key=AWZ03VE7D86K tag=GNEQFWH4ZFZQ type=write 2024-09-12T00:17:52.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.496+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~8WJN9HXGKPNQ.0 size=406596 2024-09-12T00:17:52.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.496+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=8WJN9HXGKPNQ tag=1C1P0OTU1MRS type=write size=1455172 2024-09-12T00:17:52.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.500+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~YSD379755IHK.0 size=809396 2024-09-12T00:17:52.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.508+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=YSD379755IHK tag=NDTKD4CY1OI3 type=write size=1857972 2024-09-12T00:17:52.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.508+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=PM8SPLRB53CC type=del size=113228 2024-09-12T00:17:52.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.512+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=2GK214ROVAIA type=del 2024-09-12T00:17:52.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.516+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=M05B20J01ZMS type=del size=3409746 2024-09-12T00:17:52.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.520+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=2T2OYZ92WG4E type=del 2024-09-12T00:17:52.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~JMJZBY83SP60.0 size=1048576 2024-09-12T00:17:52.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.532+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~JMJZBY83SP60.1 size=1048576 2024-09-12T00:17:52.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~JMJZBY83SP60.2 size=817291 2024-09-12T00:17:52.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.536+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=JMJZBY83SP60 tag=LVM7T9OR9W99 type=write size=3963019 2024-09-12T00:17:52.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.540+0000 7f69cdea98c0 1 < suggested update operation key=H91UXKWAJ3K8 tag=BGV5O9WO4MQ6 type=del size=498417 2024-09-12T00:17:52.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.548+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~GU6OXIFWX0WM.0 size=1048576 2024-09-12T00:17:52.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~GU6OXIFWX0WM.1 size=971879 2024-09-12T00:17:52.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.552+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=GU6OXIFWX0WM tag=OW0I4PNNZ7J9 type=write size=3069031 2024-09-12T00:17:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.556+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=NXG8170OCKN0 type=del 2024-09-12T00:17:52.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.560+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=I8ZH5JZRTQ41 type=write size=1019330 2024-09-12T00:17:52.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.564+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~I6FS4V3YLOQZ.0 size=795667 2024-09-12T00:17:52.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.568+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=I6FS4V3YLOQZ tag=OLL6RF4XOBUT type=write size=1844243 2024-09-12T00:17:52.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.576+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~5UAORTORADFB.0 size=438250 2024-09-12T00:17:52.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.576+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=5UAORTORADFB tag=89E5Y3ROUWXJ type=write size=1486826 2024-09-12T00:17:52.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.580+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~VI4JGONQ44PK.0 size=1048576 2024-09-12T00:17:52.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.580+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~VI4JGONQ44PK.1 size=1048576 2024-09-12T00:17:52.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.584+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~VI4JGONQ44PK.2 size=929135 2024-09-12T00:17:52.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.592+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=VI4JGONQ44PK tag=VCY4QB7H0L74 type=write size=4074863 2024-09-12T00:17:52.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.596+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=0L3YR62GH0XF type=del size=3565264 2024-09-12T00:17:52.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.600+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=EL7YQ9EYTUCP type=del 2024-09-12T00:17:52.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.604+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~0O8P6ISP1YS3.0 size=444181 2024-09-12T00:17:52.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.604+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=0O8P6ISP1YS3 tag=MRJF6CQ7JNTW type=write size=1492757 2024-09-12T00:17:52.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.608+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~JJLOP8352WHT.0 size=473078 2024-09-12T00:17:52.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.616+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=JJLOP8352WHT tag=08Z1AS7BML3O type=write size=1521654 2024-09-12T00:17:52.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.620+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~DYDASF4KBHCZ.0 size=160328 2024-09-12T00:17:52.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.620+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=DYDASF4KBHCZ tag=TBSOJ22PN21H type=write size=1208904 2024-09-12T00:17:52.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.624+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~B5OG419ECPFU.0 size=919515 2024-09-12T00:17:52.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.632+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=B5OG419ECPFU tag=FV2YZF35BYAZ type=write size=1968091 2024-09-12T00:17:52.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.636+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=9X5G7MLAVOY2 type=del size=4144675 2024-09-12T00:17:52.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.640+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=B1RNOAF06AFG type=write size=506936 2024-09-12T00:17:52.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.644+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=GR01313XP7W0 type=del size=1666807 2024-09-12T00:17:52.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.644+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~PDGHHYA49Q04.0 size=1048576 2024-09-12T00:17:52.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.648+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~PDGHHYA49Q04.1 size=931834 2024-09-12T00:17:52.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.652+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=PDGHHYA49Q04 tag=BLDFW11U4CU0 type=write size=3028986 2024-09-12T00:17:52.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~RIBPLYNM1S91.0 size=1048576 2024-09-12T00:17:52.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.664+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~RIBPLYNM1S91.1 size=189777 2024-09-12T00:17:52.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.664+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=RIBPLYNM1S91 tag=WAUGWKT6MPMB type=write size=2286929 2024-09-12T00:17:52.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.668+0000 7f69cdea98c0 1 < canceled operation key=IXB6WLN5M81C tag=080ZEF1CPF7D type=del size=2803767 2024-09-12T00:17:52.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.672+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=JE5HU7M613BB type=del size=3591715 2024-09-12T00:17:52.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.680+0000 7f69cdea98c0 1 < suggested remove operation key=0J667VAQGMTX tag=06TR9Z003EHI type=del 2024-09-12T00:17:52.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~L8DSXCDPZZER.0 size=1048576 2024-09-12T00:17:52.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~L8DSXCDPZZER.1 size=420609 2024-09-12T00:17:52.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.688+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=L8DSXCDPZZER tag=PHQCCQACQZLE type=write size=2517761 2024-09-12T00:17:52.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.696+0000 7f69cdea98c0 1 < suggested remove operation key=2YYP9NOUAJD0 tag=B8S516HRQ7CZ type=del 2024-09-12T00:17:52.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.700+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=PMSQ9582HUW1 type=write size=600455 2024-09-12T00:17:52.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.704+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~8WJN9HXGKPNQ.0 size=406596 2024-09-12T00:17:52.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.708+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=8WJN9HXGKPNQ tag=1C1P0OTU1MRS type=write size=1455172 2024-09-12T00:17:52.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.716+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~4G6TVA5W5O12.0 size=628443 2024-09-12T00:17:52.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.716+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=4G6TVA5W5O12 tag=Q3GVJVDAWLTJ type=write size=1677019 2024-09-12T00:17:52.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.720+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=PM8SPLRB53CC type=del 2024-09-12T00:17:52.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~QE3K9MD4RYJ9.0 size=1048576 2024-09-12T00:17:52.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~QE3K9MD4RYJ9.1 size=1048576 2024-09-12T00:17:52.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~QE3K9MD4RYJ9.2 size=687706 2024-09-12T00:17:52.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.736+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=QE3K9MD4RYJ9 tag=CQUYY12NAABA type=write size=3833434 2024-09-12T00:17:52.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.740+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=M05B20J01ZMS type=del 2024-09-12T00:17:52.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.744+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=XH9L9GHBPR0I type=del size=2376464 2024-09-12T00:17:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.748+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~JMJZBY83SP60.0 size=1048576 2024-09-12T00:17:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.748+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~JMJZBY83SP60.1 size=1048576 2024-09-12T00:17:52.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.752+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~JMJZBY83SP60.2 size=817291 2024-09-12T00:17:52.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.760+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=JMJZBY83SP60 tag=LVM7T9OR9W99 type=write size=3963019 2024-09-12T00:17:52.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.764+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~QOHUJHS4HUYE.0 size=1048576 2024-09-12T00:17:52.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.768+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~QOHUJHS4HUYE.1 size=1048576 2024-09-12T00:17:52.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.772+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~QOHUJHS4HUYE.2 size=131916 2024-09-12T00:17:52.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.772+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=QOHUJHS4HUYE tag=VQS8CRT1W1J5 type=write size=3277644 2024-09-12T00:17:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.776+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~GU6OXIFWX0WM.0 size=1048576 2024-09-12T00:17:52.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.780+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~GU6OXIFWX0WM.1 size=971879 2024-09-12T00:17:52.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.784+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=GU6OXIFWX0WM tag=OW0I4PNNZ7J9 type=write size=3069031 2024-09-12T00:17:52.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.788+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=UM8EE8NO4AXQ type=del size=3279181 2024-09-12T00:17:52.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.792+0000 7f69cdea98c0 1 < completed write operation key=LRHZKCU22AIX tag=I8ZH5JZRTQ41 type=write size=1019330 2024-09-12T00:17:52.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.796+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=H2PTHF33SLIA type=del size=894213 2024-09-12T00:17:52.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.800+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~5UAORTORADFB.0 size=438250 2024-09-12T00:17:52.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.808+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=5UAORTORADFB tag=89E5Y3ROUWXJ type=write size=1486826 2024-09-12T00:17:52.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.812+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~NRQETC50WSKI.0 size=963002 2024-09-12T00:17:52.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.812+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=NRQETC50WSKI tag=3AMMK9Y9TAJS type=write size=2011578 2024-09-12T00:17:52.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.820+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=0L3YR62GH0XF type=del 2024-09-12T00:17:52.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.828+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~3AAEQT2JFF30.0 size=1048576 2024-09-12T00:17:52.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.828+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~3AAEQT2JFF30.1 size=713309 2024-09-12T00:17:52.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.828+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=3AAEQT2JFF30 tag=F4DO9XYYYXOD type=write size=2810461 2024-09-12T00:17:52.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.832+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~0O8P6ISP1YS3.0 size=444181 2024-09-12T00:17:52.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.840+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=0O8P6ISP1YS3 tag=MRJF6CQ7JNTW type=write size=1492757 2024-09-12T00:17:52.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.844+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=XRBNOGDOR7WB type=write size=86548 2024-09-12T00:17:52.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.848+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~DYDASF4KBHCZ.0 size=160328 2024-09-12T00:17:52.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.852+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=DYDASF4KBHCZ tag=TBSOJ22PN21H type=write size=1208904 2024-09-12T00:17:52.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~XG9C5EL1E15R.0 size=484066 2024-09-12T00:17:52.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.860+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=XG9C5EL1E15R tag=5H8JW4VO4AP1 type=write size=1532642 2024-09-12T00:17:52.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.864+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=9X5G7MLAVOY2 type=del 2024-09-12T00:17:52.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~OSLO7KX3NQ4F.0 size=453214 2024-09-12T00:17:52.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.872+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=OSLO7KX3NQ4F tag=ZGXPH8X8D53J type=write size=1501790 2024-09-12T00:17:52.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.876+0000 7f69cdea98c0 1 < canceled operation key=H91UXKWAJ3K8 tag=GR01313XP7W0 type=del size=1666807 2024-09-12T00:17:52.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.880+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=7VICAF2PPO1J type=del size=553424 2024-09-12T00:17:52.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.884+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~RIBPLYNM1S91.0 size=1048576 2024-09-12T00:17:52.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.884+0000 7f69cdea98c0 1 < canceled part key=_multipart_2X78JWLK876H.2~RIBPLYNM1S91.1 size=189777 2024-09-12T00:17:52.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.892+0000 7f69cdea98c0 1 < canceled multipart upload key=2X78JWLK876H upload=RIBPLYNM1S91 tag=WAUGWKT6MPMB type=write size=2286929 2024-09-12T00:17:52.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.896+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=N8FZM8AMVYZQ type=del size=4058505 2024-09-12T00:17:52.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.900+0000 7f69cdea98c0 1 < canceled operation key=O5WBNND16BFN tag=JE5HU7M613BB type=del size=3591715 2024-09-12T00:17:52.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.904+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=F1KSOO929M4W type=del size=3768278 2024-09-12T00:17:52.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.908+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~L8DSXCDPZZER.0 size=1048576 2024-09-12T00:17:52.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.912+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~L8DSXCDPZZER.1 size=420609 2024-09-12T00:17:52.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.916+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=L8DSXCDPZZER tag=PHQCCQACQZLE type=write size=2517761 2024-09-12T00:17:52.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.924+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~FKL3BPE2UFBB.0 size=1048576 2024-09-12T00:17:52.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.928+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~FKL3BPE2UFBB.1 size=1048576 2024-09-12T00:17:52.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.932+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~FKL3BPE2UFBB.2 size=798112 2024-09-12T00:17:52.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.932+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=FKL3BPE2UFBB tag=M950BXB4T9KT type=write size=3943840 2024-09-12T00:17:52.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.936+0000 7f69cdea98c0 1 < completed write operation key=1CZXUEJLQ8FM tag=PMSQ9582HUW1 type=write size=600455 2024-09-12T00:17:52.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.940+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=5WALM0EIO8XB type=write size=755875 2024-09-12T00:17:52.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.944+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~4G6TVA5W5O12.0 size=628443 2024-09-12T00:17:52.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.952+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=4G6TVA5W5O12 tag=Q3GVJVDAWLTJ type=write size=1677019 2024-09-12T00:17:52.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.956+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=KGCYODV3NTYW type=del size=2696537 2024-09-12T00:17:52.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.960+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~QE3K9MD4RYJ9.0 size=1048576 2024-09-12T00:17:52.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.960+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~QE3K9MD4RYJ9.1 size=1048576 2024-09-12T00:17:52.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.964+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~QE3K9MD4RYJ9.2 size=687706 2024-09-12T00:17:52.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.972+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=QE3K9MD4RYJ9 tag=CQUYY12NAABA type=write size=3833434 2024-09-12T00:17:52.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.976+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=9SHA4HNBSRAI type=del size=4007071 2024-09-12T00:17:52.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.980+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=XH9L9GHBPR0I type=del 2024-09-12T00:17:52.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.980+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=IUTX0TOD2HLB type=del size=1636851 2024-09-12T00:17:52.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.984+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~QOHUJHS4HUYE.0 size=1048576 2024-09-12T00:17:52.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.988+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~QOHUJHS4HUYE.1 size=1048576 2024-09-12T00:17:52.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:52.992+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~QOHUJHS4HUYE.2 size=131916 2024-09-12T00:17:52.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.000+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=QOHUJHS4HUYE tag=VQS8CRT1W1J5 type=write size=3277644 2024-09-12T00:17:53.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.004+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=LUTOX1FTR5CJ type=del size=3625986 2024-09-12T00:17:53.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.008+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=UM8EE8NO4AXQ type=del 2024-09-12T00:17:53.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.012+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=H4JEOVEMG5J1 type=write size=18797 2024-09-12T00:17:53.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.020+0000 7f69cdea98c0 1 < suggested update operation key=K0HNNMX7CDGC tag=H2PTHF33SLIA type=del size=894213 2024-09-12T00:17:53.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.024+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=70MX5LN1JUOR type=del size=2584675 2024-09-12T00:17:53.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.028+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~NRQETC50WSKI.0 size=963002 2024-09-12T00:17:53.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.036+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=NRQETC50WSKI tag=3AMMK9Y9TAJS type=write size=2011578 2024-09-12T00:17:53.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.244+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=MYC5O0M9TTR7 type=del size=3501942 2024-09-12T00:17:53.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.248+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~3AAEQT2JFF30.0 size=1048576 2024-09-12T00:17:53.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.252+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~3AAEQT2JFF30.1 size=713309 2024-09-12T00:17:53.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.260+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=3AAEQT2JFF30 tag=F4DO9XYYYXOD type=write size=2810461 2024-09-12T00:17:53.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.264+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~5AV7ZFRU6U0C.0 size=522387 2024-09-12T00:17:53.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.264+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=5AV7ZFRU6U0C tag=K0RFU06HQ6SY type=write size=1570963 2024-09-12T00:17:53.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.268+0000 7f69cdea98c0 1 < completed write operation key=YS23U9GQS7SJ tag=XRBNOGDOR7WB type=write size=86548 2024-09-12T00:17:53.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.272+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=P0RBJI0KXC4F type=del size=2970897 2024-09-12T00:17:53.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.276+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~XG9C5EL1E15R.0 size=484066 2024-09-12T00:17:53.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.284+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=XG9C5EL1E15R tag=5H8JW4VO4AP1 type=write size=1532642 2024-09-12T00:17:53.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.288+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=U4V631SV7O3Y type=del size=4156378 2024-09-12T00:17:53.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.292+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~OSLO7KX3NQ4F.0 size=453214 2024-09-12T00:17:53.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.296+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=OSLO7KX3NQ4F tag=ZGXPH8X8D53J type=write size=1501790 2024-09-12T00:17:53.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.304+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~46JEREIWPH83.0 size=1048576 2024-09-12T00:17:53.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~46JEREIWPH83.1 size=1048576 2024-09-12T00:17:53.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~46JEREIWPH83.2 size=666001 2024-09-12T00:17:53.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.308+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=46JEREIWPH83 tag=QFH4RW1CKS7J type=write size=3811729 2024-09-12T00:17:53.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.316+0000 7f69cdea98c0 1 < suggested update operation key=YS23U9GQS7SJ tag=7VICAF2PPO1J type=del size=553424 2024-09-12T00:17:53.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.320+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=VH06CX7UYDG5 type=del size=4028210 2024-09-12T00:17:53.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.324+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=N8FZM8AMVYZQ type=del 2024-09-12T00:17:53.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.328+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=U179RCS3JU2O type=write size=323519 2024-09-12T00:17:53.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.332+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=F1KSOO929M4W type=del 2024-09-12T00:17:53.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.340+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=OYF1C5MSLL7M type=del size=2294295 2024-09-12T00:17:53.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.344+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~FKL3BPE2UFBB.0 size=1048576 2024-09-12T00:17:53.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.344+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~FKL3BPE2UFBB.1 size=1048576 2024-09-12T00:17:53.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.348+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~FKL3BPE2UFBB.2 size=798112 2024-09-12T00:17:53.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.356+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=FKL3BPE2UFBB tag=M950BXB4T9KT type=write size=3943840 2024-09-12T00:17:53.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.360+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=RKQZ9HTLBSV1 type=del size=1646661 2024-09-12T00:17:53.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.364+0000 7f69cdea98c0 1 < completed write operation key=LRHZKCU22AIX tag=5WALM0EIO8XB type=write size=755875 2024-09-12T00:17:53.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.368+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~OPMRUU2HJ6KV.0 size=1048576 2024-09-12T00:17:53.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~OPMRUU2HJ6KV.1 size=98913 2024-09-12T00:17:53.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.372+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=OPMRUU2HJ6KV tag=BA2YDN8B3UDG type=write size=2196065 2024-09-12T00:17:53.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.376+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=KGCYODV3NTYW type=del 2024-09-12T00:17:53.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.380+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=UIWSZTW240OR type=del size=2522603 2024-09-12T00:17:53.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.384+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=9SHA4HNBSRAI type=del 2024-09-12T00:17:53.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.392+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=8PAU9ATK2BXQ type=del size=2741827 2024-09-12T00:17:53.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.396+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=IUTX0TOD2HLB type=del 2024-09-12T00:17:53.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.400+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=0J5CPV5IOKKQ type=del size=2689026 2024-09-12T00:17:53.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.408+0000 7f69cdea98c0 1 < suggested update operation key=AQY7MM3OX3GW tag=LUTOX1FTR5CJ type=del size=3625986 2024-09-12T00:17:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.412+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=60N5AKJQQW5U type=del size=253065 2024-09-12T00:17:53.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.412+0000 7f69cdea98c0 1 < canceled operation key=Q0L8J0BYRFDQ tag=H4JEOVEMG5J1 type=write size=18797 2024-09-12T00:17:53.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.416+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=ZL2V720ATMQX type=del size=985586 2024-09-12T00:17:53.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.420+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=70MX5LN1JUOR type=del 2024-09-12T00:17:53.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.428+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~H9CW0S5KV3FY.0 size=1048576 2024-09-12T00:17:53.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~H9CW0S5KV3FY.1 size=752116 2024-09-12T00:17:53.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.432+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=H9CW0S5KV3FY tag=6T8C5U4VYCI1 type=write size=2849268 2024-09-12T00:17:53.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.432+0000 7f69cdea98c0 -1 < failed to complete operation key=AQY7MM3OX3GW tag=MYC5O0M9TTR7 type=del size=3501942: (22) Invalid argument 2024-09-12T00:17:53.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.436+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=UFELNO7JMIQD type=del size=356443 2024-09-12T00:17:53.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.444+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~5AV7ZFRU6U0C.0 size=522387 2024-09-12T00:17:53.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.448+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=5AV7ZFRU6U0C tag=K0RFU06HQ6SY type=write size=1570963 2024-09-12T00:17:53.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.452+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=6BQG4S10UBE9 type=del size=2176670 2024-09-12T00:17:53.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.460+0000 7f69cdea98c0 1 < suggested update operation key=Q0L8J0BYRFDQ tag=P0RBJI0KXC4F type=del size=2970897 2024-09-12T00:17:53.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.464+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=VA4CMW0JKSJH type=write size=2710 2024-09-12T00:17:53.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.468+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=U4V631SV7O3Y type=del 2024-09-12T00:17:53.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~LHPK6NDWVS1S.0 size=322577 2024-09-12T00:17:53.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.476+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=LHPK6NDWVS1S tag=JQ2IJA6XMUPB type=write size=1371153 2024-09-12T00:17:53.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.480+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~46JEREIWPH83.0 size=1048576 2024-09-12T00:17:53.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.484+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~46JEREIWPH83.1 size=1048576 2024-09-12T00:17:53.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.484+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~46JEREIWPH83.2 size=666001 2024-09-12T00:17:53.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.492+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=46JEREIWPH83 tag=QFH4RW1CKS7J type=write size=3811729 2024-09-12T00:17:53.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.500+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~17FXOVBPT18P.0 size=1048576 2024-09-12T00:17:53.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.500+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~17FXOVBPT18P.1 size=441439 2024-09-12T00:17:53.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.500+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=17FXOVBPT18P tag=RY1LBNXOLDMO type=write size=2538591 2024-09-12T00:17:53.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.508+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=VH06CX7UYDG5 type=del 2024-09-12T00:17:53.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.512+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=CQO6OI5BI920 type=del size=3180678 2024-09-12T00:17:53.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.516+0000 7f69cdea98c0 -1 < failed to complete operation key=Q0L8J0BYRFDQ tag=U179RCS3JU2O type=write size=323519: (22) Invalid argument 2024-09-12T00:17:53.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.524+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~58N4V4O020SU.0 size=637942 2024-09-12T00:17:53.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.524+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=58N4V4O020SU tag=8DSCT12LL82Y type=write size=1686518 2024-09-12T00:17:53.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.524+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=OYF1C5MSLL7M type=del 2024-09-12T00:17:53.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.528+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=V9GRFNLPIJIR type=del size=1895283 2024-09-12T00:17:53.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.536+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=RKQZ9HTLBSV1 type=del 2024-09-12T00:17:53.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.540+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=P7V1C4YMCDDZ type=del size=1298104 2024-09-12T00:17:53.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.544+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~OPMRUU2HJ6KV.0 size=1048576 2024-09-12T00:17:53.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.544+0000 7f69cdea98c0 1 < canceled part key=_multipart_SCFIVX3IHERR.2~OPMRUU2HJ6KV.1 size=98913 2024-09-12T00:17:53.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.548+0000 7f69cdea98c0 1 < canceled multipart upload key=SCFIVX3IHERR upload=OPMRUU2HJ6KV tag=BA2YDN8B3UDG type=write size=2196065 2024-09-12T00:17:53.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.556+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~55QR0DDS4O4F.0 size=978839 2024-09-12T00:17:53.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.556+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=55QR0DDS4O4F tag=FRFUTQIQFA1Q type=write size=2027415 2024-09-12T00:17:53.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.564+0000 7f69cdea98c0 1 < suggested update operation key=I23GNCI98JHU tag=UIWSZTW240OR type=del size=2522603 2024-09-12T00:17:53.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.568+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=2F9TQV2SPXR5 type=write size=364096 2024-09-12T00:17:53.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.576+0000 7f69cdea98c0 1 < suggested update operation key=VYYY8MF0P3Q7 tag=8PAU9ATK2BXQ type=del size=2741827 2024-09-12T00:17:53.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~0PSHP4RWXTMQ.0 size=1048576 2024-09-12T00:17:53.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.588+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~0PSHP4RWXTMQ.1 size=1048576 2024-09-12T00:17:53.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.592+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~0PSHP4RWXTMQ.2 size=175951 2024-09-12T00:17:53.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.592+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=0PSHP4RWXTMQ tag=DQWFZ98S1MPL type=write size=3321679 2024-09-12T00:17:53.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.596+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=0J5CPV5IOKKQ type=del 2024-09-12T00:17:53.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.600+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~O8V373I34OJC.0 size=1048576 2024-09-12T00:17:53.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.604+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~O8V373I34OJC.1 size=1048576 2024-09-12T00:17:53.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.608+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~O8V373I34OJC.2 size=389339 2024-09-12T00:17:53.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.608+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=O8V373I34OJC tag=317QSYUXVC5K type=write size=3535067 2024-09-12T00:17:53.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.612+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=60N5AKJQQW5U type=del 2024-09-12T00:17:53.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.616+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=W4P497RH45OU type=del size=3594430 2024-09-12T00:17:53.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.624+0000 7f69cdea98c0 1 < suggested update operation key=LRHZKCU22AIX tag=ZL2V720ATMQX type=del size=985586 2024-09-12T00:17:53.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.628+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~AEMG721Z0D23.0 size=1048576 2024-09-12T00:17:53.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.632+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~AEMG721Z0D23.1 size=950145 2024-09-12T00:17:53.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.632+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=AEMG721Z0D23 tag=W9THT65VJPFQ type=write size=3047297 2024-09-12T00:17:53.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.636+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~H9CW0S5KV3FY.0 size=1048576 2024-09-12T00:17:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.640+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~H9CW0S5KV3FY.1 size=752116 2024-09-12T00:17:53.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.644+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=H9CW0S5KV3FY tag=6T8C5U4VYCI1 type=write size=2849268 2024-09-12T00:17:53.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~S2R3Y24N3AVH.0 size=1048576 2024-09-12T00:17:53.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~S2R3Y24N3AVH.1 size=114026 2024-09-12T00:17:53.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.652+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=S2R3Y24N3AVH tag=3I4TY9B831TJ type=write size=2211178 2024-09-12T00:17:53.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.660+0000 7f69cdea98c0 1 < suggested update operation key=Q0L8J0BYRFDQ tag=UFELNO7JMIQD type=del size=356443 2024-09-12T00:17:53.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.664+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=SSXI5ZGMD90P type=del size=1025579 2024-09-12T00:17:53.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.668+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=6BQG4S10UBE9 type=del 2024-09-12T00:17:53.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.672+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=EUKZ1H2PWDH0 type=del size=1800530 2024-09-12T00:17:53.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.676+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=VA4CMW0JKSJH type=write size=2710 2024-09-12T00:17:53.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.680+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=XEXXW9IKJ7XD type=del size=2408697 2024-09-12T00:17:53.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.680+0000 7f69cdea98c0 1 < canceled part key=_multipart_1CZXUEJLQ8FM.2~LHPK6NDWVS1S.0 size=322577 2024-09-12T00:17:53.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.688+0000 7f69cdea98c0 1 < canceled multipart upload key=1CZXUEJLQ8FM upload=LHPK6NDWVS1S tag=JQ2IJA6XMUPB type=write size=1371153 2024-09-12T00:17:53.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.696+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~C2VMCRX90UUG.0 size=1048576 2024-09-12T00:17:53.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.696+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~C2VMCRX90UUG.1 size=1048576 2024-09-12T00:17:53.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.700+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~C2VMCRX90UUG.2 size=229933 2024-09-12T00:17:53.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.700+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=C2VMCRX90UUG tag=7N8C8ON2MH0R type=write size=3375661 2024-09-12T00:17:53.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.704+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~17FXOVBPT18P.0 size=1048576 2024-09-12T00:17:53.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.708+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~17FXOVBPT18P.1 size=441439 2024-09-12T00:17:53.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.716+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=17FXOVBPT18P tag=RY1LBNXOLDMO type=write size=2538591 2024-09-12T00:17:53.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.720+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=P7C1VLN1M1C9 type=write size=280674 2024-09-12T00:17:53.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.724+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=CQO6OI5BI920 type=del 2024-09-12T00:17:53.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.728+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=VTD2P4TUC34W type=del size=3421852 2024-09-12T00:17:53.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.732+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~58N4V4O020SU.0 size=637942 2024-09-12T00:17:53.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.740+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=58N4V4O020SU tag=8DSCT12LL82Y type=write size=1686518 2024-09-12T00:17:53.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~PYBNX2ROGQYX.0 size=1048576 2024-09-12T00:17:53.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.752+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~PYBNX2ROGQYX.1 size=199292 2024-09-12T00:17:53.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.752+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=PYBNX2ROGQYX tag=XND9WLD3BRLC type=write size=2296444 2024-09-12T00:17:53.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.764+0000 7f69cdea98c0 1 < suggested update operation key=AQY7MM3OX3GW tag=V9GRFNLPIJIR type=del size=1895283 2024-09-12T00:17:53.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.768+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=VEN8NTPPWW9X type=del size=1448002 2024-09-12T00:17:53.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.776+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=P7V1C4YMCDDZ type=del 2024-09-12T00:17:53.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.780+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=S5FDKPIFTQA1 type=del size=745540 2024-09-12T00:17:53.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.784+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~55QR0DDS4O4F.0 size=978839 2024-09-12T00:17:53.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.792+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=55QR0DDS4O4F tag=FRFUTQIQFA1Q type=write size=2027415 2024-09-12T00:17:53.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.796+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~F79HBUTYWWTQ.0 size=666357 2024-09-12T00:17:53.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.796+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=F79HBUTYWWTQ tag=S58VI6IIKTLB type=write size=1714933 2024-09-12T00:17:53.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.804+0000 7f69cdea98c0 1 < completed write operation key=K0HNNMX7CDGC tag=2F9TQV2SPXR5 type=write size=364096 2024-09-12T00:17:53.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.808+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=GV0XD2P8TFXP type=del size=1983694 2024-09-12T00:17:53.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.812+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~0PSHP4RWXTMQ.0 size=1048576 2024-09-12T00:17:53.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.812+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~0PSHP4RWXTMQ.1 size=1048576 2024-09-12T00:17:53.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.816+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~0PSHP4RWXTMQ.2 size=175951 2024-09-12T00:17:53.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.824+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=0PSHP4RWXTMQ tag=DQWFZ98S1MPL type=write size=3321679 2024-09-12T00:17:53.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.828+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=DEN9DDMONCQ2 type=del size=1359833 2024-09-12T00:17:53.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.832+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~O8V373I34OJC.0 size=1048576 2024-09-12T00:17:53.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.836+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~O8V373I34OJC.1 size=1048576 2024-09-12T00:17:53.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.840+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~O8V373I34OJC.2 size=389339 2024-09-12T00:17:53.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.844+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=O8V373I34OJC tag=317QSYUXVC5K type=write size=3535067 2024-09-12T00:17:53.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.848+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=8KAW82SLC2YW type=del size=1217252 2024-09-12T00:17:53.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.856+0000 7f69cdea98c0 1 < suggested update operation key=O5WBNND16BFN tag=W4P497RH45OU type=del size=3594430 2024-09-12T00:17:53.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.860+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=LA376GA6BFS4 type=del size=1415598 2024-09-12T00:17:53.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.864+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~AEMG721Z0D23.0 size=1048576 2024-09-12T00:17:53.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.864+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~AEMG721Z0D23.1 size=950145 2024-09-12T00:17:53.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.872+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=AEMG721Z0D23 tag=W9THT65VJPFQ type=write size=3047297 2024-09-12T00:17:53.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~P88BR6TEEFKQ.0 size=309031 2024-09-12T00:17:53.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.880+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=P88BR6TEEFKQ tag=18TUXENED3KB type=write size=1357607 2024-09-12T00:17:53.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.880+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~S2R3Y24N3AVH.0 size=1048576 2024-09-12T00:17:53.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.884+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~S2R3Y24N3AVH.1 size=114026 2024-09-12T00:17:53.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.892+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=S2R3Y24N3AVH tag=3I4TY9B831TJ type=write size=2211178 2024-09-12T00:17:53.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.892+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=6MDS6UO4X14L type=del size=2631441 2024-09-12T00:17:53.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.900+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=SSXI5ZGMD90P type=del 2024-09-12T00:17:53.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.900+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=FA6E40DVXL4V type=del size=160577 2024-09-12T00:17:53.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.908+0000 7f69cdea98c0 1 < suggested update operation key=YS23U9GQS7SJ tag=EUKZ1H2PWDH0 type=del size=1800530 2024-09-12T00:17:53.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.912+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=CQBA2DRMMCIC type=del size=3071637 2024-09-12T00:17:53.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.916+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=XEXXW9IKJ7XD type=del 2024-09-12T00:17:53.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.920+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=ET403F38489V type=del size=749680 2024-09-12T00:17:53.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.924+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~C2VMCRX90UUG.0 size=1048576 2024-09-12T00:17:53.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.928+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~C2VMCRX90UUG.1 size=1048576 2024-09-12T00:17:53.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.932+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~C2VMCRX90UUG.2 size=229933 2024-09-12T00:17:53.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.936+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=C2VMCRX90UUG tag=7N8C8ON2MH0R type=write size=3375661 2024-09-12T00:17:53.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.940+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=O3R884A9M4MG type=write size=710011 2024-09-12T00:17:53.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.944+0000 7f69cdea98c0 1 < completed write operation key=2X78JWLK876H tag=P7C1VLN1M1C9 type=write size=280674 2024-09-12T00:17:53.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.948+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=56DOXU3MPY2F type=del size=1506901 2024-09-12T00:17:53.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.952+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=VTD2P4TUC34W type=del 2024-09-12T00:17:53.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.956+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=NS083U0JETYC type=del size=1344895 2024-09-12T00:17:53.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.960+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~PYBNX2ROGQYX.0 size=1048576 2024-09-12T00:17:53.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.964+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~PYBNX2ROGQYX.1 size=199292 2024-09-12T00:17:53.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.968+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=PYBNX2ROGQYX tag=XND9WLD3BRLC type=write size=2296444 2024-09-12T00:17:53.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.972+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=V72HDW39FAK1 type=del size=2566780 2024-09-12T00:17:53.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.980+0000 7f69cdea98c0 1 < suggested remove operation key=T9OJXTZNRQJB tag=VEN8NTPPWW9X type=del 2024-09-12T00:17:53.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.984+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=O7U2UPTLK6OY type=del size=4060316 2024-09-12T00:17:53.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.988+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=S5FDKPIFTQA1 type=del 2024-09-12T00:17:53.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.992+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~X5FEQ51V5NCI.0 size=1048576 2024-09-12T00:17:53.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.996+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~X5FEQ51V5NCI.1 size=1048576 2024-09-12T00:17:53.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.996+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~X5FEQ51V5NCI.2 size=358311 2024-09-12T00:17:53.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:53.996+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=X5FEQ51V5NCI tag=IKIN0TQVRNP7 type=write size=3504039 2024-09-12T00:17:53.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.000+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~F79HBUTYWWTQ.0 size=666357 2024-09-12T00:17:54.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.004+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=F79HBUTYWWTQ tag=S58VI6IIKTLB type=write size=1714933 2024-09-12T00:17:54.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.008+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=BHIEH9BS9UTB type=del size=2895785 2024-09-12T00:17:54.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.008+0000 7f69cdea98c0 1 < canceled operation key=RDGRKQQH4B8C tag=GV0XD2P8TFXP type=del size=1983694 2024-09-12T00:17:54.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.012+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=MQUBSK2EA2NK type=del size=2083668 2024-09-12T00:17:54.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.020+0000 7f69cdea98c0 1 < suggested update operation key=0J667VAQGMTX tag=DEN9DDMONCQ2 type=del size=1359833 2024-09-12T00:17:54.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.020+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=YXG5AS5NA0PP type=write size=329310 2024-09-12T00:17:54.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.024+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=8KAW82SLC2YW type=del 2024-09-12T00:17:54.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.028+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=HEQVB7BJQSWO type=del size=3200443 2024-09-12T00:17:54.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.032+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=LA376GA6BFS4 type=del 2024-09-12T00:17:54.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.032+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=KM0EPKPBXU1Z type=del size=2893797 2024-09-12T00:17:54.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.036+0000 7f69cdea98c0 1 < canceled part key=_multipart_RDGRKQQH4B8C.2~P88BR6TEEFKQ.0 size=309031 2024-09-12T00:17:54.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.040+0000 7f69cdea98c0 1 < canceled multipart upload key=RDGRKQQH4B8C upload=P88BR6TEEFKQ tag=18TUXENED3KB type=write size=1357607 2024-09-12T00:17:54.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.040+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=AKCHE2N5EUWP type=del size=2621721 2024-09-12T00:17:54.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.044+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=6MDS6UO4X14L type=del 2024-09-12T00:17:54.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.048+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=9YLVE2UZ00XD type=del size=4005809 2024-09-12T00:17:54.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.052+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=FA6E40DVXL4V type=del 2024-09-12T00:17:54.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.056+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~YXY0NORKYOJL.0 size=1048576 2024-09-12T00:17:54.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.056+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~YXY0NORKYOJL.1 size=949 2024-09-12T00:17:54.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.056+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=YXY0NORKYOJL tag=X3UJ1HBGD05R type=write size=2098101 2024-09-12T00:17:54.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.060+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=CQBA2DRMMCIC type=del 2024-09-12T00:17:54.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.064+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~F25MDXIAEDNR.0 size=73837 2024-09-12T00:17:54.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.064+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=F25MDXIAEDNR tag=53X3FPOXMK21 type=write size=1122413 2024-09-12T00:17:54.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.068+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=ET403F38489V type=del 2024-09-12T00:17:54.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.076+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~Z3TLLO159HX5.0 size=1048576 2024-09-12T00:17:54.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.076+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~Z3TLLO159HX5.1 size=975175 2024-09-12T00:17:54.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.076+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=Z3TLLO159HX5 tag=LX9KN6820GMM type=write size=3072327 2024-09-12T00:17:54.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.080+0000 7f69cdea98c0 1 < canceled operation key=5453GP1H3OFQ tag=O3R884A9M4MG type=write size=710011 2024-09-12T00:17:54.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.088+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~F2BO43FPCGL2.0 size=361873 2024-09-12T00:17:54.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.088+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=F2BO43FPCGL2 tag=5NUSZNE4V5WP type=write size=1410449 2024-09-12T00:17:54.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.092+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=56DOXU3MPY2F type=del 2024-09-12T00:17:54.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.096+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=UTFSN5G0MJ6S type=del size=1437562 2024-09-12T00:17:54.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.104+0000 7f69cdea98c0 1 < suggested remove operation key=VYYY8MF0P3Q7 tag=NS083U0JETYC type=del 2024-09-12T00:17:54.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.104+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=R70M3MVLBPK0 type=del size=991506 2024-09-12T00:17:54.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.108+0000 7f69cdea98c0 -1 < failed to complete operation key=VYYY8MF0P3Q7 tag=V72HDW39FAK1 type=del size=2566780: (22) Invalid argument 2024-09-12T00:17:54.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.112+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=8IRFEF89T9WC type=write size=675451 2024-09-12T00:17:54.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.116+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=O7U2UPTLK6OY type=del 2024-09-12T00:17:54.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~Q55UOPH78IB2.0 size=1048576 2024-09-12T00:17:54.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.124+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~Q55UOPH78IB2.1 size=1048576 2024-09-12T00:17:54.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~Q55UOPH78IB2.2 size=1018069 2024-09-12T00:17:54.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.128+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=Q55UOPH78IB2 tag=9IA3KPT949CC type=write size=4163797 2024-09-12T00:17:54.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.128+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~X5FEQ51V5NCI.0 size=1048576 2024-09-12T00:17:54.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.132+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~X5FEQ51V5NCI.1 size=1048576 2024-09-12T00:17:54.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.136+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~X5FEQ51V5NCI.2 size=358311 2024-09-12T00:17:54.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.140+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=X5FEQ51V5NCI tag=IKIN0TQVRNP7 type=write size=3504039 2024-09-12T00:17:54.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.144+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=GN812O1JUZHK type=del size=3467039 2024-09-12T00:17:54.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.144+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=BHIEH9BS9UTB type=del 2024-09-12T00:17:54.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.148+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=623SX1KFJKLK type=del size=2673829 2024-09-12T00:17:54.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.152+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=MQUBSK2EA2NK type=del 2024-09-12T00:17:54.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.156+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~0GQZQ6OQUIFB.0 size=730002 2024-09-12T00:17:54.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.156+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=0GQZQ6OQUIFB tag=O2DVBK66Q78G type=write size=1778578 2024-09-12T00:17:54.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.160+0000 7f69cdea98c0 1 < canceled operation key=AKWTTXH2P254 tag=YXG5AS5NA0PP type=write size=329310 2024-09-12T00:17:54.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.164+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=7RYZRYF9VY4R type=write size=424132 2024-09-12T00:17:54.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.172+0000 7f69cdea98c0 1 < suggested remove operation key=H91UXKWAJ3K8 tag=HEQVB7BJQSWO type=del 2024-09-12T00:17:54.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.176+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=R69D243AXTKJ type=del size=2492555 2024-09-12T00:17:54.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.176+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=KM0EPKPBXU1Z type=del 2024-09-12T00:17:54.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.180+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=V1AP7R2ACJDM type=del size=502516 2024-09-12T00:17:54.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.184+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=AKCHE2N5EUWP type=del 2024-09-12T00:17:54.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.188+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=0X8QY7PGRO8O type=del size=4166554 2024-09-12T00:17:54.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.192+0000 7f69cdea98c0 1 < suggested update operation key=SCFIVX3IHERR tag=9YLVE2UZ00XD type=del size=4005809 2024-09-12T00:17:54.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.196+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=72JOI4SAX3X7 type=del size=2086591 2024-09-12T00:17:54.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.200+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~YXY0NORKYOJL.0 size=1048576 2024-09-12T00:17:54.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.200+0000 7f69cdea98c0 1 < canceled part key=_multipart_2YYP9NOUAJD0.2~YXY0NORKYOJL.1 size=949 2024-09-12T00:17:54.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.204+0000 7f69cdea98c0 1 < canceled multipart upload key=2YYP9NOUAJD0 upload=YXY0NORKYOJL tag=X3UJ1HBGD05R type=write size=2098101 2024-09-12T00:17:54.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.208+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=GGSR0UFORBIJ type=write size=68877 2024-09-12T00:17:54.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.212+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~F25MDXIAEDNR.0 size=73837 2024-09-12T00:17:54.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.216+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=F25MDXIAEDNR tag=53X3FPOXMK21 type=write size=1122413 2024-09-12T00:17:54.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.220+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=V86MVMKBWRJA type=del size=4068373 2024-09-12T00:17:54.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.224+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~Z3TLLO159HX5.0 size=1048576 2024-09-12T00:17:54.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.224+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~Z3TLLO159HX5.1 size=975175 2024-09-12T00:17:54.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.232+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=Z3TLLO159HX5 tag=LX9KN6820GMM type=write size=3072327 2024-09-12T00:17:54.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.236+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~WSR8ZFF6SPXA.0 size=1048576 2024-09-12T00:17:54.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~WSR8ZFF6SPXA.1 size=1048576 2024-09-12T00:17:54.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~WSR8ZFF6SPXA.2 size=895122 2024-09-12T00:17:54.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.244+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=WSR8ZFF6SPXA tag=RDHIWN7MHDSW type=write size=4040850 2024-09-12T00:17:54.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.248+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~F2BO43FPCGL2.0 size=361873 2024-09-12T00:17:54.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.252+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=F2BO43FPCGL2 tag=5NUSZNE4V5WP type=write size=1410449 2024-09-12T00:17:54.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~T5M3TZYECP9K.0 size=1048576 2024-09-12T00:17:54.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~T5M3TZYECP9K.1 size=1048576 2024-09-12T00:17:54.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.264+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~T5M3TZYECP9K.2 size=749454 2024-09-12T00:17:54.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.264+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=T5M3TZYECP9K tag=M5EUBRCSMZ0G type=write size=3895182 2024-09-12T00:17:54.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.268+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=UTFSN5G0MJ6S type=del 2024-09-12T00:17:54.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.272+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=LPQR0JBHWD8T type=del size=722272 2024-09-12T00:17:54.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.276+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=R70M3MVLBPK0 type=del 2024-09-12T00:17:54.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.280+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=LZLSNCJIUGEJ type=write size=889472 2024-09-12T00:17:54.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.288+0000 7f69cdea98c0 1 < suggested remove operation key=T9OJXTZNRQJB tag=8IRFEF89T9WC type=write 2024-09-12T00:17:54.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.292+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~QXNTXYP2O0GW.0 size=1048576 2024-09-12T00:17:54.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~QXNTXYP2O0GW.1 size=1048576 2024-09-12T00:17:54.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~QXNTXYP2O0GW.2 size=546931 2024-09-12T00:17:54.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.296+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=QXNTXYP2O0GW tag=7NH4ZUUFA6WF type=write size=3692659 2024-09-12T00:17:54.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.300+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~Q55UOPH78IB2.0 size=1048576 2024-09-12T00:17:54.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.304+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~Q55UOPH78IB2.1 size=1048576 2024-09-12T00:17:54.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.304+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~Q55UOPH78IB2.2 size=1018069 2024-09-12T00:17:54.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.312+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=Q55UOPH78IB2 tag=9IA3KPT949CC type=write size=4163797 2024-09-12T00:17:54.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.316+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~FG6TV2HNZO0E.0 size=1048576 2024-09-12T00:17:54.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.320+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~FG6TV2HNZO0E.1 size=501075 2024-09-12T00:17:54.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.320+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=FG6TV2HNZO0E tag=MDQWA1ALKOGY type=write size=2598227 2024-09-12T00:17:54.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.324+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=GN812O1JUZHK type=del size=3467039 2024-09-12T00:17:54.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.328+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=J6PLJE3HICVH type=write size=621953 2024-09-12T00:17:54.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.332+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=623SX1KFJKLK type=del 2024-09-12T00:17:54.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.336+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~3TGWI4CWFGTV.0 size=1048576 2024-09-12T00:17:54.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.340+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~3TGWI4CWFGTV.1 size=374885 2024-09-12T00:17:54.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.340+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=3TGWI4CWFGTV tag=PB7G28XQ0TQP type=write size=2472037 2024-09-12T00:17:54.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.344+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~0GQZQ6OQUIFB.0 size=730002 2024-09-12T00:17:54.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.348+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=0GQZQ6OQUIFB tag=O2DVBK66Q78G type=write size=1778578 2024-09-12T00:17:54.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~7KE0Z9GFA9L2.0 size=22508 2024-09-12T00:17:54.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.356+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=7KE0Z9GFA9L2 tag=VTW9JNO81PZ7 type=write size=1071084 2024-09-12T00:17:54.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.360+0000 7f69cdea98c0 1 < completed write operation key=SP2KVAO82MQ0 tag=7RYZRYF9VY4R type=write size=424132 2024-09-12T00:17:54.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.368+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~OEBRYMSS0HD6.0 size=1048576 2024-09-12T00:17:54.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~OEBRYMSS0HD6.1 size=1048576 2024-09-12T00:17:54.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~OEBRYMSS0HD6.2 size=892030 2024-09-12T00:17:54.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.372+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=OEBRYMSS0HD6 tag=DE2RTZ6NSLOV type=write size=4037758 2024-09-12T00:17:54.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.376+0000 7f69cdea98c0 1 < canceled operation key=IXB6WLN5M81C tag=R69D243AXTKJ type=del size=2492555 2024-09-12T00:17:54.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.380+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=ZAGADCZNHNX6 type=write size=550506 2024-09-12T00:17:54.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.384+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=V1AP7R2ACJDM type=del 2024-09-12T00:17:54.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.392+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~I7CSFJMW0W99.0 size=1048576 2024-09-12T00:17:54.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~I7CSFJMW0W99.1 size=224958 2024-09-12T00:17:54.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.396+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=I7CSFJMW0W99 tag=KWD0TJW65BOY type=write size=2322110 2024-09-12T00:17:54.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.400+0000 7f69cdea98c0 -1 < failed to complete operation key=T9OJXTZNRQJB tag=0X8QY7PGRO8O type=del size=4166554: (22) Invalid argument 2024-09-12T00:17:54.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~VQMBEYYQAZO8.0 size=1048576 2024-09-12T00:17:54.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~VQMBEYYQAZO8.1 size=1048576 2024-09-12T00:17:54.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~VQMBEYYQAZO8.2 size=993185 2024-09-12T00:17:54.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.412+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=VQMBEYYQAZO8 tag=CZ1B8DRCYIS7 type=write size=4138913 2024-09-12T00:17:54.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.420+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=72JOI4SAX3X7 type=del 2024-09-12T00:17:54.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.420+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=71SH0I4CJR4P type=del size=1579960 2024-09-12T00:17:54.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.424+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=GGSR0UFORBIJ type=write size=68877 2024-09-12T00:17:54.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~FGRN8FNMT09Y.0 size=1048576 2024-09-12T00:17:54.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.436+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~FGRN8FNMT09Y.1 size=1048576 2024-09-12T00:17:54.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.436+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~FGRN8FNMT09Y.2 size=1039863 2024-09-12T00:17:54.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.436+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=FGRN8FNMT09Y tag=NYDS6E2GCFTK type=write size=4185591 2024-09-12T00:17:54.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.440+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=V86MVMKBWRJA type=del 2024-09-12T00:17:54.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.448+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~EBVBFO704HDV.0 size=1048576 2024-09-12T00:17:54.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~EBVBFO704HDV.1 size=1048576 2024-09-12T00:17:54.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~EBVBFO704HDV.2 size=748486 2024-09-12T00:17:54.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.452+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=EBVBFO704HDV tag=GXMRNGD3E1QB type=write size=3894214 2024-09-12T00:17:54.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.456+0000 7f69cdea98c0 1 < canceled part key=_multipart_5453GP1H3OFQ.2~WSR8ZFF6SPXA.0 size=1048576 2024-09-12T00:17:54.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.456+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~WSR8ZFF6SPXA.1 size=1048576 2024-09-12T00:17:54.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.460+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~WSR8ZFF6SPXA.2 size=895122 2024-09-12T00:17:54.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.468+0000 7f69cdea98c0 1 < canceled multipart upload key=5453GP1H3OFQ upload=WSR8ZFF6SPXA tag=RDHIWN7MHDSW type=write size=4040850 2024-09-12T00:17:54.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~K1RLG7U9K6EJ.0 size=1048576 2024-09-12T00:17:54.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~K1RLG7U9K6EJ.1 size=1048576 2024-09-12T00:17:54.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.480+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~K1RLG7U9K6EJ.2 size=722272 2024-09-12T00:17:54.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.480+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=K1RLG7U9K6EJ tag=Z5H5B6AGXUNQ type=write size=3868000 2024-09-12T00:17:54.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.484+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~T5M3TZYECP9K.0 size=1048576 2024-09-12T00:17:54.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.488+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~T5M3TZYECP9K.1 size=1048576 2024-09-12T00:17:54.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.492+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~T5M3TZYECP9K.2 size=749454 2024-09-12T00:17:54.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.496+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=T5M3TZYECP9K tag=M5EUBRCSMZ0G type=write size=3895182 2024-09-12T00:17:54.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.500+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=FIAC30ZJ848R type=write size=111691 2024-09-12T00:17:54.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.504+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=LPQR0JBHWD8T type=del 2024-09-12T00:17:54.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.508+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=SG71WC3KLFSQ type=del size=619752 2024-09-12T00:17:54.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.512+0000 7f69cdea98c0 1 < completed write operation key=K0HNNMX7CDGC tag=LZLSNCJIUGEJ type=write size=889472 2024-09-12T00:17:54.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.516+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=HE6SDFEZVLRI type=del size=18537 2024-09-12T00:17:54.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.520+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~QXNTXYP2O0GW.0 size=1048576 2024-09-12T00:17:54.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.524+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~QXNTXYP2O0GW.1 size=1048576 2024-09-12T00:17:54.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.528+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~QXNTXYP2O0GW.2 size=546931 2024-09-12T00:17:54.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.532+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=QXNTXYP2O0GW tag=7NH4ZUUFA6WF type=write size=3692659 2024-09-12T00:17:54.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.536+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=UH9QJ8TKW35G type=del size=2161729 2024-09-12T00:17:54.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.540+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~FG6TV2HNZO0E.0 size=1048576 2024-09-12T00:17:54.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.544+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~FG6TV2HNZO0E.1 size=501075 2024-09-12T00:17:54.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.548+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=FG6TV2HNZO0E tag=MDQWA1ALKOGY type=write size=2598227 2024-09-12T00:17:54.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.552+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=TCWWQXUSAAHF type=del size=3645935 2024-09-12T00:17:54.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.556+0000 7f69cdea98c0 1 < canceled operation key=0EALARW4O3OB tag=J6PLJE3HICVH type=write size=621953 2024-09-12T00:17:54.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.564+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~PG1FMU1X373T.0 size=1048576 2024-09-12T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.568+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~PG1FMU1X373T.1 size=362252 2024-09-12T00:17:54.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.568+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=PG1FMU1X373T tag=ABRGGF4NN0YE type=write size=2459404 2024-09-12T00:17:54.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.572+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~3TGWI4CWFGTV.0 size=1048576 2024-09-12T00:17:54.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.576+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~3TGWI4CWFGTV.1 size=374885 2024-09-12T00:17:54.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.580+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=3TGWI4CWFGTV tag=PB7G28XQ0TQP type=write size=2472037 2024-09-12T00:17:54.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.584+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=GZR889C5XW5J type=write size=617512 2024-09-12T00:17:54.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.588+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~7KE0Z9GFA9L2.0 size=22508 2024-09-12T00:17:54.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.596+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=7KE0Z9GFA9L2 tag=VTW9JNO81PZ7 type=write size=1071084 2024-09-12T00:17:54.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.596+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=8UZS0R343XQ3 type=del size=3799963 2024-09-12T00:17:54.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.600+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~OEBRYMSS0HD6.0 size=1048576 2024-09-12T00:17:54.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.600+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~OEBRYMSS0HD6.1 size=1048576 2024-09-12T00:17:54.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.604+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~OEBRYMSS0HD6.2 size=892030 2024-09-12T00:17:54.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.612+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=OEBRYMSS0HD6 tag=DE2RTZ6NSLOV type=write size=4037758 2024-09-12T00:17:54.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.616+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~WZFPLGIPXNY2.0 size=21516 2024-09-12T00:17:54.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.616+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=WZFPLGIPXNY2 tag=6V42F7NULEO1 type=write size=1070092 2024-09-12T00:17:54.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.620+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=ZAGADCZNHNX6 type=write size=550506 2024-09-12T00:17:54.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.628+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~LYCIUKQGXTBM.0 size=1048576 2024-09-12T00:17:54.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.632+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~LYCIUKQGXTBM.1 size=550540 2024-09-12T00:17:54.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.632+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=LYCIUKQGXTBM tag=GAE0ZVTAU4IW type=write size=2647692 2024-09-12T00:17:54.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.636+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~I7CSFJMW0W99.0 size=1048576 2024-09-12T00:17:54.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.636+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~I7CSFJMW0W99.1 size=224958 2024-09-12T00:17:54.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.644+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=I7CSFJMW0W99 tag=KWD0TJW65BOY type=write size=2322110 2024-09-12T00:17:54.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~YFDH5Y78MGAX.0 size=1048576 2024-09-12T00:17:54.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~YFDH5Y78MGAX.1 size=1048576 2024-09-12T00:17:54.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~YFDH5Y78MGAX.2 size=149722 2024-09-12T00:17:54.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.656+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=YFDH5Y78MGAX tag=WI93T1ZPAPAL type=write size=3295450 2024-09-12T00:17:54.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.660+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~VQMBEYYQAZO8.0 size=1048576 2024-09-12T00:17:54.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.664+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~VQMBEYYQAZO8.1 size=1048576 2024-09-12T00:17:54.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.664+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~VQMBEYYQAZO8.2 size=993185 2024-09-12T00:17:54.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.672+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=VQMBEYYQAZO8 tag=CZ1B8DRCYIS7 type=write size=4138913 2024-09-12T00:17:54.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.676+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=LEK7529RU6EO type=write size=194379 2024-09-12T00:17:54.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.680+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=71SH0I4CJR4P type=del 2024-09-12T00:17:54.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.684+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=N9MINLV27B1J type=del size=3763178 2024-09-12T00:17:54.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.688+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~FGRN8FNMT09Y.0 size=1048576 2024-09-12T00:17:54.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.688+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~FGRN8FNMT09Y.1 size=1048576 2024-09-12T00:17:54.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.692+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~FGRN8FNMT09Y.2 size=1039863 2024-09-12T00:17:54.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.696+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=FGRN8FNMT09Y tag=NYDS6E2GCFTK type=write size=4185591 2024-09-12T00:17:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.700+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=6JIH8AQHTEL0 type=del size=742976 2024-09-12T00:17:54.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.704+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~EBVBFO704HDV.0 size=1048576 2024-09-12T00:17:54.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.708+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~EBVBFO704HDV.1 size=1048576 2024-09-12T00:17:54.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.712+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~EBVBFO704HDV.2 size=748486 2024-09-12T00:17:54.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.716+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=EBVBFO704HDV tag=GXMRNGD3E1QB type=write size=3894214 2024-09-12T00:17:54.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.720+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=MXQ1OCH4UX1I type=del size=2365061 2024-09-12T00:17:54.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.724+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~K1RLG7U9K6EJ.0 size=1048576 2024-09-12T00:17:54.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.728+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~K1RLG7U9K6EJ.1 size=1048576 2024-09-12T00:17:54.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.732+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~K1RLG7U9K6EJ.2 size=722272 2024-09-12T00:17:54.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.736+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=K1RLG7U9K6EJ tag=Z5H5B6AGXUNQ type=write size=3868000 2024-09-12T00:17:54.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~RTMBXKIM8YA6.0 size=1048576 2024-09-12T00:17:54.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.752+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~RTMBXKIM8YA6.1 size=507405 2024-09-12T00:17:54.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.752+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=RTMBXKIM8YA6 tag=4QNJDRMWNGPO type=write size=2604557 2024-09-12T00:17:54.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.756+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=FIAC30ZJ848R type=write size=111691 2024-09-12T00:17:54.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.760+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=JOBB05C8S4KM type=del size=538008 2024-09-12T00:17:54.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.764+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=SG71WC3KLFSQ type=del 2024-09-12T00:17:54.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.768+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=V3V3S3IN3WKL type=del size=3839956 2024-09-12T00:17:54.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.772+0000 7f69cdea98c0 1 < canceled operation key=0HAUC4BDL9VR tag=HE6SDFEZVLRI type=del size=18537 2024-09-12T00:17:54.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.780+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~JQSGNUIXW8W3.0 size=75369 2024-09-12T00:17:54.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.780+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=JQSGNUIXW8W3 tag=VBXAA4ILH9CF type=write size=1123945 2024-09-12T00:17:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.784+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=UH9QJ8TKW35G type=del 2024-09-12T00:17:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.792+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~T9VUZ5FFOINQ.0 size=857542 2024-09-12T00:17:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.792+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=T9VUZ5FFOINQ tag=MT8PE5UR22KC type=write size=1906118 2024-09-12T00:17:54.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.796+0000 7f69cdea98c0 1 < canceled operation key=YS23U9GQS7SJ tag=TCWWQXUSAAHF type=del size=3645935 2024-09-12T00:17:54.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.800+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=WU6W051C6LCT type=del size=3529463 2024-09-12T00:17:54.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.804+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~PG1FMU1X373T.0 size=1048576 2024-09-12T00:17:54.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.804+0000 7f69cdea98c0 1 < canceled part key=_multipart_0J667VAQGMTX.2~PG1FMU1X373T.1 size=362252 2024-09-12T00:17:54.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.808+0000 7f69cdea98c0 1 < canceled multipart upload key=0J667VAQGMTX upload=PG1FMU1X373T tag=ABRGGF4NN0YE type=write size=2459404 2024-09-12T00:17:54.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.812+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=N4HUU7L0D1OM type=del size=3017652 2024-09-12T00:17:54.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.816+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=GZR889C5XW5J type=write size=617512 2024-09-12T00:17:54.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.820+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=31CFQJZFC5RW type=del size=2684064 2024-09-12T00:17:54.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.824+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=8UZS0R343XQ3 type=del 2024-09-12T00:17:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.828+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=XFFGAU8R21EF type=write size=707413 2024-09-12T00:17:54.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.832+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~WZFPLGIPXNY2.0 size=21516 2024-09-12T00:17:54.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.836+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=WZFPLGIPXNY2 tag=6V42F7NULEO1 type=write size=1070092 2024-09-12T00:17:54.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~EWCIWE55SZA9.0 size=1048576 2024-09-12T00:17:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~EWCIWE55SZA9.1 size=465391 2024-09-12T00:17:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.848+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=EWCIWE55SZA9 tag=B8TLH533I2U1 type=write size=2562543 2024-09-12T00:17:54.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.852+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~LYCIUKQGXTBM.0 size=1048576 2024-09-12T00:17:54.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.852+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~LYCIUKQGXTBM.1 size=550540 2024-09-12T00:17:54.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.860+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=LYCIUKQGXTBM tag=GAE0ZVTAU4IW type=write size=2647692 2024-09-12T00:17:54.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~UL9PEZRQTREK.0 size=1048576 2024-09-12T00:17:54.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~UL9PEZRQTREK.1 size=718392 2024-09-12T00:17:54.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.872+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=UL9PEZRQTREK tag=33BD77G7FWOZ type=write size=2815544 2024-09-12T00:17:54.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.876+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~YFDH5Y78MGAX.0 size=1048576 2024-09-12T00:17:54.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.876+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~YFDH5Y78MGAX.1 size=1048576 2024-09-12T00:17:54.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.880+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~YFDH5Y78MGAX.2 size=149722 2024-09-12T00:17:54.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.888+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=YFDH5Y78MGAX tag=WI93T1ZPAPAL type=write size=3295450 2024-09-12T00:17:54.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~7G4O95HY8JKX.0 size=1048576 2024-09-12T00:17:54.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~7G4O95HY8JKX.1 size=453902 2024-09-12T00:17:54.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.896+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=7G4O95HY8JKX tag=JEJK1M4I1KB5 type=write size=2551054 2024-09-12T00:17:54.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.900+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=LEK7529RU6EO type=write size=194379 2024-09-12T00:17:54.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.908+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~WG88OJ80S1C3.0 size=37334 2024-09-12T00:17:54.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.908+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=WG88OJ80S1C3 tag=547PWU8JRCWX type=write size=1085910 2024-09-12T00:17:54.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.912+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=N9MINLV27B1J type=del 2024-09-12T00:17:54.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.920+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~RE3FJ2NNTF5A.0 size=343457 2024-09-12T00:17:54.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.920+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=RE3FJ2NNTF5A tag=9GHACJBZHCJN type=write size=1392033 2024-09-12T00:17:54.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.928+0000 7f69cdea98c0 1 < suggested update operation key=AWZ03VE7D86K tag=6JIH8AQHTEL0 type=del size=742976 2024-09-12T00:17:54.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.936+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~AJ0MF40H77W2.0 size=1048576 2024-09-12T00:17:54.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.936+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~AJ0MF40H77W2.1 size=1048576 2024-09-12T00:17:54.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.940+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~AJ0MF40H77W2.2 size=728980 2024-09-12T00:17:54.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.940+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=AJ0MF40H77W2 tag=KY261REBOY93 type=write size=3874708 2024-09-12T00:17:54.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.944+0000 7f69cdea98c0 1 < canceled operation key=I23GNCI98JHU tag=MXQ1OCH4UX1I type=del size=2365061 2024-09-12T00:17:54.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.952+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~XYFS2FO5NZ1J.0 size=508457 2024-09-12T00:17:54.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.952+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=XYFS2FO5NZ1J tag=7RAR5C3Z780V type=write size=1557033 2024-09-12T00:17:54.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.956+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~RTMBXKIM8YA6.0 size=1048576 2024-09-12T00:17:54.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.956+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~RTMBXKIM8YA6.1 size=507405 2024-09-12T00:17:54.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.964+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=RTMBXKIM8YA6 tag=4QNJDRMWNGPO type=write size=2604557 2024-09-12T00:17:54.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.972+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~XATTMXSAE99I.0 size=1048576 2024-09-12T00:17:54.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.972+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~XATTMXSAE99I.1 size=1008799 2024-09-12T00:17:54.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.972+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=XATTMXSAE99I tag=8V2L9IEBUHAU type=write size=3105951 2024-09-12T00:17:54.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.976+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=JOBB05C8S4KM type=del 2024-09-12T00:17:54.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~GF98VE8CFBZ3.0 size=1048576 2024-09-12T00:17:54.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~GF98VE8CFBZ3.1 size=1048576 2024-09-12T00:17:54.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~GF98VE8CFBZ3.2 size=774130 2024-09-12T00:17:54.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.988+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=GF98VE8CFBZ3 tag=Z6MLTF1HW6E2 type=write size=3919858 2024-09-12T00:17:54.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.992+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=V3V3S3IN3WKL type=del 2024-09-12T00:17:54.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:54.996+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=PYC1T4L963B5 type=del size=329126 2024-09-12T00:17:55.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.000+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~JQSGNUIXW8W3.0 size=75369 2024-09-12T00:17:55.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.008+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=JQSGNUIXW8W3 tag=VBXAA4ILH9CF type=write size=1123945 2024-09-12T00:17:55.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.012+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=XS57HF678MIG type=write size=860569 2024-09-12T00:17:55.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.016+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~T9VUZ5FFOINQ.0 size=857542 2024-09-12T00:17:55.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.020+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=T9VUZ5FFOINQ tag=MT8PE5UR22KC type=write size=1906118 2024-09-12T00:17:55.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.028+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~UVNC52ZX62SV.0 size=1048576 2024-09-12T00:17:55.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.032+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~UVNC52ZX62SV.1 size=986772 2024-09-12T00:17:55.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.032+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=UVNC52ZX62SV tag=602V420WW1YT type=write size=3083924 2024-09-12T00:17:55.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.036+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=WU6W051C6LCT type=del 2024-09-12T00:17:55.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.040+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=HXDDWSA4RQVI type=del size=3079123 2024-09-12T00:17:55.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.048+0000 7f69cdea98c0 1 < suggested remove operation key=SCFIVX3IHERR tag=N4HUU7L0D1OM type=del 2024-09-12T00:17:55.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.056+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=VY6KG52YQIKK type=write size=549176 2024-09-12T00:17:55.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.056+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=31CFQJZFC5RW type=del 2024-09-12T00:17:55.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.064+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~9E1HDLYAEFYD.0 size=1048576 2024-09-12T00:17:55.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.068+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~9E1HDLYAEFYD.1 size=804567 2024-09-12T00:17:55.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.068+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=9E1HDLYAEFYD tag=5YC0S5W61C81 type=write size=2901719 2024-09-12T00:17:55.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.072+0000 7f69cdea98c0 1 < completed write operation key=RDGRKQQH4B8C tag=XFFGAU8R21EF type=write size=707413 2024-09-12T00:17:55.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.080+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~06KT1NIIMYI0.0 size=930743 2024-09-12T00:17:55.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.080+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=06KT1NIIMYI0 tag=MBH502W4PHU1 type=write size=1979319 2024-09-12T00:17:55.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.084+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~EWCIWE55SZA9.0 size=1048576 2024-09-12T00:17:55.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.088+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~EWCIWE55SZA9.1 size=465391 2024-09-12T00:17:55.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.092+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=EWCIWE55SZA9 tag=B8TLH533I2U1 type=write size=2562543 2024-09-12T00:17:55.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.096+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=935KGJ0R8E8G type=write size=139947 2024-09-12T00:17:55.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.108+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~UL9PEZRQTREK.0 size=1048576 2024-09-12T00:17:55.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.108+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~UL9PEZRQTREK.1 size=718392 2024-09-12T00:17:55.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.116+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=UL9PEZRQTREK tag=33BD77G7FWOZ type=write size=2815544 2024-09-12T00:17:55.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.120+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=P21WUD78C1T5 type=del size=3932161 2024-09-12T00:17:55.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.124+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~7G4O95HY8JKX.0 size=1048576 2024-09-12T00:17:55.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.128+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~7G4O95HY8JKX.1 size=453902 2024-09-12T00:17:55.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.136+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=7G4O95HY8JKX tag=JEJK1M4I1KB5 type=write size=2551054 2024-09-12T00:17:55.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.140+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=PI4MPJEYW6FN type=del size=249644 2024-09-12T00:17:55.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.144+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~WG88OJ80S1C3.0 size=37334 2024-09-12T00:17:55.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.148+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=WG88OJ80S1C3 tag=547PWU8JRCWX type=write size=1085910 2024-09-12T00:17:55.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.152+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=M0MUV71J1W5W type=del size=212721 2024-09-12T00:17:55.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.156+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~RE3FJ2NNTF5A.0 size=343457 2024-09-12T00:17:55.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.164+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=RE3FJ2NNTF5A tag=9GHACJBZHCJN type=write size=1392033 2024-09-12T00:17:55.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.168+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=363E3IMZLTAP type=write size=893855 2024-09-12T00:17:55.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.172+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~AJ0MF40H77W2.0 size=1048576 2024-09-12T00:17:55.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.172+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~AJ0MF40H77W2.1 size=1048576 2024-09-12T00:17:55.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.176+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~AJ0MF40H77W2.2 size=728980 2024-09-12T00:17:55.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.184+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=AJ0MF40H77W2 tag=KY261REBOY93 type=write size=3874708 2024-09-12T00:17:55.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.188+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=ETROKQM2DYAT type=del size=2902621 2024-09-12T00:17:55.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.192+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~XYFS2FO5NZ1J.0 size=508457 2024-09-12T00:17:55.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.196+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=XYFS2FO5NZ1J tag=7RAR5C3Z780V type=write size=1557033 2024-09-12T00:17:55.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.204+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~U7U7TQH3NE4B.0 size=1048576 2024-09-12T00:17:55.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~U7U7TQH3NE4B.1 size=849973 2024-09-12T00:17:55.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.208+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=U7U7TQH3NE4B tag=NZ1VOBGM7TNX type=write size=2947125 2024-09-12T00:17:55.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.212+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~XATTMXSAE99I.0 size=1048576 2024-09-12T00:17:55.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.212+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~XATTMXSAE99I.1 size=1008799 2024-09-12T00:17:55.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.220+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=XATTMXSAE99I tag=8V2L9IEBUHAU type=write size=3105951 2024-09-12T00:17:55.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.224+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=1NK88B1OPV92 type=del size=3280472 2024-09-12T00:17:55.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.228+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~GF98VE8CFBZ3.0 size=1048576 2024-09-12T00:17:55.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.228+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~GF98VE8CFBZ3.1 size=1048576 2024-09-12T00:17:55.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.232+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~GF98VE8CFBZ3.2 size=774130 2024-09-12T00:17:55.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.236+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=GF98VE8CFBZ3 tag=Z6MLTF1HW6E2 type=write size=3919858 2024-09-12T00:17:55.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~DM4MDGNJE1QJ.0 size=1048576 2024-09-12T00:17:55.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~DM4MDGNJE1QJ.1 size=1048576 2024-09-12T00:17:55.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~DM4MDGNJE1QJ.2 size=733092 2024-09-12T00:17:55.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.248+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=DM4MDGNJE1QJ tag=N5E2R4V7D5W2 type=write size=3878820 2024-09-12T00:17:55.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.252+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=PYC1T4L963B5 type=del 2024-09-12T00:17:55.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~51ZBWE4E809N.0 size=1048576 2024-09-12T00:17:55.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.264+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~51ZBWE4E809N.1 size=733753 2024-09-12T00:17:55.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.264+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=51ZBWE4E809N tag=KHIM9LZW9PGF type=write size=2830905 2024-09-12T00:17:55.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.264+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=XS57HF678MIG type=write size=860569 2024-09-12T00:17:55.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~8QNARK90OZGT.0 size=1048576 2024-09-12T00:17:55.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~8QNARK90OZGT.1 size=1048576 2024-09-12T00:17:55.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.280+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~8QNARK90OZGT.2 size=869632 2024-09-12T00:17:55.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.280+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=8QNARK90OZGT tag=BFMJKVCH74XI type=write size=4015360 2024-09-12T00:17:55.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.280+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~UVNC52ZX62SV.0 size=1048576 2024-09-12T00:17:55.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.284+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~UVNC52ZX62SV.1 size=986772 2024-09-12T00:17:55.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.292+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=UVNC52ZX62SV tag=602V420WW1YT type=write size=3083924 2024-09-12T00:17:55.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.296+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=48WV60ZBCGTA type=del size=2596395 2024-09-12T00:17:55.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.296+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=HXDDWSA4RQVI type=del 2024-09-12T00:17:55.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.304+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~OD66G8RD1WTB.0 size=1048576 2024-09-12T00:17:55.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~OD66G8RD1WTB.1 size=1048576 2024-09-12T00:17:55.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~OD66G8RD1WTB.2 size=837038 2024-09-12T00:17:55.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.312+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=OD66G8RD1WTB tag=C8K1AAZWNLUI type=write size=3982766 2024-09-12T00:17:55.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.320+0000 7f69cdea98c0 1 < suggested update operation key=5453GP1H3OFQ tag=VY6KG52YQIKK type=write size=549176 2024-09-12T00:17:55.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.324+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=AN3XE5ZX6FHV type=del size=2057419 2024-09-12T00:17:55.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.324+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~9E1HDLYAEFYD.0 size=1048576 2024-09-12T00:17:55.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.328+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~9E1HDLYAEFYD.1 size=804567 2024-09-12T00:17:55.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.336+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=9E1HDLYAEFYD tag=5YC0S5W61C81 type=write size=2901719 2024-09-12T00:17:55.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.340+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=XEOQSIIR91IB type=del size=1683079 2024-09-12T00:17:55.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.340+0000 7f69cdea98c0 1 < canceled part key=_multipart_9K3HLTD6DMSC.2~06KT1NIIMYI0.0 size=930743 2024-09-12T00:17:55.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.348+0000 7f69cdea98c0 1 < canceled multipart upload key=9K3HLTD6DMSC upload=06KT1NIIMYI0 tag=MBH502W4PHU1 type=write size=1979319 2024-09-12T00:17:55.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.352+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=JAOLATKNX6QJ type=del size=3359693 2024-09-12T00:17:55.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.356+0000 7f69cdea98c0 1 < completed write operation key=H91UXKWAJ3K8 tag=935KGJ0R8E8G type=write size=139947 2024-09-12T00:17:55.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.360+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=MWDNS4BJ1H37 type=del size=1641027 2024-09-12T00:17:55.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.364+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=P21WUD78C1T5 type=del 2024-09-12T00:17:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~E11PTFA1UL9W.0 size=918847 2024-09-12T00:17:55.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.372+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=E11PTFA1UL9W tag=50TI478K710H type=write size=1967423 2024-09-12T00:17:55.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.380+0000 7f69cdea98c0 1 < suggested remove operation key=1CZXUEJLQ8FM tag=PI4MPJEYW6FN type=del 2024-09-12T00:17:55.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.384+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=JDIP3MFBN8LY type=del size=3937946 2024-09-12T00:17:55.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.388+0000 7f69cdea98c0 -1 < failed to complete operation key=5453GP1H3OFQ tag=M0MUV71J1W5W type=del size=212721: (22) Invalid argument 2024-09-12T00:17:55.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.392+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=7W6OMI8YORO1 type=del size=1224753 2024-09-12T00:17:55.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.400+0000 7f69cdea98c0 1 < suggested update operation key=SCFIVX3IHERR tag=363E3IMZLTAP type=write size=893855 2024-09-12T00:17:55.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~FHTTRZTOTUX9.0 size=562157 2024-09-12T00:17:55.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.408+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=FHTTRZTOTUX9 tag=TR9RYUDG7D9H type=write size=1610733 2024-09-12T00:17:55.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.408+0000 7f69cdea98c0 -1 < failed to complete operation key=SCFIVX3IHERR tag=ETROKQM2DYAT type=del size=2902621: (22) Invalid argument 2024-09-12T00:17:55.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.416+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~OR8JXX5BZZUF.0 size=1048576 2024-09-12T00:17:55.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.420+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~OR8JXX5BZZUF.1 size=959337 2024-09-12T00:17:55.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.420+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=OR8JXX5BZZUF tag=10AOOSKCJC7A type=write size=3056489 2024-09-12T00:17:55.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.424+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~U7U7TQH3NE4B.0 size=1048576 2024-09-12T00:17:55.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.428+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~U7U7TQH3NE4B.1 size=849973 2024-09-12T00:17:55.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.432+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=U7U7TQH3NE4B tag=NZ1VOBGM7TNX type=write size=2947125 2024-09-12T00:17:55.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.440+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~VAO02F756N4Q.0 size=1048576 2024-09-12T00:17:55.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~VAO02F756N4Q.1 size=458033 2024-09-12T00:17:55.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.444+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=VAO02F756N4Q tag=SWAX520R8VMB type=write size=2555185 2024-09-12T00:17:55.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.448+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=1NK88B1OPV92 type=del 2024-09-12T00:17:55.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.456+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=QSUEZT64LR4R type=del size=765484 2024-09-12T00:17:55.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.460+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~DM4MDGNJE1QJ.0 size=1048576 2024-09-12T00:17:55.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.460+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~DM4MDGNJE1QJ.1 size=1048576 2024-09-12T00:17:55.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.464+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~DM4MDGNJE1QJ.2 size=733092 2024-09-12T00:17:55.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.472+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=DM4MDGNJE1QJ tag=N5E2R4V7D5W2 type=write size=3878820 2024-09-12T00:17:55.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.472+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=5WMPNMGHDV10 type=del size=334741 2024-09-12T00:17:55.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.480+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~51ZBWE4E809N.0 size=1048576 2024-09-12T00:17:55.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.480+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~51ZBWE4E809N.1 size=733753 2024-09-12T00:17:55.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.488+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=51ZBWE4E809N tag=KHIM9LZW9PGF type=write size=2830905 2024-09-12T00:17:55.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.492+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=WKI25T4CJ88F type=del size=3733233 2024-09-12T00:17:55.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.496+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~8QNARK90OZGT.0 size=1048576 2024-09-12T00:17:55.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.496+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~8QNARK90OZGT.1 size=1048576 2024-09-12T00:17:55.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.500+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~8QNARK90OZGT.2 size=869632 2024-09-12T00:17:55.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.508+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=8QNARK90OZGT tag=BFMJKVCH74XI type=write size=4015360 2024-09-12T00:17:55.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.512+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=VR1V4PYQXOAE type=del size=2395641 2024-09-12T00:17:55.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.516+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=48WV60ZBCGTA type=del 2024-09-12T00:17:55.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.520+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=G0Z1B51BJ7KH type=write size=17692 2024-09-12T00:17:55.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.524+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~OD66G8RD1WTB.0 size=1048576 2024-09-12T00:17:55.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.524+0000 7f69cdea98c0 1 < canceled part key=_multipart_AKWTTXH2P254.2~OD66G8RD1WTB.1 size=1048576 2024-09-12T00:17:55.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.528+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~OD66G8RD1WTB.2 size=837038 2024-09-12T00:17:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.532+0000 7f69cdea98c0 1 < canceled multipart upload key=AKWTTXH2P254 upload=OD66G8RD1WTB tag=C8K1AAZWNLUI type=write size=3982766 2024-09-12T00:17:55.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.536+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=W5ZXTC0CQQQU type=del size=1892667 2024-09-12T00:17:55.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.544+0000 7f69cdea98c0 1 < suggested remove operation key=IXB6WLN5M81C tag=AN3XE5ZX6FHV type=del 2024-09-12T00:17:55.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.548+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=ZA41KVFKCHQU type=write size=478472 2024-09-12T00:17:55.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.552+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=XEOQSIIR91IB type=del 2024-09-12T00:17:55.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.556+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=YNO7D3QF0OMR type=del size=4185033 2024-09-12T00:17:55.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.560+0000 7f69cdea98c0 1 < canceled operation key=HSQZYI0SNZP1 tag=JAOLATKNX6QJ type=del size=3359693 2024-09-12T00:17:55.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.564+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=ZD8ORM0HSAKV type=del size=3121124 2024-09-12T00:17:55.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.572+0000 7f69cdea98c0 1 < suggested remove operation key=LRHZKCU22AIX tag=MWDNS4BJ1H37 type=del 2024-09-12T00:17:55.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.576+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=06WX0RSOGL1Q type=del size=4043239 2024-09-12T00:17:55.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.576+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~E11PTFA1UL9W.0 size=918847 2024-09-12T00:17:55.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.584+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=E11PTFA1UL9W tag=50TI478K710H type=write size=1967423 2024-09-12T00:17:55.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.588+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=9L0HRD5S9W4I type=del size=566659 2024-09-12T00:17:55.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.596+0000 7f69cdea98c0 1 < suggested remove operation key=RDGRKQQH4B8C tag=JDIP3MFBN8LY type=del 2024-09-12T00:17:55.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.600+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=ID5PZJ5GGIEP type=del size=3151831 2024-09-12T00:17:55.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.604+0000 7f69cdea98c0 1 < canceled operation key=0HAUC4BDL9VR tag=7W6OMI8YORO1 type=del size=1224753 2024-09-12T00:17:55.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.608+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=EGSSW5VLKMB6 type=del size=960969 2024-09-12T00:17:55.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.612+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~FHTTRZTOTUX9.0 size=562157 2024-09-12T00:17:55.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.620+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=FHTTRZTOTUX9 tag=TR9RYUDG7D9H type=write size=1610733 2024-09-12T00:17:55.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.624+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~R21LP88IPNP3.0 size=1048576 2024-09-12T00:17:55.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.628+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~R21LP88IPNP3.1 size=1020073 2024-09-12T00:17:55.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.628+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=R21LP88IPNP3 tag=V9FCZVCXKZ59 type=write size=3117225 2024-09-12T00:17:55.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.632+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~OR8JXX5BZZUF.0 size=1048576 2024-09-12T00:17:55.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.636+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~OR8JXX5BZZUF.1 size=959337 2024-09-12T00:17:55.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.644+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=OR8JXX5BZZUF tag=10AOOSKCJC7A type=write size=3056489 2024-09-12T00:17:55.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.648+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~6GBFG3LX1X5V.0 size=1048576 2024-09-12T00:17:55.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~6GBFG3LX1X5V.1 size=1048576 2024-09-12T00:17:55.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~6GBFG3LX1X5V.2 size=959078 2024-09-12T00:17:55.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.656+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=6GBFG3LX1X5V tag=NS3I1NDSVQMF type=write size=4104806 2024-09-12T00:17:55.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.660+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~VAO02F756N4Q.0 size=1048576 2024-09-12T00:17:55.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.664+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~VAO02F756N4Q.1 size=458033 2024-09-12T00:17:55.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.668+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=VAO02F756N4Q tag=SWAX520R8VMB type=write size=2555185 2024-09-12T00:17:55.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.676+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~IZ9RBLLIAPY9.0 size=544078 2024-09-12T00:17:55.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.676+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=IZ9RBLLIAPY9 tag=3FLW0W70TQ8X type=write size=1592654 2024-09-12T00:17:55.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.680+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=QSUEZT64LR4R type=del 2024-09-12T00:17:55.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~ZMZN5HV39O9O.0 size=1048576 2024-09-12T00:17:55.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~ZMZN5HV39O9O.1 size=1048576 2024-09-12T00:17:55.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.692+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~ZMZN5HV39O9O.2 size=468196 2024-09-12T00:17:55.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.692+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=ZMZN5HV39O9O tag=2HU1NIU1AKCB type=write size=3613924 2024-09-12T00:17:55.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.696+0000 7f69cdea98c0 1 < canceled operation key=4O5U4WX3N4SA tag=5WMPNMGHDV10 type=del size=334741 2024-09-12T00:17:55.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.700+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=AUJNRM49INAJ type=del size=3088097 2024-09-12T00:17:55.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.708+0000 7f69cdea98c0 1 < suggested update operation key=LRHZKCU22AIX tag=WKI25T4CJ88F type=del size=3733233 2024-09-12T00:17:55.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.712+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=SGMORK9UVVOV type=del size=2036331 2024-09-12T00:17:55.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.716+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=VR1V4PYQXOAE type=del 2024-09-12T00:17:55.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.720+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=5UF90DVEL4II type=del size=20933 2024-09-12T00:17:55.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.724+0000 7f69cdea98c0 1 < completed write operation key=4O5U4WX3N4SA tag=G0Z1B51BJ7KH type=write size=17692 2024-09-12T00:17:55.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.728+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=J9ST03KWPU1M type=del size=3354381 2024-09-12T00:17:55.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.732+0000 7f69cdea98c0 1 < canceled operation key=Z6MH459BTZ6K tag=W5ZXTC0CQQQU type=del size=1892667 2024-09-12T00:17:55.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~5BBP9D3788I1.0 size=1048576 2024-09-12T00:17:55.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.744+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~5BBP9D3788I1.1 size=1048576 2024-09-12T00:17:55.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~5BBP9D3788I1.2 size=515307 2024-09-12T00:17:55.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.748+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=5BBP9D3788I1 tag=K3LS33LWCX5X type=write size=3661035 2024-09-12T00:17:55.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.752+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=ZA41KVFKCHQU type=write size=478472 2024-09-12T00:17:55.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.756+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=GL0QTC3SGAYB type=del size=4183771 2024-09-12T00:17:55.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.760+0000 7f69cdea98c0 1 < canceled operation key=SCFIVX3IHERR tag=YNO7D3QF0OMR type=del size=4185033 2024-09-12T00:17:55.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.764+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=WWJ6J4Z8BCP2 type=del size=390549 2024-09-12T00:17:55.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.764+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=ZD8ORM0HSAKV type=del 2024-09-12T00:17:55.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.772+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~6QXTBDMJA6OR.0 size=1048576 2024-09-12T00:17:55.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.776+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~6QXTBDMJA6OR.1 size=1048576 2024-09-12T00:17:55.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.780+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~6QXTBDMJA6OR.2 size=275786 2024-09-12T00:17:55.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.780+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=6QXTBDMJA6OR tag=VAQMAEDRCQOY type=write size=3421514 2024-09-12T00:17:55.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.784+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=06WX0RSOGL1Q type=del 2024-09-12T00:17:55.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.788+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=STOZGX86Z3AE type=del size=3475167 2024-09-12T00:17:55.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.796+0000 7f69cdea98c0 1 < suggested update operation key=H91UXKWAJ3K8 tag=9L0HRD5S9W4I type=del size=566659 2024-09-12T00:17:55.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.800+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~PDBMYPFC5KS6.0 size=1048576 2024-09-12T00:17:55.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~PDBMYPFC5KS6.1 size=797321 2024-09-12T00:17:55.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.804+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=PDBMYPFC5KS6 tag=CD28J21TGQGU type=write size=2894473 2024-09-12T00:17:55.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.808+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=ID5PZJ5GGIEP type=del 2024-09-12T00:17:55.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~MWUV0WMKBXHC.0 size=1048576 2024-09-12T00:17:55.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.824+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~MWUV0WMKBXHC.1 size=40525 2024-09-12T00:17:55.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.824+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=MWUV0WMKBXHC tag=24BNCNWTEDB5 type=write size=2137677 2024-09-12T00:17:55.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.832+0000 7f69cdea98c0 1 < suggested update operation key=Z6MH459BTZ6K tag=EGSSW5VLKMB6 type=del size=960969 2024-09-12T00:17:55.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~Z0OTU0C3E762.0 size=1048576 2024-09-12T00:17:55.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~Z0OTU0C3E762.1 size=1048576 2024-09-12T00:17:55.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~Z0OTU0C3E762.2 size=229750 2024-09-12T00:17:55.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.844+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=Z0OTU0C3E762 tag=CU1S3IW6FG70 type=write size=3375478 2024-09-12T00:17:55.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.848+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~R21LP88IPNP3.0 size=1048576 2024-09-12T00:17:55.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.852+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~R21LP88IPNP3.1 size=1020073 2024-09-12T00:17:55.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.856+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=R21LP88IPNP3 tag=V9FCZVCXKZ59 type=write size=3117225 2024-09-12T00:17:55.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.860+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=NKXINRKJD8S9 type=del size=1443036 2024-09-12T00:17:55.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.860+0000 7f69cdea98c0 1 < canceled part key=_multipart_Z6MH459BTZ6K.2~6GBFG3LX1X5V.0 size=1048576 2024-09-12T00:17:55.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.864+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~6GBFG3LX1X5V.1 size=1048576 2024-09-12T00:17:55.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.868+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~6GBFG3LX1X5V.2 size=959078 2024-09-12T00:17:55.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.872+0000 7f69cdea98c0 1 < canceled multipart upload key=Z6MH459BTZ6K upload=6GBFG3LX1X5V tag=NS3I1NDSVQMF type=write size=4104806 2024-09-12T00:17:55.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~4HH4H0RVP3AJ.0 size=1048576 2024-09-12T00:17:55.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~4HH4H0RVP3AJ.1 size=690932 2024-09-12T00:17:55.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.880+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=4HH4H0RVP3AJ tag=UQ7ZGC3RIKFC type=write size=2788084 2024-09-12T00:17:55.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.888+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~IZ9RBLLIAPY9.0 size=544078 2024-09-12T00:17:55.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.892+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=IZ9RBLLIAPY9 tag=3FLW0W70TQ8X type=write size=1592654 2024-09-12T00:17:55.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.896+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=0H5MHAWYC0LT type=del size=300235 2024-09-12T00:17:55.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.900+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~ZMZN5HV39O9O.0 size=1048576 2024-09-12T00:17:55.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.900+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~ZMZN5HV39O9O.1 size=1048576 2024-09-12T00:17:55.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.904+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~ZMZN5HV39O9O.2 size=468196 2024-09-12T00:17:55.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.908+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=ZMZN5HV39O9O tag=2HU1NIU1AKCB type=write size=3613924 2024-09-12T00:17:55.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.912+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=E5LGSHKNVU0G type=del size=461958 2024-09-12T00:17:55.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.916+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=AUJNRM49INAJ type=del 2024-09-12T00:17:55.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.924+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~2SOG6KJUPXER.0 size=1048576 2024-09-12T00:17:55.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.928+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~2SOG6KJUPXER.1 size=620134 2024-09-12T00:17:55.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.928+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=2SOG6KJUPXER tag=3GRQH8SWR9KB type=write size=2717286 2024-09-12T00:17:55.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.936+0000 7f69cdea98c0 1 < suggested update operation key=IXB6WLN5M81C tag=SGMORK9UVVOV type=del size=2036331 2024-09-12T00:17:55.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.944+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~ECOI1L9WZVF1.0 size=1048576 2024-09-12T00:17:55.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.944+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~ECOI1L9WZVF1.1 size=1048576 2024-09-12T00:17:55.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~ECOI1L9WZVF1.2 size=167225 2024-09-12T00:17:55.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.948+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=ECOI1L9WZVF1 tag=MDDH3UM1HGWK type=write size=3312953 2024-09-12T00:17:55.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.952+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=5UF90DVEL4II type=del 2024-09-12T00:17:55.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.956+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=B2RH4MM68SRN type=write size=790547 2024-09-12T00:17:55.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.960+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=J9ST03KWPU1M type=del 2024-09-12T00:17:55.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.968+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~CUD78DVFRESW.0 size=1048576 2024-09-12T00:17:55.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.968+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~CUD78DVFRESW.1 size=1048576 2024-09-12T00:17:55.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.972+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~CUD78DVFRESW.2 size=617001 2024-09-12T00:17:55.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.972+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=CUD78DVFRESW tag=DPSI1LX4XMV5 type=write size=3762729 2024-09-12T00:17:55.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.976+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~5BBP9D3788I1.0 size=1048576 2024-09-12T00:17:55.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.976+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~5BBP9D3788I1.1 size=1048576 2024-09-12T00:17:55.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.980+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~5BBP9D3788I1.2 size=515307 2024-09-12T00:17:55.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.988+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=5BBP9D3788I1 tag=K3LS33LWCX5X type=write size=3661035 2024-09-12T00:17:55.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.992+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~I4MRECTBTEQ1.0 size=643493 2024-09-12T00:17:55.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.992+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=I4MRECTBTEQ1 tag=536T6643V16X type=write size=1692069 2024-09-12T00:17:55.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:55.996+0000 7f69cdea98c0 1 < canceled operation key=RDGRKQQH4B8C tag=GL0QTC3SGAYB type=del size=4183771 2024-09-12T00:17:56.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.000+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~1A7OBEGPG947.0 size=1048576 2024-09-12T00:17:56.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.004+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~1A7OBEGPG947.1 size=942069 2024-09-12T00:17:56.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.004+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=1A7OBEGPG947 tag=PK9YSO8XIO8Q type=write size=3039221 2024-09-12T00:17:56.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.008+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=WWJ6J4Z8BCP2 type=del 2024-09-12T00:17:56.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.012+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=WZO2LDNNG17K type=del size=2755079 2024-09-12T00:17:56.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.016+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~6QXTBDMJA6OR.0 size=1048576 2024-09-12T00:17:56.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.020+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~6QXTBDMJA6OR.1 size=1048576 2024-09-12T00:17:56.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.020+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~6QXTBDMJA6OR.2 size=275786 2024-09-12T00:17:56.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.028+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=6QXTBDMJA6OR tag=VAQMAEDRCQOY type=write size=3421514 2024-09-12T00:17:56.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.032+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~AEWO9MVCPWQC.0 size=1048576 2024-09-12T00:17:56.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.036+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~AEWO9MVCPWQC.1 size=715911 2024-09-12T00:17:56.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.036+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=AEWO9MVCPWQC tag=TWB3X5PR3MSI type=write size=2813063 2024-09-12T00:17:56.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.044+0000 7f69cdea98c0 1 < suggested remove operation key=IXB6WLN5M81C tag=STOZGX86Z3AE type=del 2024-09-12T00:17:56.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.044+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=J3N1BP9SA4GM type=del size=738137 2024-09-12T00:17:56.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.048+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~PDBMYPFC5KS6.0 size=1048576 2024-09-12T00:17:56.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.048+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~PDBMYPFC5KS6.1 size=797321 2024-09-12T00:17:56.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.056+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=PDBMYPFC5KS6 tag=CD28J21TGQGU type=write size=2894473 2024-09-12T00:17:56.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.060+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=2OWH4GACAW6D type=del size=3691854 2024-09-12T00:17:56.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.064+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~MWUV0WMKBXHC.0 size=1048576 2024-09-12T00:17:56.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.064+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~MWUV0WMKBXHC.1 size=40525 2024-09-12T00:17:56.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.072+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=MWUV0WMKBXHC tag=24BNCNWTEDB5 type=write size=2137677 2024-09-12T00:17:56.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.076+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=UWO712VZ84EZ type=del size=3111402 2024-09-12T00:17:56.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.080+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~Z0OTU0C3E762.0 size=1048576 2024-09-12T00:17:56.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.080+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~Z0OTU0C3E762.1 size=1048576 2024-09-12T00:17:56.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.084+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~Z0OTU0C3E762.2 size=229750 2024-09-12T00:17:56.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.092+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=Z0OTU0C3E762 tag=CU1S3IW6FG70 type=write size=3375478 2024-09-12T00:17:56.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.096+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=0B10S5AREQ9Z type=del size=80186 2024-09-12T00:17:56.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.096+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=NKXINRKJD8S9 type=del 2024-09-12T00:17:56.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.104+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~6H46ICPTW4O0.0 size=1048576 2024-09-12T00:17:56.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~6H46ICPTW4O0.1 size=1048576 2024-09-12T00:17:56.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~6H46ICPTW4O0.2 size=1047400 2024-09-12T00:17:56.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.108+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=6H46ICPTW4O0 tag=6UVRQBQA1FOH type=write size=4193128 2024-09-12T00:17:56.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.112+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~4HH4H0RVP3AJ.0 size=1048576 2024-09-12T00:17:56.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.116+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~4HH4H0RVP3AJ.1 size=690932 2024-09-12T00:17:56.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.124+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=4HH4H0RVP3AJ tag=UQ7ZGC3RIKFC type=write size=2788084 2024-09-12T00:17:56.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.128+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=HDYXKXDWDQR6 type=del size=1048336 2024-09-12T00:17:56.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.132+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=0H5MHAWYC0LT type=del 2024-09-12T00:17:56.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~0F0QWIC48FZS.0 size=312971 2024-09-12T00:17:56.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.136+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=0F0QWIC48FZS tag=64VYJO67ZDBL type=write size=1361547 2024-09-12T00:17:56.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.144+0000 7f69cdea98c0 1 < suggested update operation key=SCFIVX3IHERR tag=E5LGSHKNVU0G type=del size=461958 2024-09-12T00:17:56.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.156+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~AD1BYD0NT8KW.0 size=1048576 2024-09-12T00:17:56.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.156+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~AD1BYD0NT8KW.1 size=1048576 2024-09-12T00:17:56.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~AD1BYD0NT8KW.2 size=236235 2024-09-12T00:17:56.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.160+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=AD1BYD0NT8KW tag=7Q2WA0JUV8TA type=write size=3381963 2024-09-12T00:17:56.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.164+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~2SOG6KJUPXER.0 size=1048576 2024-09-12T00:17:56.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.164+0000 7f69cdea98c0 1 < canceled part key=_multipart_K4LNDJJUA1RZ.2~2SOG6KJUPXER.1 size=620134 2024-09-12T00:17:56.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.168+0000 7f69cdea98c0 1 < canceled multipart upload key=K4LNDJJUA1RZ upload=2SOG6KJUPXER tag=3GRQH8SWR9KB type=write size=2717286 2024-09-12T00:17:56.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.172+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=12OXT9SCRR9P type=write size=498449 2024-09-12T00:17:56.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.176+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~ECOI1L9WZVF1.0 size=1048576 2024-09-12T00:17:56.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.180+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~ECOI1L9WZVF1.1 size=1048576 2024-09-12T00:17:56.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.180+0000 7f69cdea98c0 1 < canceled part key=_multipart_0EALARW4O3OB.2~ECOI1L9WZVF1.2 size=167225 2024-09-12T00:17:56.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.184+0000 7f69cdea98c0 1 < canceled multipart upload key=0EALARW4O3OB upload=ECOI1L9WZVF1 tag=MDDH3UM1HGWK type=write size=3312953 2024-09-12T00:17:56.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.188+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=PQ5JPQCQZ38R type=del size=3319676 2024-09-12T00:17:56.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.196+0000 7f69cdea98c0 1 < suggested remove operation key=LRHZKCU22AIX tag=B2RH4MM68SRN type=write 2024-09-12T00:17:56.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.196+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=B31WR9ZTR5N6 type=del size=74205 2024-09-12T00:17:56.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.200+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~CUD78DVFRESW.0 size=1048576 2024-09-12T00:17:56.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.204+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~CUD78DVFRESW.1 size=1048576 2024-09-12T00:17:56.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.208+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~CUD78DVFRESW.2 size=617001 2024-09-12T00:17:56.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.212+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=CUD78DVFRESW tag=DPSI1LX4XMV5 type=write size=3762729 2024-09-12T00:17:56.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.220+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~KS3U1D2DQ569.0 size=1048576 2024-09-12T00:17:56.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.224+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~KS3U1D2DQ569.1 size=1048576 2024-09-12T00:17:56.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.224+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~KS3U1D2DQ569.2 size=390069 2024-09-12T00:17:56.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.224+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=KS3U1D2DQ569 tag=V1U2OJY47ULJ type=write size=3535797 2024-09-12T00:17:56.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.228+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~I4MRECTBTEQ1.0 size=643493 2024-09-12T00:17:56.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.236+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=I4MRECTBTEQ1 tag=536T6643V16X type=write size=1692069 2024-09-12T00:17:56.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~06X2VWCSMCZ0.0 size=1006586 2024-09-12T00:17:56.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.244+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=06X2VWCSMCZ0 tag=AXSE2NU8TTC0 type=write size=2055162 2024-09-12T00:17:56.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.248+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~1A7OBEGPG947.0 size=1048576 2024-09-12T00:17:56.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.248+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~1A7OBEGPG947.1 size=942069 2024-09-12T00:17:56.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.256+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=1A7OBEGPG947 tag=PK9YSO8XIO8Q type=write size=3039221 2024-09-12T00:17:56.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~G3979ZLY6WXZ.0 size=43964 2024-09-12T00:17:56.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.260+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=G3979ZLY6WXZ tag=G0U199V3H0E9 type=write size=1092540 2024-09-12T00:17:56.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.264+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=WZO2LDNNG17K type=del 2024-09-12T00:17:56.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.268+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=MVY5DYLXPJXV type=del size=4140863 2024-09-12T00:17:56.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.272+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~AEWO9MVCPWQC.0 size=1048576 2024-09-12T00:17:56.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.272+0000 7f69cdea98c0 1 < canceled part key=_multipart_2ENKC4QT2BFS.2~AEWO9MVCPWQC.1 size=715911 2024-09-12T00:17:56.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.280+0000 7f69cdea98c0 1 < canceled multipart upload key=2ENKC4QT2BFS upload=AEWO9MVCPWQC tag=TWB3X5PR3MSI type=write size=2813063 2024-09-12T00:17:56.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.280+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=QXQIP9IF4UYA type=del size=837250 2024-09-12T00:17:56.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.284+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=J3N1BP9SA4GM type=del 2024-09-12T00:17:56.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.288+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=OUGKYULFCCTN type=write size=71711 2024-09-12T00:17:56.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.292+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=2OWH4GACAW6D type=del 2024-09-12T00:17:56.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.296+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=6ZDWQGNB5YHR type=del size=2929323 2024-09-12T00:17:56.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.304+0000 7f69cdea98c0 1 < suggested update operation key=9K3HLTD6DMSC tag=UWO712VZ84EZ type=del size=3111402 2024-09-12T00:17:56.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.308+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=D2HZBEWDQZTZ type=del size=3816862 2024-09-12T00:17:56.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.312+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=0B10S5AREQ9Z type=del 2024-09-12T00:17:56.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.320+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~3R8K802UXHVO.0 size=91012 2024-09-12T00:17:56.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.320+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=3R8K802UXHVO tag=LZTD42L0IZUT type=write size=1139588 2024-09-12T00:17:56.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.324+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~6H46ICPTW4O0.0 size=1048576 2024-09-12T00:17:56.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.328+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~6H46ICPTW4O0.1 size=1048576 2024-09-12T00:17:56.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.332+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~6H46ICPTW4O0.2 size=1047400 2024-09-12T00:17:56.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.336+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=6H46ICPTW4O0 tag=6UVRQBQA1FOH type=write size=4193128 2024-09-12T00:17:56.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.340+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=A4DT6Y8AB6Y5 type=del size=2668538 2024-09-12T00:17:56.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.348+0000 7f69cdea98c0 1 < suggested remove operation key=Q0L8J0BYRFDQ tag=HDYXKXDWDQR6 type=del 2024-09-12T00:17:56.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~D2M1ZPSXJ54Q.0 size=1048576 2024-09-12T00:17:56.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.360+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~D2M1ZPSXJ54Q.1 size=1048576 2024-09-12T00:17:56.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.360+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~D2M1ZPSXJ54Q.2 size=112989 2024-09-12T00:17:56.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.360+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=D2M1ZPSXJ54Q tag=5XPV0PS5ILYV type=write size=3258717 2024-09-12T00:17:56.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.364+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~0F0QWIC48FZS.0 size=312971 2024-09-12T00:17:56.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.368+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=0F0QWIC48FZS tag=64VYJO67ZDBL type=write size=1361547 2024-09-12T00:17:56.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.372+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=C9SOBBZTGMBQ type=del size=736906 2024-09-12T00:17:56.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.376+0000 7f69cdea98c0 1 < canceled part key=_multipart_2YYP9NOUAJD0.2~AD1BYD0NT8KW.0 size=1048576 2024-09-12T00:17:56.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.376+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~AD1BYD0NT8KW.1 size=1048576 2024-09-12T00:17:56.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.380+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~AD1BYD0NT8KW.2 size=236235 2024-09-12T00:17:56.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.384+0000 7f69cdea98c0 1 < canceled multipart upload key=2YYP9NOUAJD0 upload=AD1BYD0NT8KW tag=7Q2WA0JUV8TA type=write size=3381963 2024-09-12T00:17:56.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.388+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=47PX9SFTLFNJ type=del size=2547617 2024-09-12T00:17:56.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.392+0000 7f69cdea98c0 1 < completed write operation key=5453GP1H3OFQ tag=12OXT9SCRR9P type=write size=498449 2024-09-12T00:17:56.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.396+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=60NLOWBA90S3 type=del size=474864 2024-09-12T00:17:56.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.404+0000 7f69cdea98c0 1 < suggested update operation key=HSQZYI0SNZP1 tag=PQ5JPQCQZ38R type=del size=3319676 2024-09-12T00:17:56.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.408+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=TSA3MKR6VNDH type=del size=17865 2024-09-12T00:17:56.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.412+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=B31WR9ZTR5N6 type=del 2024-09-12T00:17:56.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.416+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=6PLJ7157WVB1 type=del size=2781096 2024-09-12T00:17:56.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.420+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~KS3U1D2DQ569.0 size=1048576 2024-09-12T00:17:56.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.420+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~KS3U1D2DQ569.1 size=1048576 2024-09-12T00:17:56.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.424+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~KS3U1D2DQ569.2 size=390069 2024-09-12T00:17:56.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.432+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=KS3U1D2DQ569 tag=V1U2OJY47ULJ type=write size=3535797 2024-09-12T00:17:56.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.436+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~KUPHVXN39I5T.0 size=1048576 2024-09-12T00:17:56.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.440+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~KUPHVXN39I5T.1 size=1048576 2024-09-12T00:17:56.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~KUPHVXN39I5T.2 size=364381 2024-09-12T00:17:56.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.444+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=KUPHVXN39I5T tag=968W462HN2VB type=write size=3510109 2024-09-12T00:17:56.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.448+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~06X2VWCSMCZ0.0 size=1006586 2024-09-12T00:17:56.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.452+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=06X2VWCSMCZ0 tag=AXSE2NU8TTC0 type=write size=2055162 2024-09-12T00:17:56.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.456+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=4R17XO0TTHIE type=del size=1006735 2024-09-12T00:17:56.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.460+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~G3979ZLY6WXZ.0 size=43964 2024-09-12T00:17:56.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.468+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=G3979ZLY6WXZ tag=G0U199V3H0E9 type=write size=1092540 2024-09-12T00:17:56.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.472+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=TS6AO7DHEOUV type=del size=1167197 2024-09-12T00:17:56.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.476+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=MVY5DYLXPJXV type=del 2024-09-12T00:17:56.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.480+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=04G4QZXC96L4 type=del size=182467 2024-09-12T00:17:56.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.484+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=QXQIP9IF4UYA type=del 2024-09-12T00:17:56.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.492+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=B0C6NI22R7VO type=del size=2910804 2024-09-12T00:17:56.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.500+0000 7f69cdea98c0 1 < suggested update operation key=0HAUC4BDL9VR tag=OUGKYULFCCTN type=write size=71711 2024-09-12T00:17:56.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.500+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=3Z6GDFP6ZV8O type=del size=1684860 2024-09-12T00:17:56.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.512+0000 7f69cdea98c0 1 < suggested remove operation key=9K3HLTD6DMSC tag=6ZDWQGNB5YHR type=del 2024-09-12T00:17:56.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.516+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=CZYLI3EHJORI type=write size=784215 2024-09-12T00:17:56.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.520+0000 7f69cdea98c0 1 < suggested remove operation key=0HAUC4BDL9VR tag=D2HZBEWDQZTZ type=del 2024-09-12T00:17:56.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.524+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=SI11VHO6164W type=del size=3956799 2024-09-12T00:17:56.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.528+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~3R8K802UXHVO.0 size=91012 2024-09-12T00:17:56.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.536+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=3R8K802UXHVO tag=LZTD42L0IZUT type=write size=1139588 2024-09-12T00:17:56.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.540+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=E4ENJYPQRSC1 type=del size=1744967 2024-09-12T00:17:56.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.544+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=A4DT6Y8AB6Y5 type=del 2024-09-12T00:17:56.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.548+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=VT0AWUWLRJCA type=del size=3012323 2024-09-12T00:17:56.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.552+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~D2M1ZPSXJ54Q.0 size=1048576 2024-09-12T00:17:56.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.552+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~D2M1ZPSXJ54Q.1 size=1048576 2024-09-12T00:17:56.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.556+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~D2M1ZPSXJ54Q.2 size=112989 2024-09-12T00:17:56.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.564+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=D2M1ZPSXJ54Q tag=5XPV0PS5ILYV type=write size=3258717 2024-09-12T00:17:56.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.568+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=O9TC878TECA6 type=del size=1275183 2024-09-12T00:17:56.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.572+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=C9SOBBZTGMBQ type=del 2024-09-12T00:17:56.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.576+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~C461RIOXF3OM.0 size=230471 2024-09-12T00:17:56.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.576+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=C461RIOXF3OM tag=WV4329VY9X26 type=write size=1279047 2024-09-12T00:17:56.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.584+0000 7f69cdea98c0 1 < suggested remove operation key=O5WBNND16BFN tag=47PX9SFTLFNJ type=del 2024-09-12T00:17:56.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.588+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=B66DESZ449KM type=del size=2068622 2024-09-12T00:17:56.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.592+0000 7f69cdea98c0 -1 < failed to complete operation key=O5WBNND16BFN tag=60NLOWBA90S3 type=del size=474864: (22) Invalid argument 2024-09-12T00:17:56.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.596+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=N1GA3WEEAXP0 type=write size=651582 2024-09-12T00:17:56.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.600+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=TSA3MKR6VNDH type=del 2024-09-12T00:17:56.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.608+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~BWIHE7XI43Y4.0 size=1048576 2024-09-12T00:17:56.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.612+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~BWIHE7XI43Y4.1 size=1048576 2024-09-12T00:17:56.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.612+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~BWIHE7XI43Y4.2 size=79943 2024-09-12T00:17:56.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.612+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=BWIHE7XI43Y4 tag=KX35DXO64A5G type=write size=3225671 2024-09-12T00:17:56.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.616+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=6PLJ7157WVB1 type=del 2024-09-12T00:17:56.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.620+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=DWBPI1A1TMQU type=del size=3384381 2024-09-12T00:17:56.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.620+0000 7f69cdea98c0 1 < canceled part key=_multipart_0J667VAQGMTX.2~KUPHVXN39I5T.0 size=1048576 2024-09-12T00:17:56.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.624+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~KUPHVXN39I5T.1 size=1048576 2024-09-12T00:17:56.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.628+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~KUPHVXN39I5T.2 size=364381 2024-09-12T00:17:56.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.632+0000 7f69cdea98c0 1 < canceled multipart upload key=0J667VAQGMTX upload=KUPHVXN39I5T tag=968W462HN2VB type=write size=3510109 2024-09-12T00:17:56.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.636+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=RXUFRZ0CMOA0 type=del size=628369 2024-09-12T00:17:56.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.640+0000 7f69cdea98c0 -1 < failed to complete operation key=O5WBNND16BFN tag=4R17XO0TTHIE type=del size=1006735: (22) Invalid argument 2024-09-12T00:17:56.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.644+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=5TCZB3EXCYTE type=del size=417852 2024-09-12T00:17:56.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.652+0000 7f69cdea98c0 1 < suggested update operation key=YS23U9GQS7SJ tag=TS6AO7DHEOUV type=del size=1167197 2024-09-12T00:17:56.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~CUXCL7Z610CJ.0 size=1048576 2024-09-12T00:17:56.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.664+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~CUXCL7Z610CJ.1 size=287353 2024-09-12T00:17:56.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.664+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=CUXCL7Z610CJ tag=D4RRGAWBBJNA type=write size=2384505 2024-09-12T00:17:56.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.672+0000 7f69cdea98c0 1 < suggested remove operation key=YS23U9GQS7SJ tag=04G4QZXC96L4 type=del 2024-09-12T00:17:56.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.676+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~MH7SZJCF3T57.0 size=1048576 2024-09-12T00:17:56.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.680+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~MH7SZJCF3T57.1 size=1048576 2024-09-12T00:17:56.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~MH7SZJCF3T57.2 size=556471 2024-09-12T00:17:56.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.684+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=MH7SZJCF3T57 tag=SY5NL0RRE6C7 type=write size=3702199 2024-09-12T00:17:56.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.692+0000 7f69cdea98c0 1 < suggested update operation key=Z6MH459BTZ6K tag=B0C6NI22R7VO type=del size=2910804 2024-09-12T00:17:56.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.700+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~1MM7J9FP3VK0.0 size=1048576 2024-09-12T00:17:56.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.700+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~1MM7J9FP3VK0.1 size=653821 2024-09-12T00:17:56.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.700+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=1MM7J9FP3VK0 tag=DG5V33U5HW7C type=write size=2750973 2024-09-12T00:17:56.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.704+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=3Z6GDFP6ZV8O type=del 2024-09-12T00:17:56.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.708+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=0VOJO7EPGCDJ type=del size=3983019 2024-09-12T00:17:56.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.716+0000 7f69cdea98c0 1 < suggested update operation key=RDGRKQQH4B8C tag=CZYLI3EHJORI type=write size=784215 2024-09-12T00:17:56.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.720+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=E75A71BNCQ41 type=write size=395946 2024-09-12T00:17:56.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.724+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=SI11VHO6164W type=del 2024-09-12T00:17:56.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~RGGMSXRQ2TW3.0 size=1048576 2024-09-12T00:17:56.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~RGGMSXRQ2TW3.1 size=102697 2024-09-12T00:17:56.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.736+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=RGGMSXRQ2TW3 tag=XGWZ1EV3RTU6 type=write size=2199849 2024-09-12T00:17:56.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.740+0000 7f69cdea98c0 -1 < failed to complete operation key=O5WBNND16BFN tag=E4ENJYPQRSC1 type=del size=1744967: (22) Invalid argument 2024-09-12T00:17:56.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~3R4E002L2UWX.0 size=1048576 2024-09-12T00:17:56.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~3R4E002L2UWX.1 size=805491 2024-09-12T00:17:56.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.748+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=3R4E002L2UWX tag=AUE7X92CPWI8 type=write size=2902643 2024-09-12T00:17:56.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.752+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=VT0AWUWLRJCA type=del 2024-09-12T00:17:56.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.760+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~NRDYYPFO1N15.0 size=1048576 2024-09-12T00:17:56.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.764+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~NRDYYPFO1N15.1 size=573582 2024-09-12T00:17:56.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.764+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=NRDYYPFO1N15 tag=Z49HK43XBSNM type=write size=2670734 2024-09-12T00:17:56.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.768+0000 7f69cdea98c0 -1 < failed to complete operation key=O5WBNND16BFN tag=O9TC878TECA6 type=del size=1275183: (22) Invalid argument 2024-09-12T00:17:56.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.772+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=YAOXWDDO5KB9 type=del size=3533560 2024-09-12T00:17:56.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.776+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~C461RIOXF3OM.0 size=230471 2024-09-12T00:17:56.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.780+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=C461RIOXF3OM tag=WV4329VY9X26 type=write size=1279047 2024-09-12T00:17:56.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.784+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=F77P5NKB3N87 type=del size=2674237 2024-09-12T00:17:56.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.788+0000 7f69cdea98c0 1 < canceled operation key=2ENKC4QT2BFS tag=B66DESZ449KM type=del size=2068622 2024-09-12T00:17:56.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.792+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=6IDWZ0H6OMOB type=del size=2708340 2024-09-12T00:17:56.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.796+0000 7f69cdea98c0 1 < completed write operation key=0HAUC4BDL9VR tag=N1GA3WEEAXP0 type=write size=651582 2024-09-12T00:17:56.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~CT1DVXMXD12Z.0 size=1048576 2024-09-12T00:17:56.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.808+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~CT1DVXMXD12Z.1 size=156659 2024-09-12T00:17:56.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.808+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=CT1DVXMXD12Z tag=UK95FHC3CH47 type=write size=2253811 2024-09-12T00:17:56.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.808+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~BWIHE7XI43Y4.0 size=1048576 2024-09-12T00:17:56.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.812+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~BWIHE7XI43Y4.1 size=1048576 2024-09-12T00:17:56.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.816+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~BWIHE7XI43Y4.2 size=79943 2024-09-12T00:17:56.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.824+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=BWIHE7XI43Y4 tag=KX35DXO64A5G type=write size=3225671 2024-09-12T00:17:56.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.824+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=A3ZLD68OLRT3 type=del size=530347 2024-09-12T00:17:56.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.832+0000 7f69cdea98c0 1 < canceled operation key=7UFADFUXL28I tag=DWBPI1A1TMQU type=del size=3384381 2024-09-12T00:17:56.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.836+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~X0NJY2DQ8Q5H.0 size=1048576 2024-09-12T00:17:56.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~X0NJY2DQ8Q5H.1 size=786609 2024-09-12T00:17:56.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.840+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=X0NJY2DQ8Q5H tag=KR8X7I0VEZLN type=write size=2883761 2024-09-12T00:17:56.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.844+0000 7f69cdea98c0 -1 < failed to complete operation key=RDGRKQQH4B8C tag=RXUFRZ0CMOA0 type=del size=628369: (22) Invalid argument 2024-09-12T00:17:56.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.852+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=2CUH9OIE7C93 type=del size=3961655 2024-09-12T00:17:56.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.856+0000 7f69cdea98c0 -1 < failed to complete operation key=YS23U9GQS7SJ tag=5TCZB3EXCYTE type=del size=417852: (22) Invalid argument 2024-09-12T00:17:56.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.860+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=4K3CX07HUX0O type=del size=3579027 2024-09-12T00:17:56.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.864+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~CUXCL7Z610CJ.0 size=1048576 2024-09-12T00:17:56.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.868+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~CUXCL7Z610CJ.1 size=287353 2024-09-12T00:17:56.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.872+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=CUXCL7Z610CJ tag=D4RRGAWBBJNA type=write size=2384505 2024-09-12T00:17:56.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~SPB7FEL2LUO8.0 size=1048576 2024-09-12T00:17:56.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~SPB7FEL2LUO8.1 size=65136 2024-09-12T00:17:56.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.884+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=SPB7FEL2LUO8 tag=GLOKN29SYTZJ type=write size=2162288 2024-09-12T00:17:56.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.884+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~MH7SZJCF3T57.0 size=1048576 2024-09-12T00:17:56.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.888+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~MH7SZJCF3T57.1 size=1048576 2024-09-12T00:17:56.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.892+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~MH7SZJCF3T57.2 size=556471 2024-09-12T00:17:56.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.896+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=MH7SZJCF3T57 tag=SY5NL0RRE6C7 type=write size=3702199 2024-09-12T00:17:56.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.904+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~Z7GADWDWSBLD.0 size=157392 2024-09-12T00:17:56.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.904+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=Z7GADWDWSBLD tag=ZD4L5A9RZ2UI type=write size=1205968 2024-09-12T00:17:56.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.908+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~1MM7J9FP3VK0.0 size=1048576 2024-09-12T00:17:56.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.912+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~1MM7J9FP3VK0.1 size=653821 2024-09-12T00:17:56.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.916+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=1MM7J9FP3VK0 tag=DG5V33U5HW7C type=write size=2750973 2024-09-12T00:17:56.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.920+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=H3OLTETI82VS type=del size=3541708 2024-09-12T00:17:56.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.928+0000 7f69cdea98c0 1 < suggested remove operation key=2YYP9NOUAJD0 tag=0VOJO7EPGCDJ type=del 2024-09-12T00:17:56.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.932+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=921NMVLJRKG3 type=del size=389683 2024-09-12T00:17:56.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.936+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=E75A71BNCQ41 type=write size=395946 2024-09-12T00:17:56.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.944+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~5JV609TE3L0I.0 size=793406 2024-09-12T00:17:56.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.944+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=5JV609TE3L0I tag=RRZWU50GV4WW type=write size=1841982 2024-09-12T00:17:56.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.948+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~RGGMSXRQ2TW3.0 size=1048576 2024-09-12T00:17:56.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.952+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~RGGMSXRQ2TW3.1 size=102697 2024-09-12T00:17:56.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.956+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=RGGMSXRQ2TW3 tag=XGWZ1EV3RTU6 type=write size=2199849 2024-09-12T00:17:56.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.960+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=6SIM9Y34KBBH type=del size=3345763 2024-09-12T00:17:56.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.964+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~3R4E002L2UWX.0 size=1048576 2024-09-12T00:17:56.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.968+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~3R4E002L2UWX.1 size=805491 2024-09-12T00:17:56.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.972+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=3R4E002L2UWX tag=AUE7X92CPWI8 type=write size=2902643 2024-09-12T00:17:56.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.976+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=6ART4NYJ7N58 type=del size=2983819 2024-09-12T00:17:56.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.980+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~NRDYYPFO1N15.0 size=1048576 2024-09-12T00:17:56.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.984+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~NRDYYPFO1N15.1 size=573582 2024-09-12T00:17:56.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.988+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=NRDYYPFO1N15 tag=Z49HK43XBSNM type=write size=2670734 2024-09-12T00:17:56.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.992+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=EPJ3SGQ2UJ01 type=del size=3811911 2024-09-12T00:17:56.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:56.996+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=YAOXWDDO5KB9 type=del 2024-09-12T00:17:57.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.004+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~PRV1HENR5794.0 size=1048576 2024-09-12T00:17:57.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.008+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~PRV1HENR5794.1 size=967530 2024-09-12T00:17:57.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.008+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=PRV1HENR5794 tag=PP0B96HOANDF type=write size=3064682 2024-09-12T00:17:57.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.012+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=F77P5NKB3N87 type=del 2024-09-12T00:17:57.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.016+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=LM235OSVDEVM type=del size=1998214 2024-09-12T00:17:57.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.020+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=6IDWZ0H6OMOB type=del 2024-09-12T00:17:57.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.024+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=LHI0AHRVEGU4 type=del size=3351941 2024-09-12T00:17:57.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.028+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~CT1DVXMXD12Z.0 size=1048576 2024-09-12T00:17:57.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.028+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~CT1DVXMXD12Z.1 size=156659 2024-09-12T00:17:57.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.036+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=CT1DVXMXD12Z tag=UK95FHC3CH47 type=write size=2253811 2024-09-12T00:17:57.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.040+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=NU65UWSW6DWF type=write size=672555 2024-09-12T00:17:57.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.044+0000 7f69cdea98c0 -1 < failed to complete operation key=2YYP9NOUAJD0 tag=A3ZLD68OLRT3 type=del size=530347: (22) Invalid argument 2024-09-12T00:17:57.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.048+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=JHZI89N1KPN1 type=del size=2402382 2024-09-12T00:17:57.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.048+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~X0NJY2DQ8Q5H.0 size=1048576 2024-09-12T00:17:57.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.052+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~X0NJY2DQ8Q5H.1 size=786609 2024-09-12T00:17:57.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.060+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=X0NJY2DQ8Q5H tag=KR8X7I0VEZLN type=write size=2883761 2024-09-12T00:17:57.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.064+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=8BFQIS8DR08B type=del size=3798236 2024-09-12T00:17:57.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.068+0000 7f69cdea98c0 1 < suggested update operation key=AWZ03VE7D86K tag=2CUH9OIE7C93 type=del size=3961655 2024-09-12T00:17:57.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.072+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=NVV6L2HQSCB5 type=del size=2272764 2024-09-12T00:17:57.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.076+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=4K3CX07HUX0O type=del 2024-09-12T00:17:57.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.080+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=Y098KLX4II6I type=del size=1492966 2024-09-12T00:17:57.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.084+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~SPB7FEL2LUO8.0 size=1048576 2024-09-12T00:17:57.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.088+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~SPB7FEL2LUO8.1 size=65136 2024-09-12T00:17:57.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.096+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=SPB7FEL2LUO8 tag=GLOKN29SYTZJ type=write size=2162288 2024-09-12T00:17:57.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.100+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=NER51086MW9F type=write size=324492 2024-09-12T00:17:57.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.104+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~Z7GADWDWSBLD.0 size=157392 2024-09-12T00:17:57.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.108+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=Z7GADWDWSBLD tag=ZD4L5A9RZ2UI type=write size=1205968 2024-09-12T00:17:57.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.116+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~MXQ92K83V8OI.0 size=410999 2024-09-12T00:17:57.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.116+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=MXQ92K83V8OI tag=024XN4PF3K7W type=write size=1459575 2024-09-12T00:17:57.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.124+0000 7f69cdea98c0 1 < suggested remove operation key=5453GP1H3OFQ tag=H3OLTETI82VS type=del 2024-09-12T00:17:57.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~HOWW9UB5UVU4.0 size=1048576 2024-09-12T00:17:57.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~HOWW9UB5UVU4.1 size=36508 2024-09-12T00:17:57.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.136+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=HOWW9UB5UVU4 tag=F4VESX2VSX71 type=write size=2133660 2024-09-12T00:17:57.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.140+0000 7f69cdea98c0 1 < canceled operation key=H91UXKWAJ3K8 tag=921NMVLJRKG3 type=del size=389683 2024-09-12T00:17:57.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.144+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=4384RNITKSVZ type=write size=637645 2024-09-12T00:17:57.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.148+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~5JV609TE3L0I.0 size=793406 2024-09-12T00:17:57.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.156+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=5JV609TE3L0I tag=RRZWU50GV4WW type=write size=1841982 2024-09-12T00:17:57.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~PRXJ7JI14YC4.0 size=1048576 2024-09-12T00:17:57.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.164+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~PRXJ7JI14YC4.1 size=1048576 2024-09-12T00:17:57.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~PRXJ7JI14YC4.2 size=153682 2024-09-12T00:17:57.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.168+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=PRXJ7JI14YC4 tag=CB4FKB643O9L type=write size=3299410 2024-09-12T00:17:57.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.176+0000 7f69cdea98c0 1 < suggested remove operation key=2ENKC4QT2BFS tag=6SIM9Y34KBBH type=del 2024-09-12T00:17:57.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.180+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=K9R9CWG3PN5G type=del size=1590122 2024-09-12T00:17:57.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.184+0000 7f69cdea98c0 -1 < failed to complete operation key=2ENKC4QT2BFS tag=6ART4NYJ7N58 type=del size=2983819: (22) Invalid argument 2024-09-12T00:17:57.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.188+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=1RI1D1RZOSC1 type=del size=546818 2024-09-12T00:17:57.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.192+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=EPJ3SGQ2UJ01 type=del 2024-09-12T00:17:57.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.196+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=5NP0MG0QTY33 type=del size=3460021 2024-09-12T00:17:57.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.200+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~PRV1HENR5794.0 size=1048576 2024-09-12T00:17:57.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.208+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~PRV1HENR5794.1 size=967530 2024-09-12T00:17:57.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.212+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=PRV1HENR5794 tag=PP0B96HOANDF type=write size=3064682 2024-09-12T00:17:57.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.220+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~SO1V0P7KJY2O.0 size=364104 2024-09-12T00:17:57.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.220+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=SO1V0P7KJY2O tag=Y4ZL9OH65THR type=write size=1412680 2024-09-12T00:17:57.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.224+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=LM235OSVDEVM type=del 2024-09-12T00:17:57.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.228+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=QFPMG8LD5OEH type=del size=2011579 2024-09-12T00:17:57.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.228+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=LHI0AHRVEGU4 type=del 2024-09-12T00:17:57.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.232+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=30CK8MEPTN6L type=del size=1238384 2024-09-12T00:17:57.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.236+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=NU65UWSW6DWF type=write size=672555 2024-09-12T00:17:57.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.240+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=W29LW4VRTQOF type=write size=588476 2024-09-12T00:17:57.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.244+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=JHZI89N1KPN1 type=del 2024-09-12T00:17:57.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.248+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=277LI1MY6LEX type=write size=571363 2024-09-12T00:17:57.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.252+0000 7f69cdea98c0 1 < canceled operation key=IXB6WLN5M81C tag=8BFQIS8DR08B type=del size=3798236 2024-09-12T00:17:57.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.256+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=4QVSC7OUC27T type=del size=2390211 2024-09-12T00:17:57.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.264+0000 7f69cdea98c0 1 < suggested update operation key=0HAUC4BDL9VR tag=NVV6L2HQSCB5 type=del size=2272764 2024-09-12T00:17:57.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.268+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=7LRUE4CZ3PSM type=del size=2064410 2024-09-12T00:17:57.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.276+0000 7f69cdea98c0 1 < suggested update operation key=IXB6WLN5M81C tag=Y098KLX4II6I type=del size=1492966 2024-09-12T00:17:57.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.280+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=TR34CO4Z0EBK type=del size=3045450 2024-09-12T00:17:57.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.284+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=NER51086MW9F type=write size=324492 2024-09-12T00:17:57.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.292+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~61TM7MI00E2Q.0 size=856260 2024-09-12T00:17:57.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.292+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=61TM7MI00E2Q tag=W394K86PPHK8 type=write size=1904836 2024-09-12T00:17:57.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.296+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~MXQ92K83V8OI.0 size=410999 2024-09-12T00:17:57.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.304+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=MXQ92K83V8OI tag=024XN4PF3K7W type=write size=1459575 2024-09-12T00:17:57.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.308+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=UC2NGU8T7XCM type=del size=3839418 2024-09-12T00:17:57.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.312+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~HOWW9UB5UVU4.0 size=1048576 2024-09-12T00:17:57.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.312+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~HOWW9UB5UVU4.1 size=36508 2024-09-12T00:17:57.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.316+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=HOWW9UB5UVU4 tag=F4VESX2VSX71 type=write size=2133660 2024-09-12T00:17:57.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.324+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~R00YL4FCPH6G.0 size=1048576 2024-09-12T00:17:57.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~R00YL4FCPH6G.1 size=1048576 2024-09-12T00:17:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~R00YL4FCPH6G.2 size=948095 2024-09-12T00:17:57.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.328+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=R00YL4FCPH6G tag=VGZ0NMPLYGJJ type=write size=4093823 2024-09-12T00:17:57.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.336+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=4384RNITKSVZ type=write size=637645 2024-09-12T00:17:57.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.340+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=2ZD8WK14EI9G type=del size=2412791 2024-09-12T00:17:57.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.344+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~PRXJ7JI14YC4.0 size=1048576 2024-09-12T00:17:57.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.348+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~PRXJ7JI14YC4.1 size=1048576 2024-09-12T00:17:57.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.352+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~PRXJ7JI14YC4.2 size=153682 2024-09-12T00:17:57.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.356+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=PRXJ7JI14YC4 tag=CB4FKB643O9L type=write size=3299410 2024-09-12T00:17:57.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.360+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=TP3NVGKGOFRU type=del size=3930454 2024-09-12T00:17:57.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.364+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=K9R9CWG3PN5G type=del 2024-09-12T00:17:57.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.368+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=2SV1QIOD30FL type=write size=818676 2024-09-12T00:17:57.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.376+0000 7f69cdea98c0 1 < suggested update operation key=SP2KVAO82MQ0 tag=1RI1D1RZOSC1 type=del size=546818 2024-09-12T00:17:57.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.384+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=KJJHUESHIXQ5 type=del size=1412039 2024-09-12T00:17:57.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.388+0000 7f69cdea98c0 1 < suggested update operation key=2YYP9NOUAJD0 tag=5NP0MG0QTY33 type=del size=3460021 2024-09-12T00:17:57.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.392+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=PDGHRXULXBYD type=del size=1186839 2024-09-12T00:17:57.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.396+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~SO1V0P7KJY2O.0 size=364104 2024-09-12T00:17:57.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.404+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=SO1V0P7KJY2O tag=Y4ZL9OH65THR type=write size=1412680 2024-09-12T00:17:57.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.408+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=6ERORK0RDTZ5 type=del size=1223291 2024-09-12T00:17:57.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.416+0000 7f69cdea98c0 1 < suggested remove operation key=AWZ03VE7D86K tag=QFPMG8LD5OEH type=del 2024-09-12T00:17:57.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.420+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=VHAEVJ4E567Y type=del size=2576481 2024-09-12T00:17:57.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.424+0000 7f69cdea98c0 1 < canceled operation key=0J667VAQGMTX tag=30CK8MEPTN6L type=del size=1238384 2024-09-12T00:17:57.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.428+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=5X5FB17KSBYN type=del size=419195 2024-09-12T00:17:57.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.432+0000 7f69cdea98c0 1 < completed write operation key=5453GP1H3OFQ tag=W29LW4VRTQOF type=write size=588476 2024-09-12T00:17:57.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.436+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=9EO8W1Q2453R type=del size=2564316 2024-09-12T00:17:57.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.440+0000 7f69cdea98c0 1 < completed write operation key=IXWX7S5NWJS3 tag=277LI1MY6LEX type=write size=571363 2024-09-12T00:17:57.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~YTQWKD8NBNF6.0 size=1048576 2024-09-12T00:17:57.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.448+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~YTQWKD8NBNF6.1 size=205734 2024-09-12T00:17:57.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.448+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=YTQWKD8NBNF6 tag=EIBAE06Y289L type=write size=2302886 2024-09-12T00:17:57.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.452+0000 7f69cdea98c0 -1 < failed to complete operation key=0HAUC4BDL9VR tag=4QVSC7OUC27T type=del size=2390211: (22) Invalid argument 2024-09-12T00:17:57.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~KHJIJUD019EE.0 size=561138 2024-09-12T00:17:57.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.456+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=KHJIJUD019EE tag=YD3VZDHBLTO3 type=write size=1609714 2024-09-12T00:17:57.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.460+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=7LRUE4CZ3PSM type=del 2024-09-12T00:17:57.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.468+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~P0GE1985HZDV.0 size=505429 2024-09-12T00:17:57.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.468+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=P0GE1985HZDV tag=ZO9ZKYA30LAQ type=write size=1554005 2024-09-12T00:17:57.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.472+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=TR34CO4Z0EBK type=del 2024-09-12T00:17:57.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.476+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=L7NT3TOVWG39 type=del size=1338983 2024-09-12T00:17:57.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.480+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~61TM7MI00E2Q.0 size=856260 2024-09-12T00:17:57.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.484+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=61TM7MI00E2Q tag=W394K86PPHK8 type=write size=1904836 2024-09-12T00:17:57.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.492+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=SO84ZO2RS0OZ type=del size=3261432 2024-09-12T00:17:57.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.496+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=UC2NGU8T7XCM type=del 2024-09-12T00:17:57.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.500+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=JBDA1PG3H81F type=del size=62076 2024-09-12T00:17:57.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.504+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~R00YL4FCPH6G.0 size=1048576 2024-09-12T00:17:57.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.508+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~R00YL4FCPH6G.1 size=1048576 2024-09-12T00:17:57.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.508+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~R00YL4FCPH6G.2 size=948095 2024-09-12T00:17:57.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.516+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=R00YL4FCPH6G tag=VGZ0NMPLYGJJ type=write size=4093823 2024-09-12T00:17:57.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.524+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~U3RZBT2WFIE6.0 size=1048576 2024-09-12T00:17:57.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~U3RZBT2WFIE6.1 size=885353 2024-09-12T00:17:57.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.528+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=U3RZBT2WFIE6 tag=T6U346IC3QMK type=write size=2982505 2024-09-12T00:17:57.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.532+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=2ZD8WK14EI9G type=del 2024-09-12T00:17:57.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.536+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=Z318CU0AUE8Q type=del size=1036029 2024-09-12T00:17:57.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.540+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=TP3NVGKGOFRU type=del 2024-09-12T00:17:57.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.548+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~SEXCNAUA0OQ5.0 size=1048576 2024-09-12T00:17:57.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~SEXCNAUA0OQ5.1 size=1048576 2024-09-12T00:17:57.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~SEXCNAUA0OQ5.2 size=952210 2024-09-12T00:17:57.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.552+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=SEXCNAUA0OQ5 tag=XYDT1303I6YS type=write size=4097938 2024-09-12T00:17:57.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.556+0000 7f69cdea98c0 1 < completed write operation key=1CZXUEJLQ8FM tag=2SV1QIOD30FL type=write size=818676 2024-09-12T00:17:57.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.560+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=PEOK7U1XV78C type=write size=712096 2024-09-12T00:17:57.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.564+0000 7f69cdea98c0 -1 < failed to complete operation key=2YYP9NOUAJD0 tag=KJJHUESHIXQ5 type=del size=1412039: (22) Invalid argument 2024-09-12T00:17:57.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.568+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=RKR0HJHZBAO1 type=del size=3251692 2024-09-12T00:17:57.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.572+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=PDGHRXULXBYD type=del 2024-09-12T00:17:57.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.580+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=HC3PNPY2NV3D type=del size=1167355 2024-09-12T00:17:57.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.584+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=6ERORK0RDTZ5 type=del 2024-09-12T00:17:57.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.588+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=98CBGXUL8RO4 type=del size=3901860 2024-09-12T00:17:57.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.592+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=VHAEVJ4E567Y type=del 2024-09-12T00:17:57.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.596+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=K5I95NHQ1OT3 type=write size=862516 2024-09-12T00:17:57.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.600+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=5X5FB17KSBYN type=del 2024-09-12T00:17:57.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.604+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=V8L0IH8199Y7 type=del size=1881981 2024-09-12T00:17:57.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.608+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=9EO8W1Q2453R type=del 2024-09-12T00:17:57.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.616+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~U59GF6ZZQXM7.0 size=1048576 2024-09-12T00:17:57.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.620+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~U59GF6ZZQXM7.1 size=783249 2024-09-12T00:17:57.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.620+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=U59GF6ZZQXM7 tag=OPONZS9CQHZ5 type=write size=2880401 2024-09-12T00:17:57.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.624+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~YTQWKD8NBNF6.0 size=1048576 2024-09-12T00:17:57.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.628+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~YTQWKD8NBNF6.1 size=205734 2024-09-12T00:17:57.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.632+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=YTQWKD8NBNF6 tag=EIBAE06Y289L type=write size=2302886 2024-09-12T00:17:57.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.636+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=3MTS02OYFZDH type=write size=312973 2024-09-12T00:17:57.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.640+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~KHJIJUD019EE.0 size=561138 2024-09-12T00:17:57.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.644+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=KHJIJUD019EE tag=YD3VZDHBLTO3 type=write size=1609714 2024-09-12T00:17:57.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.648+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=526YEQDJN2FC type=del size=160623 2024-09-12T00:17:57.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.652+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~P0GE1985HZDV.0 size=505429 2024-09-12T00:17:57.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.660+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=P0GE1985HZDV tag=ZO9ZKYA30LAQ type=write size=1554005 2024-09-12T00:17:57.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~O5DT61KALG7Y.0 size=1048576 2024-09-12T00:17:57.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~O5DT61KALG7Y.1 size=1048576 2024-09-12T00:17:57.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.672+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~O5DT61KALG7Y.2 size=846868 2024-09-12T00:17:57.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.672+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=O5DT61KALG7Y tag=YYUFEMMN437D type=write size=3992596 2024-09-12T00:17:57.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.676+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=L7NT3TOVWG39 type=del 2024-09-12T00:17:57.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~6GF49LPEYI7A.0 size=267814 2024-09-12T00:17:57.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.684+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=6GF49LPEYI7A tag=E6QPEY5XJ94K type=write size=1316390 2024-09-12T00:17:57.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.688+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=SO84ZO2RS0OZ type=del 2024-09-12T00:17:57.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.692+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=YBMZJYX8IKY1 type=del size=1778410 2024-09-12T00:17:57.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.696+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=JBDA1PG3H81F type=del 2024-09-12T00:17:57.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.700+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~ELDWSXF8S8D9.0 size=1048576 2024-09-12T00:17:57.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.704+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~ELDWSXF8S8D9.1 size=1048576 2024-09-12T00:17:57.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.708+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~ELDWSXF8S8D9.2 size=151637 2024-09-12T00:17:57.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.708+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=ELDWSXF8S8D9 tag=3ONHRQJ7SPG4 type=write size=3297365 2024-09-12T00:17:57.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.708+0000 7f69cdea98c0 1 < canceled part key=_multipart_AKWTTXH2P254.2~U3RZBT2WFIE6.0 size=1048576 2024-09-12T00:17:57.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.712+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~U3RZBT2WFIE6.1 size=885353 2024-09-12T00:17:57.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.716+0000 7f69cdea98c0 1 < canceled multipart upload key=AKWTTXH2P254 upload=U3RZBT2WFIE6 tag=T6U346IC3QMK type=write size=2982505 2024-09-12T00:17:57.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.720+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=DGWRVA4PE28V type=del size=2973785 2024-09-12T00:17:57.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.724+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=Z318CU0AUE8Q type=del 2024-09-12T00:17:57.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~8HOFWSKDYYNK.0 size=1048576 2024-09-12T00:17:57.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~8HOFWSKDYYNK.1 size=1048576 2024-09-12T00:17:57.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~8HOFWSKDYYNK.2 size=913445 2024-09-12T00:17:57.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.736+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=8HOFWSKDYYNK tag=KMS2M8X71K2M type=write size=4059173 2024-09-12T00:17:57.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.740+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~SEXCNAUA0OQ5.0 size=1048576 2024-09-12T00:17:57.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.740+0000 7f69cdea98c0 1 < canceled part key=_multipart_SP2KVAO82MQ0.2~SEXCNAUA0OQ5.1 size=1048576 2024-09-12T00:17:57.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.744+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~SEXCNAUA0OQ5.2 size=952210 2024-09-12T00:17:57.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.752+0000 7f69cdea98c0 1 < canceled multipart upload key=SP2KVAO82MQ0 upload=SEXCNAUA0OQ5 tag=XYDT1303I6YS type=write size=4097938 2024-09-12T00:17:57.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.756+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=1I8N0CN1JFIL type=del size=62041 2024-09-12T00:17:57.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.764+0000 7f69cdea98c0 1 < suggested update operation key=RDGRKQQH4B8C tag=PEOK7U1XV78C type=write size=712096 2024-09-12T00:17:57.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.768+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=RD5ME13HH8YH type=del size=108950 2024-09-12T00:17:57.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.772+0000 7f69cdea98c0 -1 < failed to complete operation key=RDGRKQQH4B8C tag=RKR0HJHZBAO1 type=del size=3251692: (22) Invalid argument 2024-09-12T00:17:57.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.776+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=DG8BF5E6D1BM type=del size=85444 2024-09-12T00:17:57.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.780+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=HC3PNPY2NV3D type=del 2024-09-12T00:17:57.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.784+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=5SJQ7BX2P81X type=del size=3024840 2024-09-12T00:17:57.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.792+0000 7f69cdea98c0 1 < suggested update operation key=4O5U4WX3N4SA tag=98CBGXUL8RO4 type=del size=3901860 2024-09-12T00:17:57.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.800+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~F7NSQ1KW4KND.0 size=2219 2024-09-12T00:17:57.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.800+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=F7NSQ1KW4KND tag=9K3F5C82C15B type=write size=1050795 2024-09-12T00:17:57.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.804+0000 7f69cdea98c0 1 < completed write operation key=HSQZYI0SNZP1 tag=K5I95NHQ1OT3 type=write size=862516 2024-09-12T00:17:57.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.808+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=VLM42FG75DLF type=del size=4190154 2024-09-12T00:17:57.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.812+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=V8L0IH8199Y7 type=del 2024-09-12T00:17:57.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.816+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=3XXKL3W11RX4 type=del size=2377336 2024-09-12T00:17:57.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.820+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~U59GF6ZZQXM7.0 size=1048576 2024-09-12T00:17:57.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.824+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~U59GF6ZZQXM7.1 size=783249 2024-09-12T00:17:57.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.832+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=U59GF6ZZQXM7 tag=OPONZS9CQHZ5 type=write size=2880401 2024-09-12T00:17:57.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~GSWNCFEPUAA1.0 size=1048576 2024-09-12T00:17:57.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~GSWNCFEPUAA1.1 size=1048576 2024-09-12T00:17:57.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~GSWNCFEPUAA1.2 size=361112 2024-09-12T00:17:57.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.844+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=GSWNCFEPUAA1 tag=5CJM4WB9XV5J type=write size=3506840 2024-09-12T00:17:57.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.848+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=3MTS02OYFZDH type=write size=312973 2024-09-12T00:17:57.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.852+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=8NNNN6Q9M3UT type=write size=310689 2024-09-12T00:17:57.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.856+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=526YEQDJN2FC type=del 2024-09-12T00:17:57.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~N958O918LDL8.0 size=1048576 2024-09-12T00:17:57.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.864+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~N958O918LDL8.1 size=1048576 2024-09-12T00:17:57.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~N958O918LDL8.2 size=851618 2024-09-12T00:17:57.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.868+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=N958O918LDL8 tag=EDLIEONB4366 type=write size=3997346 2024-09-12T00:17:57.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.872+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~O5DT61KALG7Y.0 size=1048576 2024-09-12T00:17:57.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.876+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~O5DT61KALG7Y.1 size=1048576 2024-09-12T00:17:57.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.880+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~O5DT61KALG7Y.2 size=846868 2024-09-12T00:17:57.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.884+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=O5DT61KALG7Y tag=YYUFEMMN437D type=write size=3992596 2024-09-12T00:17:57.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.892+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=R2GGO5BAHA11 type=del size=3664142 2024-09-12T00:17:57.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.896+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~6GF49LPEYI7A.0 size=267814 2024-09-12T00:17:57.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.900+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=6GF49LPEYI7A tag=E6QPEY5XJ94K type=write size=1316390 2024-09-12T00:17:57.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.904+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=EMIJTV2I3W9F type=write size=1003141 2024-09-12T00:17:57.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.908+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=YBMZJYX8IKY1 type=del 2024-09-12T00:17:57.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.916+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~DLU7XMVHPOGB.0 size=635637 2024-09-12T00:17:57.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.916+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=DLU7XMVHPOGB tag=P4LPG0RPVCFJ type=write size=1684213 2024-09-12T00:17:57.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.920+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~ELDWSXF8S8D9.0 size=1048576 2024-09-12T00:17:57.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.924+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~ELDWSXF8S8D9.1 size=1048576 2024-09-12T00:17:57.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.924+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~ELDWSXF8S8D9.2 size=151637 2024-09-12T00:17:57.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.932+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=ELDWSXF8S8D9 tag=3ONHRQJ7SPG4 type=write size=3297365 2024-09-12T00:17:57.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.936+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=ZJZ2OIZ7K759 type=del size=520255 2024-09-12T00:17:57.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.944+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=DGWRVA4PE28V type=del 2024-09-12T00:17:57.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.948+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=17NU0SK6KTBN type=del size=96221 2024-09-12T00:17:57.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.952+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~8HOFWSKDYYNK.0 size=1048576 2024-09-12T00:17:57.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.956+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~8HOFWSKDYYNK.1 size=1048576 2024-09-12T00:17:57.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.956+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~8HOFWSKDYYNK.2 size=913445 2024-09-12T00:17:57.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.964+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=8HOFWSKDYYNK tag=KMS2M8X71K2M type=write size=4059173 2024-09-12T00:17:57.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.968+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=PUKTBUMZOP1W type=del size=3731547 2024-09-12T00:17:57.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.968+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=1I8N0CN1JFIL type=del 2024-09-12T00:17:57.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.976+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~01BWN1A51JE1.0 size=1048576 2024-09-12T00:17:57.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.980+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~01BWN1A51JE1.1 size=1048576 2024-09-12T00:17:57.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~01BWN1A51JE1.2 size=168235 2024-09-12T00:17:57.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.984+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=01BWN1A51JE1 tag=CUXB9LW5G0EA type=write size=3313963 2024-09-12T00:17:57.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.984+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=RD5ME13HH8YH type=del 2024-09-12T00:17:57.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.992+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~FYFV6GFXDL34.0 size=1048576 2024-09-12T00:17:57.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.996+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~FYFV6GFXDL34.1 size=538560 2024-09-12T00:17:57.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:57.996+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=FYFV6GFXDL34 tag=XBRKP3YX9550 type=write size=2635712 2024-09-12T00:17:57.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.000+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=DG8BF5E6D1BM type=del 2024-09-12T00:17:58.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.004+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=ETA7EGAOKTZR type=del size=3300088 2024-09-12T00:17:58.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.008+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=5SJQ7BX2P81X type=del 2024-09-12T00:17:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~T8ML9FOGPX2Z.0 size=640504 2024-09-12T00:17:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.012+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=T8ML9FOGPX2Z tag=1BTLEPH995HO type=write size=1689080 2024-09-12T00:17:58.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.012+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~F7NSQ1KW4KND.0 size=2219 2024-09-12T00:17:58.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.020+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=F7NSQ1KW4KND tag=9K3F5C82C15B type=write size=1050795 2024-09-12T00:17:58.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.024+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~FB0AHXPL2FP0.0 size=656446 2024-09-12T00:17:58.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.024+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=FB0AHXPL2FP0 tag=GT9S557FL4PJ type=write size=1705022 2024-09-12T00:17:58.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.028+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=VLM42FG75DLF type=del 2024-09-12T00:17:58.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.036+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~6CMNIH43RNSE.0 size=1048576 2024-09-12T00:17:58.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.040+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~6CMNIH43RNSE.1 size=1048576 2024-09-12T00:17:58.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.040+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~6CMNIH43RNSE.2 size=541963 2024-09-12T00:17:58.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.040+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=6CMNIH43RNSE tag=2MB9TSBO8KKQ type=write size=3687691 2024-09-12T00:17:58.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.044+0000 7f69cdea98c0 1 < canceled operation key=5453GP1H3OFQ tag=3XXKL3W11RX4 type=del size=2377336 2024-09-12T00:17:58.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.048+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=DQ3SURR3ZYKS type=del size=1230261 2024-09-12T00:17:58.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.052+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~GSWNCFEPUAA1.0 size=1048576 2024-09-12T00:17:58.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.056+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~GSWNCFEPUAA1.1 size=1048576 2024-09-12T00:17:58.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.056+0000 7f69cdea98c0 1 < canceled part key=_multipart_AQY7MM3OX3GW.2~GSWNCFEPUAA1.2 size=361112 2024-09-12T00:17:58.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.060+0000 7f69cdea98c0 1 < canceled multipart upload key=AQY7MM3OX3GW upload=GSWNCFEPUAA1 tag=5CJM4WB9XV5J type=write size=3506840 2024-09-12T00:17:58.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.064+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=FJOGEP9MOL3W type=del size=1694836 2024-09-12T00:17:58.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.072+0000 7f69cdea98c0 1 < suggested update operation key=HSQZYI0SNZP1 tag=8NNNN6Q9M3UT type=write size=310689 2024-09-12T00:17:58.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.080+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~NP8ZMNO8TFGP.0 size=1048576 2024-09-12T00:17:58.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.080+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~NP8ZMNO8TFGP.1 size=1048576 2024-09-12T00:17:58.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.084+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~NP8ZMNO8TFGP.2 size=146968 2024-09-12T00:17:58.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.084+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=NP8ZMNO8TFGP tag=RY9CONF3JQDL type=write size=3292696 2024-09-12T00:17:58.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.088+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~N958O918LDL8.0 size=1048576 2024-09-12T00:17:58.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.092+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~N958O918LDL8.1 size=1048576 2024-09-12T00:17:58.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.092+0000 7f69cdea98c0 1 < canceled part key=_multipart_IXB6WLN5M81C.2~N958O918LDL8.2 size=851618 2024-09-12T00:17:58.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.096+0000 7f69cdea98c0 1 < canceled multipart upload key=IXB6WLN5M81C upload=N958O918LDL8 tag=EDLIEONB4366 type=write size=3997346 2024-09-12T00:17:58.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.100+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=49B5T4416I1H type=del size=722003 2024-09-12T00:17:58.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.104+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=R2GGO5BAHA11 type=del 2024-09-12T00:17:58.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.108+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=V45P3QFWHEAB type=write size=563580 2024-09-12T00:17:58.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.112+0000 7f69cdea98c0 1 < completed write operation key=Q0L8J0BYRFDQ tag=EMIJTV2I3W9F type=write size=1003141 2024-09-12T00:17:58.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.116+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=CW8HV3YP2649 type=del size=4049900 2024-09-12T00:17:58.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.120+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~DLU7XMVHPOGB.0 size=635637 2024-09-12T00:17:58.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.124+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=DLU7XMVHPOGB tag=P4LPG0RPVCFJ type=write size=1684213 2024-09-12T00:17:58.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.128+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=8RYXNGD03GHD type=del size=1434041 2024-09-12T00:17:58.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.136+0000 7f69cdea98c0 1 < suggested update operation key=RDGRKQQH4B8C tag=ZJZ2OIZ7K759 type=del size=520255 2024-09-12T00:17:58.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~WRVH5REDWSZ1.0 size=1048576 2024-09-12T00:17:58.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.148+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~WRVH5REDWSZ1.1 size=1048576 2024-09-12T00:17:58.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.148+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~WRVH5REDWSZ1.2 size=842404 2024-09-12T00:17:58.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.148+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=WRVH5REDWSZ1 tag=G1J0X45VX5XV type=write size=3988132 2024-09-12T00:17:58.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.152+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=17NU0SK6KTBN type=del 2024-09-12T00:17:58.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~ZBY6Q37FCI7H.0 size=1048576 2024-09-12T00:17:58.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.164+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~ZBY6Q37FCI7H.1 size=1048576 2024-09-12T00:17:58.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.164+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~ZBY6Q37FCI7H.2 size=775841 2024-09-12T00:17:58.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.164+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=ZBY6Q37FCI7H tag=G6DN5R7I13O1 type=write size=3921569 2024-09-12T00:17:58.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.168+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=PUKTBUMZOP1W type=del 2024-09-12T00:17:58.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.176+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~57LKU19YQ3TT.0 size=1048576 2024-09-12T00:17:58.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.176+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~57LKU19YQ3TT.1 size=1048576 2024-09-12T00:17:58.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.180+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~57LKU19YQ3TT.2 size=712744 2024-09-12T00:17:58.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.180+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=57LKU19YQ3TT tag=66G8JVXPI1NL type=write size=3858472 2024-09-12T00:17:58.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.180+0000 7f69cdea98c0 1 < canceled part key=_multipart_T9OJXTZNRQJB.2~01BWN1A51JE1.0 size=1048576 2024-09-12T00:17:58.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.180+0000 7f69cdea98c0 1 < canceled part key=_multipart_T9OJXTZNRQJB.2~01BWN1A51JE1.1 size=1048576 2024-09-12T00:17:58.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.184+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~01BWN1A51JE1.2 size=168235 2024-09-12T00:17:58.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.188+0000 7f69cdea98c0 1 < canceled multipart upload key=T9OJXTZNRQJB upload=01BWN1A51JE1 tag=CUXB9LW5G0EA type=write size=3313963 2024-09-12T00:17:58.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.196+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~BL41F8U6H2AF.0 size=1048576 2024-09-12T00:17:58.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.200+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~BL41F8U6H2AF.1 size=1048576 2024-09-12T00:17:58.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.204+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~BL41F8U6H2AF.2 size=1003777 2024-09-12T00:17:58.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.204+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=BL41F8U6H2AF tag=Q11AZ4XRTCUO type=write size=4149505 2024-09-12T00:17:58.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.204+0000 7f69cdea98c0 1 < canceled part key=_multipart_K0HNNMX7CDGC.2~FYFV6GFXDL34.0 size=1048576 2024-09-12T00:17:58.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.208+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~FYFV6GFXDL34.1 size=538560 2024-09-12T00:17:58.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.212+0000 7f69cdea98c0 1 < canceled multipart upload key=K0HNNMX7CDGC upload=FYFV6GFXDL34 tag=XBRKP3YX9550 type=write size=2635712 2024-09-12T00:17:58.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.216+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=I76HP00VTZIR type=write size=598500 2024-09-12T00:17:58.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.220+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=ETA7EGAOKTZR type=del 2024-09-12T00:17:58.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.224+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=1S339Y9BH70A type=del size=2590454 2024-09-12T00:17:58.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.228+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~T8ML9FOGPX2Z.0 size=640504 2024-09-12T00:17:58.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.232+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=T8ML9FOGPX2Z tag=1BTLEPH995HO type=write size=1689080 2024-09-12T00:17:58.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~VTCPKQSG9KGE.0 size=518745 2024-09-12T00:17:58.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.240+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=VTCPKQSG9KGE tag=3USU3ZONANYU type=write size=1567321 2024-09-12T00:17:58.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.244+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~FB0AHXPL2FP0.0 size=656446 2024-09-12T00:17:58.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.248+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=FB0AHXPL2FP0 tag=GT9S557FL4PJ type=write size=1705022 2024-09-12T00:17:58.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.252+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=9T8LHM2ASAB5 type=del size=2297580 2024-09-12T00:17:58.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.256+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~6CMNIH43RNSE.0 size=1048576 2024-09-12T00:17:58.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.260+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~6CMNIH43RNSE.1 size=1048576 2024-09-12T00:17:58.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.264+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~6CMNIH43RNSE.2 size=541963 2024-09-12T00:17:58.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.268+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=6CMNIH43RNSE tag=2MB9TSBO8KKQ type=write size=3687691 2024-09-12T00:17:58.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.276+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=OJDNA0EPPLLF type=write size=288513 2024-09-12T00:17:58.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.280+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=DQ3SURR3ZYKS type=del 2024-09-12T00:17:58.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.284+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=PLUIV1COPV22 type=write size=261056 2024-09-12T00:17:58.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.288+0000 7f69cdea98c0 1 < canceled operation key=2YYP9NOUAJD0 tag=FJOGEP9MOL3W type=del size=1694836 2024-09-12T00:17:58.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.292+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=GUOTR6SAPDRQ type=del size=3076963 2024-09-12T00:17:58.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.296+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~NP8ZMNO8TFGP.0 size=1048576 2024-09-12T00:17:58.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.300+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~NP8ZMNO8TFGP.1 size=1048576 2024-09-12T00:17:58.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.300+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~NP8ZMNO8TFGP.2 size=146968 2024-09-12T00:17:58.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.308+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=NP8ZMNO8TFGP tag=RY9CONF3JQDL type=write size=3292696 2024-09-12T00:17:58.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.312+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=4VX0PZBWT9RX type=del size=3810634 2024-09-12T00:17:58.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.316+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=49B5T4416I1H type=del 2024-09-12T00:17:58.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.320+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=NB4NYS2UZZQE type=del size=1230833 2024-09-12T00:17:58.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.324+0000 7f69cdea98c0 1 < completed write operation key=0EALARW4O3OB tag=V45P3QFWHEAB type=write size=563580 2024-09-12T00:17:58.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.328+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=P34JTBXIN0NV type=del size=837024 2024-09-12T00:17:58.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.332+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=CW8HV3YP2649 type=del 2024-09-12T00:17:58.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.336+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=8B7ISF0VQ3BL type=del size=543413 2024-09-12T00:17:58.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.344+0000 7f69cdea98c0 1 < suggested remove operation key=Z6MH459BTZ6K tag=8RYXNGD03GHD type=del 2024-09-12T00:17:58.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.348+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=0QF80AMBVUFN type=del size=4171141 2024-09-12T00:17:58.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.348+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~WRVH5REDWSZ1.0 size=1048576 2024-09-12T00:17:58.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.352+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~WRVH5REDWSZ1.1 size=1048576 2024-09-12T00:17:58.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.356+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~WRVH5REDWSZ1.2 size=842404 2024-09-12T00:17:58.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.360+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=WRVH5REDWSZ1 tag=G1J0X45VX5XV type=write size=3988132 2024-09-12T00:17:58.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.368+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=NJ5USDMAJLN3 type=del size=660718 2024-09-12T00:17:58.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.368+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~ZBY6Q37FCI7H.0 size=1048576 2024-09-12T00:17:58.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.372+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~ZBY6Q37FCI7H.1 size=1048576 2024-09-12T00:17:58.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.372+0000 7f69cdea98c0 1 < canceled part key=_multipart_K0HNNMX7CDGC.2~ZBY6Q37FCI7H.2 size=775841 2024-09-12T00:17:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.380+0000 7f69cdea98c0 1 < canceled multipart upload key=K0HNNMX7CDGC upload=ZBY6Q37FCI7H tag=G6DN5R7I13O1 type=write size=3921569 2024-09-12T00:17:58.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.388+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~SWU94USW4SOH.0 size=536137 2024-09-12T00:17:58.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.388+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=SWU94USW4SOH tag=MJL2PPMJ4H19 type=write size=1584713 2024-09-12T00:17:58.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.392+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~57LKU19YQ3TT.0 size=1048576 2024-09-12T00:17:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.392+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~57LKU19YQ3TT.1 size=1048576 2024-09-12T00:17:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.392+0000 7f69cdea98c0 1 < canceled part key=_multipart_SCFIVX3IHERR.2~57LKU19YQ3TT.2 size=712744 2024-09-12T00:17:58.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.400+0000 7f69cdea98c0 1 < canceled multipart upload key=SCFIVX3IHERR upload=57LKU19YQ3TT tag=66G8JVXPI1NL type=write size=3858472 2024-09-12T00:17:58.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.404+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=T5M51FEGJ5P4 type=del size=1942794 2024-09-12T00:17:58.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.408+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~BL41F8U6H2AF.0 size=1048576 2024-09-12T00:17:58.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.412+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~BL41F8U6H2AF.1 size=1048576 2024-09-12T00:17:58.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.412+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~BL41F8U6H2AF.2 size=1003777 2024-09-12T00:17:58.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.420+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=BL41F8U6H2AF tag=Q11AZ4XRTCUO type=write size=4149505 2024-09-12T00:17:58.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.428+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~DBZRRAZFT5X1.0 size=1048576 2024-09-12T00:17:58.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.428+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~DBZRRAZFT5X1.1 size=1031888 2024-09-12T00:17:58.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.428+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=DBZRRAZFT5X1 tag=D24D9DX657BZ type=write size=3129040 2024-09-12T00:17:58.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.432+0000 7f69cdea98c0 1 < completed write operation key=K0HNNMX7CDGC tag=I76HP00VTZIR type=write size=598500 2024-09-12T00:17:58.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.436+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=JGR8MK4A8XFN type=del size=1336234 2024-09-12T00:17:58.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.440+0000 7f69cdea98c0 -1 < failed to complete operation key=Z6MH459BTZ6K tag=1S339Y9BH70A type=del size=2590454: (22) Invalid argument 2024-09-12T00:17:58.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.448+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~SM290QBX9G02.0 size=1048576 2024-09-12T00:17:58.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~SM290QBX9G02.1 size=826645 2024-09-12T00:17:58.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.452+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=SM290QBX9G02 tag=GO9ZZGBYUURM type=write size=2923797 2024-09-12T00:17:58.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.452+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~VTCPKQSG9KGE.0 size=518745 2024-09-12T00:17:58.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.456+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=VTCPKQSG9KGE tag=3USU3ZONANYU type=write size=1567321 2024-09-12T00:17:58.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.464+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~E25B2TM5UP5E.0 size=640561 2024-09-12T00:17:58.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.464+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=E25B2TM5UP5E tag=5R7RQTW18TX9 type=write size=1689137 2024-09-12T00:17:58.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.468+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=9T8LHM2ASAB5 type=del 2024-09-12T00:17:58.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~1YP3ZRWEO98F.0 size=138004 2024-09-12T00:17:58.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.476+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=1YP3ZRWEO98F tag=GOW6H5KH7AZR type=write size=1186580 2024-09-12T00:17:58.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.480+0000 7f69cdea98c0 1 < completed write operation key=VYYY8MF0P3Q7 tag=OJDNA0EPPLLF type=write size=288513 2024-09-12T00:17:58.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.484+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~JW3F0VXPITAP.0 size=1048576 2024-09-12T00:17:58.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.488+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~JW3F0VXPITAP.1 size=1048576 2024-09-12T00:17:58.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.492+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~JW3F0VXPITAP.2 size=353055 2024-09-12T00:17:58.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.492+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=JW3F0VXPITAP tag=NSN7V7A6V9CM type=write size=3498783 2024-09-12T00:17:58.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.496+0000 7f69cdea98c0 1 < completed write operation key=2YYP9NOUAJD0 tag=PLUIV1COPV22 type=write size=261056 2024-09-12T00:17:58.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.500+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=V05U0JP7ET1E type=del size=3217078 2024-09-12T00:17:58.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.504+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=GUOTR6SAPDRQ type=del 2024-09-12T00:17:58.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.508+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~XS184PFKK9JS.0 size=781151 2024-09-12T00:17:58.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.508+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=XS184PFKK9JS tag=BGXOA2379N85 type=write size=1829727 2024-09-12T00:17:58.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.516+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=4VX0PZBWT9RX type=del 2024-09-12T00:17:58.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.520+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=9PQ7UP0G0GZ1 type=del size=2301526 2024-09-12T00:17:58.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.524+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=NB4NYS2UZZQE type=del 2024-09-12T00:17:58.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~LEODXJJ887RH.0 size=1048576 2024-09-12T00:17:58.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.532+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~LEODXJJ887RH.1 size=1048576 2024-09-12T00:17:58.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~LEODXJJ887RH.2 size=235844 2024-09-12T00:17:58.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.536+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=LEODXJJ887RH tag=QZZT912BO0C9 type=write size=3381572 2024-09-12T00:17:58.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.540+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=P34JTBXIN0NV type=del 2024-09-12T00:17:58.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.544+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~8GX89LB3Z84G.0 size=1048576 2024-09-12T00:17:58.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.548+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~8GX89LB3Z84G.1 size=1048576 2024-09-12T00:17:58.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~8GX89LB3Z84G.2 size=652816 2024-09-12T00:17:58.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.552+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=8GX89LB3Z84G tag=UCOV6KZ5DZF8 type=write size=3798544 2024-09-12T00:17:58.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.556+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=8B7ISF0VQ3BL type=del 2024-09-12T00:17:58.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.560+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=2ZR4MGWDZ7HO type=del size=3175062 2024-09-12T00:17:58.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.564+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=0QF80AMBVUFN type=del 2024-09-12T00:17:58.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.568+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~46MMZNZPLH8T.0 size=586653 2024-09-12T00:17:58.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.568+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=46MMZNZPLH8T tag=W36QK5WS9BZU type=write size=1635229 2024-09-12T00:17:58.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.572+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=NJ5USDMAJLN3 type=del 2024-09-12T00:17:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~2UJ5CQWDPJ3G.0 size=914290 2024-09-12T00:17:58.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.580+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=2UJ5CQWDPJ3G tag=ZSOB6Y7YH2T7 type=write size=1962866 2024-09-12T00:17:58.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.580+0000 7f69cdea98c0 1 < canceled part key=_multipart_2YYP9NOUAJD0.2~SWU94USW4SOH.0 size=536137 2024-09-12T00:17:58.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.588+0000 7f69cdea98c0 1 < canceled multipart upload key=2YYP9NOUAJD0 upload=SWU94USW4SOH tag=MJL2PPMJ4H19 type=write size=1584713 2024-09-12T00:17:58.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.592+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~W4F5BGCENSHI.0 size=1048576 2024-09-12T00:17:58.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~W4F5BGCENSHI.1 size=45382 2024-09-12T00:17:58.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.596+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=W4F5BGCENSHI tag=POQ91EUEM93I type=write size=2142534 2024-09-12T00:17:58.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.600+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=T5M51FEGJ5P4 type=del 2024-09-12T00:17:58.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.604+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=CWN2H35GW4CS type=write size=583270 2024-09-12T00:17:58.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.608+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~DBZRRAZFT5X1.0 size=1048576 2024-09-12T00:17:58.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.612+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~DBZRRAZFT5X1.1 size=1031888 2024-09-12T00:17:58.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.616+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=DBZRRAZFT5X1 tag=D24D9DX657BZ type=write size=3129040 2024-09-12T00:17:58.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.620+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=15GXPPVGZ6L6 type=del size=2796540 2024-09-12T00:17:58.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.632+0000 7f69cdea98c0 1 < suggested update operation key=Z6MH459BTZ6K tag=JGR8MK4A8XFN type=del size=1336234 2024-09-12T00:17:58.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.636+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=30LMD3F130WR type=del size=218203 2024-09-12T00:17:58.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.640+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~SM290QBX9G02.0 size=1048576 2024-09-12T00:17:58.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.644+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~SM290QBX9G02.1 size=826645 2024-09-12T00:17:58.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.652+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=SM290QBX9G02 tag=GO9ZZGBYUURM type=write size=2923797 2024-09-12T00:17:58.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~55S651A22RJ9.0 size=1048576 2024-09-12T00:17:58.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~55S651A22RJ9.1 size=390495 2024-09-12T00:17:58.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.660+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=55S651A22RJ9 tag=OTF71RYBYTX6 type=write size=2487647 2024-09-12T00:17:58.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.664+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~E25B2TM5UP5E.0 size=640561 2024-09-12T00:17:58.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.668+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=E25B2TM5UP5E tag=5R7RQTW18TX9 type=write size=1689137 2024-09-12T00:17:58.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.672+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=YYVGLTKRKKSS type=del size=2697732 2024-09-12T00:17:58.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.676+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~1YP3ZRWEO98F.0 size=138004 2024-09-12T00:17:58.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.684+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=1YP3ZRWEO98F tag=GOW6H5KH7AZR type=write size=1186580 2024-09-12T00:17:58.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.688+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=VAGSYMEU4F58 type=del size=1390235 2024-09-12T00:17:58.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.692+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~JW3F0VXPITAP.0 size=1048576 2024-09-12T00:17:58.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.692+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~JW3F0VXPITAP.1 size=1048576 2024-09-12T00:17:58.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.696+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~JW3F0VXPITAP.2 size=353055 2024-09-12T00:17:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.704+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=JW3F0VXPITAP tag=NSN7V7A6V9CM type=write size=3498783 2024-09-12T00:17:58.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.708+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=Q9W5WT9EQ5BX type=write size=94649 2024-09-12T00:17:58.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.712+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=V05U0JP7ET1E type=del 2024-09-12T00:17:58.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.720+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~NPJZ21VBTN1R.0 size=1048576 2024-09-12T00:17:58.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.724+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~NPJZ21VBTN1R.1 size=841975 2024-09-12T00:17:58.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.724+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=NPJZ21VBTN1R tag=UUOB46UC1KDE type=write size=2939127 2024-09-12T00:17:58.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.724+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~XS184PFKK9JS.0 size=781151 2024-09-12T00:17:58.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.732+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=XS184PFKK9JS tag=BGXOA2379N85 type=write size=1829727 2024-09-12T00:17:58.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~BIGHZH5C6KIO.0 size=1048576 2024-09-12T00:17:58.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~BIGHZH5C6KIO.1 size=1048576 2024-09-12T00:17:58.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.744+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~BIGHZH5C6KIO.2 size=868186 2024-09-12T00:17:58.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.744+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=BIGHZH5C6KIO tag=S26U7TCRBWC9 type=write size=4013914 2024-09-12T00:17:58.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.748+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=9PQ7UP0G0GZ1 type=del 2024-09-12T00:17:58.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.752+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=5ICPKR5KVQG6 type=del size=468078 2024-09-12T00:17:58.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.756+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~LEODXJJ887RH.0 size=1048576 2024-09-12T00:17:58.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.760+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~LEODXJJ887RH.1 size=1048576 2024-09-12T00:17:58.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.760+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~LEODXJJ887RH.2 size=235844 2024-09-12T00:17:58.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.768+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=LEODXJJ887RH tag=QZZT912BO0C9 type=write size=3381572 2024-09-12T00:17:58.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.776+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~3ZO1XCLF0N7B.0 size=896217 2024-09-12T00:17:58.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.776+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=3ZO1XCLF0N7B tag=IFRE6TV1LLX3 type=write size=1944793 2024-09-12T00:17:58.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.780+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~8GX89LB3Z84G.0 size=1048576 2024-09-12T00:17:58.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.780+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~8GX89LB3Z84G.1 size=1048576 2024-09-12T00:17:58.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.784+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~8GX89LB3Z84G.2 size=652816 2024-09-12T00:17:58.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.792+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=8GX89LB3Z84G tag=UCOV6KZ5DZF8 type=write size=3798544 2024-09-12T00:17:58.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.796+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=Y94TRNDKWS6B type=del size=3319345 2024-09-12T00:17:58.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.800+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=2ZR4MGWDZ7HO type=del 2024-09-12T00:17:58.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~Z30ECBAF3FBJ.0 size=1048576 2024-09-12T00:17:58.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.808+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~Z30ECBAF3FBJ.1 size=1048576 2024-09-12T00:17:58.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.812+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~Z30ECBAF3FBJ.2 size=339424 2024-09-12T00:17:58.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.812+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=Z30ECBAF3FBJ tag=0GXFVNCYUSOQ type=write size=3485152 2024-09-12T00:17:58.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.812+0000 7f69cdea98c0 1 < canceled part key=_multipart_2YYP9NOUAJD0.2~46MMZNZPLH8T.0 size=586653 2024-09-12T00:17:58.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.820+0000 7f69cdea98c0 1 < canceled multipart upload key=2YYP9NOUAJD0 upload=46MMZNZPLH8T tag=W36QK5WS9BZU type=write size=1635229 2024-09-12T00:17:58.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.824+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=4F6VOVZ7VV1J type=del size=825809 2024-09-12T00:17:58.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.828+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~2UJ5CQWDPJ3G.0 size=914290 2024-09-12T00:17:58.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.832+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=2UJ5CQWDPJ3G tag=ZSOB6Y7YH2T7 type=write size=1962866 2024-09-12T00:17:58.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~SXFDEWMI8MA4.0 size=1048576 2024-09-12T00:17:58.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~SXFDEWMI8MA4.1 size=1048576 2024-09-12T00:17:58.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~SXFDEWMI8MA4.2 size=638740 2024-09-12T00:17:58.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.848+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=SXFDEWMI8MA4 tag=KE5KI5S51Z43 type=write size=3784468 2024-09-12T00:17:58.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.852+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~W4F5BGCENSHI.0 size=1048576 2024-09-12T00:17:58.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.852+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~W4F5BGCENSHI.1 size=45382 2024-09-12T00:17:58.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.860+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=W4F5BGCENSHI tag=POQ91EUEM93I type=write size=2142534 2024-09-12T00:17:58.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~HMYZWA5HD1G3.0 size=1048576 2024-09-12T00:17:58.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~HMYZWA5HD1G3.1 size=1048576 2024-09-12T00:17:58.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~HMYZWA5HD1G3.2 size=714848 2024-09-12T00:17:58.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.876+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=HMYZWA5HD1G3 tag=K64BQ5YJ4DJM type=write size=3860576 2024-09-12T00:17:58.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.880+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=CWN2H35GW4CS type=write size=583270 2024-09-12T00:17:58.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.884+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=FMNHDGYARWZY type=del size=1041963 2024-09-12T00:17:58.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.888+0000 7f69cdea98c0 1 < canceled operation key=H91UXKWAJ3K8 tag=15GXPPVGZ6L6 type=del size=2796540 2024-09-12T00:17:58.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~P6JT36Q6ILNJ.0 size=1048576 2024-09-12T00:17:58.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~P6JT36Q6ILNJ.1 size=921631 2024-09-12T00:17:58.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.900+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=P6JT36Q6ILNJ tag=RWWNU9W2LWXW type=write size=3018783 2024-09-12T00:17:58.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.900+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=30LMD3F130WR type=del 2024-09-12T00:17:58.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.908+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=Y0R1UP3E6XKI type=del size=1967426 2024-09-12T00:17:58.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.908+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~55S651A22RJ9.0 size=1048576 2024-09-12T00:17:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.912+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~55S651A22RJ9.1 size=390495 2024-09-12T00:17:58.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.920+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=55S651A22RJ9 tag=OTF71RYBYTX6 type=write size=2487647 2024-09-12T00:17:58.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.924+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~90UZLKQ03MK1.0 size=1048576 2024-09-12T00:17:58.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.928+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~90UZLKQ03MK1.1 size=345329 2024-09-12T00:17:58.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.928+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=90UZLKQ03MK1 tag=SJRFKUGBW5X4 type=write size=2442481 2024-09-12T00:17:58.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.936+0000 7f69cdea98c0 1 < suggested update operation key=0HAUC4BDL9VR tag=YYVGLTKRKKSS type=del size=2697732 2024-09-12T00:17:58.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.936+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=2OJWY7DVS9UF type=del size=3709925 2024-09-12T00:17:58.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.940+0000 7f69cdea98c0 1 < canceled operation key=9K3HLTD6DMSC tag=VAGSYMEU4F58 type=del size=1390235 2024-09-12T00:17:58.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~H0H168F0QSWG.0 size=1048576 2024-09-12T00:17:58.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~H0H168F0QSWG.1 size=1048576 2024-09-12T00:17:58.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.952+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~H0H168F0QSWG.2 size=77851 2024-09-12T00:17:58.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.952+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=H0H168F0QSWG tag=HAXZRIAO5J82 type=write size=3223579 2024-09-12T00:17:58.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.956+0000 7f69cdea98c0 -1 < failed to complete operation key=0HAUC4BDL9VR tag=Q9W5WT9EQ5BX type=write size=94649: (22) Invalid argument 2024-09-12T00:17:58.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.960+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=17K7YVXM5WOA type=del size=3198427 2024-09-12T00:17:58.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.964+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~NPJZ21VBTN1R.0 size=1048576 2024-09-12T00:17:58.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.964+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~NPJZ21VBTN1R.1 size=841975 2024-09-12T00:17:58.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.972+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=NPJZ21VBTN1R tag=UUOB46UC1KDE type=write size=2939127 2024-09-12T00:17:58.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.976+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=OSWYO9QZB36D type=del size=2428545 2024-09-12T00:17:58.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.980+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~BIGHZH5C6KIO.0 size=1048576 2024-09-12T00:17:58.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.980+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~BIGHZH5C6KIO.1 size=1048576 2024-09-12T00:17:58.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.984+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~BIGHZH5C6KIO.2 size=868186 2024-09-12T00:17:58.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.988+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=BIGHZH5C6KIO tag=S26U7TCRBWC9 type=write size=4013914 2024-09-12T00:17:58.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:58.992+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=TOWRJR6QSROR type=del size=2668770 2024-09-12T00:17:58.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.000+0000 7f69cdea98c0 1 < suggested update operation key=7UFADFUXL28I tag=5ICPKR5KVQG6 type=del size=468078 2024-09-12T00:17:59.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.004+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=P1IC5MRY7RJC type=del size=2292946 2024-09-12T00:17:59.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.008+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~3ZO1XCLF0N7B.0 size=896217 2024-09-12T00:17:59.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.016+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=3ZO1XCLF0N7B tag=IFRE6TV1LLX3 type=write size=1944793 2024-09-12T00:17:59.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.016+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=4FHN0645K52B type=write size=538904 2024-09-12T00:17:59.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.024+0000 7f69cdea98c0 1 < suggested remove operation key=RDGRKQQH4B8C tag=Y94TRNDKWS6B type=del 2024-09-12T00:17:59.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.028+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~GV0CMEOSM9YV.0 size=1048576 2024-09-12T00:17:59.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.032+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~GV0CMEOSM9YV.1 size=1048576 2024-09-12T00:17:59.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.036+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~GV0CMEOSM9YV.2 size=953701 2024-09-12T00:17:59.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.036+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=GV0CMEOSM9YV tag=C3HXZRE6CVSW type=write size=4099429 2024-09-12T00:17:59.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.036+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~Z30ECBAF3FBJ.0 size=1048576 2024-09-12T00:17:59.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.040+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~Z30ECBAF3FBJ.1 size=1048576 2024-09-12T00:17:59.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.044+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~Z30ECBAF3FBJ.2 size=339424 2024-09-12T00:17:59.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.048+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=Z30ECBAF3FBJ tag=0GXFVNCYUSOQ type=write size=3485152 2024-09-12T00:17:59.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.052+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=NKENT7FACSZ6 type=del size=3630298 2024-09-12T00:17:59.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.056+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=4F6VOVZ7VV1J type=del 2024-09-12T00:17:59.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.060+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=CQZ6UHMGHUNY type=del size=2456105 2024-09-12T00:17:59.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.064+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~SXFDEWMI8MA4.0 size=1048576 2024-09-12T00:17:59.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.068+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~SXFDEWMI8MA4.1 size=1048576 2024-09-12T00:17:59.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.072+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~SXFDEWMI8MA4.2 size=638740 2024-09-12T00:17:59.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.076+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=SXFDEWMI8MA4 tag=KE5KI5S51Z43 type=write size=3784468 2024-09-12T00:17:59.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.080+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=E14RRHKHGO5S type=write size=378051 2024-09-12T00:17:59.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.084+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~HMYZWA5HD1G3.0 size=1048576 2024-09-12T00:17:59.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.088+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~HMYZWA5HD1G3.1 size=1048576 2024-09-12T00:17:59.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.088+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~HMYZWA5HD1G3.2 size=714848 2024-09-12T00:17:59.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.096+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=HMYZWA5HD1G3 tag=K64BQ5YJ4DJM type=write size=3860576 2024-09-12T00:17:59.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.100+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=M2P0M5GZD16D type=write size=202720 2024-09-12T00:17:59.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.104+0000 7f69cdea98c0 -1 < failed to complete operation key=0HAUC4BDL9VR tag=FMNHDGYARWZY type=del size=1041963: (22) Invalid argument 2024-09-12T00:17:59.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.108+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=7CH53V5LTRSG type=write size=92277 2024-09-12T00:17:59.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.108+0000 7f69cdea98c0 1 < canceled part key=_multipart_T9OJXTZNRQJB.2~P6JT36Q6ILNJ.0 size=1048576 2024-09-12T00:17:59.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.112+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~P6JT36Q6ILNJ.1 size=921631 2024-09-12T00:17:59.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.116+0000 7f69cdea98c0 1 < canceled multipart upload key=T9OJXTZNRQJB upload=P6JT36Q6ILNJ tag=RWWNU9W2LWXW type=write size=3018783 2024-09-12T00:17:59.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.120+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=Q0UWV0833ERT type=del size=1125751 2024-09-12T00:17:59.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.128+0000 7f69cdea98c0 1 < suggested update operation key=Q0L8J0BYRFDQ tag=Y0R1UP3E6XKI type=del size=1967426 2024-09-12T00:17:59.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~PX6M9DZ63M2C.0 size=1048576 2024-09-12T00:17:59.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~PX6M9DZ63M2C.1 size=1048576 2024-09-12T00:17:59.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~PX6M9DZ63M2C.2 size=224574 2024-09-12T00:17:59.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.144+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=PX6M9DZ63M2C tag=I470WJN07MRE type=write size=3370302 2024-09-12T00:17:59.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.148+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~90UZLKQ03MK1.0 size=1048576 2024-09-12T00:17:59.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.148+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~90UZLKQ03MK1.1 size=345329 2024-09-12T00:17:59.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.156+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=90UZLKQ03MK1 tag=SJRFKUGBW5X4 type=write size=2442481 2024-09-12T00:17:59.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.160+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=B6OMKHOABN1U type=del size=2618580 2024-09-12T00:17:59.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.164+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=2OJWY7DVS9UF type=del 2024-09-12T00:17:59.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~BQTG6LNBJDMJ.0 size=825063 2024-09-12T00:17:59.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.172+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=BQTG6LNBJDMJ tag=CZE0NN0GT9A8 type=write size=1873639 2024-09-12T00:17:59.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.176+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~H0H168F0QSWG.0 size=1048576 2024-09-12T00:17:59.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.180+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~H0H168F0QSWG.1 size=1048576 2024-09-12T00:17:59.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.180+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~H0H168F0QSWG.2 size=77851 2024-09-12T00:17:59.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.188+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=H0H168F0QSWG tag=HAXZRIAO5J82 type=write size=3223579 2024-09-12T00:17:59.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.192+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=OHVU876FVLF0 type=write size=372820 2024-09-12T00:17:59.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.196+0000 7f69cdea98c0 1 < canceled operation key=2X78JWLK876H tag=17K7YVXM5WOA type=del size=3198427 2024-09-12T00:17:59.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.200+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=PGCAVAPVJ8RU type=del size=3114276 2024-09-12T00:17:59.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.204+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=OSWYO9QZB36D type=del 2024-09-12T00:17:59.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.208+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=UWN11N91QQWP type=del size=1954831 2024-09-12T00:17:59.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.212+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=TOWRJR6QSROR type=del 2024-09-12T00:17:59.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.216+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=KL3QRLQWBVD0 type=del size=3765775 2024-09-12T00:17:59.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.220+0000 7f69cdea98c0 -1 < failed to complete operation key=RDGRKQQH4B8C tag=P1IC5MRY7RJC type=del size=2292946: (22) Invalid argument 2024-09-12T00:17:59.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~ODSQ65FDIG5D.0 size=1048576 2024-09-12T00:17:59.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~ODSQ65FDIG5D.1 size=474994 2024-09-12T00:17:59.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.228+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=ODSQ65FDIG5D tag=YFY5T6Q9AFYC type=write size=2572146 2024-09-12T00:17:59.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.236+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=4FHN0645K52B type=write size=538904 2024-09-12T00:17:59.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~X0BE6SBH3VY0.0 size=1048576 2024-09-12T00:17:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~X0BE6SBH3VY0.1 size=797216 2024-09-12T00:17:59.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.244+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=X0BE6SBH3VY0 tag=0343B1B92KRD type=write size=2894368 2024-09-12T00:17:59.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.248+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~GV0CMEOSM9YV.0 size=1048576 2024-09-12T00:17:59.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.252+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~GV0CMEOSM9YV.1 size=1048576 2024-09-12T00:17:59.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.256+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~GV0CMEOSM9YV.2 size=953701 2024-09-12T00:17:59.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.260+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=GV0CMEOSM9YV tag=C3HXZRE6CVSW type=write size=4099429 2024-09-12T00:17:59.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.264+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=4QJ475YFXJ2A type=del size=3328895 2024-09-12T00:17:59.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.272+0000 7f69cdea98c0 1 < suggested update operation key=2ENKC4QT2BFS tag=NKENT7FACSZ6 type=del size=3630298 2024-09-12T00:17:59.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.276+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=1OGZOB9OAYHK type=del size=3282489 2024-09-12T00:17:59.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.280+0000 7f69cdea98c0 -1 < failed to complete operation key=2ENKC4QT2BFS tag=CQZ6UHMGHUNY type=del size=2456105: (22) Invalid argument 2024-09-12T00:17:59.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.284+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=KISVZCG1J23U type=del size=2965476 2024-09-12T00:17:59.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.288+0000 7f69cdea98c0 1 < completed write operation key=4O5U4WX3N4SA tag=E14RRHKHGO5S type=write size=378051 2024-09-12T00:17:59.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.292+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=166XLW7CGA5F type=del size=1020820 2024-09-12T00:17:59.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.296+0000 7f69cdea98c0 1 < completed write operation key=VYYY8MF0P3Q7 tag=M2P0M5GZD16D type=write size=202720 2024-09-12T00:17:59.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.300+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=QB7Y525BV3EE type=del size=3699477 2024-09-12T00:17:59.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.308+0000 7f69cdea98c0 1 < suggested remove operation key=2YYP9NOUAJD0 tag=7CH53V5LTRSG type=write 2024-09-12T00:17:59.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~18170CJBMCYU.0 size=1048576 2024-09-12T00:17:59.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.320+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~18170CJBMCYU.1 size=642446 2024-09-12T00:17:59.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.320+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=18170CJBMCYU tag=8T55ENDWR0NX type=write size=2739598 2024-09-12T00:17:59.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.324+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=Q0UWV0833ERT type=del 2024-09-12T00:17:59.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.332+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~OABUFUOJGM6O.0 size=1048576 2024-09-12T00:17:59.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.336+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~OABUFUOJGM6O.1 size=826491 2024-09-12T00:17:59.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.336+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=OABUFUOJGM6O tag=41FTEH7ZAKM1 type=write size=2923643 2024-09-12T00:17:59.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.336+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~PX6M9DZ63M2C.0 size=1048576 2024-09-12T00:17:59.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.340+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~PX6M9DZ63M2C.1 size=1048576 2024-09-12T00:17:59.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.344+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~PX6M9DZ63M2C.2 size=224574 2024-09-12T00:17:59.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.348+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=PX6M9DZ63M2C tag=I470WJN07MRE type=write size=3370302 2024-09-12T00:17:59.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~AP4S70T8W3E6.0 size=125621 2024-09-12T00:17:59.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.356+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=AP4S70T8W3E6 tag=GJ4TXYVJAACU type=write size=1174197 2024-09-12T00:17:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.360+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=B6OMKHOABN1U type=del 2024-09-12T00:17:59.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.364+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=TQW4Y62Y2YPS type=del size=2567431 2024-09-12T00:17:59.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.368+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~BQTG6LNBJDMJ.0 size=825063 2024-09-12T00:17:59.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.376+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=BQTG6LNBJDMJ tag=CZE0NN0GT9A8 type=write size=1873639 2024-09-12T00:17:59.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.380+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~5HJCWS6OBL4J.0 size=1048576 2024-09-12T00:17:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~5HJCWS6OBL4J.1 size=178053 2024-09-12T00:17:59.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.384+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=5HJCWS6OBL4J tag=6CJB5JZGDWTH type=write size=2275205 2024-09-12T00:17:59.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.392+0000 7f69cdea98c0 1 < suggested update operation key=LRHZKCU22AIX tag=OHVU876FVLF0 type=write size=372820 2024-09-12T00:17:59.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.400+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~8PPVLD4QR7NB.0 size=1048576 2024-09-12T00:17:59.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.400+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~8PPVLD4QR7NB.1 size=255255 2024-09-12T00:17:59.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.400+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=8PPVLD4QR7NB tag=ORA9TH6M5KZ8 type=write size=2352407 2024-09-12T00:17:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.404+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=PGCAVAPVJ8RU type=del 2024-09-12T00:17:59.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.408+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=V6USCQNFJJ7O type=write size=231112 2024-09-12T00:17:59.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.420+0000 7f69cdea98c0 1 < suggested remove operation key=1CZXUEJLQ8FM tag=UWN11N91QQWP type=del 2024-09-12T00:17:59.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.424+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=WCP6ASL1GZB3 type=del size=1052385 2024-09-12T00:17:59.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.428+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=KL3QRLQWBVD0 type=del 2024-09-12T00:17:59.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~386PVR54OSIC.0 size=1048576 2024-09-12T00:17:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.436+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~386PVR54OSIC.1 size=1011516 2024-09-12T00:17:59.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.436+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=386PVR54OSIC tag=ZFO4FEIONA31 type=write size=3108668 2024-09-12T00:17:59.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.440+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~ODSQ65FDIG5D.0 size=1048576 2024-09-12T00:17:59.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.444+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~ODSQ65FDIG5D.1 size=474994 2024-09-12T00:17:59.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.448+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=ODSQ65FDIG5D tag=YFY5T6Q9AFYC type=write size=2572146 2024-09-12T00:17:59.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~U8EWLAJ9ERYW.0 size=1048576 2024-09-12T00:17:59.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~U8EWLAJ9ERYW.1 size=883636 2024-09-12T00:17:59.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.456+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=U8EWLAJ9ERYW tag=DJQYGFYANB6I type=write size=2980788 2024-09-12T00:17:59.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.460+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~X0BE6SBH3VY0.0 size=1048576 2024-09-12T00:17:59.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.464+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~X0BE6SBH3VY0.1 size=797216 2024-09-12T00:17:59.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.472+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=X0BE6SBH3VY0 tag=0343B1B92KRD type=write size=2894368 2024-09-12T00:17:59.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.476+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~UGT7DB4KJT16.0 size=1048576 2024-09-12T00:17:59.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.480+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~UGT7DB4KJT16.1 size=860811 2024-09-12T00:17:59.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.480+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=UGT7DB4KJT16 tag=0WOEF7YP9EYO type=write size=2957963 2024-09-12T00:17:59.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.484+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=4QJ475YFXJ2A type=del 2024-09-12T00:17:59.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.488+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=V3QCQI82E5MI type=del size=2251332 2024-09-12T00:17:59.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.492+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=1OGZOB9OAYHK type=del 2024-09-12T00:17:59.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.500+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~WHX9ZHPA2A3E.0 size=436019 2024-09-12T00:17:59.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.500+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=WHX9ZHPA2A3E tag=H7AZ91IZPXLS type=write size=1484595 2024-09-12T00:17:59.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.504+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=KISVZCG1J23U type=del 2024-09-12T00:17:59.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.508+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=BX1TJCW7PUHA type=del size=105568 2024-09-12T00:17:59.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.516+0000 7f69cdea98c0 1 < suggested update operation key=O5WBNND16BFN tag=166XLW7CGA5F type=del size=1020820 2024-09-12T00:17:59.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.520+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=JI4ZHT4NBQ9T type=write size=877545 2024-09-12T00:17:59.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.524+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=QB7Y525BV3EE type=del 2024-09-12T00:17:59.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.528+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=OJHJ6FMN00SY type=write size=671030 2024-09-12T00:17:59.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.532+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~18170CJBMCYU.0 size=1048576 2024-09-12T00:17:59.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.532+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~18170CJBMCYU.1 size=642446 2024-09-12T00:17:59.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.540+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=18170CJBMCYU tag=8T55ENDWR0NX type=write size=2739598 2024-09-12T00:17:59.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.544+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=57NL2XH9C3BY type=del size=3627026 2024-09-12T00:17:59.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.548+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~OABUFUOJGM6O.0 size=1048576 2024-09-12T00:17:59.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.552+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~OABUFUOJGM6O.1 size=826491 2024-09-12T00:17:59.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.560+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=OABUFUOJGM6O tag=41FTEH7ZAKM1 type=write size=2923643 2024-09-12T00:17:59.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.564+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~80ZOVF7V159V.0 size=1048576 2024-09-12T00:17:59.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.568+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~80ZOVF7V159V.1 size=1048576 2024-09-12T00:17:59.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.572+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~80ZOVF7V159V.2 size=513440 2024-09-12T00:17:59.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.572+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=80ZOVF7V159V tag=VFF4PSUTRPG2 type=write size=3659168 2024-09-12T00:17:59.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.572+0000 7f69cdea98c0 1 < canceled part key=_multipart_I23GNCI98JHU.2~AP4S70T8W3E6.0 size=125621 2024-09-12T00:17:59.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.580+0000 7f69cdea98c0 1 < canceled multipart upload key=I23GNCI98JHU upload=AP4S70T8W3E6 tag=GJ4TXYVJAACU type=write size=1174197 2024-09-12T00:17:59.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.580+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=KKQBXV1YWJXC type=del size=831774 2024-09-12T00:17:59.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.584+0000 7f69cdea98c0 -1 < failed to complete operation key=O5WBNND16BFN tag=TQW4Y62Y2YPS type=del size=2567431: (22) Invalid argument 2024-09-12T00:17:59.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.588+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=KF3MPTEE9NMC type=del size=2777406 2024-09-12T00:17:59.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.592+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~5HJCWS6OBL4J.0 size=1048576 2024-09-12T00:17:59.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.596+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~5HJCWS6OBL4J.1 size=178053 2024-09-12T00:17:59.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.604+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=5HJCWS6OBL4J tag=6CJB5JZGDWTH type=write size=2275205 2024-09-12T00:17:59.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.608+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~CI0TC2CTVVPD.0 size=1048576 2024-09-12T00:17:59.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.612+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~CI0TC2CTVVPD.1 size=801522 2024-09-12T00:17:59.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.612+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=CI0TC2CTVVPD tag=CUO6585BL38T type=write size=2898674 2024-09-12T00:17:59.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.616+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~8PPVLD4QR7NB.0 size=1048576 2024-09-12T00:17:59.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.616+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~8PPVLD4QR7NB.1 size=255255 2024-09-12T00:17:59.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.624+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=8PPVLD4QR7NB tag=ORA9TH6M5KZ8 type=write size=2352407 2024-09-12T00:17:59.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.628+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=TGPD5ZWOU3DW type=del size=2181711 2024-09-12T00:17:59.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.636+0000 7f69cdea98c0 1 < suggested remove operation key=O5WBNND16BFN tag=V6USCQNFJJ7O type=write 2024-09-12T00:17:59.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.640+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=SIQHU7DB4SNB type=del size=3453527 2024-09-12T00:17:59.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.644+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=WCP6ASL1GZB3 type=del 2024-09-12T00:17:59.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.648+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=CIT9BC19GQKI type=del size=2572656 2024-09-12T00:17:59.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.652+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~386PVR54OSIC.0 size=1048576 2024-09-12T00:17:59.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.656+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~386PVR54OSIC.1 size=1011516 2024-09-12T00:17:59.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.660+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=386PVR54OSIC tag=ZFO4FEIONA31 type=write size=3108668 2024-09-12T00:17:59.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.664+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=M4IBF9BQ933U type=del size=3332479 2024-09-12T00:17:59.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.668+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~U8EWLAJ9ERYW.0 size=1048576 2024-09-12T00:17:59.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.676+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~U8EWLAJ9ERYW.1 size=883636 2024-09-12T00:17:59.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.684+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=U8EWLAJ9ERYW tag=DJQYGFYANB6I type=write size=2980788 2024-09-12T00:17:59.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.688+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=HNJ21BY0OMVO type=write size=830243 2024-09-12T00:17:59.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.692+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~UGT7DB4KJT16.0 size=1048576 2024-09-12T00:17:59.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.696+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~UGT7DB4KJT16.1 size=860811 2024-09-12T00:17:59.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.704+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=UGT7DB4KJT16 tag=0WOEF7YP9EYO type=write size=2957963 2024-09-12T00:17:59.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.708+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=0OD8C4V39XTK type=del size=2105469 2024-09-12T00:17:59.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.712+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=V3QCQI82E5MI type=del 2024-09-12T00:17:59.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.716+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=B8O1TX7Z82OU type=del size=1827568 2024-09-12T00:17:59.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.720+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~WHX9ZHPA2A3E.0 size=436019 2024-09-12T00:17:59.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.728+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=WHX9ZHPA2A3E tag=H7AZ91IZPXLS type=write size=1484595 2024-09-12T00:17:59.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~DBEE0E28E7SF.0 size=1048576 2024-09-12T00:17:59.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~DBEE0E28E7SF.1 size=1048576 2024-09-12T00:17:59.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~DBEE0E28E7SF.2 size=612093 2024-09-12T00:17:59.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.740+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=DBEE0E28E7SF tag=1ETA67G2KVWK type=write size=3757821 2024-09-12T00:17:59.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.744+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=BX1TJCW7PUHA type=del 2024-09-12T00:17:59.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.748+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=D6HHRNP0P9RF type=del size=1043422 2024-09-12T00:17:59.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.752+0000 7f69cdea98c0 1 < completed write operation key=IXB6WLN5M81C tag=JI4ZHT4NBQ9T type=write size=877545 2024-09-12T00:17:59.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.760+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~8XKDHOF5MJ2A.0 size=1048576 2024-09-12T00:17:59.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.764+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~8XKDHOF5MJ2A.1 size=1048576 2024-09-12T00:17:59.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.768+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~8XKDHOF5MJ2A.2 size=997032 2024-09-12T00:17:59.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.768+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=8XKDHOF5MJ2A tag=ISZLA6X0J4DV type=write size=4142760 2024-09-12T00:17:59.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.772+0000 7f69cdea98c0 1 < canceled operation key=HSQZYI0SNZP1 tag=OJHJ6FMN00SY type=write size=671030 2024-09-12T00:17:59.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.776+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=3LMUGP3EKRL6 type=del size=823610 2024-09-12T00:17:59.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.780+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=57NL2XH9C3BY type=del 2024-09-12T00:17:59.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.784+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=NBLGE81F2V5R type=del size=2477325 2024-09-12T00:17:59.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.788+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~80ZOVF7V159V.0 size=1048576 2024-09-12T00:17:59.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.792+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~80ZOVF7V159V.1 size=1048576 2024-09-12T00:17:59.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.796+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~80ZOVF7V159V.2 size=513440 2024-09-12T00:17:59.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.800+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=80ZOVF7V159V tag=VFF4PSUTRPG2 type=write size=3659168 2024-09-12T00:17:59.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.808+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=AB8ORSS8Y4IJ type=del size=1122190 2024-09-12T00:17:59.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.812+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=KKQBXV1YWJXC type=del 2024-09-12T00:17:59.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.816+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=65NJEFCDXFZQ type=del size=1612103 2024-09-12T00:17:59.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.824+0000 7f69cdea98c0 1 < suggested remove operation key=I23GNCI98JHU tag=KF3MPTEE9NMC type=del 2024-09-12T00:17:59.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.828+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=Y8I4U45FTRIG type=del size=2965290 2024-09-12T00:17:59.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.828+0000 7f69cdea98c0 1 < canceled part key=_multipart_IXWX7S5NWJS3.2~CI0TC2CTVVPD.0 size=1048576 2024-09-12T00:17:59.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.832+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~CI0TC2CTVVPD.1 size=801522 2024-09-12T00:17:59.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.836+0000 7f69cdea98c0 1 < canceled multipart upload key=IXWX7S5NWJS3 upload=CI0TC2CTVVPD tag=CUO6585BL38T type=write size=2898674 2024-09-12T00:17:59.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~9WCPCVCS8VXD.0 size=1048576 2024-09-12T00:17:59.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.848+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~9WCPCVCS8VXD.1 size=194870 2024-09-12T00:17:59.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.848+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=9WCPCVCS8VXD tag=JVM3MR1VP3JR type=write size=2292022 2024-09-12T00:17:59.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.848+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=TGPD5ZWOU3DW type=del 2024-09-12T00:17:59.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.856+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~LQRHI7DZVDGV.0 size=1048576 2024-09-12T00:17:59.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.856+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~LQRHI7DZVDGV.1 size=1048576 2024-09-12T00:17:59.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~LQRHI7DZVDGV.2 size=119217 2024-09-12T00:17:59.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.860+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=LQRHI7DZVDGV tag=IOTHVRX6USFJ type=write size=3264945 2024-09-12T00:17:59.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.864+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=SIQHU7DB4SNB type=del 2024-09-12T00:17:59.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.868+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=HA917RYIIOOF type=del size=4115233 2024-09-12T00:17:59.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.868+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=CIT9BC19GQKI type=del 2024-09-12T00:17:59.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~UGGZNANIGTP3.0 size=518338 2024-09-12T00:17:59.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.876+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=UGGZNANIGTP3 tag=Z7KK7K8S6EO7 type=write size=1566914 2024-09-12T00:17:59.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.880+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=M4IBF9BQ933U type=del 2024-09-12T00:17:59.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~D7FX0TK7KHX8.0 size=738554 2024-09-12T00:17:59.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.884+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=D7FX0TK7KHX8 tag=O01SSEH5ZD6Z type=write size=1787130 2024-09-12T00:17:59.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.892+0000 7f69cdea98c0 1 < suggested remove operation key=Q0L8J0BYRFDQ tag=HNJ21BY0OMVO type=write 2024-09-12T00:17:59.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.900+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~BWH47G2RLP1D.0 size=296308 2024-09-12T00:17:59.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.900+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=BWH47G2RLP1D tag=KY7O0L59LM6R type=write size=1344884 2024-09-12T00:17:59.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.904+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=0OD8C4V39XTK type=del 2024-09-12T00:17:59.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.908+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~N5RI217CPF6K.0 size=1048576 2024-09-12T00:17:59.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.912+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~N5RI217CPF6K.1 size=1048576 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.916+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~N5RI217CPF6K.2 size=267160 2024-09-12T00:17:59.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.916+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=N5RI217CPF6K tag=OLM1LG241PNJ type=write size=3412888 2024-09-12T00:17:59.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.920+0000 7f69cdea98c0 1 < canceled operation key=0EALARW4O3OB tag=B8O1TX7Z82OU type=del size=1827568 2024-09-12T00:17:59.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.924+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=E4JN18DDIUOC type=del size=797921 2024-09-12T00:17:59.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.928+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~DBEE0E28E7SF.0 size=1048576 2024-09-12T00:17:59.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.928+0000 7f69cdea98c0 1 < canceled part key=_multipart_VYYY8MF0P3Q7.2~DBEE0E28E7SF.1 size=1048576 2024-09-12T00:17:59.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.928+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~DBEE0E28E7SF.2 size=612093 2024-09-12T00:17:59.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.936+0000 7f69cdea98c0 1 < canceled multipart upload key=VYYY8MF0P3Q7 upload=DBEE0E28E7SF tag=1ETA67G2KVWK type=write size=3757821 2024-09-12T00:17:59.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.940+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=IXE9USHP2M8K type=del size=703626 2024-09-12T00:17:59.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.944+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=D6HHRNP0P9RF type=del 2024-09-12T00:17:59.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.948+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=2F9CI1820QEG type=del size=2630350 2024-09-12T00:17:59.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.952+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~8XKDHOF5MJ2A.0 size=1048576 2024-09-12T00:17:59.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.952+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~8XKDHOF5MJ2A.1 size=1048576 2024-09-12T00:17:59.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.952+0000 7f69cdea98c0 1 < canceled part key=_multipart_0HAUC4BDL9VR.2~8XKDHOF5MJ2A.2 size=997032 2024-09-12T00:17:59.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.960+0000 7f69cdea98c0 1 < canceled multipart upload key=0HAUC4BDL9VR upload=8XKDHOF5MJ2A tag=ISZLA6X0J4DV type=write size=4142760 2024-09-12T00:17:59.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.964+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=HAQWBHUF7XH2 type=del size=3080945 2024-09-12T00:17:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.968+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=3LMUGP3EKRL6 type=del 2024-09-12T00:17:59.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.972+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=70ROR8CLMU8S type=write size=175748 2024-09-12T00:17:59.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.976+0000 7f69cdea98c0 -1 < failed to complete operation key=Q0L8J0BYRFDQ tag=NBLGE81F2V5R type=del size=2477325: (22) Invalid argument 2024-09-12T00:17:59.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~J264Z67HB3U0.0 size=1048576 2024-09-12T00:17:59.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~J264Z67HB3U0.1 size=898291 2024-09-12T00:17:59.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.984+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=J264Z67HB3U0 tag=XCO37L71B3O6 type=write size=2995443 2024-09-12T00:17:59.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.988+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=AB8ORSS8Y4IJ type=del 2024-09-12T00:17:59.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.992+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=SOGG71HZQC6D type=del size=1354729 2024-09-12T00:17:59.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:17:59.996+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=65NJEFCDXFZQ type=del 2024-09-12T00:17:59.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.000+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=QKD2ZXL89FD1 type=del size=4020176 2024-09-12T00:18:00.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.004+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=Y8I4U45FTRIG type=del 2024-09-12T00:18:00.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.008+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=GOC9Z5PGBH00 type=del size=628337 2024-09-12T00:18:00.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.012+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~9WCPCVCS8VXD.0 size=1048576 2024-09-12T00:18:00.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.016+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~9WCPCVCS8VXD.1 size=194870 2024-09-12T00:18:00.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.020+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=9WCPCVCS8VXD tag=JVM3MR1VP3JR type=write size=2292022 2024-09-12T00:18:00.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.024+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=M1CWHU1YJJM9 type=write size=13798 2024-09-12T00:18:00.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.028+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~LQRHI7DZVDGV.0 size=1048576 2024-09-12T00:18:00.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.028+0000 7f69cdea98c0 1 < canceled part key=_multipart_2YYP9NOUAJD0.2~LQRHI7DZVDGV.1 size=1048576 2024-09-12T00:18:00.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.032+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~LQRHI7DZVDGV.2 size=119217 2024-09-12T00:18:00.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.040+0000 7f69cdea98c0 1 < canceled multipart upload key=2YYP9NOUAJD0 upload=LQRHI7DZVDGV tag=IOTHVRX6USFJ type=write size=3264945 2024-09-12T00:18:00.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~1MYA2UV9TJQ7.0 size=1048576 2024-09-12T00:18:00.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~1MYA2UV9TJQ7.1 size=268442 2024-09-12T00:18:00.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.048+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=1MYA2UV9TJQ7 tag=3WM5L1MNS9AU type=write size=2365594 2024-09-12T00:18:00.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.052+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=HA917RYIIOOF type=del 2024-09-12T00:18:00.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.060+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~3ZH83FH9ULKB.0 size=1048576 2024-09-12T00:18:00.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.064+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~3ZH83FH9ULKB.1 size=1048576 2024-09-12T00:18:00.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.064+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~3ZH83FH9ULKB.2 size=103435 2024-09-12T00:18:00.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.064+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=3ZH83FH9ULKB tag=YT9Z3VNFGHY1 type=write size=3249163 2024-09-12T00:18:00.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.068+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~UGGZNANIGTP3.0 size=518338 2024-09-12T00:18:00.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.072+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=UGGZNANIGTP3 tag=Z7KK7K8S6EO7 type=write size=1566914 2024-09-12T00:18:00.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.076+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=6HL1338I2F4V type=del size=2897553 2024-09-12T00:18:00.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.080+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~D7FX0TK7KHX8.0 size=738554 2024-09-12T00:18:00.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.088+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=D7FX0TK7KHX8 tag=O01SSEH5ZD6Z type=write size=1787130 2024-09-12T00:18:00.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.088+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=9UBUVI0WZJ90 type=del size=742123 2024-09-12T00:18:00.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.092+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~BWH47G2RLP1D.0 size=296308 2024-09-12T00:18:00.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.096+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=BWH47G2RLP1D tag=KY7O0L59LM6R type=write size=1344884 2024-09-12T00:18:00.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.100+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=JF2Y12BRLHRL type=del size=124545 2024-09-12T00:18:00.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.100+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~N5RI217CPF6K.0 size=1048576 2024-09-12T00:18:00.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.104+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~N5RI217CPF6K.1 size=1048576 2024-09-12T00:18:00.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.104+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~N5RI217CPF6K.2 size=267160 2024-09-12T00:18:00.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.108+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=N5RI217CPF6K tag=OLM1LG241PNJ type=write size=3412888 2024-09-12T00:18:00.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.112+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=V36QU80SQG6Y type=del size=1861744 2024-09-12T00:18:00.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.116+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=E4JN18DDIUOC type=del 2024-09-12T00:18:00.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~H9J6Y9ROC6AY.0 size=1048576 2024-09-12T00:18:00.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~H9J6Y9ROC6AY.1 size=533738 2024-09-12T00:18:00.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.120+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=H9J6Y9ROC6AY tag=FR0KIAN95NQR type=write size=2630890 2024-09-12T00:18:00.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.124+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=IXE9USHP2M8K type=del 2024-09-12T00:18:00.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.128+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=A4FPU7L532IS type=del size=2792124 2024-09-12T00:18:00.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.128+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=2F9CI1820QEG type=del 2024-09-12T00:18:00.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~J6PRGGT8D2KH.0 size=144954 2024-09-12T00:18:00.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.132+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=J6PRGGT8D2KH tag=2KNR3SEF2I3X type=write size=1193530 2024-09-12T00:18:00.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.136+0000 7f69cdea98c0 1 < suggested remove operation key=SP2KVAO82MQ0 tag=HAQWBHUF7XH2 type=del 2024-09-12T00:18:00.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~RA42LLO3W27O.0 size=1048576 2024-09-12T00:18:00.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~RA42LLO3W27O.1 size=754812 2024-09-12T00:18:00.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.144+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=RA42LLO3W27O tag=R7QPYACS6CO8 type=write size=2851964 2024-09-12T00:18:00.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.148+0000 7f69cdea98c0 1 < completed write operation key=2X78JWLK876H tag=70ROR8CLMU8S type=write size=175748 2024-09-12T00:18:00.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.152+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=O4KE4ULJFVCN type=del size=3650727 2024-09-12T00:18:00.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.152+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~J264Z67HB3U0.0 size=1048576 2024-09-12T00:18:00.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.156+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~J264Z67HB3U0.1 size=898291 2024-09-12T00:18:00.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.160+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=J264Z67HB3U0 tag=XCO37L71B3O6 type=write size=2995443 2024-09-12T00:18:00.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.164+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=GAIYABFNJG6F type=del size=1263245 2024-09-12T00:18:00.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.164+0000 7f69cdea98c0 1 < canceled operation key=UTZNJQJQMXJS tag=SOGG71HZQC6D type=del size=1354729 2024-09-12T00:18:00.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.168+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=ETAAD9Z6215R type=del size=3611760 2024-09-12T00:18:00.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.172+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=QKD2ZXL89FD1 type=del 2024-09-12T00:18:00.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.176+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=5UUNMK1RW3XW type=del size=2489614 2024-09-12T00:18:00.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.176+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=GOC9Z5PGBH00 type=del 2024-09-12T00:18:00.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.184+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~3OBT3PR5GF34.0 size=1048576 2024-09-12T00:18:00.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.184+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~3OBT3PR5GF34.1 size=1041870 2024-09-12T00:18:00.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.184+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=3OBT3PR5GF34 tag=MRIDUY6W9QBL type=write size=3139022 2024-09-12T00:18:00.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.188+0000 7f69cdea98c0 1 < completed write operation key=SCFIVX3IHERR tag=M1CWHU1YJJM9 type=write size=13798 2024-09-12T00:18:00.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.192+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=720C48MDMJGD type=del size=3578243 2024-09-12T00:18:00.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.196+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~1MYA2UV9TJQ7.0 size=1048576 2024-09-12T00:18:00.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.196+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~1MYA2UV9TJQ7.1 size=268442 2024-09-12T00:18:00.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.200+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=1MYA2UV9TJQ7 tag=3WM5L1MNS9AU type=write size=2365594 2024-09-12T00:18:00.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~YPXUS7Z0H0OF.0 size=1048576 2024-09-12T00:18:00.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~YPXUS7Z0H0OF.1 size=1048576 2024-09-12T00:18:00.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~YPXUS7Z0H0OF.2 size=156141 2024-09-12T00:18:00.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.212+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=YPXUS7Z0H0OF tag=GFXZ08L9682D type=write size=3301869 2024-09-12T00:18:00.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.212+0000 7f69cdea98c0 1 < canceled part key=_multipart_H91UXKWAJ3K8.2~3ZH83FH9ULKB.0 size=1048576 2024-09-12T00:18:00.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.216+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~3ZH83FH9ULKB.1 size=1048576 2024-09-12T00:18:00.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.216+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~3ZH83FH9ULKB.2 size=103435 2024-09-12T00:18:00.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.224+0000 7f69cdea98c0 1 < canceled multipart upload key=H91UXKWAJ3K8 upload=3ZH83FH9ULKB tag=YT9Z3VNFGHY1 type=write size=3249163 2024-09-12T00:18:00.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.228+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=N5VGUEMMSO9P type=del size=2451614 2024-09-12T00:18:00.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.228+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=6HL1338I2F4V type=del 2024-09-12T00:18:00.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.236+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~WNO7S7BQCKW0.0 size=1048576 2024-09-12T00:18:00.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~WNO7S7BQCKW0.1 size=1048576 2024-09-12T00:18:00.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~WNO7S7BQCKW0.2 size=757119 2024-09-12T00:18:00.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.240+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=WNO7S7BQCKW0 tag=LNWL2XTXK61N type=write size=3902847 2024-09-12T00:18:00.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.244+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=9UBUVI0WZJ90 type=del 2024-09-12T00:18:00.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~KMACVF47V3UN.0 size=1048576 2024-09-12T00:18:00.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.252+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~KMACVF47V3UN.1 size=1048576 2024-09-12T00:18:00.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.256+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~KMACVF47V3UN.2 size=521647 2024-09-12T00:18:00.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.256+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=KMACVF47V3UN tag=RONEBVT3VDUT type=write size=3667375 2024-09-12T00:18:00.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.260+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=JF2Y12BRLHRL type=del 2024-09-12T00:18:00.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.260+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=5FVK1COJOAJR type=del size=3543303 2024-09-12T00:18:00.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.264+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=V36QU80SQG6Y type=del 2024-09-12T00:18:00.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~18NIZCGVSFOM.0 size=1048576 2024-09-12T00:18:00.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~18NIZCGVSFOM.1 size=851654 2024-09-12T00:18:00.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.276+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=18NIZCGVSFOM tag=ZOJX4FNQ8DFU type=write size=2948806 2024-09-12T00:18:00.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.276+0000 7f69cdea98c0 1 < canceled part key=_multipart_1CZXUEJLQ8FM.2~H9J6Y9ROC6AY.0 size=1048576 2024-09-12T00:18:00.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.280+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~H9J6Y9ROC6AY.1 size=533738 2024-09-12T00:18:00.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.284+0000 7f69cdea98c0 1 < canceled multipart upload key=1CZXUEJLQ8FM upload=H9J6Y9ROC6AY tag=FR0KIAN95NQR type=write size=2630890 2024-09-12T00:18:00.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.288+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=8IRDB2P4YFH0 type=del size=3739328 2024-09-12T00:18:00.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.292+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=A4FPU7L532IS type=del 2024-09-12T00:18:00.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.296+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=DF0L7V5M0OAX type=del size=86642 2024-09-12T00:18:00.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.300+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~J6PRGGT8D2KH.0 size=144954 2024-09-12T00:18:00.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.304+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=J6PRGGT8D2KH tag=2KNR3SEF2I3X type=write size=1193530 2024-09-12T00:18:00.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.308+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=UOXT26CRGI8D type=del size=602048 2024-09-12T00:18:00.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.312+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~RA42LLO3W27O.0 size=1048576 2024-09-12T00:18:00.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.316+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~RA42LLO3W27O.1 size=754812 2024-09-12T00:18:00.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.324+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=RA42LLO3W27O tag=R7QPYACS6CO8 type=write size=2851964 2024-09-12T00:18:00.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.328+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=1JQJ0NVDEPVD type=del size=746154 2024-09-12T00:18:00.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.332+0000 7f69cdea98c0 1 < canceled operation key=Q0L8J0BYRFDQ tag=O4KE4ULJFVCN type=del size=3650727 2024-09-12T00:18:00.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.336+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=6DYY5Y320998 type=del size=373927 2024-09-12T00:18:00.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.344+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=GAIYABFNJG6F type=del 2024-09-12T00:18:00.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.348+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=L0Q26JV6TUWY type=del size=664956 2024-09-12T00:18:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.352+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=ETAAD9Z6215R type=del 2024-09-12T00:18:00.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~2U36STPVEFIC.0 size=675500 2024-09-12T00:18:00.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.356+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=2U36STPVEFIC tag=HEDFPBDMK9HM type=write size=1724076 2024-09-12T00:18:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.360+0000 7f69cdea98c0 1 < canceled operation key=SP2KVAO82MQ0 tag=5UUNMK1RW3XW type=del size=2489614 2024-09-12T00:18:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.364+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=B4BXBE0KRF2E type=del size=4140916 2024-09-12T00:18:00.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.368+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~3OBT3PR5GF34.0 size=1048576 2024-09-12T00:18:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.372+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~3OBT3PR5GF34.1 size=1041870 2024-09-12T00:18:00.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.376+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=3OBT3PR5GF34 tag=MRIDUY6W9QBL type=write size=3139022 2024-09-12T00:18:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.380+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=4TAW42VKOBJU type=write size=839878 2024-09-12T00:18:00.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.384+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=720C48MDMJGD type=del 2024-09-12T00:18:00.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.388+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~PPAA658IIJL8.0 size=1048576 2024-09-12T00:18:00.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.392+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~PPAA658IIJL8.1 size=1048576 2024-09-12T00:18:00.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~PPAA658IIJL8.2 size=49088 2024-09-12T00:18:00.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.396+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=PPAA658IIJL8 tag=438OF7CGJ2YC type=write size=3194816 2024-09-12T00:18:00.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.396+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~YPXUS7Z0H0OF.0 size=1048576 2024-09-12T00:18:00.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.400+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~YPXUS7Z0H0OF.1 size=1048576 2024-09-12T00:18:00.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.400+0000 7f69cdea98c0 1 < canceled part key=_multipart_AQY7MM3OX3GW.2~YPXUS7Z0H0OF.2 size=156141 2024-09-12T00:18:00.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.404+0000 7f69cdea98c0 1 < canceled multipart upload key=AQY7MM3OX3GW upload=YPXUS7Z0H0OF tag=GFXZ08L9682D type=write size=3301869 2024-09-12T00:18:00.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.408+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=6R8C0ZQVVLK4 type=del size=2130278 2024-09-12T00:18:00.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.412+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=N5VGUEMMSO9P type=del 2024-09-12T00:18:00.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.416+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=ET44GF24354P type=write size=986342 2024-09-12T00:18:00.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.420+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~WNO7S7BQCKW0.0 size=1048576 2024-09-12T00:18:00.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.424+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~WNO7S7BQCKW0.1 size=1048576 2024-09-12T00:18:00.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.424+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~WNO7S7BQCKW0.2 size=757119 2024-09-12T00:18:00.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.432+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=WNO7S7BQCKW0 tag=LNWL2XTXK61N type=write size=3902847 2024-09-12T00:18:00.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.432+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=JFR3ZRJEMT7Q type=write size=471041 2024-09-12T00:18:00.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.436+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~KMACVF47V3UN.0 size=1048576 2024-09-12T00:18:00.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.440+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~KMACVF47V3UN.1 size=1048576 2024-09-12T00:18:00.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.440+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~KMACVF47V3UN.2 size=521647 2024-09-12T00:18:00.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.448+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=KMACVF47V3UN tag=RONEBVT3VDUT type=write size=3667375 2024-09-12T00:18:00.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.452+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=HIT0ETC7ST7W type=del size=3425531 2024-09-12T00:18:00.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.456+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=5FVK1COJOAJR type=del 2024-09-12T00:18:00.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.460+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~JQF2JN4GIA03.0 size=1048576 2024-09-12T00:18:00.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.464+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~JQF2JN4GIA03.1 size=1048576 2024-09-12T00:18:00.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.464+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~JQF2JN4GIA03.2 size=860077 2024-09-12T00:18:00.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.464+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=JQF2JN4GIA03 tag=EEQWXQUX2HBG type=write size=4005805 2024-09-12T00:18:00.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.472+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~18NIZCGVSFOM.0 size=1048576 2024-09-12T00:18:00.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.472+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~18NIZCGVSFOM.1 size=851654 2024-09-12T00:18:00.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.480+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=18NIZCGVSFOM tag=ZOJX4FNQ8DFU type=write size=2948806 2024-09-12T00:18:00.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.484+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=CU6Q6L8GZ3VR type=del size=3661078 2024-09-12T00:18:00.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.488+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=8IRDB2P4YFH0 type=del 2024-09-12T00:18:00.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.492+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=GY6OFC24ZK40 type=del size=1000555 2024-09-12T00:18:00.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.496+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=DF0L7V5M0OAX type=del 2024-09-12T00:18:00.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.496+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=I25FZ3UMIY9I type=del size=267637 2024-09-12T00:18:00.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.500+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=UOXT26CRGI8D type=del 2024-09-12T00:18:00.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.504+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=RJ2UY0OF1AP6 type=del size=1381697 2024-09-12T00:18:00.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.508+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=1JQJ0NVDEPVD type=del 2024-09-12T00:18:00.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.512+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=1WNT90S7YC49 type=del size=4113705 2024-09-12T00:18:00.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.516+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=6DYY5Y320998 type=del 2024-09-12T00:18:00.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.520+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=3Q20659L29ZD type=del size=1152673 2024-09-12T00:18:00.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.524+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=L0Q26JV6TUWY type=del 2024-09-12T00:18:00.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.528+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=S9NSQR0PCHMD type=write size=906890 2024-09-12T00:18:00.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.532+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~2U36STPVEFIC.0 size=675500 2024-09-12T00:18:00.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.540+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=2U36STPVEFIC tag=HEDFPBDMK9HM type=write size=1724076 2024-09-12T00:18:00.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.544+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=P0BG8YBXBOIJ type=del size=1845561 2024-09-12T00:18:00.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.548+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=B4BXBE0KRF2E type=del 2024-09-12T00:18:00.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.552+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=30HRAZCWWKZG type=del size=938127 2024-09-12T00:18:00.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.556+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=4TAW42VKOBJU type=write size=839878 2024-09-12T00:18:00.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.560+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=DK4JU0MJGTBQ type=del size=2600068 2024-09-12T00:18:00.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.564+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~PPAA658IIJL8.0 size=1048576 2024-09-12T00:18:00.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.568+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~PPAA658IIJL8.1 size=1048576 2024-09-12T00:18:00.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.568+0000 7f69cdea98c0 1 < canceled part key=_multipart_IXB6WLN5M81C.2~PPAA658IIJL8.2 size=49088 2024-09-12T00:18:00.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.572+0000 7f69cdea98c0 1 < canceled multipart upload key=IXB6WLN5M81C upload=PPAA658IIJL8 tag=438OF7CGJ2YC type=write size=3194816 2024-09-12T00:18:00.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~LLWXEEHAAGQS.0 size=1048576 2024-09-12T00:18:00.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~LLWXEEHAAGQS.1 size=1048576 2024-09-12T00:18:00.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~LLWXEEHAAGQS.2 size=201620 2024-09-12T00:18:00.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.584+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=LLWXEEHAAGQS tag=6AHZ999UBVYQ type=write size=3347348 2024-09-12T00:18:00.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.588+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=6R8C0ZQVVLK4 type=del 2024-09-12T00:18:00.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~OQZ46SEER1VK.0 size=1048576 2024-09-12T00:18:00.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~OQZ46SEER1VK.1 size=1048576 2024-09-12T00:18:00.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.600+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~OQZ46SEER1VK.2 size=982667 2024-09-12T00:18:00.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.600+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=OQZ46SEER1VK tag=GOKFDUB5WK1J type=write size=4128395 2024-09-12T00:18:00.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.604+0000 7f69cdea98c0 1 < completed write operation key=2YYP9NOUAJD0 tag=ET44GF24354P type=write size=986342 2024-09-12T00:18:00.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.608+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=6RS8OQB0502D type=del size=3351733 2024-09-12T00:18:00.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.612+0000 7f69cdea98c0 1 < completed write operation key=YS23U9GQS7SJ tag=JFR3ZRJEMT7Q type=write size=471041 2024-09-12T00:18:00.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.616+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=1HSOTV99CAP2 type=del size=3798196 2024-09-12T00:18:00.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.616+0000 7f69cdea98c0 1 < canceled operation key=K0HNNMX7CDGC tag=HIT0ETC7ST7W type=del size=3425531 2024-09-12T00:18:00.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.624+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~Q2X131RE18XD.0 size=1048576 2024-09-12T00:18:00.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.624+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~Q2X131RE18XD.1 size=1048576 2024-09-12T00:18:00.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.628+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~Q2X131RE18XD.2 size=564144 2024-09-12T00:18:00.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.628+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=Q2X131RE18XD tag=897S9CJV8YCO type=write size=3709872 2024-09-12T00:18:00.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.632+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~JQF2JN4GIA03.0 size=1048576 2024-09-12T00:18:00.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.632+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~JQF2JN4GIA03.1 size=1048576 2024-09-12T00:18:00.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.636+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~JQF2JN4GIA03.2 size=860077 2024-09-12T00:18:00.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.640+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=JQF2JN4GIA03 tag=EEQWXQUX2HBG type=write size=4005805 2024-09-12T00:18:00.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.644+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=Z4QZA5ZB2S2Q type=del size=1398207 2024-09-12T00:18:00.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.648+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=CU6Q6L8GZ3VR type=del 2024-09-12T00:18:00.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~AR2510J1KBBY.0 size=1048576 2024-09-12T00:18:00.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~AR2510J1KBBY.1 size=1048576 2024-09-12T00:18:00.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.664+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~AR2510J1KBBY.2 size=540707 2024-09-12T00:18:00.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.664+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=AR2510J1KBBY tag=6NQ67VYAHZGT type=write size=3686435 2024-09-12T00:18:00.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.668+0000 7f69cdea98c0 1 < canceled operation key=2YYP9NOUAJD0 tag=GY6OFC24ZK40 type=del size=1000555 2024-09-12T00:18:00.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.672+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~02N9C8W7022X.0 size=1048576 2024-09-12T00:18:00.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.676+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~02N9C8W7022X.1 size=51003 2024-09-12T00:18:00.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.676+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=02N9C8W7022X tag=KMY7FD78ZCPN type=write size=2148155 2024-09-12T00:18:00.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.680+0000 7f69cdea98c0 1 < canceled operation key=AKWTTXH2P254 tag=I25FZ3UMIY9I type=del size=267637 2024-09-12T00:18:00.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.684+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=CXLOKASY843Z type=del size=354332 2024-09-12T00:18:00.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.688+0000 7f69cdea98c0 1 < canceled operation key=1CZXUEJLQ8FM tag=RJ2UY0OF1AP6 type=del size=1381697 2024-09-12T00:18:00.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.696+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~OH5OCMYZQJRG.0 size=517028 2024-09-12T00:18:00.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.696+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=OH5OCMYZQJRG tag=9TXXT2ILX3AQ type=write size=1565604 2024-09-12T00:18:00.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.704+0000 7f69cdea98c0 1 < suggested remove operation key=K0HNNMX7CDGC tag=1WNT90S7YC49 type=del 2024-09-12T00:18:00.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.708+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~400R2OL87KG8.0 size=1048576 2024-09-12T00:18:00.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.712+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~400R2OL87KG8.1 size=860355 2024-09-12T00:18:00.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.712+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=400R2OL87KG8 tag=U3O0EEPMJLP7 type=write size=2957507 2024-09-12T00:18:00.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.716+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=3Q20659L29ZD type=del 2024-09-12T00:18:00.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.720+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=TSD9VLY9T7B5 type=write size=9322 2024-09-12T00:18:00.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.724+0000 7f69cdea98c0 1 < suggested remove operation key=YS23U9GQS7SJ tag=S9NSQR0PCHMD type=write 2024-09-12T00:18:00.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.728+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=MVP0G1REXAJX type=write size=478954 2024-09-12T00:18:00.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.732+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=P0BG8YBXBOIJ type=del 2024-09-12T00:18:00.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~RPHT14WGUEVP.0 size=1048576 2024-09-12T00:18:00.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~RPHT14WGUEVP.1 size=1048576 2024-09-12T00:18:00.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.744+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~RPHT14WGUEVP.2 size=345952 2024-09-12T00:18:00.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.744+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=RPHT14WGUEVP tag=MQYZLDON3S1N type=write size=3491680 2024-09-12T00:18:00.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.752+0000 7f69cdea98c0 1 < suggested update operation key=Z6MH459BTZ6K tag=30HRAZCWWKZG type=del size=938127 2024-09-12T00:18:00.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.756+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=8NEPNGQCFLXY type=del size=2203211 2024-09-12T00:18:00.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.764+0000 7f69cdea98c0 1 < suggested remove operation key=0J667VAQGMTX tag=DK4JU0MJGTBQ type=del 2024-09-12T00:18:00.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.764+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=D6M35NSR671M type=del size=2432639 2024-09-12T00:18:00.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.768+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~LLWXEEHAAGQS.0 size=1048576 2024-09-12T00:18:00.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.772+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~LLWXEEHAAGQS.1 size=1048576 2024-09-12T00:18:00.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.776+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~LLWXEEHAAGQS.2 size=201620 2024-09-12T00:18:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.784+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=LLWXEEHAAGQS tag=6AHZ999UBVYQ type=write size=3347348 2024-09-12T00:18:00.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.788+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~WSF8YW0VIAKX.0 size=1048576 2024-09-12T00:18:00.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.792+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~WSF8YW0VIAKX.1 size=519913 2024-09-12T00:18:00.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.792+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=WSF8YW0VIAKX tag=6MBMD7VC1CWH type=write size=2617065 2024-09-12T00:18:00.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.796+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~OQZ46SEER1VK.0 size=1048576 2024-09-12T00:18:00.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.800+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~OQZ46SEER1VK.1 size=1048576 2024-09-12T00:18:00.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.800+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~OQZ46SEER1VK.2 size=982667 2024-09-12T00:18:00.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.808+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=OQZ46SEER1VK tag=GOKFDUB5WK1J type=write size=4128395 2024-09-12T00:18:00.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.816+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~6HWGHRIFSUW7.0 size=1048576 2024-09-12T00:18:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~6HWGHRIFSUW7.1 size=232483 2024-09-12T00:18:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.820+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=6HWGHRIFSUW7 tag=PMF1IR5UQMMW type=write size=2329635 2024-09-12T00:18:00.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.824+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=6RS8OQB0502D type=del 2024-09-12T00:18:00.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.828+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=0NK9Z9SLSC5K type=del size=2930950 2024-09-12T00:18:00.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.832+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=1HSOTV99CAP2 type=del 2024-09-12T00:18:00.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.836+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=BJLEFUZFPHIU type=write size=142088 2024-09-12T00:18:00.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.840+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~Q2X131RE18XD.0 size=1048576 2024-09-12T00:18:00.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.840+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~Q2X131RE18XD.1 size=1048576 2024-09-12T00:18:00.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.844+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~Q2X131RE18XD.2 size=564144 2024-09-12T00:18:00.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.852+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=Q2X131RE18XD tag=897S9CJV8YCO type=write size=3709872 2024-09-12T00:18:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.856+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=QP7RNY6ZRLA2 type=write size=698597 2024-09-12T00:18:00.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.860+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=Z4QZA5ZB2S2Q type=del 2024-09-12T00:18:00.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~H8OCTF6E207M.0 size=1048576 2024-09-12T00:18:00.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~H8OCTF6E207M.1 size=895992 2024-09-12T00:18:00.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.868+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=H8OCTF6E207M tag=J5ZQDO6GVE22 type=write size=2993144 2024-09-12T00:18:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.872+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~AR2510J1KBBY.0 size=1048576 2024-09-12T00:18:00.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.876+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~AR2510J1KBBY.1 size=1048576 2024-09-12T00:18:00.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.880+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~AR2510J1KBBY.2 size=540707 2024-09-12T00:18:00.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.884+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=AR2510J1KBBY tag=6NQ67VYAHZGT type=write size=3686435 2024-09-12T00:18:00.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.892+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~WSG82V5QE0JA.0 size=1048576 2024-09-12T00:18:00.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.900+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~WSG82V5QE0JA.1 size=452606 2024-09-12T00:18:00.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.900+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=WSG82V5QE0JA tag=7NB52ADE1W2D type=write size=2549758 2024-09-12T00:18:00.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.900+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~02N9C8W7022X.0 size=1048576 2024-09-12T00:18:00.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.904+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~02N9C8W7022X.1 size=51003 2024-09-12T00:18:00.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.912+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=02N9C8W7022X tag=KMY7FD78ZCPN type=write size=2148155 2024-09-12T00:18:00.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.916+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~DJNHLX41LXBO.0 size=1048576 2024-09-12T00:18:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.920+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~DJNHLX41LXBO.1 size=1048576 2024-09-12T00:18:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.924+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~DJNHLX41LXBO.2 size=887005 2024-09-12T00:18:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.924+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=DJNHLX41LXBO tag=A7UZ3IN3Q1LQ type=write size=4032733 2024-09-12T00:18:00.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.924+0000 7f69cdea98c0 1 < canceled operation key=0HAUC4BDL9VR tag=CXLOKASY843Z type=del size=354332 2024-09-12T00:18:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.928+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=NL7FO4T29UAQ type=del size=1420093 2024-09-12T00:18:00.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.932+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~OH5OCMYZQJRG.0 size=517028 2024-09-12T00:18:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.940+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=OH5OCMYZQJRG tag=9TXXT2ILX3AQ type=write size=1565604 2024-09-12T00:18:00.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.944+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=D1KOWO4VAKA8 type=del size=2551312 2024-09-12T00:18:00.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.948+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~400R2OL87KG8.0 size=1048576 2024-09-12T00:18:00.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.952+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~400R2OL87KG8.1 size=860355 2024-09-12T00:18:00.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.956+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=400R2OL87KG8 tag=U3O0EEPMJLP7 type=write size=2957507 2024-09-12T00:18:00.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.960+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=OGAMYJI28B61 type=del size=991868 2024-09-12T00:18:00.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.964+0000 7f69cdea98c0 1 < completed write operation key=4O5U4WX3N4SA tag=TSD9VLY9T7B5 type=write size=9322 2024-09-12T00:18:00.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.972+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~5N4LOOZJN9C3.0 size=1048576 2024-09-12T00:18:00.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.976+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~5N4LOOZJN9C3.1 size=1048576 2024-09-12T00:18:00.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.976+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~5N4LOOZJN9C3.2 size=138973 2024-09-12T00:18:00.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.976+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=5N4LOOZJN9C3 tag=B97H05Y999X2 type=write size=3284701 2024-09-12T00:18:00.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.980+0000 7f69cdea98c0 1 < completed write operation key=SP2KVAO82MQ0 tag=MVP0G1REXAJX type=write size=478954 2024-09-12T00:18:00.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.984+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=6X9C49GHT72E type=del size=1710440 2024-09-12T00:18:00.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.988+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~RPHT14WGUEVP.0 size=1048576 2024-09-12T00:18:00.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:00.992+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~RPHT14WGUEVP.1 size=1048576 2024-09-12T00:18:00.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.000+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~RPHT14WGUEVP.2 size=345952 2024-09-12T00:18:01.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.004+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=RPHT14WGUEVP tag=MQYZLDON3S1N type=write size=3491680 2024-09-12T00:18:01.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.008+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=1O9IVSKZSXY1 type=del size=2716566 2024-09-12T00:18:01.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.016+0000 7f69cdea98c0 1 < suggested remove operation key=2X78JWLK876H tag=8NEPNGQCFLXY type=del 2024-09-12T00:18:01.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.020+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=2LZZ0SI1P66B type=del size=556752 2024-09-12T00:18:01.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.024+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=D6M35NSR671M type=del 2024-09-12T00:18:01.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.028+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=93B81WN3OGRS type=write size=784541 2024-09-12T00:18:01.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.032+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~WSF8YW0VIAKX.0 size=1048576 2024-09-12T00:18:01.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.032+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~WSF8YW0VIAKX.1 size=519913 2024-09-12T00:18:01.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.036+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=WSF8YW0VIAKX tag=6MBMD7VC1CWH type=write size=2617065 2024-09-12T00:18:01.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~0DN1NWEZMUIG.0 size=1048576 2024-09-12T00:18:01.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~0DN1NWEZMUIG.1 size=571788 2024-09-12T00:18:01.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.048+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=0DN1NWEZMUIG tag=TVFZKENZKL5W type=write size=2668940 2024-09-12T00:18:01.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.052+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~6HWGHRIFSUW7.0 size=1048576 2024-09-12T00:18:01.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.052+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~6HWGHRIFSUW7.1 size=232483 2024-09-12T00:18:01.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.060+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=6HWGHRIFSUW7 tag=PMF1IR5UQMMW type=write size=2329635 2024-09-12T00:18:01.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.068+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~DCEYM9LFJOXF.0 size=1048576 2024-09-12T00:18:01.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.068+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~DCEYM9LFJOXF.1 size=677637 2024-09-12T00:18:01.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.068+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=DCEYM9LFJOXF tag=6A9RM6Y01M1R type=write size=2774789 2024-09-12T00:18:01.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.076+0000 7f69cdea98c0 1 < suggested update operation key=2ENKC4QT2BFS tag=0NK9Z9SLSC5K type=del size=2930950 2024-09-12T00:18:01.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.084+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~LKTHXKE2IYZ5.0 size=1048576 2024-09-12T00:18:01.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.088+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~LKTHXKE2IYZ5.1 size=815201 2024-09-12T00:18:01.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.088+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=LKTHXKE2IYZ5 tag=VWKT4TIX22F3 type=write size=2912353 2024-09-12T00:18:01.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.100+0000 7f69cdea98c0 1 < suggested remove operation key=5453GP1H3OFQ tag=BJLEFUZFPHIU type=write 2024-09-12T00:18:01.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.104+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=9FEH15RB6Z3N type=del size=2254326 2024-09-12T00:18:01.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.108+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=QP7RNY6ZRLA2 type=write size=698597 2024-09-12T00:18:01.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.112+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=OPZRDU13NUH2 type=write size=956667 2024-09-12T00:18:01.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.116+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~H8OCTF6E207M.0 size=1048576 2024-09-12T00:18:01.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.120+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~H8OCTF6E207M.1 size=895992 2024-09-12T00:18:01.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.124+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=H8OCTF6E207M tag=J5ZQDO6GVE22 type=write size=2993144 2024-09-12T00:18:01.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~PNIT0BZX0VPW.0 size=1048576 2024-09-12T00:18:01.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~PNIT0BZX0VPW.1 size=1048576 2024-09-12T00:18:01.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~PNIT0BZX0VPW.2 size=780028 2024-09-12T00:18:01.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.140+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=PNIT0BZX0VPW tag=4YO1HUC7Z1U1 type=write size=3925756 2024-09-12T00:18:01.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.144+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~WSG82V5QE0JA.0 size=1048576 2024-09-12T00:18:01.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.148+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~WSG82V5QE0JA.1 size=452606 2024-09-12T00:18:01.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.156+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=WSG82V5QE0JA tag=7NB52ADE1W2D type=write size=2549758 2024-09-12T00:18:01.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.160+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=S2G529VX2ZW7 type=del size=3613256 2024-09-12T00:18:01.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.164+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~DJNHLX41LXBO.0 size=1048576 2024-09-12T00:18:01.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.168+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~DJNHLX41LXBO.1 size=1048576 2024-09-12T00:18:01.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.172+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~DJNHLX41LXBO.2 size=887005 2024-09-12T00:18:01.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.176+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=DJNHLX41LXBO tag=A7UZ3IN3Q1LQ type=write size=4032733 2024-09-12T00:18:01.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.180+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=DGK1APVJAHDD type=del size=3383421 2024-09-12T00:18:01.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.188+0000 7f69cdea98c0 1 < suggested remove operation key=SP2KVAO82MQ0 tag=NL7FO4T29UAQ type=del 2024-09-12T00:18:01.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.196+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~3BQ1TC77VL5H.0 size=879034 2024-09-12T00:18:01.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.196+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=3BQ1TC77VL5H tag=FTXWADFGGXVW type=write size=1927610 2024-09-12T00:18:01.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.204+0000 7f69cdea98c0 1 < canceled operation key=0EALARW4O3OB tag=D1KOWO4VAKA8 type=del size=2551312 2024-09-12T00:18:01.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.208+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=QXO0LG7I7LXO type=del size=2076024 2024-09-12T00:18:01.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.208+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=OGAMYJI28B61 type=del 2024-09-12T00:18:01.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.216+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~74YOD1P4RP6G.0 size=1048576 2024-09-12T00:18:01.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.220+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~74YOD1P4RP6G.1 size=561587 2024-09-12T00:18:01.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.220+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=74YOD1P4RP6G tag=0F0751V62WZ1 type=write size=2658739 2024-09-12T00:18:01.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.220+0000 7f69cdea98c0 1 < canceled part key=_multipart_AKWTTXH2P254.2~5N4LOOZJN9C3.0 size=1048576 2024-09-12T00:18:01.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.220+0000 7f69cdea98c0 1 < canceled part key=_multipart_AKWTTXH2P254.2~5N4LOOZJN9C3.1 size=1048576 2024-09-12T00:18:01.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.224+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~5N4LOOZJN9C3.2 size=138973 2024-09-12T00:18:01.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.228+0000 7f69cdea98c0 1 < canceled multipart upload key=AKWTTXH2P254 upload=5N4LOOZJN9C3 tag=B97H05Y999X2 type=write size=3284701 2024-09-12T00:18:01.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.236+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~DPZXRWHFU17M.0 size=1048576 2024-09-12T00:18:01.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~DPZXRWHFU17M.1 size=1048576 2024-09-12T00:18:01.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~DPZXRWHFU17M.2 size=299373 2024-09-12T00:18:01.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.244+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=DPZXRWHFU17M tag=4CSXRX3QZKUY type=write size=3445101 2024-09-12T00:18:01.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.248+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=6X9C49GHT72E type=del 2024-09-12T00:18:01.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.252+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=CFXNBQRMGWSI type=del size=1809985 2024-09-12T00:18:01.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.256+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=1O9IVSKZSXY1 type=del 2024-09-12T00:18:01.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.260+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=BR37EQ70EV2P type=write size=132588 2024-09-12T00:18:01.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.268+0000 7f69cdea98c0 1 < suggested remove operation key=0HAUC4BDL9VR tag=2LZZ0SI1P66B type=del 2024-09-12T00:18:01.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~WQVPDVVUJZ86.0 size=1048576 2024-09-12T00:18:01.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~WQVPDVVUJZ86.1 size=1048576 2024-09-12T00:18:01.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.280+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~WQVPDVVUJZ86.2 size=373398 2024-09-12T00:18:01.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.280+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=WQVPDVVUJZ86 tag=TI5W216DS9TK type=write size=3519126 2024-09-12T00:18:01.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.284+0000 7f69cdea98c0 1 < completed write operation key=IXWX7S5NWJS3 tag=93B81WN3OGRS type=write size=784541 2024-09-12T00:18:01.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.288+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=WCU4Z1KM6QRJ type=del size=1647643 2024-09-12T00:18:01.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.292+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~0DN1NWEZMUIG.0 size=1048576 2024-09-12T00:18:01.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.292+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~0DN1NWEZMUIG.1 size=571788 2024-09-12T00:18:01.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.300+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=0DN1NWEZMUIG tag=TVFZKENZKL5W type=write size=2668940 2024-09-12T00:18:01.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~99FUXK2GEW7L.0 size=1048576 2024-09-12T00:18:01.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~99FUXK2GEW7L.1 size=1048576 2024-09-12T00:18:01.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.316+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~99FUXK2GEW7L.2 size=675970 2024-09-12T00:18:01.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.316+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=99FUXK2GEW7L tag=GV0NMJYF2G40 type=write size=3821698 2024-09-12T00:18:01.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.316+0000 7f69cdea98c0 1 < canceled part key=_multipart_SP2KVAO82MQ0.2~DCEYM9LFJOXF.0 size=1048576 2024-09-12T00:18:01.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.320+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~DCEYM9LFJOXF.1 size=677637 2024-09-12T00:18:01.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.324+0000 7f69cdea98c0 1 < canceled multipart upload key=SP2KVAO82MQ0 upload=DCEYM9LFJOXF tag=6A9RM6Y01M1R type=write size=2774789 2024-09-12T00:18:01.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.328+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=NNUEGG41XJC9 type=del size=3941413 2024-09-12T00:18:01.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.332+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~LKTHXKE2IYZ5.0 size=1048576 2024-09-12T00:18:01.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.332+0000 7f69cdea98c0 1 < canceled part key=_multipart_UTZNJQJQMXJS.2~LKTHXKE2IYZ5.1 size=815201 2024-09-12T00:18:01.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.340+0000 7f69cdea98c0 1 < canceled multipart upload key=UTZNJQJQMXJS upload=LKTHXKE2IYZ5 tag=VWKT4TIX22F3 type=write size=2912353 2024-09-12T00:18:01.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.344+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~GGUOTO2PM5FN.0 size=1048576 2024-09-12T00:18:01.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.348+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~GGUOTO2PM5FN.1 size=430416 2024-09-12T00:18:01.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.348+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=GGUOTO2PM5FN tag=N9I4IOEI0LG4 type=write size=2527568 2024-09-12T00:18:01.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.352+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=9FEH15RB6Z3N type=del 2024-09-12T00:18:01.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.356+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=P2GPJSEC23FJ type=write size=853037 2024-09-12T00:18:01.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.368+0000 7f69cdea98c0 1 < completed write operation key=UTZNJQJQMXJS tag=OPZRDU13NUH2 type=write size=956667 2024-09-12T00:18:01.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.372+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=RLMACRZVQ8WF type=write size=441 2024-09-12T00:18:01.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.376+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~PNIT0BZX0VPW.0 size=1048576 2024-09-12T00:18:01.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.376+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~PNIT0BZX0VPW.1 size=1048576 2024-09-12T00:18:01.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.380+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~PNIT0BZX0VPW.2 size=780028 2024-09-12T00:18:01.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.384+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=PNIT0BZX0VPW tag=4YO1HUC7Z1U1 type=write size=3925756 2024-09-12T00:18:01.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.392+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~I13T4HWWR1FJ.0 size=1048576 2024-09-12T00:18:01.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~I13T4HWWR1FJ.1 size=1048576 2024-09-12T00:18:01.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~I13T4HWWR1FJ.2 size=114075 2024-09-12T00:18:01.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.396+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=I13T4HWWR1FJ tag=EZQ0T3BR57X5 type=write size=3259803 2024-09-12T00:18:01.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.400+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=S2G529VX2ZW7 type=del 2024-09-12T00:18:01.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.408+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~IDVJ1TJJ5BG9.0 size=1048576 2024-09-12T00:18:01.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~IDVJ1TJJ5BG9.1 size=44043 2024-09-12T00:18:01.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.412+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=IDVJ1TJJ5BG9 tag=TAS7RUUNT9Z8 type=write size=2141195 2024-09-12T00:18:01.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.420+0000 7f69cdea98c0 1 < suggested remove operation key=AKWTTXH2P254 tag=DGK1APVJAHDD type=del 2024-09-12T00:18:01.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.420+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=G0JKD1THVZRC type=del size=1691379 2024-09-12T00:18:01.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.424+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~3BQ1TC77VL5H.0 size=879034 2024-09-12T00:18:01.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.432+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=3BQ1TC77VL5H tag=FTXWADFGGXVW type=write size=1927610 2024-09-12T00:18:01.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.436+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=JL6IFNHJ85HD type=write size=101459 2024-09-12T00:18:01.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.440+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=QXO0LG7I7LXO type=del 2024-09-12T00:18:01.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.444+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=L2V2VQAERVNZ type=write size=1009578 2024-09-12T00:18:01.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.448+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~74YOD1P4RP6G.0 size=1048576 2024-09-12T00:18:01.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.452+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~74YOD1P4RP6G.1 size=561587 2024-09-12T00:18:01.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.456+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=74YOD1P4RP6G tag=0F0751V62WZ1 type=write size=2658739 2024-09-12T00:18:01.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.460+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=72JRA2L4MY2H type=write size=771615 2024-09-12T00:18:01.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.464+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~DPZXRWHFU17M.0 size=1048576 2024-09-12T00:18:01.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.468+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~DPZXRWHFU17M.1 size=1048576 2024-09-12T00:18:01.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.472+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~DPZXRWHFU17M.2 size=299373 2024-09-12T00:18:01.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.476+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=DPZXRWHFU17M tag=4CSXRX3QZKUY type=write size=3445101 2024-09-12T00:18:01.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.480+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=3V0RIEC7C03I type=del size=3358967 2024-09-12T00:18:01.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.484+0000 7f69cdea98c0 -1 < failed to complete operation key=0HAUC4BDL9VR tag=CFXNBQRMGWSI type=del size=1809985: (22) Invalid argument 2024-09-12T00:18:01.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.492+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~P12UZ8TPM1TQ.0 size=926837 2024-09-12T00:18:01.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.492+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=P12UZ8TPM1TQ tag=9HMP0JUFBCME type=write size=1975413 2024-09-12T00:18:01.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.500+0000 7f69cdea98c0 1 < suggested remove operation key=K4LNDJJUA1RZ tag=BR37EQ70EV2P type=write 2024-09-12T00:18:01.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.504+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=71SHZ3OU18YF type=del size=3177185 2024-09-12T00:18:01.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.508+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~WQVPDVVUJZ86.0 size=1048576 2024-09-12T00:18:01.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.512+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~WQVPDVVUJZ86.1 size=1048576 2024-09-12T00:18:01.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.520+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~WQVPDVVUJZ86.2 size=373398 2024-09-12T00:18:01.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.524+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=WQVPDVVUJZ86 tag=TI5W216DS9TK type=write size=3519126 2024-09-12T00:18:01.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.528+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=L0V7AIGT5OUJ type=del size=1478810 2024-09-12T00:18:01.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.536+0000 7f69cdea98c0 1 < suggested update operation key=AWZ03VE7D86K tag=WCU4Z1KM6QRJ type=del size=1647643 2024-09-12T00:18:01.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.548+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~HV953AM1ZZMF.0 size=1048576 2024-09-12T00:18:01.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.548+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~HV953AM1ZZMF.1 size=908533 2024-09-12T00:18:01.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.548+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=HV953AM1ZZMF tag=C9N5094BSNIJ type=write size=3005685 2024-09-12T00:18:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.552+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~99FUXK2GEW7L.0 size=1048576 2024-09-12T00:18:01.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.556+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~99FUXK2GEW7L.1 size=1048576 2024-09-12T00:18:01.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.556+0000 7f69cdea98c0 1 < canceled part key=_multipart_HSQZYI0SNZP1.2~99FUXK2GEW7L.2 size=675970 2024-09-12T00:18:01.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.564+0000 7f69cdea98c0 1 < canceled multipart upload key=HSQZYI0SNZP1 upload=99FUXK2GEW7L tag=GV0NMJYF2G40 type=write size=3821698 2024-09-12T00:18:01.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.568+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=KYG3MAZXZE6L type=del size=2214896 2024-09-12T00:18:01.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.568+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=NNUEGG41XJC9 type=del 2024-09-12T00:18:01.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.572+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=HYD5IYO7MDLD type=write size=57583 2024-09-12T00:18:01.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.580+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~GGUOTO2PM5FN.0 size=1048576 2024-09-12T00:18:01.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.580+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~GGUOTO2PM5FN.1 size=430416 2024-09-12T00:18:01.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.588+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=GGUOTO2PM5FN tag=N9I4IOEI0LG4 type=write size=2527568 2024-09-12T00:18:01.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~281R564DITBK.0 size=1048576 2024-09-12T00:18:01.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~281R564DITBK.1 size=1022243 2024-09-12T00:18:01.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.596+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=281R564DITBK tag=ILPBESCZQLC3 type=write size=3119395 2024-09-12T00:18:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.600+0000 7f69cdea98c0 1 < completed write operation key=YS23U9GQS7SJ tag=P2GPJSEC23FJ type=write size=853037 2024-09-12T00:18:01.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.604+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=I50MXUTE2ZLL type=del size=222484 2024-09-12T00:18:01.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.608+0000 7f69cdea98c0 1 < completed write operation key=5453GP1H3OFQ tag=RLMACRZVQ8WF type=write size=441 2024-09-12T00:18:01.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.612+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=P40G7YB36PS7 type=del size=1229756 2024-09-12T00:18:01.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.616+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~I13T4HWWR1FJ.0 size=1048576 2024-09-12T00:18:01.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.620+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~I13T4HWWR1FJ.1 size=1048576 2024-09-12T00:18:01.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.624+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~I13T4HWWR1FJ.2 size=114075 2024-09-12T00:18:01.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.628+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=I13T4HWWR1FJ tag=EZQ0T3BR57X5 type=write size=3259803 2024-09-12T00:18:01.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.632+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=BD1Q25VA4FDW type=del size=1447182 2024-09-12T00:18:01.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.636+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~IDVJ1TJJ5BG9.0 size=1048576 2024-09-12T00:18:01.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.640+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~IDVJ1TJJ5BG9.1 size=44043 2024-09-12T00:18:01.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.644+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=IDVJ1TJJ5BG9 tag=TAS7RUUNT9Z8 type=write size=2141195 2024-09-12T00:18:01.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~J9UEU0XV3CXL.0 size=1048576 2024-09-12T00:18:01.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~J9UEU0XV3CXL.1 size=149827 2024-09-12T00:18:01.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.656+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=J9UEU0XV3CXL tag=EVI8JA5A856A type=write size=2246979 2024-09-12T00:18:01.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.664+0000 7f69cdea98c0 1 < suggested remove operation key=AQY7MM3OX3GW tag=G0JKD1THVZRC type=del 2024-09-12T00:18:01.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.668+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=MSHC6DYOS94S type=del size=3726371 2024-09-12T00:18:01.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.672+0000 7f69cdea98c0 1 < completed write operation key=0HAUC4BDL9VR tag=JL6IFNHJ85HD type=write size=101459 2024-09-12T00:18:01.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.680+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~AU0RO0QP4LAD.0 size=1048576 2024-09-12T00:18:01.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.680+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~AU0RO0QP4LAD.1 size=153860 2024-09-12T00:18:01.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.680+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=AU0RO0QP4LAD tag=RFDKRP5U4RTW type=write size=2251012 2024-09-12T00:18:01.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.684+0000 7f69cdea98c0 1 < completed write operation key=UTZNJQJQMXJS tag=L2V2VQAERVNZ type=write size=1009578 2024-09-12T00:18:01.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.692+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~SB03Q9RK8GP3.0 size=1048576 2024-09-12T00:18:01.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.696+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~SB03Q9RK8GP3.1 size=448088 2024-09-12T00:18:01.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.696+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=SB03Q9RK8GP3 tag=464ZDR0J7ZPC type=write size=2545240 2024-09-12T00:18:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.704+0000 7f69cdea98c0 1 < suggested update operation key=IXWX7S5NWJS3 tag=72JRA2L4MY2H type=write size=771615 2024-09-12T00:18:01.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.712+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~UMP7HAABAD4N.0 size=34835 2024-09-12T00:18:01.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.712+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=UMP7HAABAD4N tag=FZXDL2W0XJ6R type=write size=1083411 2024-09-12T00:18:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.716+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=3V0RIEC7C03I type=del 2024-09-12T00:18:01.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.720+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~51OZS8JPIKG3.0 size=1048576 2024-09-12T00:18:01.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~51OZS8JPIKG3.1 size=334244 2024-09-12T00:18:01.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.728+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=51OZS8JPIKG3 tag=I1LSXRE2JOIW type=write size=2431396 2024-09-12T00:18:01.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.736+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~P12UZ8TPM1TQ.0 size=926837 2024-09-12T00:18:01.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.740+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=P12UZ8TPM1TQ tag=9HMP0JUFBCME type=write size=1975413 2024-09-12T00:18:01.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~7FZNY6GLQRJC.0 size=469236 2024-09-12T00:18:01.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.748+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=7FZNY6GLQRJC tag=WNX0ZYJ4XI6L type=write size=1517812 2024-09-12T00:18:01.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.756+0000 7f69cdea98c0 1 < suggested update operation key=SP2KVAO82MQ0 tag=71SHZ3OU18YF type=del size=3177185 2024-09-12T00:18:01.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.760+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=HO6E2C8F801N type=del size=2380309 2024-09-12T00:18:01.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.764+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=L0V7AIGT5OUJ type=del 2024-09-12T00:18:01.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.772+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~W25QR26E207N.0 size=1048576 2024-09-12T00:18:01.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.776+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~W25QR26E207N.1 size=1048576 2024-09-12T00:18:01.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.776+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~W25QR26E207N.2 size=192001 2024-09-12T00:18:01.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.776+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=W25QR26E207N tag=NAY1ARTV4GEP type=write size=3337729 2024-09-12T00:18:01.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.780+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~HV953AM1ZZMF.0 size=1048576 2024-09-12T00:18:01.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.784+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~HV953AM1ZZMF.1 size=908533 2024-09-12T00:18:01.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.792+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=HV953AM1ZZMF tag=C9N5094BSNIJ type=write size=3005685 2024-09-12T00:18:01.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.796+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=X3RWHZ03XFVP type=del size=1071110 2024-09-12T00:18:01.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.800+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=KYG3MAZXZE6L type=del 2024-09-12T00:18:01.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.804+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=01JJCEWFPFV8 type=del size=2408513 2024-09-12T00:18:01.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.808+0000 7f69cdea98c0 -1 < failed to complete operation key=AQY7MM3OX3GW tag=HYD5IYO7MDLD type=write size=57583: (22) Invalid argument 2024-09-12T00:18:01.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.812+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=LN7LDHE3VCZ1 type=del size=412459 2024-09-12T00:18:01.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.816+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~281R564DITBK.0 size=1048576 2024-09-12T00:18:01.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.820+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~281R564DITBK.1 size=1022243 2024-09-12T00:18:01.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.824+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=281R564DITBK tag=ILPBESCZQLC3 type=write size=3119395 2024-09-12T00:18:01.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.828+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=WWMESDIILI72 type=del size=621243 2024-09-12T00:18:01.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.832+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=I50MXUTE2ZLL type=del 2024-09-12T00:18:01.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.836+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=PDU3LE72RK5H type=del size=1571976 2024-09-12T00:18:01.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.840+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=P40G7YB36PS7 type=del 2024-09-12T00:18:01.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.844+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=5D4GNZSAJ1Q7 type=del size=1991433 2024-09-12T00:18:01.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.852+0000 7f69cdea98c0 1 < suggested remove operation key=Q0L8J0BYRFDQ tag=BD1Q25VA4FDW type=del 2024-09-12T00:18:01.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.856+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=4SM977JDDY5Z type=write size=190533 2024-09-12T00:18:01.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.860+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~J9UEU0XV3CXL.0 size=1048576 2024-09-12T00:18:01.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.864+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~J9UEU0XV3CXL.1 size=149827 2024-09-12T00:18:01.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.868+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=J9UEU0XV3CXL tag=EVI8JA5A856A type=write size=2246979 2024-09-12T00:18:01.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~PJH85QZKFW30.0 size=1048576 2024-09-12T00:18:01.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~PJH85QZKFW30.1 size=598979 2024-09-12T00:18:01.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.880+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=PJH85QZKFW30 tag=8JHUEPLN8AC1 type=write size=2696131 2024-09-12T00:18:01.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.884+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=MSHC6DYOS94S type=del 2024-09-12T00:18:01.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.892+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~4G4NYSP44JY7.0 size=1048576 2024-09-12T00:18:01.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~4G4NYSP44JY7.1 size=32495 2024-09-12T00:18:01.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.896+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=4G4NYSP44JY7 tag=QR90Z61GOONR type=write size=2129647 2024-09-12T00:18:01.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.896+0000 7f69cdea98c0 1 < canceled part key=_multipart_0EALARW4O3OB.2~AU0RO0QP4LAD.0 size=1048576 2024-09-12T00:18:01.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.900+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~AU0RO0QP4LAD.1 size=153860 2024-09-12T00:18:01.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.904+0000 7f69cdea98c0 1 < canceled multipart upload key=0EALARW4O3OB upload=AU0RO0QP4LAD tag=RFDKRP5U4RTW type=write size=2251012 2024-09-12T00:18:01.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.908+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=A874AS97MLXX type=del size=2537896 2024-09-12T00:18:01.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.912+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~SB03Q9RK8GP3.0 size=1048576 2024-09-12T00:18:01.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.916+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~SB03Q9RK8GP3.1 size=448088 2024-09-12T00:18:01.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.920+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=SB03Q9RK8GP3 tag=464ZDR0J7ZPC type=write size=2545240 2024-09-12T00:18:01.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.924+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=XJPHUWCGJ0PG type=del size=3602896 2024-09-12T00:18:01.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.928+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~UMP7HAABAD4N.0 size=34835 2024-09-12T00:18:01.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.936+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=UMP7HAABAD4N tag=FZXDL2W0XJ6R type=write size=1083411 2024-09-12T00:18:01.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.944+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~54J3XI0DH0PP.0 size=723083 2024-09-12T00:18:01.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.944+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=54J3XI0DH0PP tag=WIA46NPOX9RX type=write size=1771659 2024-09-12T00:18:01.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.948+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~51OZS8JPIKG3.0 size=1048576 2024-09-12T00:18:01.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.952+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~51OZS8JPIKG3.1 size=334244 2024-09-12T00:18:01.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.956+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=51OZS8JPIKG3 tag=I1LSXRE2JOIW type=write size=2431396 2024-09-12T00:18:01.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.960+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=FAV7XWRIFRVV type=write size=584602 2024-09-12T00:18:01.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.964+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~7FZNY6GLQRJC.0 size=469236 2024-09-12T00:18:01.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.968+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=7FZNY6GLQRJC tag=WNX0ZYJ4XI6L type=write size=1517812 2024-09-12T00:18:01.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.972+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=U5KJPKTLTA52 type=del size=144632 2024-09-12T00:18:01.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.976+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=HO6E2C8F801N type=del 2024-09-12T00:18:01.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~HZZ7Z9F1MKEQ.0 size=1048576 2024-09-12T00:18:01.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~HZZ7Z9F1MKEQ.1 size=328436 2024-09-12T00:18:01.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.988+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=HZZ7Z9F1MKEQ tag=SZCKQVK2ZFVA type=write size=2425588 2024-09-12T00:18:01.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.988+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~W25QR26E207N.0 size=1048576 2024-09-12T00:18:01.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.992+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~W25QR26E207N.1 size=1048576 2024-09-12T00:18:01.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:01.996+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~W25QR26E207N.2 size=192001 2024-09-12T00:18:01.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.000+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=W25QR26E207N tag=NAY1ARTV4GEP type=write size=3337729 2024-09-12T00:18:02.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.004+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=1L9KDL5T0NM2 type=del size=168916 2024-09-12T00:18:02.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.008+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=X3RWHZ03XFVP type=del 2024-09-12T00:18:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~TMVHW6D8V1C3.0 size=170031 2024-09-12T00:18:02.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.012+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=TMVHW6D8V1C3 tag=7RHIN9APN13T type=write size=1218607 2024-09-12T00:18:02.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.016+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=01JJCEWFPFV8 type=del 2024-09-12T00:18:02.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.024+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~1EJAIFW69J8G.0 size=924789 2024-09-12T00:18:02.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.024+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=1EJAIFW69J8G tag=CYG4V38EUM77 type=write size=1973365 2024-09-12T00:18:02.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.024+0000 7f69cdea98c0 1 < canceled operation key=2X78JWLK876H tag=LN7LDHE3VCZ1 type=del size=412459 2024-09-12T00:18:02.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.028+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=1IRWTI4HODTW type=del size=2688175 2024-09-12T00:18:02.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.032+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=WWMESDIILI72 type=del 2024-09-12T00:18:02.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.036+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=7RDMR7GPU9GV type=del size=1445954 2024-09-12T00:18:02.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.036+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=PDU3LE72RK5H type=del 2024-09-12T00:18:02.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.040+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=UK1I8E43XEGZ type=del size=2503537 2024-09-12T00:18:02.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.044+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=5D4GNZSAJ1Q7 type=del 2024-09-12T00:18:02.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.048+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=S3W9ELX67FVO type=write size=622212 2024-09-12T00:18:02.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.052+0000 7f69cdea98c0 1 < completed write operation key=Q0L8J0BYRFDQ tag=4SM977JDDY5Z type=write size=190533 2024-09-12T00:18:02.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.052+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=HV4DNNEFKIXJ type=write size=228497 2024-09-12T00:18:02.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.056+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~PJH85QZKFW30.0 size=1048576 2024-09-12T00:18:02.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.060+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~PJH85QZKFW30.1 size=598979 2024-09-12T00:18:02.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.064+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=PJH85QZKFW30 tag=8JHUEPLN8AC1 type=write size=2696131 2024-09-12T00:18:02.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~EPTZ1AWRE0G7.0 size=1048576 2024-09-12T00:18:02.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.076+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~EPTZ1AWRE0G7.1 size=1048576 2024-09-12T00:18:02.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.076+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~EPTZ1AWRE0G7.2 size=796465 2024-09-12T00:18:02.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.076+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=EPTZ1AWRE0G7 tag=WAPBXQEI9J1X type=write size=3942193 2024-09-12T00:18:02.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.080+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~4G4NYSP44JY7.0 size=1048576 2024-09-12T00:18:02.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.084+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~4G4NYSP44JY7.1 size=32495 2024-09-12T00:18:02.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.092+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=4G4NYSP44JY7 tag=QR90Z61GOONR type=write size=2129647 2024-09-12T00:18:02.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.096+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=2I1FLN3EIBDW type=del size=1584849 2024-09-12T00:18:02.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.104+0000 7f69cdea98c0 1 < suggested remove operation key=IXB6WLN5M81C tag=A874AS97MLXX type=del 2024-09-12T00:18:02.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.104+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=7RLB387ULRNZ type=del size=3938114 2024-09-12T00:18:02.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.108+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=XJPHUWCGJ0PG type=del 2024-09-12T00:18:02.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.112+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=P167AGTFK63G type=del size=884134 2024-09-12T00:18:02.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.116+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~54J3XI0DH0PP.0 size=723083 2024-09-12T00:18:02.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.120+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=54J3XI0DH0PP tag=WIA46NPOX9RX type=write size=1771659 2024-09-12T00:18:02.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.124+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=1G3ME9ND0F59 type=write size=175172 2024-09-12T00:18:02.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.128+0000 7f69cdea98c0 1 < completed write operation key=K0HNNMX7CDGC tag=FAV7XWRIFRVV type=write size=584602 2024-09-12T00:18:02.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.132+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=O19INBJSZV8P type=del size=5427 2024-09-12T00:18:02.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.136+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=U5KJPKTLTA52 type=del 2024-09-12T00:18:02.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.136+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=SS3JNNITV4NA type=del size=106911 2024-09-12T00:18:02.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.140+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~HZZ7Z9F1MKEQ.0 size=1048576 2024-09-12T00:18:02.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.144+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~HZZ7Z9F1MKEQ.1 size=328436 2024-09-12T00:18:02.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.148+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=HZZ7Z9F1MKEQ tag=SZCKQVK2ZFVA type=write size=2425588 2024-09-12T00:18:02.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.156+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~1Q2UIAIQTKRM.0 size=1048576 2024-09-12T00:18:02.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~1Q2UIAIQTKRM.1 size=1048576 2024-09-12T00:18:02.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~1Q2UIAIQTKRM.2 size=1038360 2024-09-12T00:18:02.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.160+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=1Q2UIAIQTKRM tag=D1OOTR7K6EPP type=write size=4184088 2024-09-12T00:18:02.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.164+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=1L9KDL5T0NM2 type=del 2024-09-12T00:18:02.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~B9CS2F9OJYS9.0 size=1048576 2024-09-12T00:18:02.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~B9CS2F9OJYS9.1 size=780497 2024-09-12T00:18:02.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.172+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=B9CS2F9OJYS9 tag=K2HL6YDHWND3 type=write size=2877649 2024-09-12T00:18:02.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.176+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~TMVHW6D8V1C3.0 size=170031 2024-09-12T00:18:02.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.180+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=TMVHW6D8V1C3 tag=7RHIN9APN13T type=write size=1218607 2024-09-12T00:18:02.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.188+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~C87LUUVK38M4.0 size=692759 2024-09-12T00:18:02.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.188+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=C87LUUVK38M4 tag=ZHCJYTUN2XV4 type=write size=1741335 2024-09-12T00:18:02.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.188+0000 7f69cdea98c0 1 < canceled part key=_multipart_0J667VAQGMTX.2~1EJAIFW69J8G.0 size=924789 2024-09-12T00:18:02.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.196+0000 7f69cdea98c0 1 < canceled multipart upload key=0J667VAQGMTX upload=1EJAIFW69J8G tag=CYG4V38EUM77 type=write size=1973365 2024-09-12T00:18:02.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.200+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~TGRXCB0ABCH6.0 size=961503 2024-09-12T00:18:02.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.200+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=TGRXCB0ABCH6 tag=QXRBTOB0SDBF type=write size=2010079 2024-09-12T00:18:02.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.204+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=1IRWTI4HODTW type=del 2024-09-12T00:18:02.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~M8Y9LTS1ST2Z.0 size=1048576 2024-09-12T00:18:02.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.216+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~M8Y9LTS1ST2Z.1 size=551085 2024-09-12T00:18:02.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.216+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=M8Y9LTS1ST2Z tag=XSSK79AA8BX9 type=write size=2648237 2024-09-12T00:18:02.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.216+0000 7f69cdea98c0 1 < canceled operation key=0J667VAQGMTX tag=7RDMR7GPU9GV type=del size=1445954 2024-09-12T00:18:02.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.220+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=LS2CKXBHQ672 type=del size=1986588 2024-09-12T00:18:02.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.224+0000 7f69cdea98c0 -1 < failed to complete operation key=IXB6WLN5M81C tag=UK1I8E43XEGZ type=del size=2503537: (22) Invalid argument 2024-09-12T00:18:02.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.228+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=ZE6KWBH3MSKK type=del size=740085 2024-09-12T00:18:02.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.232+0000 7f69cdea98c0 1 < completed write operation key=2YYP9NOUAJD0 tag=S3W9ELX67FVO type=write size=622212 2024-09-12T00:18:02.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~1ZPK5F32QKT9.0 size=1048576 2024-09-12T00:18:02.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~1ZPK5F32QKT9.1 size=1048576 2024-09-12T00:18:02.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~1ZPK5F32QKT9.2 size=617047 2024-09-12T00:18:02.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.244+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=1ZPK5F32QKT9 tag=NVRTGB0LF05Y type=write size=3762775 2024-09-12T00:18:02.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.248+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=HV4DNNEFKIXJ type=write size=228497 2024-09-12T00:18:02.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.252+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=R8593NTCEOSE type=del size=3558261 2024-09-12T00:18:02.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.256+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~EPTZ1AWRE0G7.0 size=1048576 2024-09-12T00:18:02.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.260+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~EPTZ1AWRE0G7.1 size=1048576 2024-09-12T00:18:02.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.260+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~EPTZ1AWRE0G7.2 size=796465 2024-09-12T00:18:02.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.268+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=EPTZ1AWRE0G7 tag=WAPBXQEI9J1X type=write size=3942193 2024-09-12T00:18:02.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~KC4V981M3P3M.0 size=968222 2024-09-12T00:18:02.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.276+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=KC4V981M3P3M tag=PH023CZTRKNU type=write size=2016798 2024-09-12T00:18:02.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.280+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=2I1FLN3EIBDW type=del 2024-09-12T00:18:02.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.284+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=O598YP14CKWO type=del size=2088242 2024-09-12T00:18:02.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.288+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=7RLB387ULRNZ type=del 2024-09-12T00:18:02.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~J5M9FTMV2RH2.0 size=1048576 2024-09-12T00:18:02.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~J5M9FTMV2RH2.1 size=1004246 2024-09-12T00:18:02.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.296+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=J5M9FTMV2RH2 tag=L6QS29P3811B type=write size=3101398 2024-09-12T00:18:02.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.300+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=P167AGTFK63G type=del 2024-09-12T00:18:02.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~5P3PPTLOY7FQ.0 size=1048576 2024-09-12T00:18:02.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~5P3PPTLOY7FQ.1 size=344340 2024-09-12T00:18:02.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.312+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=5P3PPTLOY7FQ tag=WVIW5RFYD3RV type=write size=2441492 2024-09-12T00:18:02.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.320+0000 7f69cdea98c0 1 < suggested update operation key=AKWTTXH2P254 tag=1G3ME9ND0F59 type=write size=175172 2024-09-12T00:18:02.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.324+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~AQNF43XU73Z0.0 size=1048576 2024-09-12T00:18:02.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~AQNF43XU73Z0.1 size=1048576 2024-09-12T00:18:02.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.332+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~AQNF43XU73Z0.2 size=617884 2024-09-12T00:18:02.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.332+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=AQNF43XU73Z0 tag=BYW1MVQYRMMP type=write size=3763612 2024-09-12T00:18:02.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.336+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=O19INBJSZV8P type=del 2024-09-12T00:18:02.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.340+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~XXDY1S7MX28T.0 size=1048576 2024-09-12T00:18:02.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.344+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~XXDY1S7MX28T.1 size=1048576 2024-09-12T00:18:02.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.348+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~XXDY1S7MX28T.2 size=162077 2024-09-12T00:18:02.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.348+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=XXDY1S7MX28T tag=6AYX4IQ27M8A type=write size=3307805 2024-09-12T00:18:02.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.352+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=SS3JNNITV4NA type=del 2024-09-12T00:18:02.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.352+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=THES4NCOCHO0 type=write size=381241 2024-09-12T00:18:02.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.356+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~1Q2UIAIQTKRM.0 size=1048576 2024-09-12T00:18:02.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.356+0000 7f69cdea98c0 1 < canceled part key=_multipart_5453GP1H3OFQ.2~1Q2UIAIQTKRM.1 size=1048576 2024-09-12T00:18:02.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.356+0000 7f69cdea98c0 1 < canceled part key=_multipart_5453GP1H3OFQ.2~1Q2UIAIQTKRM.2 size=1038360 2024-09-12T00:18:02.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.364+0000 7f69cdea98c0 1 < canceled multipart upload key=5453GP1H3OFQ upload=1Q2UIAIQTKRM tag=D1OOTR7K6EPP type=write size=4184088 2024-09-12T00:18:02.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.368+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=DD9YOSX5X6EC type=del size=2934011 2024-09-12T00:18:02.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.372+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~B9CS2F9OJYS9.0 size=1048576 2024-09-12T00:18:02.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.372+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~B9CS2F9OJYS9.1 size=780497 2024-09-12T00:18:02.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.380+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=B9CS2F9OJYS9 tag=K2HL6YDHWND3 type=write size=2877649 2024-09-12T00:18:02.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.384+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=FHYYID7TLZ3V type=del size=3012803 2024-09-12T00:18:02.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.384+0000 7f69cdea98c0 1 < canceled part key=_multipart_UTZNJQJQMXJS.2~C87LUUVK38M4.0 size=692759 2024-09-12T00:18:02.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.388+0000 7f69cdea98c0 1 < canceled multipart upload key=UTZNJQJQMXJS upload=C87LUUVK38M4 tag=ZHCJYTUN2XV4 type=write size=1741335 2024-09-12T00:18:02.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~OK4FINQQERO6.0 size=1048576 2024-09-12T00:18:02.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~OK4FINQQERO6.1 size=1048576 2024-09-12T00:18:02.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~OK4FINQQERO6.2 size=409891 2024-09-12T00:18:02.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.404+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=OK4FINQQERO6 tag=KW5Z75JUGLVT type=write size=3555619 2024-09-12T00:18:02.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.408+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~TGRXCB0ABCH6.0 size=961503 2024-09-12T00:18:02.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.416+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=TGRXCB0ABCH6 tag=QXRBTOB0SDBF type=write size=2010079 2024-09-12T00:18:02.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.420+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=A6W7PFKUC6V3 type=del size=2556214 2024-09-12T00:18:02.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.420+0000 7f69cdea98c0 1 < canceled part key=_multipart_IXB6WLN5M81C.2~M8Y9LTS1ST2Z.0 size=1048576 2024-09-12T00:18:02.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.420+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~M8Y9LTS1ST2Z.1 size=551085 2024-09-12T00:18:02.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.428+0000 7f69cdea98c0 1 < canceled multipart upload key=IXB6WLN5M81C upload=M8Y9LTS1ST2Z tag=XSSK79AA8BX9 type=write size=2648237 2024-09-12T00:18:02.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~HOWN14X2HERF.0 size=1048576 2024-09-12T00:18:02.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.436+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~HOWN14X2HERF.1 size=1048576 2024-09-12T00:18:02.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.440+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~HOWN14X2HERF.2 size=493372 2024-09-12T00:18:02.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.440+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=HOWN14X2HERF tag=LWL1ID5ADA4K type=write size=3639100 2024-09-12T00:18:02.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.444+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=LS2CKXBHQ672 type=del 2024-09-12T00:18:02.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.448+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=KYMF0MDC4LG1 type=write size=179704 2024-09-12T00:18:02.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.452+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=ZE6KWBH3MSKK type=del 2024-09-12T00:18:02.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.456+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=SDNMGXIZAN58 type=del size=2177529 2024-09-12T00:18:02.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.460+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~1ZPK5F32QKT9.0 size=1048576 2024-09-12T00:18:02.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.464+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~1ZPK5F32QKT9.1 size=1048576 2024-09-12T00:18:02.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.464+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~1ZPK5F32QKT9.2 size=617047 2024-09-12T00:18:02.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.472+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=1ZPK5F32QKT9 tag=NVRTGB0LF05Y type=write size=3762775 2024-09-12T00:18:02.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.480+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~KERFRYC615ZX.0 size=1048576 2024-09-12T00:18:02.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.480+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~KERFRYC615ZX.1 size=1048576 2024-09-12T00:18:02.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.484+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~KERFRYC615ZX.2 size=1002091 2024-09-12T00:18:02.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.484+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=KERFRYC615ZX tag=4P375UZC28ET type=write size=4147819 2024-09-12T00:18:02.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.492+0000 7f69cdea98c0 1 < suggested remove operation key=2YYP9NOUAJD0 tag=R8593NTCEOSE type=del 2024-09-12T00:18:02.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.496+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=WQ9F5BMTVDSI type=del size=1571619 2024-09-12T00:18:02.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.500+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~KC4V981M3P3M.0 size=968222 2024-09-12T00:18:02.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.508+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=KC4V981M3P3M tag=PH023CZTRKNU type=write size=2016798 2024-09-12T00:18:02.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.508+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=VB6EMOJABZEX type=del size=4035444 2024-09-12T00:18:02.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.516+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=O598YP14CKWO type=del 2024-09-12T00:18:02.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.520+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~MZY5TV7E3OMD.0 size=1048576 2024-09-12T00:18:02.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.524+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~MZY5TV7E3OMD.1 size=580038 2024-09-12T00:18:02.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.524+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=MZY5TV7E3OMD tag=SWY06DH525IY type=write size=2677190 2024-09-12T00:18:02.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.528+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~J5M9FTMV2RH2.0 size=1048576 2024-09-12T00:18:02.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.532+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~J5M9FTMV2RH2.1 size=1004246 2024-09-12T00:18:02.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.536+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=J5M9FTMV2RH2 tag=L6QS29P3811B type=write size=3101398 2024-09-12T00:18:02.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.540+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=NRFM4YEMVANM type=del size=3730751 2024-09-12T00:18:02.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.544+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~5P3PPTLOY7FQ.0 size=1048576 2024-09-12T00:18:02.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.548+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~5P3PPTLOY7FQ.1 size=344340 2024-09-12T00:18:02.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.552+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=5P3PPTLOY7FQ tag=WVIW5RFYD3RV type=write size=2441492 2024-09-12T00:18:02.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.556+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=PLA1Z78VOF8B type=del size=1578250 2024-09-12T00:18:02.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.560+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~AQNF43XU73Z0.0 size=1048576 2024-09-12T00:18:02.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.564+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~AQNF43XU73Z0.1 size=1048576 2024-09-12T00:18:02.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.568+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~AQNF43XU73Z0.2 size=617884 2024-09-12T00:18:02.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.572+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=AQNF43XU73Z0 tag=BYW1MVQYRMMP type=write size=3763612 2024-09-12T00:18:02.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.576+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=V8GH7B2IILRM type=del size=1891795 2024-09-12T00:18:02.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.580+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~XXDY1S7MX28T.0 size=1048576 2024-09-12T00:18:02.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.584+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~XXDY1S7MX28T.1 size=1048576 2024-09-12T00:18:02.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.588+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~XXDY1S7MX28T.2 size=162077 2024-09-12T00:18:02.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.592+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=XXDY1S7MX28T tag=6AYX4IQ27M8A type=write size=3307805 2024-09-12T00:18:02.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.596+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=QO1LVILOXEJD type=write size=842631 2024-09-12T00:18:02.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.600+0000 7f69cdea98c0 1 < completed write operation key=AKWTTXH2P254 tag=THES4NCOCHO0 type=write size=381241 2024-09-12T00:18:02.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.608+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~4IGWE09XC51O.0 size=1031235 2024-09-12T00:18:02.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.608+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=4IGWE09XC51O tag=6Q7W4GB8ZPUF type=write size=2079811 2024-09-12T00:18:02.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.612+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=DD9YOSX5X6EC type=del 2024-09-12T00:18:02.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.616+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~VV9NM0FVDI0U.0 size=935260 2024-09-12T00:18:02.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.616+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=VV9NM0FVDI0U tag=0IN9OEUN93DD type=write size=1983836 2024-09-12T00:18:02.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.620+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=FHYYID7TLZ3V type=del 2024-09-12T00:18:02.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.628+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=43GHOOI3MVY6 type=del size=2773851 2024-09-12T00:18:02.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.632+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~OK4FINQQERO6.0 size=1048576 2024-09-12T00:18:02.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.632+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~OK4FINQQERO6.1 size=1048576 2024-09-12T00:18:02.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.636+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~OK4FINQQERO6.2 size=409891 2024-09-12T00:18:02.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.644+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=OK4FINQQERO6 tag=KW5Z75JUGLVT type=write size=3555619 2024-09-12T00:18:02.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.648+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=CFKL2QVMBQZ8 type=write size=20003 2024-09-12T00:18:02.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.652+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=A6W7PFKUC6V3 type=del 2024-09-12T00:18:02.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.656+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=7X0CE5AA03CR type=del size=121042 2024-09-12T00:18:02.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.656+0000 7f69cdea98c0 1 < canceled part key=_multipart_VYYY8MF0P3Q7.2~HOWN14X2HERF.0 size=1048576 2024-09-12T00:18:02.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.660+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~HOWN14X2HERF.1 size=1048576 2024-09-12T00:18:02.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.660+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~HOWN14X2HERF.2 size=493372 2024-09-12T00:18:02.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.668+0000 7f69cdea98c0 1 < canceled multipart upload key=VYYY8MF0P3Q7 upload=HOWN14X2HERF tag=LWL1ID5ADA4K type=write size=3639100 2024-09-12T00:18:02.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.672+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=8GL1D1BGPC4U type=del size=3445763 2024-09-12T00:18:02.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.676+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=KYMF0MDC4LG1 type=write size=179704 2024-09-12T00:18:02.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.680+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=6PLQ6VSMUUL6 type=del size=3616782 2024-09-12T00:18:02.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.684+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=SDNMGXIZAN58 type=del 2024-09-12T00:18:02.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.692+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~C78P0PMAK4RI.0 size=1048576 2024-09-12T00:18:02.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.696+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~C78P0PMAK4RI.1 size=1048576 2024-09-12T00:18:02.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.700+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~C78P0PMAK4RI.2 size=637752 2024-09-12T00:18:02.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.700+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=C78P0PMAK4RI tag=4OY5WWW302LH type=write size=3783480 2024-09-12T00:18:02.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.704+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~KERFRYC615ZX.0 size=1048576 2024-09-12T00:18:02.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.708+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~KERFRYC615ZX.1 size=1048576 2024-09-12T00:18:02.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.712+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~KERFRYC615ZX.2 size=1002091 2024-09-12T00:18:02.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.716+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=KERFRYC615ZX tag=4P375UZC28ET type=write size=4147819 2024-09-12T00:18:02.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.720+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=667IFCKSE1PP type=del size=3086815 2024-09-12T00:18:02.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.724+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=WQ9F5BMTVDSI type=del size=1571619 2024-09-12T00:18:02.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.728+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=2L1QZ5XHZUQ0 type=del size=2058714 2024-09-12T00:18:02.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.732+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=VB6EMOJABZEX type=del 2024-09-12T00:18:02.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.736+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=JSK3G5MI5412 type=del size=1406316 2024-09-12T00:18:02.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.740+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~MZY5TV7E3OMD.0 size=1048576 2024-09-12T00:18:02.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.744+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~MZY5TV7E3OMD.1 size=580038 2024-09-12T00:18:02.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.756+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=MZY5TV7E3OMD tag=SWY06DH525IY type=write size=2677190 2024-09-12T00:18:02.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.760+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=GICF3Y1UHHJG type=del size=2251207 2024-09-12T00:18:02.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.768+0000 7f69cdea98c0 1 < suggested update operation key=RDGRKQQH4B8C tag=NRFM4YEMVANM type=del size=3730751 2024-09-12T00:18:02.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.772+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=51TI88R2HT71 type=del size=695327 2024-09-12T00:18:02.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.776+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=PLA1Z78VOF8B type=del 2024-09-12T00:18:02.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.784+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~8X0QOAZL7REK.0 size=1048576 2024-09-12T00:18:02.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.788+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~8X0QOAZL7REK.1 size=1048576 2024-09-12T00:18:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.792+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~8X0QOAZL7REK.2 size=629554 2024-09-12T00:18:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.792+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=8X0QOAZL7REK tag=30FDV431DT4A type=write size=3775282 2024-09-12T00:18:02.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.796+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=V8GH7B2IILRM type=del 2024-09-12T00:18:02.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~24YD1OSHYGSS.0 size=1048576 2024-09-12T00:18:02.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.808+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~24YD1OSHYGSS.1 size=1048576 2024-09-12T00:18:02.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.808+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~24YD1OSHYGSS.2 size=8063 2024-09-12T00:18:02.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.808+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=24YD1OSHYGSS tag=99XQPHCHXJH3 type=write size=3153791 2024-09-12T00:18:02.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.812+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=QO1LVILOXEJD type=write size=842631 2024-09-12T00:18:02.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~CQGHAU2R0FH3.0 size=266714 2024-09-12T00:18:02.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.820+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=CQGHAU2R0FH3 tag=AXSYLIK8DKZO type=write size=1315290 2024-09-12T00:18:02.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.824+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~4IGWE09XC51O.0 size=1031235 2024-09-12T00:18:02.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.828+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=4IGWE09XC51O tag=6Q7W4GB8ZPUF type=write size=2079811 2024-09-12T00:18:02.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.836+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~3TZWVEJX08V1.0 size=1048576 2024-09-12T00:18:02.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~3TZWVEJX08V1.1 size=1048576 2024-09-12T00:18:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~3TZWVEJX08V1.2 size=541711 2024-09-12T00:18:02.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.844+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=3TZWVEJX08V1 tag=ZEJY062KHOHL type=write size=3687439 2024-09-12T00:18:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.844+0000 7f69cdea98c0 1 < canceled part key=_multipart_AWZ03VE7D86K.2~VV9NM0FVDI0U.0 size=935260 2024-09-12T00:18:02.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.848+0000 7f69cdea98c0 1 < canceled multipart upload key=AWZ03VE7D86K upload=VV9NM0FVDI0U tag=0IN9OEUN93DD type=write size=1983836 2024-09-12T00:18:02.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.852+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=YWDQI3TF3W7K type=del size=434815 2024-09-12T00:18:02.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.856+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=43GHOOI3MVY6 type=del 2024-09-12T00:18:02.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.864+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~BUXSLBL1K2PO.0 size=1048576 2024-09-12T00:18:02.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.864+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~BUXSLBL1K2PO.1 size=1031946 2024-09-12T00:18:02.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.864+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=BUXSLBL1K2PO tag=5QD509W39QBB type=write size=3129098 2024-09-12T00:18:02.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.872+0000 7f69cdea98c0 1 < suggested update operation key=2X78JWLK876H tag=CFKL2QVMBQZ8 type=write size=20003 2024-09-12T00:18:02.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.876+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=65PELSH0RWY9 type=del size=1614638 2024-09-12T00:18:02.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.880+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=7X0CE5AA03CR type=del 2024-09-12T00:18:02.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.884+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=DYCJQGKJWYDT type=del size=2860219 2024-09-12T00:18:02.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.888+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=8GL1D1BGPC4U type=del 2024-09-12T00:18:02.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~0WAP4J3I0X74.0 size=809563 2024-09-12T00:18:02.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.896+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=0WAP4J3I0X74 tag=7EEVIEC7FI5H type=write size=1858139 2024-09-12T00:18:02.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.904+0000 7f69cdea98c0 1 < suggested remove operation key=H91UXKWAJ3K8 tag=6PLQ6VSMUUL6 type=del 2024-09-12T00:18:02.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.904+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=Z5B6LGE85IAY type=del size=404959 2024-09-12T00:18:02.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.908+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~C78P0PMAK4RI.0 size=1048576 2024-09-12T00:18:02.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.912+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~C78P0PMAK4RI.1 size=1048576 2024-09-12T00:18:02.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.916+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~C78P0PMAK4RI.2 size=637752 2024-09-12T00:18:02.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.920+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=C78P0PMAK4RI tag=4OY5WWW302LH type=write size=3783480 2024-09-12T00:18:02.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.928+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=X5ZG9OB9ZQZK type=del size=1842003 2024-09-12T00:18:02.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.932+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=667IFCKSE1PP type=del 2024-09-12T00:18:02.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.936+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=AB3O9H8AUHYA type=del size=1005143 2024-09-12T00:18:02.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.940+0000 7f69cdea98c0 -1 < failed to complete operation key=H91UXKWAJ3K8 tag=2L1QZ5XHZUQ0 type=del size=2058714: (22) Invalid argument 2024-09-12T00:18:02.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.944+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=9TDNW3ALCCYQ type=del size=2832199 2024-09-12T00:18:03.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.948+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=JSK3G5MI5412 type=del 2024-09-12T00:18:03.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.956+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~DH7FNZXI36U3.0 size=1048576 2024-09-12T00:18:03.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.960+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~DH7FNZXI36U3.1 size=819688 2024-09-12T00:18:03.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.960+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=DH7FNZXI36U3 tag=ZPTESWOLJIMO type=write size=2916840 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.960+0000 7f69cdea98c0 -1 < no bi entry to suggest for operation key=H91UXKWAJ3K8 tag=GICF3Y1UHHJG type=del size=2251207: (2) No such file or directory 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.964+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=YKVSF83MMW3J type=write size=930565 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.968+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=51TI88R2HT71 type=del 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.972+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=8YA8JZ84JHPF type=del size=4062386 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.976+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~8X0QOAZL7REK.0 size=1048576 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.980+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~8X0QOAZL7REK.1 size=1048576 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.984+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~8X0QOAZL7REK.2 size=629554 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.988+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=8X0QOAZL7REK tag=30FDV431DT4A type=write size=3775282 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:02.996+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~HKMB9SCCDGZK.0 size=1048576 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.000+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~HKMB9SCCDGZK.1 size=1048576 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.004+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~HKMB9SCCDGZK.2 size=18673 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.004+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=HKMB9SCCDGZK tag=2T7EY8E28LZM type=write size=3164401 2024-09-12T00:18:03.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.008+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~24YD1OSHYGSS.0 size=1048576 2024-09-12T00:18:03.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.008+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~24YD1OSHYGSS.1 size=1048576 2024-09-12T00:18:03.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.012+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~24YD1OSHYGSS.2 size=8063 2024-09-12T00:18:03.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.020+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=24YD1OSHYGSS tag=99XQPHCHXJH3 type=write size=3153791 2024-09-12T00:18:03.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.024+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=90DQ0NYNDLMD type=del size=807288 2024-09-12T00:18:03.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.028+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~CQGHAU2R0FH3.0 size=266714 2024-09-12T00:18:03.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.032+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=CQGHAU2R0FH3 tag=AXSYLIK8DKZO type=write size=1315290 2024-09-12T00:18:03.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.036+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=9GT4LIY4IM29 type=del size=879714 2024-09-12T00:18:03.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.040+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~3TZWVEJX08V1.0 size=1048576 2024-09-12T00:18:03.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.044+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~3TZWVEJX08V1.1 size=1048576 2024-09-12T00:18:03.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.048+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~3TZWVEJX08V1.2 size=541711 2024-09-12T00:18:03.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.052+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=3TZWVEJX08V1 tag=ZEJY062KHOHL type=write size=3687439 2024-09-12T00:18:03.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.060+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~G4CFQBEJDIRJ.0 size=842789 2024-09-12T00:18:03.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.060+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=G4CFQBEJDIRJ tag=0AC1SDX2KRH0 type=write size=1891365 2024-09-12T00:18:03.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.064+0000 7f69cdea98c0 1 < canceled operation key=2ENKC4QT2BFS tag=YWDQI3TF3W7K type=del size=434815 2024-09-12T00:18:03.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.064+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=8BN5UEAYHBAK type=write size=319573 2024-09-12T00:18:03.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.068+0000 7f69cdea98c0 1 < canceled part key=_multipart_9K3HLTD6DMSC.2~BUXSLBL1K2PO.0 size=1048576 2024-09-12T00:18:03.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.068+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~BUXSLBL1K2PO.1 size=1031946 2024-09-12T00:18:03.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.076+0000 7f69cdea98c0 1 < canceled multipart upload key=9K3HLTD6DMSC upload=BUXSLBL1K2PO tag=5QD509W39QBB type=write size=3129098 2024-09-12T00:18:03.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.080+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~YO4N2UU19UYH.0 size=1048576 2024-09-12T00:18:03.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.084+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~YO4N2UU19UYH.1 size=1048576 2024-09-12T00:18:03.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.088+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~YO4N2UU19UYH.2 size=1014738 2024-09-12T00:18:03.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.088+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=YO4N2UU19UYH tag=Y467N3N4LZVP type=write size=4160466 2024-09-12T00:18:03.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.092+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=65PELSH0RWY9 type=del 2024-09-12T00:18:03.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.096+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=S59JWU01EEEN type=del size=1405273 2024-09-12T00:18:03.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.100+0000 7f69cdea98c0 1 < canceled operation key=2ENKC4QT2BFS tag=DYCJQGKJWYDT type=del size=2860219 2024-09-12T00:18:03.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.104+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=Y9ZUNF3466II type=del size=2593595 2024-09-12T00:18:03.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.108+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~0WAP4J3I0X74.0 size=809563 2024-09-12T00:18:03.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.120+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=0WAP4J3I0X74 tag=7EEVIEC7FI5H type=write size=1858139 2024-09-12T00:18:03.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.124+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=DZQK8LE8VQ6D type=write size=445726 2024-09-12T00:18:03.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.128+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=Z5B6LGE85IAY type=del 2024-09-12T00:18:03.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.132+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=IQWWYXIB06L7 type=del size=2149031 2024-09-12T00:18:03.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.136+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=X5ZG9OB9ZQZK type=del 2024-09-12T00:18:03.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.140+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=KRXKAUQTY6H4 type=write size=53024 2024-09-12T00:18:03.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.144+0000 7f69cdea98c0 1 < canceled operation key=RDGRKQQH4B8C tag=AB3O9H8AUHYA type=del size=1005143 2024-09-12T00:18:03.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.148+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=S9WRMPXW1HJ8 type=write size=826276 2024-09-12T00:18:03.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.152+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=9TDNW3ALCCYQ type=del 2024-09-12T00:18:03.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~7EM84FL9F9TE.0 size=606225 2024-09-12T00:18:03.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.160+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=7EM84FL9F9TE tag=MMVCTY0PD88L type=write size=1654801 2024-09-12T00:18:03.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.160+0000 7f69cdea98c0 1 < canceled part key=_multipart_7UFADFUXL28I.2~DH7FNZXI36U3.0 size=1048576 2024-09-12T00:18:03.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.164+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~DH7FNZXI36U3.1 size=819688 2024-09-12T00:18:03.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.168+0000 7f69cdea98c0 1 < canceled multipart upload key=7UFADFUXL28I upload=DH7FNZXI36U3 tag=ZPTESWOLJIMO type=write size=2916840 2024-09-12T00:18:03.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.172+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=RJ8OJA56JDRU type=del size=2413194 2024-09-12T00:18:03.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.176+0000 7f69cdea98c0 1 < canceled operation key=0J667VAQGMTX tag=YKVSF83MMW3J type=write size=930565 2024-09-12T00:18:03.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.180+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=28LVHHB3S2NH type=del size=2190469 2024-09-12T00:18:03.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.188+0000 7f69cdea98c0 1 < suggested remove operation key=1CZXUEJLQ8FM tag=8YA8JZ84JHPF type=del 2024-09-12T00:18:03.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.192+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=OOV21G3B6FTJ type=del size=3028165 2024-09-12T00:18:03.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.196+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~HKMB9SCCDGZK.0 size=1048576 2024-09-12T00:18:03.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.200+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~HKMB9SCCDGZK.1 size=1048576 2024-09-12T00:18:03.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.200+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~HKMB9SCCDGZK.2 size=18673 2024-09-12T00:18:03.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.208+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=HKMB9SCCDGZK tag=2T7EY8E28LZM type=write size=3164401 2024-09-12T00:18:03.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.216+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~ZBTQE590IGF0.0 size=1048576 2024-09-12T00:18:03.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.216+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~ZBTQE590IGF0.1 size=1048576 2024-09-12T00:18:03.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.220+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~ZBTQE590IGF0.2 size=583548 2024-09-12T00:18:03.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.220+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=ZBTQE590IGF0 tag=VH72094ZXO21 type=write size=3729276 2024-09-12T00:18:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.224+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=90DQ0NYNDLMD type=del 2024-09-12T00:18:03.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.228+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=1GLA9WU8O3IL type=del size=2980547 2024-09-12T00:18:03.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.232+0000 7f69cdea98c0 1 < canceled operation key=IXWX7S5NWJS3 tag=9GT4LIY4IM29 type=del size=879714 2024-09-12T00:18:03.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.236+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=PEQLS5XEPHHR type=del size=160130 2024-09-12T00:18:03.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.240+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~G4CFQBEJDIRJ.0 size=842789 2024-09-12T00:18:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.244+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=G4CFQBEJDIRJ tag=0AC1SDX2KRH0 type=write size=1891365 2024-09-12T00:18:03.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.248+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=LDBFGN12F173 type=write size=175281 2024-09-12T00:18:03.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.252+0000 7f69cdea98c0 1 < completed write operation key=YS23U9GQS7SJ tag=8BN5UEAYHBAK type=write size=319573 2024-09-12T00:18:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.256+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=MWQNPNM4MHLG type=write size=231435 2024-09-12T00:18:03.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.260+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~YO4N2UU19UYH.0 size=1048576 2024-09-12T00:18:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.264+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~YO4N2UU19UYH.1 size=1048576 2024-09-12T00:18:03.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.268+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~YO4N2UU19UYH.2 size=1014738 2024-09-12T00:18:03.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.272+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=YO4N2UU19UYH tag=Y467N3N4LZVP type=write size=4160466 2024-09-12T00:18:03.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.276+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=QK37DJV7KHJW type=del size=399600 2024-09-12T00:18:03.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.284+0000 7f69cdea98c0 1 < suggested update operation key=2YYP9NOUAJD0 tag=S59JWU01EEEN type=del size=1405273 2024-09-12T00:18:03.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.288+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=H6RO0TBL8IV7 type=del size=590699 2024-09-12T00:18:03.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.292+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=Y9ZUNF3466II type=del 2024-09-12T00:18:03.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.296+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=7DEMGGW33RHD type=write size=479339 2024-09-12T00:18:03.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.300+0000 7f69cdea98c0 -1 < failed to complete operation key=1CZXUEJLQ8FM tag=DZQK8LE8VQ6D type=write size=445726: (22) Invalid argument 2024-09-12T00:18:03.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.304+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=903QI3BSY3AS type=del size=1659875 2024-09-12T00:18:03.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.312+0000 7f69cdea98c0 1 < suggested remove operation key=YS23U9GQS7SJ tag=IQWWYXIB06L7 type=del 2024-09-12T00:18:03.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.316+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=98ZR6C2KSZ36 type=del size=610820 2024-09-12T00:18:03.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.320+0000 7f69cdea98c0 1 < completed write operation key=Q0L8J0BYRFDQ tag=KRXKAUQTY6H4 type=write size=53024 2024-09-12T00:18:03.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.324+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=C0M0Z8VA5SRF type=del size=3457760 2024-09-12T00:18:03.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.328+0000 7f69cdea98c0 1 < completed write operation key=SP2KVAO82MQ0 tag=S9WRMPXW1HJ8 type=write size=826276 2024-09-12T00:18:03.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.336+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~HXQD2O6Z2SUQ.0 size=1048576 2024-09-12T00:18:03.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.336+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~HXQD2O6Z2SUQ.1 size=1048576 2024-09-12T00:18:03.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.340+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~HXQD2O6Z2SUQ.2 size=573788 2024-09-12T00:18:03.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.340+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=HXQD2O6Z2SUQ tag=IFL3CBEBIPL3 type=write size=3719516 2024-09-12T00:18:03.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.344+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~7EM84FL9F9TE.0 size=606225 2024-09-12T00:18:03.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.348+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=7EM84FL9F9TE tag=MMVCTY0PD88L type=write size=1654801 2024-09-12T00:18:03.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~51AKZNLVNAYK.0 size=548986 2024-09-12T00:18:03.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.356+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=51AKZNLVNAYK tag=HZLGDOIUQ0V8 type=write size=1597562 2024-09-12T00:18:03.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.360+0000 7f69cdea98c0 1 < canceled operation key=O5WBNND16BFN tag=RJ8OJA56JDRU type=del size=2413194 2024-09-12T00:18:03.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.368+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~7PFPQE3L80EM.0 size=212334 2024-09-12T00:18:03.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.368+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=7PFPQE3L80EM tag=9X6PCCILTEJI type=write size=1260910 2024-09-12T00:18:03.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.372+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=28LVHHB3S2NH type=del 2024-09-12T00:18:03.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.372+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=G6ES0CHXQ16C type=write size=927479 2024-09-12T00:18:03.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.380+0000 7f69cdea98c0 1 < suggested remove operation key=H91UXKWAJ3K8 tag=OOV21G3B6FTJ type=del 2024-09-12T00:18:03.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.384+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=CHX9V0ZQN0SQ type=del size=992463 2024-09-12T00:18:03.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.388+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~ZBTQE590IGF0.0 size=1048576 2024-09-12T00:18:03.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.392+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~ZBTQE590IGF0.1 size=1048576 2024-09-12T00:18:03.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.396+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~ZBTQE590IGF0.2 size=583548 2024-09-12T00:18:03.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.400+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=ZBTQE590IGF0 tag=VH72094ZXO21 type=write size=3729276 2024-09-12T00:18:03.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.404+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=47MPLEEW98FA type=write size=834591 2024-09-12T00:18:03.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.408+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=1GLA9WU8O3IL type=del 2024-09-12T00:18:03.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.412+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=VGQ8BN1X9DWP type=write size=284145 2024-09-12T00:18:03.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.416+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=PEQLS5XEPHHR type=del 2024-09-12T00:18:03.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.420+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=C5YXQHCR8XHO type=del size=2608607 2024-09-12T00:18:03.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.424+0000 7f69cdea98c0 1 < completed write operation key=2ENKC4QT2BFS tag=LDBFGN12F173 type=write size=175281 2024-09-12T00:18:03.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.428+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=RUYP01RZWIHB type=del size=3998770 2024-09-12T00:18:03.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.436+0000 7f69cdea98c0 1 < suggested update operation key=0EALARW4O3OB tag=MWQNPNM4MHLG type=write size=231435 2024-09-12T00:18:03.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.440+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=L8XJ6GNBGO6Z type=write size=810558 2024-09-12T00:18:03.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.444+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=QK37DJV7KHJW type=del 2024-09-12T00:18:03.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.448+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~SGMZZ59RS8IT.0 size=1048576 2024-09-12T00:18:03.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~SGMZZ59RS8IT.1 size=1048576 2024-09-12T00:18:03.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~SGMZZ59RS8IT.2 size=742908 2024-09-12T00:18:03.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.456+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=SGMZZ59RS8IT tag=306UA89DPOVW type=write size=3888636 2024-09-12T00:18:03.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.460+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=H6RO0TBL8IV7 type=del 2024-09-12T00:18:03.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.464+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=09LSHA0YWRPA type=write size=599481 2024-09-12T00:18:03.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.468+0000 7f69cdea98c0 -1 < failed to complete operation key=0EALARW4O3OB tag=7DEMGGW33RHD type=write size=479339: (22) Invalid argument 2024-09-12T00:18:03.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.472+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=0JCZPSOMDXO9 type=write size=676183 2024-09-12T00:18:03.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.484+0000 7f69cdea98c0 1 < suggested remove operation key=O5WBNND16BFN tag=903QI3BSY3AS type=del 2024-09-12T00:18:03.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.488+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~WS38ERXWCQUX.0 size=1048576 2024-09-12T00:18:03.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.492+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~WS38ERXWCQUX.1 size=1048576 2024-09-12T00:18:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.496+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~WS38ERXWCQUX.2 size=576972 2024-09-12T00:18:03.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.496+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=WS38ERXWCQUX tag=YGF8I1B6M7QM type=write size=3722700 2024-09-12T00:18:03.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.500+0000 7f69cdea98c0 1 < canceled operation key=7UFADFUXL28I tag=98ZR6C2KSZ36 type=del size=610820 2024-09-12T00:18:03.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.504+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=9IYY48VTXUD1 type=del size=33313 2024-09-12T00:18:03.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.512+0000 7f69cdea98c0 1 < suggested remove operation key=4O5U4WX3N4SA tag=C0M0Z8VA5SRF type=del 2024-09-12T00:18:03.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.516+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=WN6CWWG6JC6Y type=del size=3886585 2024-09-12T00:18:03.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.520+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~HXQD2O6Z2SUQ.0 size=1048576 2024-09-12T00:18:03.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.520+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~HXQD2O6Z2SUQ.1 size=1048576 2024-09-12T00:18:03.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.524+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~HXQD2O6Z2SUQ.2 size=573788 2024-09-12T00:18:03.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.532+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=HXQD2O6Z2SUQ tag=IFL3CBEBIPL3 type=write size=3719516 2024-09-12T00:18:03.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.536+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=6K2GG3OFBPKV type=del size=2008253 2024-09-12T00:18:03.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.540+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~51AKZNLVNAYK.0 size=548986 2024-09-12T00:18:03.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.544+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=51AKZNLVNAYK tag=HZLGDOIUQ0V8 type=write size=1597562 2024-09-12T00:18:03.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~NF5GVXC74UOW.0 size=1048576 2024-09-12T00:18:03.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~NF5GVXC74UOW.1 size=1048576 2024-09-12T00:18:03.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.556+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~NF5GVXC74UOW.2 size=30320 2024-09-12T00:18:03.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.556+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=NF5GVXC74UOW tag=D11GXNWADPC5 type=write size=3176048 2024-09-12T00:18:03.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.560+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~7PFPQE3L80EM.0 size=212334 2024-09-12T00:18:03.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.568+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=7PFPQE3L80EM tag=9X6PCCILTEJI type=write size=1260910 2024-09-12T00:18:03.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.568+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=JLC8B81ZA49N type=del size=3008125 2024-09-12T00:18:03.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.572+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=G6ES0CHXQ16C type=write size=927479 2024-09-12T00:18:03.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~I0C6D858MJH4.0 size=1048576 2024-09-12T00:18:03.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~I0C6D858MJH4.1 size=237402 2024-09-12T00:18:03.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.584+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=I0C6D858MJH4 tag=ULO3GE7VZPBZ type=write size=2334554 2024-09-12T00:18:03.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.588+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=CHX9V0ZQN0SQ type=del 2024-09-12T00:18:03.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~1TOQADQ9T512.0 size=1048576 2024-09-12T00:18:03.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.600+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~1TOQADQ9T512.1 size=1048576 2024-09-12T00:18:03.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.604+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~1TOQADQ9T512.2 size=231201 2024-09-12T00:18:03.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.604+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=1TOQADQ9T512 tag=LBX1TJCX6MCH type=write size=3376929 2024-09-12T00:18:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.612+0000 7f69cdea98c0 1 < suggested remove operation key=2YYP9NOUAJD0 tag=47MPLEEW98FA type=write 2024-09-12T00:18:03.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.616+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=KYFFPP5PJ1YD type=del size=885265 2024-09-12T00:18:03.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.620+0000 7f69cdea98c0 1 < completed write operation key=I23GNCI98JHU tag=VGQ8BN1X9DWP type=write size=284145 2024-09-12T00:18:03.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.624+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=CBCMR3D20DPY type=del size=1194302 2024-09-12T00:18:03.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.628+0000 7f69cdea98c0 -1 < failed to complete operation key=0EALARW4O3OB tag=C5YXQHCR8XHO type=del size=2608607: (22) Invalid argument 2024-09-12T00:18:03.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.632+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=RD1QL3ARNAEE type=del size=3274846 2024-09-12T00:18:03.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.636+0000 7f69cdea98c0 -1 < failed to complete operation key=0EALARW4O3OB tag=RUYP01RZWIHB type=del size=3998770: (22) Invalid argument 2024-09-12T00:18:03.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.640+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=EPDGG4IRQ37E type=del size=2832091 2024-09-12T00:18:03.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.644+0000 7f69cdea98c0 1 < completed write operation key=1CZXUEJLQ8FM tag=L8XJ6GNBGO6Z type=write size=810558 2024-09-12T00:18:03.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.648+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=DK2XJ2KD21P0 type=del size=4152783 2024-09-12T00:18:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.652+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~SGMZZ59RS8IT.0 size=1048576 2024-09-12T00:18:03.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.652+0000 7f69cdea98c0 1 < canceled part key=_multipart_0EALARW4O3OB.2~SGMZZ59RS8IT.1 size=1048576 2024-09-12T00:18:03.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.656+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~SGMZZ59RS8IT.2 size=742908 2024-09-12T00:18:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.664+0000 7f69cdea98c0 1 < canceled multipart upload key=0EALARW4O3OB upload=SGMZZ59RS8IT tag=306UA89DPOVW type=write size=3888636 2024-09-12T00:18:03.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~BRFPAMFU26YB.0 size=234780 2024-09-12T00:18:03.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.668+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=BRFPAMFU26YB tag=A74N9M94P47I type=write size=1283356 2024-09-12T00:18:03.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.672+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=09LSHA0YWRPA type=write size=599481 2024-09-12T00:18:03.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.676+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=H578PS1RIQ9B type=write size=349639 2024-09-12T00:18:03.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.680+0000 7f69cdea98c0 1 < completed write operation key=VYYY8MF0P3Q7 tag=0JCZPSOMDXO9 type=write size=676183 2024-09-12T00:18:03.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.684+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=5W2TQ47VS074 type=del size=2313891 2024-09-12T00:18:03.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.688+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~WS38ERXWCQUX.0 size=1048576 2024-09-12T00:18:03.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.692+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~WS38ERXWCQUX.1 size=1048576 2024-09-12T00:18:03.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.692+0000 7f69cdea98c0 1 < canceled part key=_multipart_LRHZKCU22AIX.2~WS38ERXWCQUX.2 size=576972 2024-09-12T00:18:03.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.696+0000 7f69cdea98c0 1 < canceled multipart upload key=LRHZKCU22AIX upload=WS38ERXWCQUX tag=YGF8I1B6M7QM type=write size=3722700 2024-09-12T00:18:03.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.700+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=Z0AZRKO3284K type=del size=2126481 2024-09-12T00:18:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.704+0000 7f69cdea98c0 -1 < failed to complete operation key=4O5U4WX3N4SA tag=9IYY48VTXUD1 type=del size=33313: (22) Invalid argument 2024-09-12T00:18:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.712+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~R2AC4NHES10D.0 size=1048576 2024-09-12T00:18:03.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.716+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~R2AC4NHES10D.1 size=592043 2024-09-12T00:18:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.716+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=R2AC4NHES10D tag=ZQHKSI5G1POD type=write size=2689195 2024-09-12T00:18:03.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.720+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=WN6CWWG6JC6Y type=del 2024-09-12T00:18:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.724+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=F63QSE063BDQ type=write size=12233 2024-09-12T00:18:03.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.724+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=6K2GG3OFBPKV type=del 2024-09-12T00:18:03.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.728+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=7WUF8RN86TXZ type=del size=1467523 2024-09-12T00:18:03.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.732+0000 7f69cdea98c0 1 < canceled part key=_multipart_H91UXKWAJ3K8.2~NF5GVXC74UOW.0 size=1048576 2024-09-12T00:18:03.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.732+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~NF5GVXC74UOW.1 size=1048576 2024-09-12T00:18:03.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.736+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~NF5GVXC74UOW.2 size=30320 2024-09-12T00:18:03.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.744+0000 7f69cdea98c0 1 < canceled multipart upload key=H91UXKWAJ3K8 upload=NF5GVXC74UOW tag=D11GXNWADPC5 type=write size=3176048 2024-09-12T00:18:03.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.748+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=NZ36T9RG40N9 type=del size=647773 2024-09-12T00:18:03.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.752+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=JLC8B81ZA49N type=del 2024-09-12T00:18:03.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.756+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~1C6UP397NUGN.0 size=1048576 2024-09-12T00:18:03.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.760+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~1C6UP397NUGN.1 size=308162 2024-09-12T00:18:03.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.760+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=1C6UP397NUGN tag=VMG0GUWM9A80 type=write size=2405314 2024-09-12T00:18:03.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.764+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~I0C6D858MJH4.0 size=1048576 2024-09-12T00:18:03.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.768+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~I0C6D858MJH4.1 size=237402 2024-09-12T00:18:03.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.772+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=I0C6D858MJH4 tag=ULO3GE7VZPBZ type=write size=2334554 2024-09-12T00:18:03.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.780+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~Z9RWSKKRD2SP.0 size=633569 2024-09-12T00:18:03.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.780+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=Z9RWSKKRD2SP tag=CI4HT08LS48S type=write size=1682145 2024-09-12T00:18:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.784+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~1TOQADQ9T512.0 size=1048576 2024-09-12T00:18:03.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.788+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~1TOQADQ9T512.1 size=1048576 2024-09-12T00:18:03.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.788+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~1TOQADQ9T512.2 size=231201 2024-09-12T00:18:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.796+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=1TOQADQ9T512 tag=LBX1TJCX6MCH type=write size=3376929 2024-09-12T00:18:03.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.800+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=H1LAIARRCEA7 type=write size=632396 2024-09-12T00:18:03.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.808+0000 7f69cdea98c0 1 < suggested update operation key=O5WBNND16BFN tag=KYFFPP5PJ1YD type=del size=885265 2024-09-12T00:18:03.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.812+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=C1BCO1VWX2D9 type=write size=1025120 2024-09-12T00:18:03.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.816+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=CBCMR3D20DPY type=del 2024-09-12T00:18:03.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~4WD59H877Q4N.0 size=1048576 2024-09-12T00:18:03.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.824+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~4WD59H877Q4N.1 size=979126 2024-09-12T00:18:03.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.824+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=4WD59H877Q4N tag=O1X55RTVNLOW type=write size=3076278 2024-09-12T00:18:03.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.828+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=RD1QL3ARNAEE type=del 2024-09-12T00:18:03.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.836+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=XR4540EVASEM type=write size=684977 2024-09-12T00:18:03.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.840+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=EPDGG4IRQ37E type=del 2024-09-12T00:18:03.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.844+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=3UKWPHABYRMY type=write size=1035876 2024-09-12T00:18:03.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.848+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=DK2XJ2KD21P0 type=del 2024-09-12T00:18:03.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.852+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=CEWH2SGP9G91 type=del size=2561133 2024-09-12T00:18:03.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.856+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~BRFPAMFU26YB.0 size=234780 2024-09-12T00:18:03.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.860+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=BRFPAMFU26YB tag=A74N9M94P47I type=write size=1283356 2024-09-12T00:18:03.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.864+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=V5Q37W9PP6XF type=del size=38227 2024-09-12T00:18:03.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.868+0000 7f69cdea98c0 1 < completed write operation key=2YYP9NOUAJD0 tag=H578PS1RIQ9B type=write size=349639 2024-09-12T00:18:03.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~Z4NVNOGL40DS.0 size=1048576 2024-09-12T00:18:03.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~Z4NVNOGL40DS.1 size=1048576 2024-09-12T00:18:03.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~Z4NVNOGL40DS.2 size=326601 2024-09-12T00:18:03.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.880+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=Z4NVNOGL40DS tag=6A81RJRXE670 type=write size=3472329 2024-09-12T00:18:03.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.884+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=5W2TQ47VS074 type=del 2024-09-12T00:18:03.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.888+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=KV1LCCXOGXCS type=del size=2102626 2024-09-12T00:18:03.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.892+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=Z0AZRKO3284K type=del 2024-09-12T00:18:03.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.896+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=ZB2PCNH382VV type=del size=998388 2024-09-12T00:18:03.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.900+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~R2AC4NHES10D.0 size=1048576 2024-09-12T00:18:03.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.904+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~R2AC4NHES10D.1 size=592043 2024-09-12T00:18:03.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.908+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=R2AC4NHES10D tag=ZQHKSI5G1POD type=write size=2689195 2024-09-12T00:18:03.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.916+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~R46WP425BHE2.0 size=1048576 2024-09-12T00:18:03.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.916+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~R46WP425BHE2.1 size=605319 2024-09-12T00:18:03.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.916+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=R46WP425BHE2 tag=M0MLK6ZUOPZV type=write size=2702471 2024-09-12T00:18:03.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.920+0000 7f69cdea98c0 1 < completed write operation key=HSQZYI0SNZP1 tag=F63QSE063BDQ type=write size=12233 2024-09-12T00:18:03.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.928+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~RYANPVKAJENO.0 size=63068 2024-09-12T00:18:03.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.928+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=RYANPVKAJENO tag=WLSMQQR436T9 type=write size=1111644 2024-09-12T00:18:03.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.932+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=7WUF8RN86TXZ type=del 2024-09-12T00:18:03.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.936+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=6LWVGHLV3VGN type=del size=4026525 2024-09-12T00:18:03.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.944+0000 7f69cdea98c0 1 < suggested update operation key=0J667VAQGMTX tag=NZ36T9RG40N9 type=del size=647773 2024-09-12T00:18:03.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.948+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=JY1JS5WCVU23 type=write size=625887 2024-09-12T00:18:03.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.948+0000 7f69cdea98c0 1 < canceled part key=_multipart_AQY7MM3OX3GW.2~1C6UP397NUGN.0 size=1048576 2024-09-12T00:18:03.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.952+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~1C6UP397NUGN.1 size=308162 2024-09-12T00:18:03.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.960+0000 7f69cdea98c0 1 < canceled multipart upload key=AQY7MM3OX3GW upload=1C6UP397NUGN tag=VMG0GUWM9A80 type=write size=2405314 2024-09-12T00:18:03.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~S2UXKTE8K2PT.0 size=1048576 2024-09-12T00:18:03.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.968+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~S2UXKTE8K2PT.1 size=916260 2024-09-12T00:18:03.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.968+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=S2UXKTE8K2PT tag=CMOZM1Y1JIA6 type=write size=3013412 2024-09-12T00:18:03.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.972+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~Z9RWSKKRD2SP.0 size=633569 2024-09-12T00:18:03.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.976+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=Z9RWSKKRD2SP tag=CI4HT08LS48S type=write size=1682145 2024-09-12T00:18:03.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.980+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=WXTLOKP5IYLY type=del size=3757217 2024-09-12T00:18:03.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.988+0000 7f69cdea98c0 1 < suggested update operation key=I23GNCI98JHU tag=H1LAIARRCEA7 type=write size=632396 2024-09-12T00:18:03.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:03.996+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~IXPIIL5FWCC0.0 size=1048576 2024-09-12T00:18:03.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.000+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~IXPIIL5FWCC0.1 size=1048576 2024-09-12T00:18:04.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.000+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~IXPIIL5FWCC0.2 size=384028 2024-09-12T00:18:04.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.000+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=IXPIIL5FWCC0 tag=WUHWR81WQEU0 type=write size=3529756 2024-09-12T00:18:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.004+0000 7f69cdea98c0 1 < completed write operation key=7UFADFUXL28I tag=C1BCO1VWX2D9 type=write size=1025120 2024-09-12T00:18:04.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.008+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=M6SL0FLSAC5I type=del size=3880635 2024-09-12T00:18:04.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.012+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~4WD59H877Q4N.0 size=1048576 2024-09-12T00:18:04.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.016+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~4WD59H877Q4N.1 size=979126 2024-09-12T00:18:04.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.020+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=4WD59H877Q4N tag=O1X55RTVNLOW type=write size=3076278 2024-09-12T00:18:04.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.024+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=0FW4GHZ91FUH type=del size=1032532 2024-09-12T00:18:04.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.028+0000 7f69cdea98c0 1 < completed write operation key=VYYY8MF0P3Q7 tag=XR4540EVASEM type=write size=684977 2024-09-12T00:18:04.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.032+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=T3NII8TH912S type=del size=3612081 2024-09-12T00:18:04.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.036+0000 7f69cdea98c0 1 < completed write operation key=AWZ03VE7D86K tag=3UKWPHABYRMY type=write size=1035876 2024-09-12T00:18:04.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.040+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~UICPRBTYTNW3.0 size=1048576 2024-09-12T00:18:04.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~UICPRBTYTNW3.1 size=1048576 2024-09-12T00:18:04.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~UICPRBTYTNW3.2 size=759809 2024-09-12T00:18:04.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.048+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=UICPRBTYTNW3 tag=W7MBBR00Q8OL type=write size=3905537 2024-09-12T00:18:04.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.052+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=CEWH2SGP9G91 type=del 2024-09-12T00:18:04.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.056+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=7G1HFWFC9IGL type=del size=155284 2024-09-12T00:18:04.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.056+0000 7f69cdea98c0 1 < canceled operation key=0HAUC4BDL9VR tag=V5Q37W9PP6XF type=del size=38227 2024-09-12T00:18:04.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.060+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=QJZO20YB20VX type=write size=715009 2024-09-12T00:18:04.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.068+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~Z4NVNOGL40DS.0 size=1048576 2024-09-12T00:18:04.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.068+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~Z4NVNOGL40DS.1 size=1048576 2024-09-12T00:18:04.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.072+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~Z4NVNOGL40DS.2 size=326601 2024-09-12T00:18:04.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.076+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=Z4NVNOGL40DS tag=6A81RJRXE670 type=write size=3472329 2024-09-12T00:18:04.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.080+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=8LBDPQOT8HAI type=del size=3256170 2024-09-12T00:18:04.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.084+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=KV1LCCXOGXCS type=del 2024-09-12T00:18:04.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.088+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=7N0XVCFT82W8 type=write size=783545 2024-09-12T00:18:04.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.092+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=ZB2PCNH382VV type=del 2024-09-12T00:18:04.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.096+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=QBHLMM43ACTI type=del size=3770779 2024-09-12T00:18:04.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.100+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~R46WP425BHE2.0 size=1048576 2024-09-12T00:18:04.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.104+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~R46WP425BHE2.1 size=605319 2024-09-12T00:18:04.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.108+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=R46WP425BHE2 tag=M0MLK6ZUOPZV type=write size=2702471 2024-09-12T00:18:04.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.116+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~6GYXRQ0HUFWO.0 size=1048576 2024-09-12T00:18:04.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~6GYXRQ0HUFWO.1 size=1048576 2024-09-12T00:18:04.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~6GYXRQ0HUFWO.2 size=763867 2024-09-12T00:18:04.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.120+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=6GYXRQ0HUFWO tag=0Z1X0LGXTXNF type=write size=3909595 2024-09-12T00:18:04.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.124+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~RYANPVKAJENO.0 size=63068 2024-09-12T00:18:04.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.128+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=RYANPVKAJENO tag=WLSMQQR436T9 type=write size=1111644 2024-09-12T00:18:04.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.132+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=DW9F1RDU15BZ type=write size=233443 2024-09-12T00:18:04.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.136+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=6LWVGHLV3VGN type=del 2024-09-12T00:18:04.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~B11XUCTR2OD6.0 size=122074 2024-09-12T00:18:04.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.144+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=B11XUCTR2OD6 tag=27D0SDZDNP7H type=write size=1170650 2024-09-12T00:18:04.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.148+0000 7f69cdea98c0 1 < completed write operation key=RDGRKQQH4B8C tag=JY1JS5WCVU23 type=write size=625887 2024-09-12T00:18:04.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.152+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=HQGN2VBC4WRW type=del size=969415 2024-09-12T00:18:04.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.152+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~S2UXKTE8K2PT.0 size=1048576 2024-09-12T00:18:04.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.160+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~S2UXKTE8K2PT.1 size=916260 2024-09-12T00:18:04.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.164+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=S2UXKTE8K2PT tag=CMOZM1Y1JIA6 type=write size=3013412 2024-09-12T00:18:04.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.168+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=OVX275ALQ021 type=write size=551516 2024-09-12T00:18:04.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.172+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=WXTLOKP5IYLY type=del 2024-09-12T00:18:04.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.180+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~2CL846DNQGKI.0 size=238540 2024-09-12T00:18:04.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.180+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=2CL846DNQGKI tag=PCP05G3RSJ61 type=write size=1287116 2024-09-12T00:18:04.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.184+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~IXPIIL5FWCC0.0 size=1048576 2024-09-12T00:18:04.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.188+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~IXPIIL5FWCC0.1 size=1048576 2024-09-12T00:18:04.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.192+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~IXPIIL5FWCC0.2 size=384028 2024-09-12T00:18:04.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.196+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=IXPIIL5FWCC0 tag=WUHWR81WQEU0 type=write size=3529756 2024-09-12T00:18:04.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.200+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=01BDFLXJTOM7 type=del size=2244084 2024-09-12T00:18:04.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.204+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=M6SL0FLSAC5I type=del 2024-09-12T00:18:04.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~O1Y3C4XZP25R.0 size=1048576 2024-09-12T00:18:04.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~O1Y3C4XZP25R.1 size=1048576 2024-09-12T00:18:04.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~O1Y3C4XZP25R.2 size=970378 2024-09-12T00:18:04.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.212+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=O1Y3C4XZP25R tag=QNC2D88IXD9T type=write size=4116106 2024-09-12T00:18:04.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.216+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=0FW4GHZ91FUH type=del 2024-09-12T00:18:04.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.220+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=D4XWWAUPNM42 type=del size=1266120 2024-09-12T00:18:04.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.224+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=T3NII8TH912S type=del 2024-09-12T00:18:04.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.228+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=LA1DW34YZ53B type=del size=3857751 2024-09-12T00:18:04.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.232+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~UICPRBTYTNW3.0 size=1048576 2024-09-12T00:18:04.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.232+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~UICPRBTYTNW3.1 size=1048576 2024-09-12T00:18:04.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.236+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~UICPRBTYTNW3.2 size=759809 2024-09-12T00:18:04.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.244+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=UICPRBTYTNW3 tag=W7MBBR00Q8OL type=write size=3905537 2024-09-12T00:18:04.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~45RNETFG8OOE.0 size=1048576 2024-09-12T00:18:04.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.252+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~45RNETFG8OOE.1 size=135758 2024-09-12T00:18:04.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.252+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=45RNETFG8OOE tag=39HCDQJFLM3I type=write size=2232910 2024-09-12T00:18:04.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.256+0000 7f69cdea98c0 1 < canceled operation key=K4LNDJJUA1RZ tag=7G1HFWFC9IGL type=del size=155284 2024-09-12T00:18:04.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~XBCH0L81KPJQ.0 size=1048576 2024-09-12T00:18:04.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.264+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~XBCH0L81KPJQ.1 size=984517 2024-09-12T00:18:04.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.264+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=XBCH0L81KPJQ tag=GHW61MXG54T4 type=write size=3081669 2024-09-12T00:18:04.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.268+0000 7f69cdea98c0 1 < completed write operation key=UTZNJQJQMXJS tag=QJZO20YB20VX type=write size=715009 2024-09-12T00:18:04.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.272+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=3SMYCW1126QN type=del size=3243098 2024-09-12T00:18:04.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.276+0000 7f69cdea98c0 1 < canceled operation key=SP2KVAO82MQ0 tag=8LBDPQOT8HAI type=del size=3256170 2024-09-12T00:18:04.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.284+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~7GQQ77C2D3X3.0 size=1048576 2024-09-12T00:18:04.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.284+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~7GQQ77C2D3X3.1 size=1048576 2024-09-12T00:18:04.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.288+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~7GQQ77C2D3X3.2 size=288021 2024-09-12T00:18:04.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.288+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=7GQQ77C2D3X3 tag=4F4NL45F09AX type=write size=3433749 2024-09-12T00:18:04.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.292+0000 7f69cdea98c0 1 < completed write operation key=2X78JWLK876H tag=7N0XVCFT82W8 type=write size=783545 2024-09-12T00:18:04.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.296+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=O3WUXVNIETBO type=del size=1331040 2024-09-12T00:18:04.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.304+0000 7f69cdea98c0 1 < suggested update operation key=HSQZYI0SNZP1 tag=QBHLMM43ACTI type=del size=3770779 2024-09-12T00:18:04.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.308+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=F5OII04028YI type=del size=3299312 2024-09-12T00:18:04.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.312+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~6GYXRQ0HUFWO.0 size=1048576 2024-09-12T00:18:04.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.312+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~6GYXRQ0HUFWO.1 size=1048576 2024-09-12T00:18:04.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.316+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~6GYXRQ0HUFWO.2 size=763867 2024-09-12T00:18:04.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.324+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=6GYXRQ0HUFWO tag=0Z1X0LGXTXNF type=write size=3909595 2024-09-12T00:18:04.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.328+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=C5IZUJ40VYZD type=del size=69135 2024-09-12T00:18:04.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.332+0000 7f69cdea98c0 1 < completed write operation key=2ENKC4QT2BFS tag=DW9F1RDU15BZ type=write size=233443 2024-09-12T00:18:04.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.332+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=CT6OXTNPA04R type=del size=390905 2024-09-12T00:18:04.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.336+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~B11XUCTR2OD6.0 size=122074 2024-09-12T00:18:04.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.344+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=B11XUCTR2OD6 tag=27D0SDZDNP7H type=write size=1170650 2024-09-12T00:18:04.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.352+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~F7LD5I25ON1P.0 size=1048576 2024-09-12T00:18:04.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.352+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~F7LD5I25ON1P.1 size=1048576 2024-09-12T00:18:04.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~F7LD5I25ON1P.2 size=89458 2024-09-12T00:18:04.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.356+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=F7LD5I25ON1P tag=SBV3LM4CPQ43 type=write size=3235186 2024-09-12T00:18:04.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.360+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=HQGN2VBC4WRW type=del 2024-09-12T00:18:04.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.364+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=480YZCSEKRVD type=del size=1939691 2024-09-12T00:18:04.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.368+0000 7f69cdea98c0 1 < completed write operation key=2YYP9NOUAJD0 tag=OVX275ALQ021 type=write size=551516 2024-09-12T00:18:04.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.372+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=PMRDBG0FOOCU type=del size=1581021 2024-09-12T00:18:04.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.376+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~2CL846DNQGKI.0 size=238540 2024-09-12T00:18:04.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.380+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=2CL846DNQGKI tag=PCP05G3RSJ61 type=write size=1287116 2024-09-12T00:18:04.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.384+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=A9XCSL0ZCIH8 type=write size=283911 2024-09-12T00:18:04.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.392+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=01BDFLXJTOM7 type=del 2024-09-12T00:18:04.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.396+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=Y051JLBQ3254 type=del size=2076546 2024-09-12T00:18:04.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.400+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~O1Y3C4XZP25R.0 size=1048576 2024-09-12T00:18:04.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.400+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~O1Y3C4XZP25R.1 size=1048576 2024-09-12T00:18:04.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.404+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~O1Y3C4XZP25R.2 size=970378 2024-09-12T00:18:04.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.412+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=O1Y3C4XZP25R tag=QNC2D88IXD9T type=write size=4116106 2024-09-12T00:18:04.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.416+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=D2GJDOC6HULL type=write size=831669 2024-09-12T00:18:04.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.420+0000 7f69cdea98c0 1 < canceled operation key=AWZ03VE7D86K tag=D4XWWAUPNM42 type=del size=1266120 2024-09-12T00:18:04.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.424+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~KZC052S1T4NL.0 size=903071 2024-09-12T00:18:04.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.424+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=KZC052S1T4NL tag=942P35E9E9E5 type=write size=1951647 2024-09-12T00:18:04.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.432+0000 7f69cdea98c0 1 < suggested update operation key=UTZNJQJQMXJS tag=LA1DW34YZ53B type=del size=3857751 2024-09-12T00:18:04.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.436+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=QH75VAI681Y1 type=write size=836010 2024-09-12T00:18:04.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.440+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~45RNETFG8OOE.0 size=1048576 2024-09-12T00:18:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.444+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~45RNETFG8OOE.1 size=135758 2024-09-12T00:18:04.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.448+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=45RNETFG8OOE tag=39HCDQJFLM3I type=write size=2232910 2024-09-12T00:18:04.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.452+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=2L67K1ORLOFO type=del size=2105898 2024-09-12T00:18:04.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.456+0000 7f69cdea98c0 1 < canceled part key=_multipart_AWZ03VE7D86K.2~XBCH0L81KPJQ.0 size=1048576 2024-09-12T00:18:04.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.456+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~XBCH0L81KPJQ.1 size=984517 2024-09-12T00:18:04.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.464+0000 7f69cdea98c0 1 < canceled multipart upload key=AWZ03VE7D86K upload=XBCH0L81KPJQ tag=GHW61MXG54T4 type=write size=3081669 2024-09-12T00:18:04.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~B4YBNTVW4XS8.0 size=1048576 2024-09-12T00:18:04.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~B4YBNTVW4XS8.1 size=882771 2024-09-12T00:18:04.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.472+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=B4YBNTVW4XS8 tag=63NHXDPEFYQ8 type=write size=2979923 2024-09-12T00:18:04.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.476+0000 7f69cdea98c0 -1 < failed to complete operation key=HSQZYI0SNZP1 tag=3SMYCW1126QN type=del size=3243098: (22) Invalid argument 2024-09-12T00:18:04.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.484+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~H2THGAUZF1RZ.0 size=1048576 2024-09-12T00:18:04.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.488+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~H2THGAUZF1RZ.1 size=967266 2024-09-12T00:18:04.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.488+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=H2THGAUZF1RZ tag=3T5F8Y78E657 type=write size=3064418 2024-09-12T00:18:04.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.492+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~7GQQ77C2D3X3.0 size=1048576 2024-09-12T00:18:04.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.492+0000 7f69cdea98c0 1 < canceled part key=_multipart_RDGRKQQH4B8C.2~7GQQ77C2D3X3.1 size=1048576 2024-09-12T00:18:04.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.496+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~7GQQ77C2D3X3.2 size=288021 2024-09-12T00:18:04.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.500+0000 7f69cdea98c0 1 < canceled multipart upload key=RDGRKQQH4B8C upload=7GQQ77C2D3X3 tag=4F4NL45F09AX type=write size=3433749 2024-09-12T00:18:04.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.508+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~6NEFD4GR7FCG.0 size=1048576 2024-09-12T00:18:04.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.512+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~6NEFD4GR7FCG.1 size=1048576 2024-09-12T00:18:04.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.516+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~6NEFD4GR7FCG.2 size=186686 2024-09-12T00:18:04.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.516+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=6NEFD4GR7FCG tag=1R66LW4C6L0X type=write size=3332414 2024-09-12T00:18:04.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.524+0000 7f69cdea98c0 1 < suggested remove operation key=Z6MH459BTZ6K tag=O3WUXVNIETBO type=del 2024-09-12T00:18:04.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.532+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~OB8PGVH8WNRU.0 size=1048576 2024-09-12T00:18:04.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~OB8PGVH8WNRU.1 size=1048576 2024-09-12T00:18:04.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~OB8PGVH8WNRU.2 size=825514 2024-09-12T00:18:04.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.536+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=OB8PGVH8WNRU tag=P5MWH2GCFTC2 type=write size=3971242 2024-09-12T00:18:04.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.540+0000 7f69cdea98c0 1 < canceled operation key=AQY7MM3OX3GW tag=F5OII04028YI type=del size=3299312 2024-09-12T00:18:04.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.544+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=VRIX4OVHIGPA type=del size=1605978 2024-09-12T00:18:04.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.548+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=C5IZUJ40VYZD type=del 2024-09-12T00:18:04.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.552+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=JCGDBTMIW063 type=del size=2574210 2024-09-12T00:18:04.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.556+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=CT6OXTNPA04R type=del 2024-09-12T00:18:04.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.560+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=16O3U9RT6Q1F type=del size=3621220 2024-09-12T00:18:04.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.564+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~F7LD5I25ON1P.0 size=1048576 2024-09-12T00:18:04.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.568+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~F7LD5I25ON1P.1 size=1048576 2024-09-12T00:18:04.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.568+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~F7LD5I25ON1P.2 size=89458 2024-09-12T00:18:04.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.576+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=F7LD5I25ON1P tag=SBV3LM4CPQ43 type=write size=3235186 2024-09-12T00:18:04.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~9XSA90XLKJTO.0 size=1048576 2024-09-12T00:18:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~9XSA90XLKJTO.1 size=1048576 2024-09-12T00:18:04.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.588+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~9XSA90XLKJTO.2 size=138755 2024-09-12T00:18:04.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.588+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=9XSA90XLKJTO tag=3IPJ8IC14RH0 type=write size=3284483 2024-09-12T00:18:04.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.592+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=480YZCSEKRVD type=del 2024-09-12T00:18:04.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.600+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~1K80OLP69JW1.0 size=247695 2024-09-12T00:18:04.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.600+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=1K80OLP69JW1 tag=ANEL2BPIIRJ9 type=write size=1296271 2024-09-12T00:18:04.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.604+0000 7f69cdea98c0 1 < suggested update operation key=AQY7MM3OX3GW tag=PMRDBG0FOOCU type=del size=1581021 2024-09-12T00:18:04.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.608+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=ZJA4YX28G7QB type=write size=211789 2024-09-12T00:18:04.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.612+0000 7f69cdea98c0 -1 < failed to complete operation key=Z6MH459BTZ6K tag=A9XCSL0ZCIH8 type=write size=283911: (22) Invalid argument 2024-09-12T00:18:04.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.616+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=NYSG8INM278O type=write size=179376 2024-09-12T00:18:04.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.620+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=Y051JLBQ3254 type=del 2024-09-12T00:18:04.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.628+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~RAAMZ9T0571P.0 size=644609 2024-09-12T00:18:04.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.628+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=RAAMZ9T0571P tag=IPZ5PPDM7PFG type=write size=1693185 2024-09-12T00:18:04.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.628+0000 7f69cdea98c0 1 < completed write operation key=K4LNDJJUA1RZ tag=D2GJDOC6HULL type=write size=831669 2024-09-12T00:18:04.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.636+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~YGPBXZXTUTA9.0 size=519032 2024-09-12T00:18:04.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.636+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=YGPBXZXTUTA9 tag=2JF2DSC2WVS4 type=write size=1567608 2024-09-12T00:18:04.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.640+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~KZC052S1T4NL.0 size=903071 2024-09-12T00:18:04.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.644+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=KZC052S1T4NL tag=942P35E9E9E5 type=write size=1951647 2024-09-12T00:18:04.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.648+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=YJ1KYN40E2ZX type=del size=2541276 2024-09-12T00:18:04.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.656+0000 7f69cdea98c0 1 < suggested remove operation key=VYYY8MF0P3Q7 tag=QH75VAI681Y1 type=write 2024-09-12T00:18:04.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.660+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=F8KQI1MENCAN type=del size=192643 2024-09-12T00:18:04.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.664+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=2L67K1ORLOFO type=del 2024-09-12T00:18:04.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.668+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=KF62VLQIRLUG type=del size=2032663 2024-09-12T00:18:04.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.672+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~B4YBNTVW4XS8.0 size=1048576 2024-09-12T00:18:04.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.676+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~B4YBNTVW4XS8.1 size=882771 2024-09-12T00:18:04.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.680+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=B4YBNTVW4XS8 tag=63NHXDPEFYQ8 type=write size=2979923 2024-09-12T00:18:04.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~Z6SUOHID0VG5.0 size=1048576 2024-09-12T00:18:04.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~Z6SUOHID0VG5.1 size=978428 2024-09-12T00:18:04.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.688+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=Z6SUOHID0VG5 tag=0L2M7183YK93 type=write size=3075580 2024-09-12T00:18:04.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.688+0000 7f69cdea98c0 1 < canceled part key=_multipart_SP2KVAO82MQ0.2~H2THGAUZF1RZ.0 size=1048576 2024-09-12T00:18:04.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.692+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~H2THGAUZF1RZ.1 size=967266 2024-09-12T00:18:04.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.696+0000 7f69cdea98c0 1 < canceled multipart upload key=SP2KVAO82MQ0 upload=H2THGAUZF1RZ tag=3T5F8Y78E657 type=write size=3064418 2024-09-12T00:18:04.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.700+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=GDT06QDEJ5W1 type=del size=1435744 2024-09-12T00:18:04.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.704+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~6NEFD4GR7FCG.0 size=1048576 2024-09-12T00:18:04.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.708+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~6NEFD4GR7FCG.1 size=1048576 2024-09-12T00:18:04.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.708+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~6NEFD4GR7FCG.2 size=186686 2024-09-12T00:18:04.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.716+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=6NEFD4GR7FCG tag=1R66LW4C6L0X type=write size=3332414 2024-09-12T00:18:04.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.720+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~FXT6S0MZRHHU.0 size=1048576 2024-09-12T00:18:04.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.724+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~FXT6S0MZRHHU.1 size=1048576 2024-09-12T00:18:04.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~FXT6S0MZRHHU.2 size=381254 2024-09-12T00:18:04.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.728+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=FXT6S0MZRHHU tag=6KUJWNG2F3KK type=write size=3526982 2024-09-12T00:18:04.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.732+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~OB8PGVH8WNRU.0 size=1048576 2024-09-12T00:18:04.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.732+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~OB8PGVH8WNRU.1 size=1048576 2024-09-12T00:18:04.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.736+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~OB8PGVH8WNRU.2 size=825514 2024-09-12T00:18:04.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.744+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=OB8PGVH8WNRU tag=P5MWH2GCFTC2 type=write size=3971242 2024-09-12T00:18:04.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.744+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=K8PTEAQFR1H4 type=del size=2964839 2024-09-12T00:18:04.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.752+0000 7f69cdea98c0 1 < suggested remove operation key=AQY7MM3OX3GW tag=VRIX4OVHIGPA type=del 2024-09-12T00:18:04.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.756+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=FA143B6P5OOQ type=write size=922612 2024-09-12T00:18:04.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.760+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=JCGDBTMIW063 type=del 2024-09-12T00:18:04.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.764+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~ZI3579N0CJ81.0 size=1048576 2024-09-12T00:18:04.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.768+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~ZI3579N0CJ81.1 size=1048576 2024-09-12T00:18:04.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.772+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~ZI3579N0CJ81.2 size=154792 2024-09-12T00:18:04.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.772+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=ZI3579N0CJ81 tag=ZFEHEP266TRZ type=write size=3300520 2024-09-12T00:18:04.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.772+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=16O3U9RT6Q1F type=del 2024-09-12T00:18:04.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.780+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~ZLH1DUM7CTHG.0 size=486692 2024-09-12T00:18:04.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.780+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=ZLH1DUM7CTHG tag=TB7UZ7SB41R6 type=write size=1535268 2024-09-12T00:18:04.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.784+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~9XSA90XLKJTO.0 size=1048576 2024-09-12T00:18:04.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.784+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~9XSA90XLKJTO.1 size=1048576 2024-09-12T00:18:04.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.788+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~9XSA90XLKJTO.2 size=138755 2024-09-12T00:18:04.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.792+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=9XSA90XLKJTO tag=3IPJ8IC14RH0 type=write size=3284483 2024-09-12T00:18:04.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.800+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~7YEHGZASGHJ7.0 size=1048576 2024-09-12T00:18:04.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~7YEHGZASGHJ7.1 size=1047165 2024-09-12T00:18:04.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.804+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=7YEHGZASGHJ7 tag=Q9CTZ537T8C9 type=write size=3144317 2024-09-12T00:18:04.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.808+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~1K80OLP69JW1.0 size=247695 2024-09-12T00:18:04.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.812+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=1K80OLP69JW1 tag=ANEL2BPIIRJ9 type=write size=1296271 2024-09-12T00:18:04.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~1Y4IZPELW305.0 size=853369 2024-09-12T00:18:04.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.820+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=1Y4IZPELW305 tag=UWTH9F8WWOQY type=write size=1901945 2024-09-12T00:18:04.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.824+0000 7f69cdea98c0 1 < completed write operation key=IXWX7S5NWJS3 tag=ZJA4YX28G7QB type=write size=211789 2024-09-12T00:18:04.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.828+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=TC59HXFXGOTZ type=del size=1222634 2024-09-12T00:18:04.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.832+0000 7f69cdea98c0 -1 < failed to complete operation key=AQY7MM3OX3GW tag=NYSG8INM278O type=write size=179376: (22) Invalid argument 2024-09-12T00:18:04.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.836+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=13JPZSRAMPGQ type=del size=427518 2024-09-12T00:18:04.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.836+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~RAAMZ9T0571P.0 size=644609 2024-09-12T00:18:04.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.848+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=RAAMZ9T0571P tag=IPZ5PPDM7PFG type=write size=1693185 2024-09-12T00:18:04.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.852+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~XZ500B4T89J2.0 size=1048576 2024-09-12T00:18:04.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.856+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~XZ500B4T89J2.1 size=1048576 2024-09-12T00:18:04.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~XZ500B4T89J2.2 size=162170 2024-09-12T00:18:04.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.860+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=XZ500B4T89J2 tag=JN9IFJ2YN2YE type=write size=3307898 2024-09-12T00:18:04.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.864+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~YGPBXZXTUTA9.0 size=519032 2024-09-12T00:18:04.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.868+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=YGPBXZXTUTA9 tag=2JF2DSC2WVS4 type=write size=1567608 2024-09-12T00:18:04.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~WBO423AUA0AL.0 size=1048576 2024-09-12T00:18:04.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~WBO423AUA0AL.1 size=1048576 2024-09-12T00:18:04.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~WBO423AUA0AL.2 size=58132 2024-09-12T00:18:04.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.880+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=WBO423AUA0AL tag=QE9QO1DPHORD type=write size=3203860 2024-09-12T00:18:04.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.884+0000 7f69cdea98c0 1 < suggested update operation key=IXWX7S5NWJS3 tag=YJ1KYN40E2ZX type=del size=2541276 2024-09-12T00:18:04.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.888+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=DWOOURM6XRKJ type=del size=916791 2024-09-12T00:18:04.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.892+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=F8KQI1MENCAN type=del 2024-09-12T00:18:04.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.896+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=CUY5XYI2D12X type=del size=2619675 2024-09-12T00:18:04.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.900+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=KF62VLQIRLUG type=del 2024-09-12T00:18:04.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.900+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=UERYLOI39E12 type=del size=4107661 2024-09-12T00:18:04.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.904+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~Z6SUOHID0VG5.0 size=1048576 2024-09-12T00:18:04.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.904+0000 7f69cdea98c0 1 < canceled part key=_multipart_2YYP9NOUAJD0.2~Z6SUOHID0VG5.1 size=978428 2024-09-12T00:18:04.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.912+0000 7f69cdea98c0 1 < canceled multipart upload key=2YYP9NOUAJD0 upload=Z6SUOHID0VG5 tag=0L2M7183YK93 type=write size=3075580 2024-09-12T00:18:04.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.916+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~KYSC6F3X1I6B.0 size=223259 2024-09-12T00:18:04.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.916+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=KYSC6F3X1I6B tag=324K0EXSRN24 type=write size=1271835 2024-09-12T00:18:04.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.920+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=GDT06QDEJ5W1 type=del 2024-09-12T00:18:04.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.928+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=3YDSFVZHLELB type=del size=776632 2024-09-12T00:18:04.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.928+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~FXT6S0MZRHHU.0 size=1048576 2024-09-12T00:18:04.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.932+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~FXT6S0MZRHHU.1 size=1048576 2024-09-12T00:18:04.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.936+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~FXT6S0MZRHHU.2 size=381254 2024-09-12T00:18:04.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.940+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=FXT6S0MZRHHU tag=6KUJWNG2F3KK type=write size=3526982 2024-09-12T00:18:04.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.944+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=XX7ANA3VDP8N type=write size=271014 2024-09-12T00:18:04.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.948+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=K8PTEAQFR1H4 type=del 2024-09-12T00:18:04.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.952+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=KM63EPP8L5Y9 type=del size=869822 2024-09-12T00:18:04.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.956+0000 7f69cdea98c0 1 < completed write operation key=9K3HLTD6DMSC tag=FA143B6P5OOQ type=write size=922612 2024-09-12T00:18:04.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.960+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~TQGBGBYSOP84.0 size=1048576 2024-09-12T00:18:04.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~TQGBGBYSOP84.1 size=787238 2024-09-12T00:18:04.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.964+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=TQGBGBYSOP84 tag=5M2TL9H3MYX8 type=write size=2884390 2024-09-12T00:18:04.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.968+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~ZI3579N0CJ81.0 size=1048576 2024-09-12T00:18:04.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.972+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~ZI3579N0CJ81.1 size=1048576 2024-09-12T00:18:04.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.972+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~ZI3579N0CJ81.2 size=154792 2024-09-12T00:18:04.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.980+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=ZI3579N0CJ81 tag=ZFEHEP266TRZ type=write size=3300520 2024-09-12T00:18:04.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~NZDXPCZ87UBI.0 size=1048576 2024-09-12T00:18:04.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~NZDXPCZ87UBI.1 size=377242 2024-09-12T00:18:04.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.988+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=NZDXPCZ87UBI tag=XO1KRRQLFMJB type=write size=2474394 2024-09-12T00:18:04.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:04.992+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~ZLH1DUM7CTHG.0 size=486692 2024-09-12T00:18:04.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.000+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=ZLH1DUM7CTHG tag=TB7UZ7SB41R6 type=write size=1535268 2024-09-12T00:18:05.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.004+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=R7A3BBPB1OIE type=del size=472969 2024-09-12T00:18:05.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.008+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~7YEHGZASGHJ7.0 size=1048576 2024-09-12T00:18:05.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.008+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~7YEHGZASGHJ7.1 size=1047165 2024-09-12T00:18:05.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.016+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=7YEHGZASGHJ7 tag=Q9CTZ537T8C9 type=write size=3144317 2024-09-12T00:18:05.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.020+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=QI0R5K9375JQ type=del size=3836184 2024-09-12T00:18:05.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.024+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~1Y4IZPELW305.0 size=853369 2024-09-12T00:18:05.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.032+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=1Y4IZPELW305 tag=UWTH9F8WWOQY type=write size=1901945 2024-09-12T00:18:05.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.036+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=4FZFNL5TCJHV type=del size=672562 2024-09-12T00:18:05.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.036+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=TC59HXFXGOTZ type=del 2024-09-12T00:18:05.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.040+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=Y0SOM0FRPXY0 type=del size=50630 2024-09-12T00:18:05.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.044+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=13JPZSRAMPGQ type=del 2024-09-12T00:18:05.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.048+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=L7ENBURNYGDC type=del size=66857 2024-09-12T00:18:05.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.052+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~XZ500B4T89J2.0 size=1048576 2024-09-12T00:18:05.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.056+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~XZ500B4T89J2.1 size=1048576 2024-09-12T00:18:05.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.060+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~XZ500B4T89J2.2 size=162170 2024-09-12T00:18:05.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.064+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=XZ500B4T89J2 tag=JN9IFJ2YN2YE type=write size=3307898 2024-09-12T00:18:05.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~IX61ICBRZIAL.0 size=1048576 2024-09-12T00:18:05.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~IX61ICBRZIAL.1 size=716721 2024-09-12T00:18:05.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.072+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=IX61ICBRZIAL tag=LKOBQN91M5ZI type=write size=2813873 2024-09-12T00:18:05.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.076+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~WBO423AUA0AL.0 size=1048576 2024-09-12T00:18:05.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.080+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~WBO423AUA0AL.1 size=1048576 2024-09-12T00:18:05.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.084+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~WBO423AUA0AL.2 size=58132 2024-09-12T00:18:05.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.088+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=WBO423AUA0AL tag=QE9QO1DPHORD type=write size=3203860 2024-09-12T00:18:05.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.096+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~NY1U45WCC4RA.0 size=292750 2024-09-12T00:18:05.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.096+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=NY1U45WCC4RA tag=DB42FF7Y8SVI type=write size=1341326 2024-09-12T00:18:05.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.100+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=DWOOURM6XRKJ type=del 2024-09-12T00:18:05.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~LXLW5VN702OA.0 size=1048576 2024-09-12T00:18:05.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~LXLW5VN702OA.1 size=212304 2024-09-12T00:18:05.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.108+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=LXLW5VN702OA tag=80YS4XX0DTIX type=write size=2309456 2024-09-12T00:18:05.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.116+0000 7f69cdea98c0 1 < suggested update operation key=YS23U9GQS7SJ tag=CUY5XYI2D12X type=del size=2619675 2024-09-12T00:18:05.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.124+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=NV9Z5HA91N31 type=del size=618944 2024-09-12T00:18:05.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.128+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=UERYLOI39E12 type=del 2024-09-12T00:18:05.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~XOE0K091KFYP.0 size=289443 2024-09-12T00:18:05.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.132+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=XOE0K091KFYP tag=92SMF3ZY9C3A type=write size=1338019 2024-09-12T00:18:05.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.136+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~KYSC6F3X1I6B.0 size=223259 2024-09-12T00:18:05.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.144+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=KYSC6F3X1I6B tag=324K0EXSRN24 type=write size=1271835 2024-09-12T00:18:05.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.148+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=J7WUVF3VT2FA type=del size=1863835 2024-09-12T00:18:05.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.152+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=3YDSFVZHLELB type=del 2024-09-12T00:18:05.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~J7OOMX18O6QP.0 size=1048576 2024-09-12T00:18:05.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~J7OOMX18O6QP.1 size=993510 2024-09-12T00:18:05.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.160+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=J7OOMX18O6QP tag=LVGYTYJJ0529 type=write size=3090662 2024-09-12T00:18:05.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.164+0000 7f69cdea98c0 1 < completed write operation key=0HAUC4BDL9VR tag=XX7ANA3VDP8N type=write size=271014 2024-09-12T00:18:05.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.168+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=WS0EGN28VB61 type=del size=2974228 2024-09-12T00:18:05.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.172+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=KM63EPP8L5Y9 type=del 2024-09-12T00:18:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.184+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~JJ9U1JVU949F.0 size=65044 2024-09-12T00:18:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.184+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=JJ9U1JVU949F tag=PYY6159DV9RV type=write size=1113620 2024-09-12T00:18:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.188+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~TQGBGBYSOP84.0 size=1048576 2024-09-12T00:18:05.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.192+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~TQGBGBYSOP84.1 size=787238 2024-09-12T00:18:05.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.196+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=TQGBGBYSOP84 tag=5M2TL9H3MYX8 type=write size=2884390 2024-09-12T00:18:05.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.204+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~C4VG2A2V2SPH.0 size=462351 2024-09-12T00:18:05.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.204+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=C4VG2A2V2SPH tag=JVXUQWYJYM45 type=write size=1510927 2024-09-12T00:18:05.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.208+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~NZDXPCZ87UBI.0 size=1048576 2024-09-12T00:18:05.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.212+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~NZDXPCZ87UBI.1 size=377242 2024-09-12T00:18:05.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.216+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=NZDXPCZ87UBI tag=XO1KRRQLFMJB type=write size=2474394 2024-09-12T00:18:05.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.224+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~Y0ZIF436TOVA.0 size=1048576 2024-09-12T00:18:05.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~Y0ZIF436TOVA.1 size=1048576 2024-09-12T00:18:05.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~Y0ZIF436TOVA.2 size=187163 2024-09-12T00:18:05.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.228+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=Y0ZIF436TOVA tag=HRJWN7YI0BQ0 type=write size=3332891 2024-09-12T00:18:05.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.236+0000 7f69cdea98c0 1 < suggested update operation key=T9OJXTZNRQJB tag=R7A3BBPB1OIE type=del size=472969 2024-09-12T00:18:05.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.240+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=KG88C2ERTUMG type=del size=2926927 2024-09-12T00:18:05.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.244+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=QI0R5K9375JQ type=del 2024-09-12T00:18:05.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.248+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=827WBU9S2IYC type=del size=2572263 2024-09-12T00:18:05.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.256+0000 7f69cdea98c0 1 < suggested update operation key=O5WBNND16BFN tag=4FZFNL5TCJHV type=del size=672562 2024-09-12T00:18:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~12QRX3V9QCBQ.0 size=7619 2024-09-12T00:18:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.260+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=12QRX3V9QCBQ tag=XW6VORVRCJI2 type=write size=1056195 2024-09-12T00:18:05.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.264+0000 7f69cdea98c0 1 < canceled operation key=AKWTTXH2P254 tag=Y0SOM0FRPXY0 type=del size=50630 2024-09-12T00:18:05.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~WPBEJCH5AQFP.0 size=1048576 2024-09-12T00:18:05.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~WPBEJCH5AQFP.1 size=1048576 2024-09-12T00:18:05.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~WPBEJCH5AQFP.2 size=481458 2024-09-12T00:18:05.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.276+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=WPBEJCH5AQFP tag=HZB1BR8AGJNO type=write size=3627186 2024-09-12T00:18:05.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.284+0000 7f69cdea98c0 1 < suggested update operation key=Z6MH459BTZ6K tag=L7ENBURNYGDC type=del size=66857 2024-09-12T00:18:05.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.288+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=10XL69RO4SSC type=write size=733749 2024-09-12T00:18:05.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.292+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~IX61ICBRZIAL.0 size=1048576 2024-09-12T00:18:05.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.296+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~IX61ICBRZIAL.1 size=716721 2024-09-12T00:18:05.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.300+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=IX61ICBRZIAL tag=LKOBQN91M5ZI type=write size=2813873 2024-09-12T00:18:05.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.304+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=09YOHGO5P73E type=write size=368783 2024-09-12T00:18:05.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.308+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~NY1U45WCC4RA.0 size=292750 2024-09-12T00:18:05.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.312+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=NY1U45WCC4RA tag=DB42FF7Y8SVI type=write size=1341326 2024-09-12T00:18:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.320+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~CX9NDXLDRFTK.0 size=532841 2024-09-12T00:18:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.320+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=CX9NDXLDRFTK tag=I976H2Q3ATWS type=write size=1581417 2024-09-12T00:18:05.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.324+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~LXLW5VN702OA.0 size=1048576 2024-09-12T00:18:05.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.324+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~LXLW5VN702OA.1 size=212304 2024-09-12T00:18:05.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.332+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=LXLW5VN702OA tag=80YS4XX0DTIX type=write size=2309456 2024-09-12T00:18:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.336+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=5FILFDI134JX type=write size=195414 2024-09-12T00:18:05.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.340+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=NV9Z5HA91N31 type=del 2024-09-12T00:18:05.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.344+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=3LIW7GFGCCEZ type=write size=42545 2024-09-12T00:18:05.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.348+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~XOE0K091KFYP.0 size=289443 2024-09-12T00:18:05.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.352+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=XOE0K091KFYP tag=92SMF3ZY9C3A type=write size=1338019 2024-09-12T00:18:05.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.360+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~BV1YQ1EXZD41.0 size=1048576 2024-09-12T00:18:05.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.364+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~BV1YQ1EXZD41.1 size=198356 2024-09-12T00:18:05.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.364+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=BV1YQ1EXZD41 tag=W2OMEC7IS61O type=write size=2295508 2024-09-12T00:18:05.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.368+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=J7WUVF3VT2FA type=del 2024-09-12T00:18:05.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~MILN20IW3WNB.0 size=1048576 2024-09-12T00:18:05.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~MILN20IW3WNB.1 size=152916 2024-09-12T00:18:05.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.376+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=MILN20IW3WNB tag=6N9G0QOGJQ1Q type=write size=2250068 2024-09-12T00:18:05.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.380+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~J7OOMX18O6QP.0 size=1048576 2024-09-12T00:18:05.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.384+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~J7OOMX18O6QP.1 size=993510 2024-09-12T00:18:05.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.392+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=J7OOMX18O6QP tag=LVGYTYJJ0529 type=write size=3090662 2024-09-12T00:18:05.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.392+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=N1E268IKQRF5 type=del size=3238234 2024-09-12T00:18:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.396+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=WS0EGN28VB61 type=del 2024-09-12T00:18:05.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.400+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=4OCOL0J6B00C type=del size=3678139 2024-09-12T00:18:05.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.404+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~JJ9U1JVU949F.0 size=65044 2024-09-12T00:18:05.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.412+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=JJ9U1JVU949F tag=PYY6159DV9RV type=write size=1113620 2024-09-12T00:18:05.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.416+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=3C12WZAAZHF9 type=write size=88958 2024-09-12T00:18:05.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.420+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~C4VG2A2V2SPH.0 size=462351 2024-09-12T00:18:05.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.424+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=C4VG2A2V2SPH tag=JVXUQWYJYM45 type=write size=1510927 2024-09-12T00:18:05.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~HWRMG4S6DN7G.0 size=1048576 2024-09-12T00:18:05.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~HWRMG4S6DN7G.1 size=1048576 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.436+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~HWRMG4S6DN7G.2 size=626389 2024-09-12T00:18:05.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.436+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=HWRMG4S6DN7G tag=2PJQOGFOT4D7 type=write size=3772117 2024-09-12T00:18:05.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.440+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~Y0ZIF436TOVA.0 size=1048576 2024-09-12T00:18:05.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.444+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~Y0ZIF436TOVA.1 size=1048576 2024-09-12T00:18:05.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.444+0000 7f69cdea98c0 1 < canceled part key=_multipart_IXB6WLN5M81C.2~Y0ZIF436TOVA.2 size=187163 2024-09-12T00:18:05.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.448+0000 7f69cdea98c0 1 < canceled multipart upload key=IXB6WLN5M81C upload=Y0ZIF436TOVA tag=HRJWN7YI0BQ0 type=write size=3332891 2024-09-12T00:18:05.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.452+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=ZB2WC6VGDN6U type=del size=853628 2024-09-12T00:18:05.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.456+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=KG88C2ERTUMG type=del 2024-09-12T00:18:05.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.460+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=HHVGADW9NWZA type=del size=1774208 2024-09-12T00:18:05.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.464+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=827WBU9S2IYC type=del 2024-09-12T00:18:05.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.468+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=E2RWNDNWEKTF type=del size=3776476 2024-09-12T00:18:05.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.472+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~12QRX3V9QCBQ.0 size=7619 2024-09-12T00:18:05.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.480+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=12QRX3V9QCBQ tag=XW6VORVRCJI2 type=write size=1056195 2024-09-12T00:18:05.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.484+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=SCWB410RTTYE type=del size=2435329 2024-09-12T00:18:05.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.488+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~WPBEJCH5AQFP.0 size=1048576 2024-09-12T00:18:05.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.488+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~WPBEJCH5AQFP.1 size=1048576 2024-09-12T00:18:05.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.492+0000 7f69cdea98c0 1 < completed part key=_multipart_RDGRKQQH4B8C.2~WPBEJCH5AQFP.2 size=481458 2024-09-12T00:18:05.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.500+0000 7f69cdea98c0 1 < completed multipart upload key=RDGRKQQH4B8C upload=WPBEJCH5AQFP tag=HZB1BR8AGJNO type=write size=3627186 2024-09-12T00:18:05.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.504+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=ZGGOHOZXUHMT type=write size=905428 2024-09-12T00:18:05.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.504+0000 7f69cdea98c0 1 < canceled operation key=AQY7MM3OX3GW tag=10XL69RO4SSC type=write size=733749 2024-09-12T00:18:05.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.512+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~UN7XP55F62EV.0 size=1048576 2024-09-12T00:18:05.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.520+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~UN7XP55F62EV.1 size=714157 2024-09-12T00:18:05.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.520+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=UN7XP55F62EV tag=9EA27XCWWB72 type=write size=2811309 2024-09-12T00:18:05.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.528+0000 7f69cdea98c0 1 < suggested update operation key=VYYY8MF0P3Q7 tag=09YOHGO5P73E type=write size=368783 2024-09-12T00:18:05.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~2UWX2AL65IL4.0 size=1048576 2024-09-12T00:18:05.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~2UWX2AL65IL4.1 size=406192 2024-09-12T00:18:05.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.536+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=2UWX2AL65IL4 tag=111WWTDKY281 type=write size=2503344 2024-09-12T00:18:05.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.540+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~CX9NDXLDRFTK.0 size=532841 2024-09-12T00:18:05.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.548+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=CX9NDXLDRFTK tag=I976H2Q3ATWS type=write size=1581417 2024-09-12T00:18:05.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.552+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=AKXYLOU4BKAB type=del size=558397 2024-09-12T00:18:05.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.560+0000 7f69cdea98c0 1 < suggested update operation key=K0HNNMX7CDGC tag=5FILFDI134JX type=write size=195414 2024-09-12T00:18:05.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.564+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=C12QH9TUHIFK type=del size=3185587 2024-09-12T00:18:05.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.568+0000 7f69cdea98c0 1 < canceled operation key=4O5U4WX3N4SA tag=3LIW7GFGCCEZ type=write size=42545 2024-09-12T00:18:05.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.572+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~HHDSPYK0HPY6.0 size=130309 2024-09-12T00:18:05.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.572+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=HHDSPYK0HPY6 tag=BMXUSISMYH5M type=write size=1178885 2024-09-12T00:18:05.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.576+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~BV1YQ1EXZD41.0 size=1048576 2024-09-12T00:18:05.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.576+0000 7f69cdea98c0 1 < canceled part key=_multipart_K0HNNMX7CDGC.2~BV1YQ1EXZD41.1 size=198356 2024-09-12T00:18:05.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.584+0000 7f69cdea98c0 1 < canceled multipart upload key=K0HNNMX7CDGC upload=BV1YQ1EXZD41 tag=W2OMEC7IS61O type=write size=2295508 2024-09-12T00:18:05.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.588+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=VG1E4WHNI50O type=del size=184949 2024-09-12T00:18:05.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.592+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~MILN20IW3WNB.0 size=1048576 2024-09-12T00:18:05.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.596+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~MILN20IW3WNB.1 size=152916 2024-09-12T00:18:05.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.600+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=MILN20IW3WNB tag=6N9G0QOGJQ1Q type=write size=2250068 2024-09-12T00:18:05.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.608+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~LYF58TQ4CCLU.0 size=96833 2024-09-12T00:18:05.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.608+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=LYF58TQ4CCLU tag=VYYF7FVPEFB9 type=write size=1145409 2024-09-12T00:18:05.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.612+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=N1E268IKQRF5 type=del 2024-09-12T00:18:05.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.616+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~L99DBGNQU10N.0 size=1048576 2024-09-12T00:18:05.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.620+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~L99DBGNQU10N.1 size=696098 2024-09-12T00:18:05.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.620+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=L99DBGNQU10N tag=PNVEC72M4IET type=write size=2793250 2024-09-12T00:18:05.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.624+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=4OCOL0J6B00C type=del 2024-09-12T00:18:05.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.632+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~UC0T3ABE59ZW.0 size=18243 2024-09-12T00:18:05.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.632+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=UC0T3ABE59ZW tag=P3KPPF61Y3KT type=write size=1066819 2024-09-12T00:18:05.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.636+0000 7f69cdea98c0 1 < completed write operation key=0HAUC4BDL9VR tag=3C12WZAAZHF9 type=write size=88958 2024-09-12T00:18:05.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.640+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=JET3VKSY3AAP type=del size=689784 2024-09-12T00:18:05.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.644+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~HWRMG4S6DN7G.0 size=1048576 2024-09-12T00:18:05.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.648+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~HWRMG4S6DN7G.1 size=1048576 2024-09-12T00:18:05.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.648+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~HWRMG4S6DN7G.2 size=626389 2024-09-12T00:18:05.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.656+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=HWRMG4S6DN7G tag=2PJQOGFOT4D7 type=write size=3772117 2024-09-12T00:18:05.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.660+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=CHLMLJA6LL24 type=del size=2347424 2024-09-12T00:18:05.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.664+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=ZB2WC6VGDN6U type=del 2024-09-12T00:18:05.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.668+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=XLIY5619U72S type=del size=28822 2024-09-12T00:18:05.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.676+0000 7f69cdea98c0 1 < suggested remove operation key=K0HNNMX7CDGC tag=HHVGADW9NWZA type=del 2024-09-12T00:18:05.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~CX4BGCRN9RM0.0 size=1048576 2024-09-12T00:18:05.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~CX4BGCRN9RM0.1 size=235514 2024-09-12T00:18:05.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.684+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=CX4BGCRN9RM0 tag=JUXQN0D3K3DA type=write size=2332666 2024-09-12T00:18:05.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.688+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=E2RWNDNWEKTF type=del 2024-09-12T00:18:05.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.692+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=N55DDM2B45NS type=del size=3758590 2024-09-12T00:18:05.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.696+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=SCWB410RTTYE type=del 2024-09-12T00:18:05.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.700+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=TG9SX670YMK3 type=del size=3725614 2024-09-12T00:18:05.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.704+0000 7f69cdea98c0 1 < completed write operation key=4O5U4WX3N4SA tag=ZGGOHOZXUHMT type=write size=905428 2024-09-12T00:18:05.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.712+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~76Q6B5FSU7QC.0 size=1048576 2024-09-12T00:18:05.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.716+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~76Q6B5FSU7QC.1 size=1048576 2024-09-12T00:18:05.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.716+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~76Q6B5FSU7QC.2 size=216539 2024-09-12T00:18:05.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.716+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=76Q6B5FSU7QC tag=P0EWYTF0EWHV type=write size=3362267 2024-09-12T00:18:05.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.720+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~UN7XP55F62EV.0 size=1048576 2024-09-12T00:18:05.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.724+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~UN7XP55F62EV.1 size=714157 2024-09-12T00:18:05.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.732+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=UN7XP55F62EV tag=9EA27XCWWB72 type=write size=2811309 2024-09-12T00:18:05.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~1WJFXPVDC3FW.0 size=1048576 2024-09-12T00:18:05.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~1WJFXPVDC3FW.1 size=760771 2024-09-12T00:18:05.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.740+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=1WJFXPVDC3FW tag=UAHZ7GA3H564 type=write size=2857923 2024-09-12T00:18:05.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.744+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~2UWX2AL65IL4.0 size=1048576 2024-09-12T00:18:05.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.748+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~2UWX2AL65IL4.1 size=406192 2024-09-12T00:18:05.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.752+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=2UWX2AL65IL4 tag=111WWTDKY281 type=write size=2503344 2024-09-12T00:18:05.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.756+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=DPRNTR95ABLY type=del size=2195473 2024-09-12T00:18:05.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.764+0000 7f69cdea98c0 1 < suggested remove operation key=2YYP9NOUAJD0 tag=AKXYLOU4BKAB type=del 2024-09-12T00:18:05.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.768+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~JVI6HE10Y3JW.0 size=161862 2024-09-12T00:18:05.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.768+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=JVI6HE10Y3JW tag=YOXWSKFW8CZ4 type=write size=1210438 2024-09-12T00:18:05.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.772+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=C12QH9TUHIFK type=del 2024-09-12T00:18:05.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.780+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~9214OX6AN02S.0 size=1048576 2024-09-12T00:18:05.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.784+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~9214OX6AN02S.1 size=1048576 2024-09-12T00:18:05.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.788+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~9214OX6AN02S.2 size=825227 2024-09-12T00:18:05.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.788+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=9214OX6AN02S tag=YA6230GVW0KW type=write size=3970955 2024-09-12T00:18:05.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.792+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~HHDSPYK0HPY6.0 size=130309 2024-09-12T00:18:05.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.796+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=HHDSPYK0HPY6 tag=BMXUSISMYH5M type=write size=1178885 2024-09-12T00:18:05.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~ZO4A7YJFPFGR.0 size=65947 2024-09-12T00:18:05.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.804+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=ZO4A7YJFPFGR tag=2X8IXT3J08HU type=write size=1114523 2024-09-12T00:18:05.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.812+0000 7f69cdea98c0 1 < suggested remove operation key=LRHZKCU22AIX tag=VG1E4WHNI50O type=del 2024-09-12T00:18:05.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.816+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=TWO90Z22JLAI type=del size=3161527 2024-09-12T00:18:05.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.820+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~LYF58TQ4CCLU.0 size=96833 2024-09-12T00:18:05.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.824+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=LYF58TQ4CCLU tag=VYYF7FVPEFB9 type=write size=1145409 2024-09-12T00:18:05.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.832+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~1J71KTKWJB9X.0 size=1048576 2024-09-12T00:18:05.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.836+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~1J71KTKWJB9X.1 size=1048576 2024-09-12T00:18:05.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.840+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~1J71KTKWJB9X.2 size=869948 2024-09-12T00:18:05.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.840+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=1J71KTKWJB9X tag=TTXX4LCALMQK type=write size=4015676 2024-09-12T00:18:05.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.844+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~L99DBGNQU10N.0 size=1048576 2024-09-12T00:18:05.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.848+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~L99DBGNQU10N.1 size=696098 2024-09-12T00:18:05.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.852+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=L99DBGNQU10N tag=PNVEC72M4IET type=write size=2793250 2024-09-12T00:18:05.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.856+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=1Z26Q0OA01J8 type=del size=2488712 2024-09-12T00:18:05.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.856+0000 7f69cdea98c0 1 < canceled part key=_multipart_LRHZKCU22AIX.2~UC0T3ABE59ZW.0 size=18243 2024-09-12T00:18:05.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.864+0000 7f69cdea98c0 1 < canceled multipart upload key=LRHZKCU22AIX upload=UC0T3ABE59ZW tag=P3KPPF61Y3KT type=write size=1066819 2024-09-12T00:18:05.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.872+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=OO7NMUL7U8VJ type=del size=2840252 2024-09-12T00:18:05.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.876+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=JET3VKSY3AAP type=del 2024-09-12T00:18:05.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.880+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=ERGUZBPD6XFA type=del size=230704 2024-09-12T00:18:05.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.884+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=CHLMLJA6LL24 type=del 2024-09-12T00:18:05.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.888+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=BWL7N4HAQIXO type=del size=3686087 2024-09-12T00:18:05.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.892+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=XLIY5619U72S type=del 2024-09-12T00:18:05.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.892+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=IQMQHYDUU3ST type=del size=1888084 2024-09-12T00:18:05.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.896+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~CX4BGCRN9RM0.0 size=1048576 2024-09-12T00:18:05.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.900+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~CX4BGCRN9RM0.1 size=235514 2024-09-12T00:18:05.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.908+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=CX4BGCRN9RM0 tag=JUXQN0D3K3DA type=write size=2332666 2024-09-12T00:18:05.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.912+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~N8ETCUIPLASV.0 size=808618 2024-09-12T00:18:05.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.912+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=N8ETCUIPLASV tag=MLQ7PUV05Y4B type=write size=1857194 2024-09-12T00:18:05.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.916+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=N55DDM2B45NS type=del 2024-09-12T00:18:05.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.920+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=1N114ST0Z6B6 type=del size=636841 2024-09-12T00:18:05.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.924+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=TG9SX670YMK3 type=del 2024-09-12T00:18:05.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.928+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=ZZP09GT5K0VN type=del size=2315326 2024-09-12T00:18:05.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.932+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~76Q6B5FSU7QC.0 size=1048576 2024-09-12T00:18:05.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.936+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~76Q6B5FSU7QC.1 size=1048576 2024-09-12T00:18:05.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.936+0000 7f69cdea98c0 1 < canceled part key=_multipart_SCFIVX3IHERR.2~76Q6B5FSU7QC.2 size=216539 2024-09-12T00:18:05.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.940+0000 7f69cdea98c0 1 < canceled multipart upload key=SCFIVX3IHERR upload=76Q6B5FSU7QC tag=P0EWYTF0EWHV type=write size=3362267 2024-09-12T00:18:05.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.944+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=R5AS2CIPGWGR type=del size=4099377 2024-09-12T00:18:05.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.948+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~1WJFXPVDC3FW.0 size=1048576 2024-09-12T00:18:05.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.952+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~1WJFXPVDC3FW.1 size=760771 2024-09-12T00:18:05.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.956+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=1WJFXPVDC3FW tag=UAHZ7GA3H564 type=write size=2857923 2024-09-12T00:18:05.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~N8Z4KDTJEELH.0 size=1048576 2024-09-12T00:18:05.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~N8Z4KDTJEELH.1 size=1048576 2024-09-12T00:18:05.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.968+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~N8Z4KDTJEELH.2 size=186287 2024-09-12T00:18:05.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.968+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=N8Z4KDTJEELH tag=5NHR7SZ0JUWM type=write size=3332015 2024-09-12T00:18:05.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.972+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=DPRNTR95ABLY type=del 2024-09-12T00:18:05.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.976+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=P68GXNHC8HY7 type=write size=327913 2024-09-12T00:18:05.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.980+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~JVI6HE10Y3JW.0 size=161862 2024-09-12T00:18:05.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.984+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=JVI6HE10Y3JW tag=YOXWSKFW8CZ4 type=write size=1210438 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.988+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=U5CI1EEJG6N3 type=del size=2667985 2024-09-12T00:18:05.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.988+0000 7f69cdea98c0 1 < canceled part key=_multipart_2YYP9NOUAJD0.2~9214OX6AN02S.0 size=1048576 2024-09-12T00:18:05.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.992+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~9214OX6AN02S.1 size=1048576 2024-09-12T00:18:05.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:05.992+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~9214OX6AN02S.2 size=825227 2024-09-12T00:18:05.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.000+0000 7f69cdea98c0 1 < canceled multipart upload key=2YYP9NOUAJD0 upload=9214OX6AN02S tag=YA6230GVW0KW type=write size=3970955 2024-09-12T00:18:06.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.004+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~8NY8K023TQN3.0 size=1048576 2024-09-12T00:18:06.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.008+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~8NY8K023TQN3.1 size=1048576 2024-09-12T00:18:06.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~8NY8K023TQN3.2 size=850809 2024-09-12T00:18:06.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.012+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=8NY8K023TQN3 tag=OALZ7026R572 type=write size=3996537 2024-09-12T00:18:06.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.016+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~ZO4A7YJFPFGR.0 size=65947 2024-09-12T00:18:06.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.020+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=ZO4A7YJFPFGR tag=2X8IXT3J08HU type=write size=1114523 2024-09-12T00:18:06.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.028+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~FUN2VSA38IR6.0 size=1048576 2024-09-12T00:18:06.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.032+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~FUN2VSA38IR6.1 size=720188 2024-09-12T00:18:06.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.032+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=FUN2VSA38IR6 tag=APH3TN05YM5D type=write size=2817340 2024-09-12T00:18:06.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.036+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=TWO90Z22JLAI type=del 2024-09-12T00:18:06.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.040+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=ASE2YFHYFVR4 type=write size=387399 2024-09-12T00:18:06.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.044+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~1J71KTKWJB9X.0 size=1048576 2024-09-12T00:18:06.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.044+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~1J71KTKWJB9X.1 size=1048576 2024-09-12T00:18:06.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.044+0000 7f69cdea98c0 1 < canceled part key=_multipart_H91UXKWAJ3K8.2~1J71KTKWJB9X.2 size=869948 2024-09-12T00:18:06.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.052+0000 7f69cdea98c0 1 < canceled multipart upload key=H91UXKWAJ3K8 upload=1J71KTKWJB9X tag=TTXX4LCALMQK type=write size=4015676 2024-09-12T00:18:06.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.056+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=J1TJDR3NXH6Y type=write size=369910 2024-09-12T00:18:06.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.060+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=1Z26Q0OA01J8 type=del 2024-09-12T00:18:06.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.064+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=EQJ4O2IK5N1I type=del size=3765617 2024-09-12T00:18:06.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.068+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=OO7NMUL7U8VJ type=del 2024-09-12T00:18:06.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.072+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=FSCY3ZHLG9DK type=del size=3468682 2024-09-12T00:18:06.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.080+0000 7f69cdea98c0 1 < suggested remove operation key=AQY7MM3OX3GW tag=ERGUZBPD6XFA type=del 2024-09-12T00:18:06.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.088+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~QLI55ZU3Y63I.0 size=1048576 2024-09-12T00:18:06.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.092+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~QLI55ZU3Y63I.1 size=814785 2024-09-12T00:18:06.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.092+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=QLI55ZU3Y63I tag=WMO7JOWNB9LU type=write size=2911937 2024-09-12T00:18:06.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.096+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=BWL7N4HAQIXO type=del 2024-09-12T00:18:06.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.100+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=DF6G733G9MPD type=write size=664417 2024-09-12T00:18:06.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.108+0000 7f69cdea98c0 1 < suggested update operation key=0HAUC4BDL9VR tag=IQMQHYDUU3ST type=del size=1888084 2024-09-12T00:18:06.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.112+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=TNGJ0DN2VLWI type=del size=1793444 2024-09-12T00:18:06.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.116+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~N8ETCUIPLASV.0 size=808618 2024-09-12T00:18:06.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.120+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=N8ETCUIPLASV tag=MLQ7PUV05Y4B type=write size=1857194 2024-09-12T00:18:06.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~HLU3IXHG2RBU.0 size=1048576 2024-09-12T00:18:06.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~HLU3IXHG2RBU.1 size=1048576 2024-09-12T00:18:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~HLU3IXHG2RBU.2 size=492085 2024-09-12T00:18:06.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.132+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=HLU3IXHG2RBU tag=1UC0707O4XYF type=write size=3637813 2024-09-12T00:18:06.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.136+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=1N114ST0Z6B6 type=del 2024-09-12T00:18:06.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.140+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=YG3D6SY8HAN0 type=del size=2477631 2024-09-12T00:18:06.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.144+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=ZZP09GT5K0VN type=del 2024-09-12T00:18:06.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.152+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~W7RC0Y1HGQHK.0 size=1048576 2024-09-12T00:18:06.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.152+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~W7RC0Y1HGQHK.1 size=1048576 2024-09-12T00:18:06.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.156+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~W7RC0Y1HGQHK.2 size=374197 2024-09-12T00:18:06.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.156+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=W7RC0Y1HGQHK tag=QPEV1B33TB2S type=write size=3519925 2024-09-12T00:18:06.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.164+0000 7f69cdea98c0 1 < suggested update operation key=7UFADFUXL28I tag=R5AS2CIPGWGR type=del size=4099377 2024-09-12T00:18:06.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~9GT3OB5NSH7Z.0 size=1048576 2024-09-12T00:18:06.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~9GT3OB5NSH7Z.1 size=525265 2024-09-12T00:18:06.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.172+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=9GT3OB5NSH7Z tag=D8SNRH2P6GEL type=write size=2622417 2024-09-12T00:18:06.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.176+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~N8Z4KDTJEELH.0 size=1048576 2024-09-12T00:18:06.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.176+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~N8Z4KDTJEELH.1 size=1048576 2024-09-12T00:18:06.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.180+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~N8Z4KDTJEELH.2 size=186287 2024-09-12T00:18:06.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.188+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=N8Z4KDTJEELH tag=5NHR7SZ0JUWM type=write size=3332015 2024-09-12T00:18:06.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.188+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=G1JVOFMLPNWM type=del size=205972 2024-09-12T00:18:06.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.192+0000 7f69cdea98c0 1 < completed write operation key=4O5U4WX3N4SA tag=P68GXNHC8HY7 type=write size=327913 2024-09-12T00:18:06.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.196+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=BNB0OA8V10QB type=del size=277178 2024-09-12T00:18:06.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.204+0000 7f69cdea98c0 -1 < failed to complete operation key=AQY7MM3OX3GW tag=U5CI1EEJG6N3 type=del size=2667985: (22) Invalid argument 2024-09-12T00:18:06.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.204+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=ZPMVZ61T4KFL type=del size=3257484 2024-09-12T00:18:06.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.216+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~8NY8K023TQN3.0 size=1048576 2024-09-12T00:18:06.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.216+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~8NY8K023TQN3.1 size=1048576 2024-09-12T00:18:06.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.216+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~8NY8K023TQN3.2 size=850809 2024-09-12T00:18:06.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.224+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=8NY8K023TQN3 tag=OALZ7026R572 type=write size=3996537 2024-09-12T00:18:06.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.228+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=P783GU10RD43 type=del size=513292 2024-09-12T00:18:06.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.232+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~FUN2VSA38IR6.0 size=1048576 2024-09-12T00:18:06.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.236+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~FUN2VSA38IR6.1 size=720188 2024-09-12T00:18:06.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.240+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=FUN2VSA38IR6 tag=APH3TN05YM5D type=write size=2817340 2024-09-12T00:18:06.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.244+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=Z43QYCKO8Y05 type=del size=1932263 2024-09-12T00:18:06.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.248+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=ASE2YFHYFVR4 type=write size=387399 2024-09-12T00:18:06.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.256+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~8KU20TBPGB6W.0 size=1048576 2024-09-12T00:18:06.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.260+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~8KU20TBPGB6W.1 size=58634 2024-09-12T00:18:06.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.260+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=8KU20TBPGB6W tag=Q5FXEGYK5K24 type=write size=2155786 2024-09-12T00:18:06.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.264+0000 7f69cdea98c0 1 < completed write operation key=9K3HLTD6DMSC tag=J1TJDR3NXH6Y type=write size=369910 2024-09-12T00:18:06.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.268+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~7YI54CZCAPWE.0 size=1048576 2024-09-12T00:18:06.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~7YI54CZCAPWE.1 size=1048576 2024-09-12T00:18:06.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~7YI54CZCAPWE.2 size=119977 2024-09-12T00:18:06.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.276+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=7YI54CZCAPWE tag=25L2KF9QF66E type=write size=3265705 2024-09-12T00:18:06.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.280+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=EQJ4O2IK5N1I type=del 2024-09-12T00:18:06.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.284+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=7LEBFJLGQ5KD type=del size=812502 2024-09-12T00:18:06.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.288+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=FSCY3ZHLG9DK type=del 2024-09-12T00:18:06.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.292+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~7TPMQJLLUPQO.0 size=1048576 2024-09-12T00:18:06.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~7TPMQJLLUPQO.1 size=1048576 2024-09-12T00:18:06.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.300+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~7TPMQJLLUPQO.2 size=1045207 2024-09-12T00:18:06.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.300+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=7TPMQJLLUPQO tag=7N0ESR8TPZFL type=write size=4190935 2024-09-12T00:18:06.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.304+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~QLI55ZU3Y63I.0 size=1048576 2024-09-12T00:18:06.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.308+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~QLI55ZU3Y63I.1 size=814785 2024-09-12T00:18:06.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.312+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=QLI55ZU3Y63I tag=WMO7JOWNB9LU type=write size=2911937 2024-09-12T00:18:06.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.316+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=YFTVFL8Y1HWC type=del size=399653 2024-09-12T00:18:06.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.320+0000 7f69cdea98c0 1 < completed write operation key=UTZNJQJQMXJS tag=DF6G733G9MPD type=write size=664417 2024-09-12T00:18:06.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~H8ZNTXBZKMCF.0 size=1048576 2024-09-12T00:18:06.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.332+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~H8ZNTXBZKMCF.1 size=30912 2024-09-12T00:18:06.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.332+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=H8ZNTXBZKMCF tag=35BF8OCIH4AV type=write size=2128064 2024-09-12T00:18:06.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.336+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=TNGJ0DN2VLWI type=del 2024-09-12T00:18:06.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.340+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~GJAY7SO1T5GU.0 size=1048576 2024-09-12T00:18:06.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.344+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~GJAY7SO1T5GU.1 size=372337 2024-09-12T00:18:06.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.344+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=GJAY7SO1T5GU tag=UD32HXQZNHSV type=write size=2469489 2024-09-12T00:18:06.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.348+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~HLU3IXHG2RBU.0 size=1048576 2024-09-12T00:18:06.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.352+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~HLU3IXHG2RBU.1 size=1048576 2024-09-12T00:18:06.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.352+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~HLU3IXHG2RBU.2 size=492085 2024-09-12T00:18:06.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.360+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=HLU3IXHG2RBU tag=1UC0707O4XYF type=write size=3637813 2024-09-12T00:18:06.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.368+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~O1COEHN4AVOM.0 size=1048576 2024-09-12T00:18:06.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.368+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~O1COEHN4AVOM.1 size=1048576 2024-09-12T00:18:06.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~O1COEHN4AVOM.2 size=226536 2024-09-12T00:18:06.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.372+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=O1COEHN4AVOM tag=6CTBCFV19Q9R type=write size=3372264 2024-09-12T00:18:06.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.376+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=YG3D6SY8HAN0 type=del 2024-09-12T00:18:06.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~ICIMR4YB8U3N.0 size=545492 2024-09-12T00:18:06.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.384+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=ICIMR4YB8U3N tag=H3FBCP8FV5HP type=write size=1594068 2024-09-12T00:18:06.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.388+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~W7RC0Y1HGQHK.0 size=1048576 2024-09-12T00:18:06.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.392+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~W7RC0Y1HGQHK.1 size=1048576 2024-09-12T00:18:06.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.396+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~W7RC0Y1HGQHK.2 size=374197 2024-09-12T00:18:06.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.400+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=W7RC0Y1HGQHK tag=QPEV1B33TB2S type=write size=3519925 2024-09-12T00:18:06.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.404+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=4SZYCNPPZ78R type=del size=625332 2024-09-12T00:18:06.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.408+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~9GT3OB5NSH7Z.0 size=1048576 2024-09-12T00:18:06.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.412+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~9GT3OB5NSH7Z.1 size=525265 2024-09-12T00:18:06.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.420+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=9GT3OB5NSH7Z tag=D8SNRH2P6GEL type=write size=2622417 2024-09-12T00:18:06.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.424+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=K63WWLCEL1WR type=del size=464536 2024-09-12T00:18:06.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.428+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=G1JVOFMLPNWM type=del 2024-09-12T00:18:06.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.432+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=2YMJKFX2NUNO type=write size=58224 2024-09-12T00:18:06.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.436+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=BNB0OA8V10QB type=del 2024-09-12T00:18:06.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.440+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=G52P2UETIPDR type=del size=2541421 2024-09-12T00:18:06.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.444+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=ZPMVZ61T4KFL type=del 2024-09-12T00:18:06.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.448+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=SPUWT00G9XG1 type=write size=1005397 2024-09-12T00:18:06.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.452+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=P783GU10RD43 type=del 2024-09-12T00:18:06.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.456+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=UUDQNSF2VMJR type=del size=2912389 2024-09-12T00:18:06.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.460+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=Z43QYCKO8Y05 type=del 2024-09-12T00:18:06.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.464+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=HDKYF6T0INDD type=write size=410210 2024-09-12T00:18:06.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.468+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~8KU20TBPGB6W.0 size=1048576 2024-09-12T00:18:06.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.468+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~8KU20TBPGB6W.1 size=58634 2024-09-12T00:18:06.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.476+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=8KU20TBPGB6W tag=Q5FXEGYK5K24 type=write size=2155786 2024-09-12T00:18:06.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.484+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~IAXY803IY2ZM.0 size=1048576 2024-09-12T00:18:06.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.484+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~IAXY803IY2ZM.1 size=1048576 2024-09-12T00:18:06.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.488+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~IAXY803IY2ZM.2 size=949025 2024-09-12T00:18:06.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.488+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=IAXY803IY2ZM tag=P7RNFT90F8IK type=write size=4094753 2024-09-12T00:18:06.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.488+0000 7f69cdea98c0 1 < canceled part key=_multipart_SP2KVAO82MQ0.2~7YI54CZCAPWE.0 size=1048576 2024-09-12T00:18:06.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.492+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~7YI54CZCAPWE.1 size=1048576 2024-09-12T00:18:06.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.496+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~7YI54CZCAPWE.2 size=119977 2024-09-12T00:18:06.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.504+0000 7f69cdea98c0 1 < canceled multipart upload key=SP2KVAO82MQ0 upload=7YI54CZCAPWE tag=25L2KF9QF66E type=write size=3265705 2024-09-12T00:18:06.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.508+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=ICEEICNKH1E5 type=del size=3401061 2024-09-12T00:18:06.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.512+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=7LEBFJLGQ5KD type=del 2024-09-12T00:18:06.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.516+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=QGJH61V66F2N type=write size=14881 2024-09-12T00:18:06.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.520+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~7TPMQJLLUPQO.0 size=1048576 2024-09-12T00:18:06.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.520+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~7TPMQJLLUPQO.1 size=1048576 2024-09-12T00:18:06.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.524+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~7TPMQJLLUPQO.2 size=1045207 2024-09-12T00:18:06.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.532+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=7TPMQJLLUPQO tag=7N0ESR8TPZFL type=write size=4190935 2024-09-12T00:18:06.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.532+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=CK9626EKNV87 type=del size=678155 2024-09-12T00:18:06.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.540+0000 7f69cdea98c0 1 < suggested update operation key=UTZNJQJQMXJS tag=YFTVFL8Y1HWC type=del size=399653 2024-09-12T00:18:06.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.544+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=RCSGJCCRR1DO type=del size=2647444 2024-09-12T00:18:06.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.548+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~H8ZNTXBZKMCF.0 size=1048576 2024-09-12T00:18:06.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.548+0000 7f69cdea98c0 1 < canceled part key=_multipart_SP2KVAO82MQ0.2~H8ZNTXBZKMCF.1 size=30912 2024-09-12T00:18:06.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.556+0000 7f69cdea98c0 1 < canceled multipart upload key=SP2KVAO82MQ0 upload=H8ZNTXBZKMCF tag=35BF8OCIH4AV type=write size=2128064 2024-09-12T00:18:06.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.568+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~ZA2BGYYQHJHS.0 size=967692 2024-09-12T00:18:06.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.568+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=ZA2BGYYQHJHS tag=DH6MU2LFZZ2X type=write size=2016268 2024-09-12T00:18:06.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.572+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~GJAY7SO1T5GU.0 size=1048576 2024-09-12T00:18:06.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.576+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~GJAY7SO1T5GU.1 size=372337 2024-09-12T00:18:06.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.580+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=GJAY7SO1T5GU tag=UD32HXQZNHSV type=write size=2469489 2024-09-12T00:18:06.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.584+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=1A3N72YPDQJ0 type=del size=541258 2024-09-12T00:18:06.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.592+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~O1COEHN4AVOM.0 size=1048576 2024-09-12T00:18:06.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.592+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~O1COEHN4AVOM.1 size=1048576 2024-09-12T00:18:06.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.596+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~O1COEHN4AVOM.2 size=226536 2024-09-12T00:18:06.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.604+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=O1COEHN4AVOM tag=6CTBCFV19Q9R type=write size=3372264 2024-09-12T00:18:06.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.608+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=AU4KSVNRV9JH type=del size=2005190 2024-09-12T00:18:06.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.612+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~ICIMR4YB8U3N.0 size=545492 2024-09-12T00:18:06.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.616+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=ICIMR4YB8U3N tag=H3FBCP8FV5HP type=write size=1594068 2024-09-12T00:18:06.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.620+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=R3X9LIXZ4PUX type=del size=1567468 2024-09-12T00:18:06.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.624+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=4SZYCNPPZ78R type=del 2024-09-12T00:18:06.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.628+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=R3QEQHCA01QV type=del size=3851134 2024-09-12T00:18:06.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.632+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=K63WWLCEL1WR type=del 2024-09-12T00:18:06.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.636+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=10U7BLEQHO48 type=write size=761787 2024-09-12T00:18:06.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.640+0000 7f69cdea98c0 1 < completed write operation key=7UFADFUXL28I tag=2YMJKFX2NUNO type=write size=58224 2024-09-12T00:18:06.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.644+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=61VEH0JFEGKA type=del size=3691480 2024-09-12T00:18:06.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.652+0000 7f69cdea98c0 1 < suggested remove operation key=AWZ03VE7D86K tag=G52P2UETIPDR type=del 2024-09-12T00:18:06.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~0F22DXTPHH71.0 size=1048576 2024-09-12T00:18:06.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~0F22DXTPHH71.1 size=848741 2024-09-12T00:18:06.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.660+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=0F22DXTPHH71 tag=3J6DVFR4BND2 type=write size=2945893 2024-09-12T00:18:06.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.664+0000 7f69cdea98c0 1 < completed write operation key=2YYP9NOUAJD0 tag=SPUWT00G9XG1 type=write size=1005397 2024-09-12T00:18:06.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.672+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~OJB2NG92EEVO.0 size=1048576 2024-09-12T00:18:06.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.672+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~OJB2NG92EEVO.1 size=989292 2024-09-12T00:18:06.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.672+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=OJB2NG92EEVO tag=2QPDXXETC8Y6 type=write size=3086444 2024-09-12T00:18:06.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.676+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=UUDQNSF2VMJR type=del 2024-09-12T00:18:06.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~DA1X8MCRRR5U.0 size=1048576 2024-09-12T00:18:06.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~DA1X8MCRRR5U.1 size=792926 2024-09-12T00:18:06.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.688+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=DA1X8MCRRR5U tag=AE6DX74S8JLN type=write size=2890078 2024-09-12T00:18:06.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.696+0000 7f69cdea98c0 1 < suggested remove operation key=IXWX7S5NWJS3 tag=HDKYF6T0INDD type=write 2024-09-12T00:18:06.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.700+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=8S2R7K37FQPE type=del size=3394073 2024-09-12T00:18:06.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.700+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~IAXY803IY2ZM.0 size=1048576 2024-09-12T00:18:06.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.704+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~IAXY803IY2ZM.1 size=1048576 2024-09-12T00:18:06.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.708+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~IAXY803IY2ZM.2 size=949025 2024-09-12T00:18:06.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.716+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=IAXY803IY2ZM tag=P7RNFT90F8IK type=write size=4094753 2024-09-12T00:18:06.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.720+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=1JZ0HSJNMW1E type=del size=731650 2024-09-12T00:18:06.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.724+0000 7f69cdea98c0 1 < canceled operation key=4O5U4WX3N4SA tag=ICEEICNKH1E5 type=del size=3401061 2024-09-12T00:18:06.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~Y91S9KM8G162.0 size=1048576 2024-09-12T00:18:06.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~Y91S9KM8G162.1 size=103206 2024-09-12T00:18:06.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.732+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=Y91S9KM8G162 tag=EWGQXVWMGH6N type=write size=2200358 2024-09-12T00:18:06.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.736+0000 7f69cdea98c0 1 < completed write operation key=7UFADFUXL28I tag=QGJH61V66F2N type=write size=14881 2024-09-12T00:18:06.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.740+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=9A62X9PR7UF1 type=del size=3298479 2024-09-12T00:18:06.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.744+0000 7f69cdea98c0 -1 < failed to complete operation key=UTZNJQJQMXJS tag=CK9626EKNV87 type=del size=678155: (22) Invalid argument 2024-09-12T00:18:06.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.748+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=GBOV0DA9H1NG type=del size=949372 2024-09-12T00:18:06.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.752+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=RCSGJCCRR1DO type=del 2024-09-12T00:18:06.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.756+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=A681YGM9E6AQ type=del size=2776798 2024-09-12T00:18:06.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.760+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~ZA2BGYYQHJHS.0 size=967692 2024-09-12T00:18:06.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.768+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=ZA2BGYYQHJHS tag=DH6MU2LFZZ2X type=write size=2016268 2024-09-12T00:18:06.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.772+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=ZE442EYF84M3 type=del size=2054169 2024-09-12T00:18:06.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.780+0000 7f69cdea98c0 1 < suggested update operation key=4O5U4WX3N4SA tag=1A3N72YPDQJ0 type=del size=541258 2024-09-12T00:18:06.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.788+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~XL9IIM1CTIDA.0 size=1048576 2024-09-12T00:18:06.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.788+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~XL9IIM1CTIDA.1 size=760080 2024-09-12T00:18:06.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.788+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=XL9IIM1CTIDA tag=XFPTEVVFGC4U type=write size=2857232 2024-09-12T00:18:06.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.792+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=AU4KSVNRV9JH type=del 2024-09-12T00:18:06.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.796+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=VU21YFCXBE75 type=del size=725478 2024-09-12T00:18:06.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.800+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=R3X9LIXZ4PUX type=del 2024-09-12T00:18:06.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.808+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~JE2OGN55RTK6.0 size=1048576 2024-09-12T00:18:06.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.812+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~JE2OGN55RTK6.1 size=87460 2024-09-12T00:18:06.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.812+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=JE2OGN55RTK6 tag=QUKRJBN5VRLS type=write size=2184612 2024-09-12T00:18:06.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.816+0000 7f69cdea98c0 -1 < failed to complete operation key=AWZ03VE7D86K tag=R3QEQHCA01QV type=del size=3851134: (22) Invalid argument 2024-09-12T00:18:06.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.824+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~NKDM95JY4AQY.0 size=989746 2024-09-12T00:18:06.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.824+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=NKDM95JY4AQY tag=YCVTBCSH4S9F type=write size=2038322 2024-09-12T00:18:06.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.828+0000 7f69cdea98c0 1 < completed write operation key=VYYY8MF0P3Q7 tag=10U7BLEQHO48 type=write size=761787 2024-09-12T00:18:06.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.832+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=L85HCL3740SP type=del size=3581161 2024-09-12T00:18:06.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.836+0000 7f69cdea98c0 1 < canceled operation key=2YYP9NOUAJD0 tag=61VEH0JFEGKA type=del size=3691480 2024-09-12T00:18:06.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.840+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=HO6HUSZWYYSN type=write size=926344 2024-09-12T00:18:06.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.844+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~0F22DXTPHH71.0 size=1048576 2024-09-12T00:18:06.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.844+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~0F22DXTPHH71.1 size=848741 2024-09-12T00:18:06.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.852+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=0F22DXTPHH71 tag=3J6DVFR4BND2 type=write size=2945893 2024-09-12T00:18:06.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~8U1RBSN7NUOY.0 size=1048576 2024-09-12T00:18:06.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~8U1RBSN7NUOY.1 size=1729 2024-09-12T00:18:06.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.860+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=8U1RBSN7NUOY tag=D2R9V21DKTOW type=write size=2098881 2024-09-12T00:18:06.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.864+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~OJB2NG92EEVO.0 size=1048576 2024-09-12T00:18:06.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.868+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~OJB2NG92EEVO.1 size=989292 2024-09-12T00:18:06.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.876+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=OJB2NG92EEVO tag=2QPDXXETC8Y6 type=write size=3086444 2024-09-12T00:18:06.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~X42JEPVA6C15.0 size=1048576 2024-09-12T00:18:06.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~X42JEPVA6C15.1 size=546128 2024-09-12T00:18:06.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.884+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=X42JEPVA6C15 tag=6O4F48ONGFSH type=write size=2643280 2024-09-12T00:18:06.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.892+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~DA1X8MCRRR5U.0 size=1048576 2024-09-12T00:18:06.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.892+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~DA1X8MCRRR5U.1 size=792926 2024-09-12T00:18:06.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.900+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=DA1X8MCRRR5U tag=AE6DX74S8JLN type=write size=2890078 2024-09-12T00:18:06.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.904+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=CNMNG41RLFSP type=write size=805918 2024-09-12T00:18:06.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.908+0000 7f69cdea98c0 1 < canceled operation key=AKWTTXH2P254 tag=8S2R7K37FQPE type=del size=3394073 2024-09-12T00:18:06.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.912+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=SKO1265DYYNZ type=write size=365782 2024-09-12T00:18:06.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.916+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=1JZ0HSJNMW1E type=del 2024-09-12T00:18:06.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.920+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=40SB96A8EED2 type=del size=636120 2024-09-12T00:18:06.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.924+0000 7f69cdea98c0 1 < canceled part key=_multipart_UTZNJQJQMXJS.2~Y91S9KM8G162.0 size=1048576 2024-09-12T00:18:06.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.924+0000 7f69cdea98c0 1 < canceled part key=_multipart_UTZNJQJQMXJS.2~Y91S9KM8G162.1 size=103206 2024-09-12T00:18:06.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.936+0000 7f69cdea98c0 1 < canceled multipart upload key=UTZNJQJQMXJS upload=Y91S9KM8G162 tag=EWGQXVWMGH6N type=write size=2200358 2024-09-12T00:18:06.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.940+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~F42YRWB6LRGA.0 size=759972 2024-09-12T00:18:06.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.940+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=F42YRWB6LRGA tag=O4C2FHGDQZT0 type=write size=1808548 2024-09-12T00:18:06.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.948+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=9A62X9PR7UF1 type=del 2024-09-12T00:18:06.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.948+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=E8BXQYLK0YCQ type=del size=655775 2024-09-12T00:18:06.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.952+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=GBOV0DA9H1NG type=del 2024-09-12T00:18:06.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.956+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=UP5CTIF6K3KD type=del size=1073762 2024-09-12T00:18:06.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.964+0000 7f69cdea98c0 1 < suggested remove operation key=YS23U9GQS7SJ tag=A681YGM9E6AQ type=del 2024-09-12T00:18:06.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.968+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=RJXDMUBUGX74 type=del size=3463415 2024-09-12T00:18:06.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.976+0000 7f69cdea98c0 1 < suggested update operation key=2YYP9NOUAJD0 tag=ZE442EYF84M3 type=del size=2054169 2024-09-12T00:18:06.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~8KI6FQSQIUFJ.0 size=1001480 2024-09-12T00:18:06.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.984+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=8KI6FQSQIUFJ tag=HJL8N994R0RE type=write size=2050056 2024-09-12T00:18:06.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.988+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~XL9IIM1CTIDA.0 size=1048576 2024-09-12T00:18:06.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.988+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~XL9IIM1CTIDA.1 size=760080 2024-09-12T00:18:06.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:06.996+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=XL9IIM1CTIDA tag=XFPTEVVFGC4U type=write size=2857232 2024-09-12T00:18:07.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.004+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~VMK3181EAVAZ.0 size=1048576 2024-09-12T00:18:07.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.008+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~VMK3181EAVAZ.1 size=273635 2024-09-12T00:18:07.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.008+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=VMK3181EAVAZ tag=TG9134YOV4N5 type=write size=2370787 2024-09-12T00:18:07.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.012+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=VU21YFCXBE75 type=del 2024-09-12T00:18:07.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.016+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=RXL2N61Z9D9W type=del size=3307228 2024-09-12T00:18:07.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.020+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~JE2OGN55RTK6.0 size=1048576 2024-09-12T00:18:07.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.024+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~JE2OGN55RTK6.1 size=87460 2024-09-12T00:18:07.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.032+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=JE2OGN55RTK6 tag=QUKRJBN5VRLS type=write size=2184612 2024-09-12T00:18:07.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.032+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=9QPGY4AVL9N0 type=del size=2750572 2024-09-12T00:18:07.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.036+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~NKDM95JY4AQY.0 size=989746 2024-09-12T00:18:07.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.044+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=NKDM95JY4AQY tag=YCVTBCSH4S9F type=write size=2038322 2024-09-12T00:18:07.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.052+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~ZOQ09L5A5R90.0 size=891213 2024-09-12T00:18:07.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.052+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=ZOQ09L5A5R90 tag=SUXTYCW0CNJ7 type=write size=1939789 2024-09-12T00:18:07.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.056+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=L85HCL3740SP type=del 2024-09-12T00:18:07.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.056+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=DGA0PRQZXONA type=del size=3959722 2024-09-12T00:18:07.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.060+0000 7f69cdea98c0 -1 < failed to complete operation key=YS23U9GQS7SJ tag=HO6HUSZWYYSN type=write size=926344: (22) Invalid argument 2024-09-12T00:18:07.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.064+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=FWCLSV8XR9BA type=del size=3271254 2024-09-12T00:18:07.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.068+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~8U1RBSN7NUOY.0 size=1048576 2024-09-12T00:18:07.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.072+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~8U1RBSN7NUOY.1 size=1729 2024-09-12T00:18:07.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.080+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=8U1RBSN7NUOY tag=D2R9V21DKTOW type=write size=2098881 2024-09-12T00:18:07.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.084+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=AI7AI2OXVLY4 type=del size=3917403 2024-09-12T00:18:07.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.088+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~X42JEPVA6C15.0 size=1048576 2024-09-12T00:18:07.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.092+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~X42JEPVA6C15.1 size=546128 2024-09-12T00:18:07.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.100+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=X42JEPVA6C15 tag=6O4F48ONGFSH type=write size=2643280 2024-09-12T00:18:07.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.104+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~KNVH1Q1EXJXO.0 size=1048576 2024-09-12T00:18:07.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~KNVH1Q1EXJXO.1 size=61611 2024-09-12T00:18:07.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.108+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=KNVH1Q1EXJXO tag=BUFIVEULBX5I type=write size=2158763 2024-09-12T00:18:07.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.112+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=CNMNG41RLFSP type=write size=805918 2024-09-12T00:18:07.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~6HX73VMTSAHT.0 size=1048576 2024-09-12T00:18:07.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~6HX73VMTSAHT.1 size=1048576 2024-09-12T00:18:07.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.124+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~6HX73VMTSAHT.2 size=796509 2024-09-12T00:18:07.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.124+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=6HX73VMTSAHT tag=XKTF6ADC8ZBS type=write size=3942237 2024-09-12T00:18:07.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.128+0000 7f69cdea98c0 1 < canceled operation key=0EALARW4O3OB tag=SKO1265DYYNZ type=write size=365782 2024-09-12T00:18:07.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~6HD5E9G083NH.0 size=1048576 2024-09-12T00:18:07.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~6HD5E9G083NH.1 size=271188 2024-09-12T00:18:07.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.136+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=6HD5E9G083NH tag=Y8HZY99ICTL8 type=write size=2368340 2024-09-12T00:18:07.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.140+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=40SB96A8EED2 type=del 2024-09-12T00:18:07.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.144+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=6JFI1RPAUL7S type=write size=662897 2024-09-12T00:18:07.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.148+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~F42YRWB6LRGA.0 size=759972 2024-09-12T00:18:07.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.156+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=F42YRWB6LRGA tag=O4C2FHGDQZT0 type=write size=1808548 2024-09-12T00:18:07.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.160+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=P8S1E0547D7J type=del size=2862252 2024-09-12T00:18:07.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.164+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=E8BXQYLK0YCQ type=del 2024-09-12T00:18:07.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.168+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=H55I82RG8Q8H type=del size=2005590 2024-09-12T00:18:07.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.176+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=UP5CTIF6K3KD type=del 2024-09-12T00:18:07.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.180+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=UGZU4VK5V692 type=del size=2408296 2024-09-12T00:18:07.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.184+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=RJXDMUBUGX74 type=del 2024-09-12T00:18:07.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.188+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~5FZZ4N2BBBH1.0 size=1048576 2024-09-12T00:18:07.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.192+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~5FZZ4N2BBBH1.1 size=751310 2024-09-12T00:18:07.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.192+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=5FZZ4N2BBBH1 tag=PBJOY2BRP0BI type=write size=2848462 2024-09-12T00:18:07.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.196+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~8KI6FQSQIUFJ.0 size=1001480 2024-09-12T00:18:07.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.204+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=8KI6FQSQIUFJ tag=HJL8N994R0RE type=write size=2050056 2024-09-12T00:18:07.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~DJQZJL4E1K34.0 size=1048576 2024-09-12T00:18:07.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~DJQZJL4E1K34.1 size=898647 2024-09-12T00:18:07.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.212+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=DJQZJL4E1K34 tag=8W25QQTMF953 type=write size=2995799 2024-09-12T00:18:07.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.212+0000 7f69cdea98c0 1 < canceled part key=_multipart_2X78JWLK876H.2~VMK3181EAVAZ.0 size=1048576 2024-09-12T00:18:07.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.216+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~VMK3181EAVAZ.1 size=273635 2024-09-12T00:18:07.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.224+0000 7f69cdea98c0 1 < canceled multipart upload key=2X78JWLK876H upload=VMK3181EAVAZ tag=TG9134YOV4N5 type=write size=2370787 2024-09-12T00:18:07.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~N3QKQA9ZBE0Y.0 size=57784 2024-09-12T00:18:07.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.228+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=N3QKQA9ZBE0Y tag=A29X3G6C5SMK type=write size=1106360 2024-09-12T00:18:07.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.232+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=RXL2N61Z9D9W type=del 2024-09-12T00:18:07.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.236+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=XE0UE8QND77Y type=del size=3410531 2024-09-12T00:18:07.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.240+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=9QPGY4AVL9N0 type=del 2024-09-12T00:18:07.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~FX8VTMSV78E5.0 size=1048576 2024-09-12T00:18:07.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.252+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~FX8VTMSV78E5.1 size=371511 2024-09-12T00:18:07.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.252+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=FX8VTMSV78E5 tag=F5Q7JMF47OTK type=write size=2468663 2024-09-12T00:18:07.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.256+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~ZOQ09L5A5R90.0 size=891213 2024-09-12T00:18:07.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.264+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=ZOQ09L5A5R90 tag=SUXTYCW0CNJ7 type=write size=1939789 2024-09-12T00:18:07.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~SGIX1NHZBNA5.0 size=1048576 2024-09-12T00:18:07.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.276+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~SGIX1NHZBNA5.1 size=360310 2024-09-12T00:18:07.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.276+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=SGIX1NHZBNA5 tag=OJTO0MLYMJB1 type=write size=2457462 2024-09-12T00:18:07.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.280+0000 7f69cdea98c0 1 < canceled operation key=YS23U9GQS7SJ tag=DGA0PRQZXONA type=del size=3959722 2024-09-12T00:18:07.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.280+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=RYKPTVKWRRCW type=del size=3747362 2024-09-12T00:18:07.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.284+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=FWCLSV8XR9BA type=del 2024-09-12T00:18:07.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.288+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=8RRMJ42D9RXG type=del size=2855663 2024-09-12T00:18:07.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.292+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=AI7AI2OXVLY4 type=del 2024-09-12T00:18:07.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.300+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=AUMC1DT871NT type=del size=577896 2024-09-12T00:18:07.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.304+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~KNVH1Q1EXJXO.0 size=1048576 2024-09-12T00:18:07.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.308+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~KNVH1Q1EXJXO.1 size=61611 2024-09-12T00:18:07.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.316+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=KNVH1Q1EXJXO tag=BUFIVEULBX5I type=write size=2158763 2024-09-12T00:18:07.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.320+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~97KM70XPI3TI.0 size=1048576 2024-09-12T00:18:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.324+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~97KM70XPI3TI.1 size=474073 2024-09-12T00:18:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.324+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=97KM70XPI3TI tag=S48393QN9MB9 type=write size=2571225 2024-09-12T00:18:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.324+0000 7f69cdea98c0 1 < canceled part key=_multipart_Z6MH459BTZ6K.2~6HX73VMTSAHT.0 size=1048576 2024-09-12T00:18:07.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.328+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~6HX73VMTSAHT.1 size=1048576 2024-09-12T00:18:07.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.328+0000 7f69cdea98c0 1 < canceled part key=_multipart_Z6MH459BTZ6K.2~6HX73VMTSAHT.2 size=796509 2024-09-12T00:18:07.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.332+0000 7f69cdea98c0 1 < canceled multipart upload key=Z6MH459BTZ6K upload=6HX73VMTSAHT tag=XKTF6ADC8ZBS type=write size=3942237 2024-09-12T00:18:07.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.340+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~M3HIV2LDJJ43.0 size=1048576 2024-09-12T00:18:07.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.344+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~M3HIV2LDJJ43.1 size=1048576 2024-09-12T00:18:07.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.344+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~M3HIV2LDJJ43.2 size=930868 2024-09-12T00:18:07.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.344+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=M3HIV2LDJJ43 tag=CJZBO8MZH23H type=write size=4076596 2024-09-12T00:18:07.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.348+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~6HD5E9G083NH.0 size=1048576 2024-09-12T00:18:07.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.352+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~6HD5E9G083NH.1 size=271188 2024-09-12T00:18:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.360+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=6HD5E9G083NH tag=Y8HZY99ICTL8 type=write size=2368340 2024-09-12T00:18:07.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.364+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=FV18SDOZJ21M type=del size=3329808 2024-09-12T00:18:07.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.368+0000 7f69cdea98c0 1 < completed write operation key=K4LNDJJUA1RZ tag=6JFI1RPAUL7S type=write size=662897 2024-09-12T00:18:07.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.372+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=P81MBRRB3EI3 type=del size=1640444 2024-09-12T00:18:07.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.376+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=P8S1E0547D7J type=del 2024-09-12T00:18:07.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.380+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=5WGS1TAXS2V9 type=write size=350424 2024-09-12T00:18:07.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.380+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=H55I82RG8Q8H type=del 2024-09-12T00:18:07.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.388+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~A6XBN0H4OH98.0 size=114576 2024-09-12T00:18:07.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.388+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=A6XBN0H4OH98 tag=KJRAAWZ7FXRP type=write size=1163152 2024-09-12T00:18:07.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.392+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=UGZU4VK5V692 type=del 2024-09-12T00:18:07.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.400+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=K8I332RWOTU1 type=del size=2605390 2024-09-12T00:18:07.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.404+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~5FZZ4N2BBBH1.0 size=1048576 2024-09-12T00:18:07.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.404+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~5FZZ4N2BBBH1.1 size=751310 2024-09-12T00:18:07.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.412+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=5FZZ4N2BBBH1 tag=PBJOY2BRP0BI type=write size=2848462 2024-09-12T00:18:07.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.416+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=LD74IZD2A406 type=del size=3052340 2024-09-12T00:18:07.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.420+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~DJQZJL4E1K34.0 size=1048576 2024-09-12T00:18:07.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.424+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~DJQZJL4E1K34.1 size=898647 2024-09-12T00:18:07.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.428+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=DJQZJL4E1K34 tag=8W25QQTMF953 type=write size=2995799 2024-09-12T00:18:07.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.432+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=W0IN04S2WIB8 type=del size=2326971 2024-09-12T00:18:07.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.436+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~N3QKQA9ZBE0Y.0 size=57784 2024-09-12T00:18:07.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.444+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=N3QKQA9ZBE0Y tag=A29X3G6C5SMK type=write size=1106360 2024-09-12T00:18:07.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~FL1QTL5HFIZK.0 size=1048576 2024-09-12T00:18:07.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~FL1QTL5HFIZK.1 size=1048576 2024-09-12T00:18:07.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.456+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~FL1QTL5HFIZK.2 size=1036881 2024-09-12T00:18:07.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.456+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=FL1QTL5HFIZK tag=SC1RIU3LJ6J8 type=write size=4182609 2024-09-12T00:18:07.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.460+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=XE0UE8QND77Y type=del 2024-09-12T00:18:07.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.464+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=NAT44N8TKGPV type=del size=4097145 2024-09-12T00:18:07.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.468+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~FX8VTMSV78E5.0 size=1048576 2024-09-12T00:18:07.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.472+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~FX8VTMSV78E5.1 size=371511 2024-09-12T00:18:07.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.480+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=FX8VTMSV78E5 tag=F5Q7JMF47OTK type=write size=2468663 2024-09-12T00:18:07.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.484+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~DRHYOLIHZV3G.0 size=1048576 2024-09-12T00:18:07.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.488+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~DRHYOLIHZV3G.1 size=361604 2024-09-12T00:18:07.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.488+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=DRHYOLIHZV3G tag=TQ70826P3PNR type=write size=2458756 2024-09-12T00:18:07.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.492+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~SGIX1NHZBNA5.0 size=1048576 2024-09-12T00:18:07.494 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.496+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~SGIX1NHZBNA5.1 size=360310 2024-09-12T00:18:07.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.500+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=SGIX1NHZBNA5 tag=OJTO0MLYMJB1 type=write size=2457462 2024-09-12T00:18:07.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.504+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=8LENT3P0NIQF type=del size=2211441 2024-09-12T00:18:07.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.512+0000 7f69cdea98c0 1 < suggested update operation key=AKWTTXH2P254 tag=RYKPTVKWRRCW type=del size=3747362 2024-09-12T00:18:07.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.516+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=W4L6NZ7Z88FR type=del size=4052734 2024-09-12T00:18:07.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.520+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=8RRMJ42D9RXG type=del 2024-09-12T00:18:07.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~DF08N6EUB6ZP.0 size=13273 2024-09-12T00:18:07.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.528+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=DF08N6EUB6ZP tag=DQVGL2BMEB1U type=write size=1061849 2024-09-12T00:18:07.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.532+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=AUMC1DT871NT type=del 2024-09-12T00:18:07.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.540+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~6ET9LRFOVG1F.0 size=1048576 2024-09-12T00:18:07.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.540+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~6ET9LRFOVG1F.1 size=667756 2024-09-12T00:18:07.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.540+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=6ET9LRFOVG1F tag=59X66351NDQR type=write size=2764908 2024-09-12T00:18:07.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.544+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~97KM70XPI3TI.0 size=1048576 2024-09-12T00:18:07.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.548+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~97KM70XPI3TI.1 size=474073 2024-09-12T00:18:07.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.552+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=97KM70XPI3TI tag=S48393QN9MB9 type=write size=2571225 2024-09-12T00:18:07.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.560+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~X5JCL7U0V8GQ.0 size=1048576 2024-09-12T00:18:07.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.564+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~X5JCL7U0V8GQ.1 size=692396 2024-09-12T00:18:07.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.564+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=X5JCL7U0V8GQ tag=68MSNR3SGTTV type=write size=2789548 2024-09-12T00:18:07.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.568+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~M3HIV2LDJJ43.0 size=1048576 2024-09-12T00:18:07.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.568+0000 7f69cdea98c0 1 < canceled part key=_multipart_9K3HLTD6DMSC.2~M3HIV2LDJJ43.1 size=1048576 2024-09-12T00:18:07.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.572+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~M3HIV2LDJJ43.2 size=930868 2024-09-12T00:18:07.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.576+0000 7f69cdea98c0 1 < canceled multipart upload key=9K3HLTD6DMSC upload=M3HIV2LDJJ43 tag=CJZBO8MZH23H type=write size=4076596 2024-09-12T00:18:07.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.580+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=4HZ3W53XC59P type=del size=348429 2024-09-12T00:18:07.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.584+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=FV18SDOZJ21M type=del 2024-09-12T00:18:07.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.592+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~B8KY444E777V.0 size=1048576 2024-09-12T00:18:07.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~B8KY444E777V.1 size=116320 2024-09-12T00:18:07.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.596+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=B8KY444E777V tag=4G027MB9ZHI8 type=write size=2213472 2024-09-12T00:18:07.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.600+0000 7f69cdea98c0 1 < suggested remove operation key=AKWTTXH2P254 tag=P81MBRRB3EI3 type=del 2024-09-12T00:18:07.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.604+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=F3N7HQARI0EM type=del size=2168986 2024-09-12T00:18:07.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.608+0000 7f69cdea98c0 1 < completed write operation key=Q0L8J0BYRFDQ tag=5WGS1TAXS2V9 type=write size=350424 2024-09-12T00:18:07.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.612+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=WHQE6FCHQ13M type=del size=68149 2024-09-12T00:18:07.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.616+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~A6XBN0H4OH98.0 size=114576 2024-09-12T00:18:07.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.624+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=A6XBN0H4OH98 tag=KJRAAWZ7FXRP type=write size=1163152 2024-09-12T00:18:07.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.628+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=FMZRP572ZWZH type=del size=3376353 2024-09-12T00:18:07.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.628+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=K8I332RWOTU1 type=del 2024-09-12T00:18:07.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.636+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=B7RVJGAJD691 type=del size=2383367 2024-09-12T00:18:07.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.640+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=LD74IZD2A406 type=del 2024-09-12T00:18:07.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.644+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=GQ3ZDTBI0DGI type=del size=1399592 2024-09-12T00:18:07.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.648+0000 7f69cdea98c0 -1 < failed to complete operation key=AKWTTXH2P254 tag=W0IN04S2WIB8 type=del size=2326971: (22) Invalid argument 2024-09-12T00:18:07.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~MGM6A9TQ6PRG.0 size=1048576 2024-09-12T00:18:07.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.664+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~MGM6A9TQ6PRG.1 size=1048576 2024-09-12T00:18:07.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~MGM6A9TQ6PRG.2 size=922807 2024-09-12T00:18:07.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.668+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=MGM6A9TQ6PRG tag=WO90Z6XVMKA2 type=write size=4068535 2024-09-12T00:18:07.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.672+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~FL1QTL5HFIZK.0 size=1048576 2024-09-12T00:18:07.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.676+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~FL1QTL5HFIZK.1 size=1048576 2024-09-12T00:18:07.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.676+0000 7f69cdea98c0 1 < canceled part key=_multipart_Z6MH459BTZ6K.2~FL1QTL5HFIZK.2 size=1036881 2024-09-12T00:18:07.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.680+0000 7f69cdea98c0 1 < canceled multipart upload key=Z6MH459BTZ6K upload=FL1QTL5HFIZK tag=SC1RIU3LJ6J8 type=write size=4182609 2024-09-12T00:18:07.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.684+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=FTMNP2Y3ACK7 type=del size=1053168 2024-09-12T00:18:07.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.688+0000 7f69cdea98c0 1 < completed delete operation key=IXWX7S5NWJS3 tag=NAT44N8TKGPV type=del 2024-09-12T00:18:07.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.696+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~GGV4DKTD5K95.0 size=1048576 2024-09-12T00:18:07.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.700+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~GGV4DKTD5K95.1 size=1048576 2024-09-12T00:18:07.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.704+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~GGV4DKTD5K95.2 size=883727 2024-09-12T00:18:07.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.704+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=GGV4DKTD5K95 tag=T8W75LZVQV9L type=write size=4029455 2024-09-12T00:18:07.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.708+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~DRHYOLIHZV3G.0 size=1048576 2024-09-12T00:18:07.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.712+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~DRHYOLIHZV3G.1 size=361604 2024-09-12T00:18:07.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.716+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=DRHYOLIHZV3G tag=TQ70826P3PNR type=write size=2458756 2024-09-12T00:18:07.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.720+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=QJK5PMM27QQF type=del size=1039197 2024-09-12T00:18:07.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.724+0000 7f69cdea98c0 1 < canceled operation key=2X78JWLK876H tag=8LENT3P0NIQF type=del size=2211441 2024-09-12T00:18:07.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~ZCBSBCYKJELD.0 size=1048576 2024-09-12T00:18:07.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.732+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~ZCBSBCYKJELD.1 size=1048576 2024-09-12T00:18:07.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~ZCBSBCYKJELD.2 size=668116 2024-09-12T00:18:07.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.736+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=ZCBSBCYKJELD tag=2HZ3EM2UBY9K type=write size=3813844 2024-09-12T00:18:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.740+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=W4L6NZ7Z88FR type=del 2024-09-12T00:18:07.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.744+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=W4J33KM67YUG type=del size=751844 2024-09-12T00:18:07.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.748+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~DF08N6EUB6ZP.0 size=13273 2024-09-12T00:18:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.756+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=DF08N6EUB6ZP tag=DQVGL2BMEB1U type=write size=1061849 2024-09-12T00:18:07.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.760+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=E020QSXFGUU6 type=del size=230135 2024-09-12T00:18:07.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.764+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~6ET9LRFOVG1F.0 size=1048576 2024-09-12T00:18:07.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.768+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~6ET9LRFOVG1F.1 size=667756 2024-09-12T00:18:07.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.772+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=6ET9LRFOVG1F tag=59X66351NDQR type=write size=2764908 2024-09-12T00:18:07.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.780+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~00F5O9E7BW8O.0 size=1048576 2024-09-12T00:18:07.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.784+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~00F5O9E7BW8O.1 size=388610 2024-09-12T00:18:07.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.784+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=00F5O9E7BW8O tag=QAVAJOZIZT4L type=write size=2485762 2024-09-12T00:18:07.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.788+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~X5JCL7U0V8GQ.0 size=1048576 2024-09-12T00:18:07.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.788+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~X5JCL7U0V8GQ.1 size=692396 2024-09-12T00:18:07.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.796+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=X5JCL7U0V8GQ tag=68MSNR3SGTTV type=write size=2789548 2024-09-12T00:18:07.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.804+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~IIB3V9YN6ATF.0 size=531298 2024-09-12T00:18:07.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.804+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=IIB3V9YN6ATF tag=X3PE7YIRPE8N type=write size=1579874 2024-09-12T00:18:07.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.808+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=4HZ3W53XC59P type=del 2024-09-12T00:18:07.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.812+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=K8LWSDI2ATYS type=write size=1010466 2024-09-12T00:18:07.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.816+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~B8KY444E777V.0 size=1048576 2024-09-12T00:18:07.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.816+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~B8KY444E777V.1 size=116320 2024-09-12T00:18:07.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.824+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=B8KY444E777V tag=4G027MB9ZHI8 type=write size=2213472 2024-09-12T00:18:07.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.832+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~81NZ3Q2VZZY2.0 size=1048576 2024-09-12T00:18:07.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.832+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~81NZ3Q2VZZY2.1 size=665769 2024-09-12T00:18:07.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.832+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=81NZ3Q2VZZY2 tag=1B26ZTP359YO type=write size=2762921 2024-09-12T00:18:07.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.836+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=F3N7HQARI0EM type=del 2024-09-12T00:18:07.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.840+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=QETOYUD6FU4O type=del size=2453981 2024-09-12T00:18:07.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.848+0000 7f69cdea98c0 1 < suggested update operation key=Z6MH459BTZ6K tag=WHQE6FCHQ13M type=del size=68149 2024-09-12T00:18:07.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.852+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=Q429PLVCI06P type=del size=3541124 2024-09-12T00:18:07.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.856+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=FMZRP572ZWZH type=del 2024-09-12T00:18:07.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.864+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~WHP1WVW6A5WZ.0 size=1048576 2024-09-12T00:18:07.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~WHP1WVW6A5WZ.1 size=141174 2024-09-12T00:18:07.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.868+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=WHP1WVW6A5WZ tag=VOVU0PWJPJIM type=write size=2238326 2024-09-12T00:18:07.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.872+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=B7RVJGAJD691 type=del 2024-09-12T00:18:07.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.880+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~68VL1YX2ACR3.0 size=1048576 2024-09-12T00:18:07.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~68VL1YX2ACR3.1 size=1048576 2024-09-12T00:18:07.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.884+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~68VL1YX2ACR3.2 size=30126 2024-09-12T00:18:07.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.884+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=68VL1YX2ACR3 tag=S92MR1R8MAAV type=write size=3175854 2024-09-12T00:18:07.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.896+0000 7f69cdea98c0 1 < suggested update operation key=AQY7MM3OX3GW tag=GQ3ZDTBI0DGI type=del size=1399592 2024-09-12T00:18:07.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.900+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=2WZXPRYJ5NLX type=del size=503624 2024-09-12T00:18:07.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.904+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~MGM6A9TQ6PRG.0 size=1048576 2024-09-12T00:18:07.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.908+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~MGM6A9TQ6PRG.1 size=1048576 2024-09-12T00:18:07.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.908+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~MGM6A9TQ6PRG.2 size=922807 2024-09-12T00:18:07.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.916+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=MGM6A9TQ6PRG tag=WO90Z6XVMKA2 type=write size=4068535 2024-09-12T00:18:07.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.920+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=L8VKX3VZJND4 type=del size=3856483 2024-09-12T00:18:07.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.928+0000 7f69cdea98c0 1 < suggested update operation key=5453GP1H3OFQ tag=FTMNP2Y3ACK7 type=del size=1053168 2024-09-12T00:18:07.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.932+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=16WV9HAYXQKM type=del size=2372376 2024-09-12T00:18:07.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.936+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~GGV4DKTD5K95.0 size=1048576 2024-09-12T00:18:07.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.936+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~GGV4DKTD5K95.1 size=1048576 2024-09-12T00:18:07.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.940+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~GGV4DKTD5K95.2 size=883727 2024-09-12T00:18:07.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.948+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=GGV4DKTD5K95 tag=T8W75LZVQV9L type=write size=4029455 2024-09-12T00:18:07.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.952+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=20LW8XMVYAOJ type=del size=2152334 2024-09-12T00:18:07.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.956+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=QJK5PMM27QQF type=del 2024-09-12T00:18:07.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.960+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=Q1MEU6GZ07YV type=del size=3403412 2024-09-12T00:18:07.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.960+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~ZCBSBCYKJELD.0 size=1048576 2024-09-12T00:18:07.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.964+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~ZCBSBCYKJELD.1 size=1048576 2024-09-12T00:18:07.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.964+0000 7f69cdea98c0 1 < canceled part key=_multipart_T9OJXTZNRQJB.2~ZCBSBCYKJELD.2 size=668116 2024-09-12T00:18:07.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.972+0000 7f69cdea98c0 1 < canceled multipart upload key=T9OJXTZNRQJB upload=ZCBSBCYKJELD tag=2HZ3EM2UBY9K type=write size=3813844 2024-09-12T00:18:07.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.972+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=G9M3XDGVLP3O type=del size=2743771 2024-09-12T00:18:07.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.976+0000 7f69cdea98c0 1 < canceled operation key=VYYY8MF0P3Q7 tag=W4J33KM67YUG type=del size=751844 2024-09-12T00:18:07.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.984+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~G0ATUMVFDK8U.0 size=1048576 2024-09-12T00:18:07.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~G0ATUMVFDK8U.1 size=572684 2024-09-12T00:18:07.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.988+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=G0ATUMVFDK8U tag=TAGIY67AKH3I type=write size=2669836 2024-09-12T00:18:07.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.992+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=E020QSXFGUU6 type=del 2024-09-12T00:18:07.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:07.996+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=FZP3IUX1XQ4H type=del size=2157718 2024-09-12T00:18:07.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.000+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~00F5O9E7BW8O.0 size=1048576 2024-09-12T00:18:07.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.000+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~00F5O9E7BW8O.1 size=388610 2024-09-12T00:18:08.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.008+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=00F5O9E7BW8O tag=QAVAJOZIZT4L type=write size=2485762 2024-09-12T00:18:08.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.012+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=2Q74YXYV8H5W type=del size=3970764 2024-09-12T00:18:08.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.020+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~IIB3V9YN6ATF.0 size=531298 2024-09-12T00:18:08.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.024+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=IIB3V9YN6ATF tag=X3PE7YIRPE8N type=write size=1579874 2024-09-12T00:18:08.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.028+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=D6ER11TXQ1L4 type=del size=651045 2024-09-12T00:18:08.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.032+0000 7f69cdea98c0 1 < completed write operation key=7UFADFUXL28I tag=K8LWSDI2ATYS type=write size=1010466 2024-09-12T00:18:08.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.036+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=3CSC2PFO5TBM type=del size=4043698 2024-09-12T00:18:08.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.040+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~81NZ3Q2VZZY2.0 size=1048576 2024-09-12T00:18:08.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.044+0000 7f69cdea98c0 1 < completed part key=_multipart_7UFADFUXL28I.2~81NZ3Q2VZZY2.1 size=665769 2024-09-12T00:18:08.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.048+0000 7f69cdea98c0 1 < completed multipart upload key=7UFADFUXL28I upload=81NZ3Q2VZZY2 tag=1B26ZTP359YO type=write size=2762921 2024-09-12T00:18:08.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.056+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~INS1AXHU6314.0 size=709963 2024-09-12T00:18:08.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.056+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=INS1AXHU6314 tag=0Y9CMUM235O9 type=write size=1758539 2024-09-12T00:18:08.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.060+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=QETOYUD6FU4O type=del 2024-09-12T00:18:08.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.064+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=7O7P7ZW41K7Z type=del size=1701838 2024-09-12T00:18:08.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.072+0000 7f69cdea98c0 1 < suggested update operation key=I23GNCI98JHU tag=Q429PLVCI06P type=del size=3541124 2024-09-12T00:18:08.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.076+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=27EXPAELV6CV type=del size=1327175 2024-09-12T00:18:08.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.080+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~WHP1WVW6A5WZ.0 size=1048576 2024-09-12T00:18:08.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.080+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~WHP1WVW6A5WZ.1 size=141174 2024-09-12T00:18:08.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.088+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=WHP1WVW6A5WZ tag=VOVU0PWJPJIM type=write size=2238326 2024-09-12T00:18:08.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.092+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=LIWU4ED2Q6L1 type=del size=1471012 2024-09-12T00:18:08.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.092+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~68VL1YX2ACR3.0 size=1048576 2024-09-12T00:18:08.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.096+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~68VL1YX2ACR3.1 size=1048576 2024-09-12T00:18:08.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.100+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~68VL1YX2ACR3.2 size=30126 2024-09-12T00:18:08.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.104+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=68VL1YX2ACR3 tag=S92MR1R8MAAV type=write size=3175854 2024-09-12T00:18:08.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.108+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=CRMZJ2UHX89I type=del size=522118 2024-09-12T00:18:08.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.112+0000 7f69cdea98c0 1 < canceled operation key=2ENKC4QT2BFS tag=2WZXPRYJ5NLX type=del size=503624 2024-09-12T00:18:08.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.116+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=QH2TTKTM84D7 type=del size=2563890 2024-09-12T00:18:08.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.120+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=L8VKX3VZJND4 type=del 2024-09-12T00:18:08.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.124+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=X0XTWPVA8LNY type=del size=3001339 2024-09-12T00:18:08.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.132+0000 7f69cdea98c0 1 < suggested update operation key=1CZXUEJLQ8FM tag=16WV9HAYXQKM type=del size=2372376 2024-09-12T00:18:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~MALP1YPM2KY2.0 size=1048576 2024-09-12T00:18:08.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.144+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~MALP1YPM2KY2.1 size=606055 2024-09-12T00:18:08.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.144+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=MALP1YPM2KY2 tag=OOJU07X7MVHX type=write size=2703207 2024-09-12T00:18:08.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.148+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=20LW8XMVYAOJ type=del 2024-09-12T00:18:08.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.156+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~DPXJ2JHLMZB2.0 size=312620 2024-09-12T00:18:08.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.156+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=DPXJ2JHLMZB2 tag=UZA7Y4UREKZ9 type=write size=1361196 2024-09-12T00:18:08.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.160+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=Q1MEU6GZ07YV type=del 2024-09-12T00:18:08.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.164+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=HLXKB83C00DI type=write size=199956 2024-09-12T00:18:08.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.168+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=G9M3XDGVLP3O type=del 2024-09-12T00:18:08.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.176+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~II0C5KT9HMGF.0 size=545644 2024-09-12T00:18:08.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.176+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=II0C5KT9HMGF tag=DEKX5R6RWE0H type=write size=1594220 2024-09-12T00:18:08.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.180+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~G0ATUMVFDK8U.0 size=1048576 2024-09-12T00:18:08.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.180+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~G0ATUMVFDK8U.1 size=572684 2024-09-12T00:18:08.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.188+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=G0ATUMVFDK8U tag=TAGIY67AKH3I type=write size=2669836 2024-09-12T00:18:08.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.192+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=FQ0YC3YFAXAC type=write size=767298 2024-09-12T00:18:08.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.196+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=FZP3IUX1XQ4H type=del 2024-09-12T00:18:08.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.200+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=CK0O117PXVL1 type=del size=1596624 2024-09-12T00:18:08.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.204+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=2Q74YXYV8H5W type=del 2024-09-12T00:18:08.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.208+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~1SYPLUM7SMGV.0 size=1048576 2024-09-12T00:18:08.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.212+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~1SYPLUM7SMGV.1 size=73985 2024-09-12T00:18:08.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.212+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=1SYPLUM7SMGV tag=FMXRGW9IC5MN type=write size=2171137 2024-09-12T00:18:08.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.216+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=D6ER11TXQ1L4 type=del 2024-09-12T00:18:08.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.220+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=LSUIOTOH1PGQ type=del size=510379 2024-09-12T00:18:08.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.228+0000 7f69cdea98c0 1 < suggested update operation key=Q0L8J0BYRFDQ tag=3CSC2PFO5TBM type=del size=4043698 2024-09-12T00:18:08.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.236+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~H1OFX83FZZQS.0 size=515485 2024-09-12T00:18:08.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.236+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=H1OFX83FZZQS tag=KG3EXN8FG4W8 type=write size=1564061 2024-09-12T00:18:08.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.240+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~INS1AXHU6314.0 size=709963 2024-09-12T00:18:08.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.248+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=INS1AXHU6314 tag=0Y9CMUM235O9 type=write size=1758539 2024-09-12T00:18:08.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.248+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=MS72JO080F92 type=del size=3853407 2024-09-12T00:18:08.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.252+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=7O7P7ZW41K7Z type=del 2024-09-12T00:18:08.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.256+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=DD7P7NSRTC0F type=del size=761410 2024-09-12T00:18:08.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.264+0000 7f69cdea98c0 1 < canceled operation key=7UFADFUXL28I tag=27EXPAELV6CV type=del size=1327175 2024-09-12T00:18:08.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.264+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=BWDR0BKS1Z11 type=del size=3564786 2024-09-12T00:18:08.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.268+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=LIWU4ED2Q6L1 type=del 2024-09-12T00:18:08.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.276+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=KQ1Y52MAY43L type=write size=252218 2024-09-12T00:18:08.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.280+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=CRMZJ2UHX89I type=del 2024-09-12T00:18:08.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.284+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~S566SZADG95A.0 size=176707 2024-09-12T00:18:08.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.284+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=S566SZADG95A tag=O1R60PIJ95A6 type=write size=1225283 2024-09-12T00:18:08.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.292+0000 7f69cdea98c0 1 < suggested remove operation key=K4LNDJJUA1RZ tag=QH2TTKTM84D7 type=del 2024-09-12T00:18:08.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.300+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~GVK8YO4M8SDA.0 size=863493 2024-09-12T00:18:08.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.300+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=GVK8YO4M8SDA tag=E46WUIZHB6WV type=write size=1912069 2024-09-12T00:18:08.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.304+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=X0XTWPVA8LNY type=del 2024-09-12T00:18:08.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~JD9LBSM5J1A5.0 size=1048576 2024-09-12T00:18:08.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.316+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~JD9LBSM5J1A5.1 size=736492 2024-09-12T00:18:08.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.316+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=JD9LBSM5J1A5 tag=EGVPR57HOCA5 type=write size=2833644 2024-09-12T00:18:08.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.320+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~MALP1YPM2KY2.0 size=1048576 2024-09-12T00:18:08.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.320+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~MALP1YPM2KY2.1 size=606055 2024-09-12T00:18:08.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.328+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=MALP1YPM2KY2 tag=OOJU07X7MVHX type=write size=2703207 2024-09-12T00:18:08.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.332+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=XH0VT3DZUA4C type=del size=291173 2024-09-12T00:18:08.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.336+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~DPXJ2JHLMZB2.0 size=312620 2024-09-12T00:18:08.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.340+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=DPXJ2JHLMZB2 tag=UZA7Y4UREKZ9 type=write size=1361196 2024-09-12T00:18:08.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.344+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=I253L4R3K4RI type=write size=216244 2024-09-12T00:18:08.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.348+0000 7f69cdea98c0 1 < completed write operation key=SP2KVAO82MQ0 tag=HLXKB83C00DI type=write size=199956 2024-09-12T00:18:08.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.352+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~H005EZ3UBI80.0 size=751289 2024-09-12T00:18:08.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.352+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=H005EZ3UBI80 tag=UPG5ODCMTJQ9 type=write size=1799865 2024-09-12T00:18:08.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.356+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~II0C5KT9HMGF.0 size=545644 2024-09-12T00:18:08.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.364+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=II0C5KT9HMGF tag=DEKX5R6RWE0H type=write size=1594220 2024-09-12T00:18:08.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.372+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=FXAYH9RU2XX1 type=write size=390537 2024-09-12T00:18:08.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.376+0000 7f69cdea98c0 1 < completed write operation key=K0HNNMX7CDGC tag=FQ0YC3YFAXAC type=write size=767298 2024-09-12T00:18:08.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.376+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=L2UU93WDJKDH type=del size=1209968 2024-09-12T00:18:08.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.380+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=CK0O117PXVL1 type=del 2024-09-12T00:18:08.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.384+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=42IAJIJMCV7M type=del size=3396458 2024-09-12T00:18:08.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.388+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~1SYPLUM7SMGV.0 size=1048576 2024-09-12T00:18:08.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.388+0000 7f69cdea98c0 1 < canceled part key=_multipart_UTZNJQJQMXJS.2~1SYPLUM7SMGV.1 size=73985 2024-09-12T00:18:08.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.396+0000 7f69cdea98c0 1 < canceled multipart upload key=UTZNJQJQMXJS upload=1SYPLUM7SMGV tag=FMXRGW9IC5MN type=write size=2171137 2024-09-12T00:18:08.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.400+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=YPZSTID6OHNM type=del size=3942493 2024-09-12T00:18:08.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.408+0000 7f69cdea98c0 1 < suggested update operation key=SCFIVX3IHERR tag=LSUIOTOH1PGQ type=del size=510379 2024-09-12T00:18:08.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.412+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=26190K1S0YIF type=del size=2026740 2024-09-12T00:18:08.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.412+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~H1OFX83FZZQS.0 size=515485 2024-09-12T00:18:08.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.420+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=H1OFX83FZZQS tag=KG3EXN8FG4W8 type=write size=1564061 2024-09-12T00:18:08.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.424+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=3E0OZT8MW05P type=write size=923834 2024-09-12T00:18:08.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.428+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=MS72JO080F92 type=del 2024-09-12T00:18:08.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.432+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=HSZH29MR5355 type=del size=1092413 2024-09-12T00:18:08.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.432+0000 7f69cdea98c0 -1 < failed to complete operation key=K4LNDJJUA1RZ tag=DD7P7NSRTC0F type=del size=761410: (22) Invalid argument 2024-09-12T00:18:08.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.440+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~23P0NQ2B3Z2S.0 size=1048576 2024-09-12T00:18:08.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~23P0NQ2B3Z2S.1 size=1048576 2024-09-12T00:18:08.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~23P0NQ2B3Z2S.2 size=765291 2024-09-12T00:18:08.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.444+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=23P0NQ2B3Z2S tag=OGN534ORZKE1 type=write size=3911019 2024-09-12T00:18:08.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.452+0000 7f69cdea98c0 1 < suggested remove operation key=2YYP9NOUAJD0 tag=BWDR0BKS1Z11 type=del 2024-09-12T00:18:08.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.460+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~S6UMJHGSMPZE.0 size=704762 2024-09-12T00:18:08.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.460+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=S6UMJHGSMPZE tag=LGBK3ERNV1TE type=write size=1753338 2024-09-12T00:18:08.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.464+0000 7f69cdea98c0 1 < canceled operation key=0HAUC4BDL9VR tag=KQ1Y52MAY43L type=write size=252218 2024-09-12T00:18:08.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~0NS1FU1P1JX0.0 size=1048576 2024-09-12T00:18:08.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.472+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~0NS1FU1P1JX0.1 size=815922 2024-09-12T00:18:08.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.472+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=0NS1FU1P1JX0 tag=RO20YIWWYD4A type=write size=2913074 2024-09-12T00:18:08.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.476+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~S566SZADG95A.0 size=176707 2024-09-12T00:18:08.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.484+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=S566SZADG95A tag=O1R60PIJ95A6 type=write size=1225283 2024-09-12T00:18:08.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.488+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=0D9SXOWPLYEK type=write size=206814 2024-09-12T00:18:08.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.492+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~GVK8YO4M8SDA.0 size=863493 2024-09-12T00:18:08.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.496+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=GVK8YO4M8SDA tag=E46WUIZHB6WV type=write size=1912069 2024-09-12T00:18:08.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.500+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=316E1M85SY70 type=del size=2243226 2024-09-12T00:18:08.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.504+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~JD9LBSM5J1A5.0 size=1048576 2024-09-12T00:18:08.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.508+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~JD9LBSM5J1A5.1 size=736492 2024-09-12T00:18:08.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.512+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=JD9LBSM5J1A5 tag=EGVPR57HOCA5 type=write size=2833644 2024-09-12T00:18:08.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.516+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=SGKNEEY2J12S type=del size=499431 2024-09-12T00:18:08.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.520+0000 7f69cdea98c0 -1 < failed to complete operation key=SCFIVX3IHERR tag=XH0VT3DZUA4C type=del size=291173: (22) Invalid argument 2024-09-12T00:18:08.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~2YDKZMREXSQC.0 size=243700 2024-09-12T00:18:08.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.528+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=2YDKZMREXSQC tag=FPNMPWHADHMJ type=write size=1292276 2024-09-12T00:18:08.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.536+0000 7f69cdea98c0 1 < suggested update operation key=Q0L8J0BYRFDQ tag=I253L4R3K4RI type=write size=216244 2024-09-12T00:18:08.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.540+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~VFT0X1W4LDIX.0 size=1048576 2024-09-12T00:18:08.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.544+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~VFT0X1W4LDIX.1 size=1048576 2024-09-12T00:18:08.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.548+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~VFT0X1W4LDIX.2 size=112034 2024-09-12T00:18:08.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.548+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=VFT0X1W4LDIX tag=1ED6VU35QO0I type=write size=3257762 2024-09-12T00:18:08.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.552+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~H005EZ3UBI80.0 size=751289 2024-09-12T00:18:08.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.556+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=H005EZ3UBI80 tag=UPG5ODCMTJQ9 type=write size=1799865 2024-09-12T00:18:08.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.564+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~AJZ6WQ7RV2G2.0 size=57425 2024-09-12T00:18:08.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.564+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=AJZ6WQ7RV2G2 tag=YJD0779PF65T type=write size=1106001 2024-09-12T00:18:08.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.572+0000 7f69cdea98c0 1 < suggested update operation key=YS23U9GQS7SJ tag=FXAYH9RU2XX1 type=write size=390537 2024-09-12T00:18:08.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~016N9GZEV67F.0 size=1048576 2024-09-12T00:18:08.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~016N9GZEV67F.1 size=1048576 2024-09-12T00:18:08.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.584+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~016N9GZEV67F.2 size=775099 2024-09-12T00:18:08.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.584+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=016N9GZEV67F tag=EVJBT33YT58K type=write size=3920827 2024-09-12T00:18:08.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.588+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=L2UU93WDJKDH type=del 2024-09-12T00:18:08.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.592+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=RKBK8DBTHRBS type=write size=533631 2024-09-12T00:18:08.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.600+0000 7f69cdea98c0 1 < suggested update operation key=K0HNNMX7CDGC tag=42IAJIJMCV7M type=del size=3396458 2024-09-12T00:18:08.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.604+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=EGWF4KUMLEY6 type=del size=3655923 2024-09-12T00:18:08.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.608+0000 7f69cdea98c0 1 < canceled operation key=O5WBNND16BFN tag=YPZSTID6OHNM type=del size=3942493 2024-09-12T00:18:08.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.616+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~SP7L1MKRLA1R.0 size=1048576 2024-09-12T00:18:08.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.620+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~SP7L1MKRLA1R.1 size=1048576 2024-09-12T00:18:08.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.624+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~SP7L1MKRLA1R.2 size=518425 2024-09-12T00:18:08.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.624+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=SP7L1MKRLA1R tag=C75MQ67EW8UG type=write size=3664153 2024-09-12T00:18:08.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.628+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=26190K1S0YIF type=del 2024-09-12T00:18:08.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.632+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=0KBTWR68U8JX type=write size=734189 2024-09-12T00:18:08.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.640+0000 7f69cdea98c0 1 < suggested remove operation key=IXB6WLN5M81C tag=3E0OZT8MW05P type=write 2024-09-12T00:18:08.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.644+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=NYZN7GV7SZHE type=del size=1339704 2024-09-12T00:18:08.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.648+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=HSZH29MR5355 type=del 2024-09-12T00:18:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~J54B1IMFKD2D.0 size=43429 2024-09-12T00:18:08.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.652+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=J54B1IMFKD2D tag=ME6Z6X0GL2SO type=write size=1092005 2024-09-12T00:18:08.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.656+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~23P0NQ2B3Z2S.0 size=1048576 2024-09-12T00:18:08.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.660+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~23P0NQ2B3Z2S.1 size=1048576 2024-09-12T00:18:08.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.664+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~23P0NQ2B3Z2S.2 size=765291 2024-09-12T00:18:08.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.668+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=23P0NQ2B3Z2S tag=OGN534ORZKE1 type=write size=3911019 2024-09-12T00:18:08.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.676+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~ZXVXHWB1SKD8.0 size=1048576 2024-09-12T00:18:08.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.680+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~ZXVXHWB1SKD8.1 size=1048576 2024-09-12T00:18:08.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.680+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~ZXVXHWB1SKD8.2 size=1025867 2024-09-12T00:18:08.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.680+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=ZXVXHWB1SKD8 tag=WP0EL22EZ2EV type=write size=4171595 2024-09-12T00:18:08.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.684+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~S6UMJHGSMPZE.0 size=704762 2024-09-12T00:18:08.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.692+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=S6UMJHGSMPZE tag=LGBK3ERNV1TE type=write size=1753338 2024-09-12T00:18:08.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.696+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=JTRI2N4AIVIC type=del size=1554633 2024-09-12T00:18:08.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.700+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~0NS1FU1P1JX0.0 size=1048576 2024-09-12T00:18:08.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.700+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~0NS1FU1P1JX0.1 size=815922 2024-09-12T00:18:08.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.708+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=0NS1FU1P1JX0 tag=RO20YIWWYD4A type=write size=2913074 2024-09-12T00:18:08.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.712+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=G9WJY241804C type=del size=2474936 2024-09-12T00:18:08.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.720+0000 7f69cdea98c0 -1 < failed to complete operation key=K0HNNMX7CDGC tag=0D9SXOWPLYEK type=write size=206814: (22) Invalid argument 2024-09-12T00:18:08.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.724+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=QAFO81O6HQAV type=del size=201548 2024-09-12T00:18:08.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.728+0000 7f69cdea98c0 -1 < failed to complete operation key=YS23U9GQS7SJ tag=316E1M85SY70 type=del size=2243226: (22) Invalid argument 2024-09-12T00:18:08.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.732+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=236ZRA2NAD8W type=del size=568265 2024-09-12T00:18:08.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.736+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=SGKNEEY2J12S type=del 2024-09-12T00:18:08.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.744+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~93P9YFDGJJH2.0 size=1048576 2024-09-12T00:18:08.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.748+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~93P9YFDGJJH2.1 size=764051 2024-09-12T00:18:08.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.748+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=93P9YFDGJJH2 tag=W25C8J14HV65 type=write size=2861203 2024-09-12T00:18:08.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.752+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~2YDKZMREXSQC.0 size=243700 2024-09-12T00:18:08.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.756+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=2YDKZMREXSQC tag=FPNMPWHADHMJ type=write size=1292276 2024-09-12T00:18:08.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.764+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~MORYDZH9JWY9.0 size=840458 2024-09-12T00:18:08.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.764+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=MORYDZH9JWY9 tag=V4VF3VI2AJTR type=write size=1889034 2024-09-12T00:18:08.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.768+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~VFT0X1W4LDIX.0 size=1048576 2024-09-12T00:18:08.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.768+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~VFT0X1W4LDIX.1 size=1048576 2024-09-12T00:18:08.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.772+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~VFT0X1W4LDIX.2 size=112034 2024-09-12T00:18:08.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.780+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=VFT0X1W4LDIX tag=1ED6VU35QO0I type=write size=3257762 2024-09-12T00:18:08.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.784+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~CIWENR4UJOD6.0 size=840779 2024-09-12T00:18:08.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.784+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=CIWENR4UJOD6 tag=G8LZ2XQ7UP5R type=write size=1889355 2024-09-12T00:18:08.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.784+0000 7f69cdea98c0 1 < canceled part key=_multipart_9K3HLTD6DMSC.2~AJZ6WQ7RV2G2.0 size=57425 2024-09-12T00:18:08.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.792+0000 7f69cdea98c0 1 < canceled multipart upload key=9K3HLTD6DMSC upload=AJZ6WQ7RV2G2 tag=YJD0779PF65T type=write size=1106001 2024-09-12T00:18:08.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.796+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=2SY01KZ1DK0B type=del size=2462263 2024-09-12T00:18:08.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.800+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~016N9GZEV67F.0 size=1048576 2024-09-12T00:18:08.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.800+0000 7f69cdea98c0 1 < canceled part key=_multipart_0J667VAQGMTX.2~016N9GZEV67F.1 size=1048576 2024-09-12T00:18:08.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.800+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~016N9GZEV67F.2 size=775099 2024-09-12T00:18:08.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.808+0000 7f69cdea98c0 1 < canceled multipart upload key=0J667VAQGMTX upload=016N9GZEV67F tag=EVJBT33YT58K type=write size=3920827 2024-09-12T00:18:08.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.812+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=3N2AU7GZ2XO6 type=del size=3861359 2024-09-12T00:18:08.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.816+0000 7f69cdea98c0 1 < completed write operation key=VYYY8MF0P3Q7 tag=RKBK8DBTHRBS type=write size=533631 2024-09-12T00:18:08.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.820+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=IS4PAM581M1S type=del size=410837 2024-09-12T00:18:08.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.824+0000 7f69cdea98c0 1 < canceled operation key=O5WBNND16BFN tag=EGWF4KUMLEY6 type=del size=3655923 2024-09-12T00:18:08.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.824+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=W9AQTF028SWC type=del size=612625 2024-09-12T00:18:08.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.828+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~SP7L1MKRLA1R.0 size=1048576 2024-09-12T00:18:08.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.828+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~SP7L1MKRLA1R.1 size=1048576 2024-09-12T00:18:08.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.832+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~SP7L1MKRLA1R.2 size=518425 2024-09-12T00:18:08.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.840+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=SP7L1MKRLA1R tag=C75MQ67EW8UG type=write size=3664153 2024-09-12T00:18:08.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.844+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=YF4CM54IZXPX type=del size=2267517 2024-09-12T00:18:08.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.848+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=0KBTWR68U8JX type=write size=734189 2024-09-12T00:18:08.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.852+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=3261W2FOCOR5 type=del size=2332328 2024-09-12T00:18:08.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.856+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=NYZN7GV7SZHE type=del 2024-09-12T00:18:08.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~6FZHPOH5UZIA.0 size=1048576 2024-09-12T00:18:08.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.864+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~6FZHPOH5UZIA.1 size=1048576 2024-09-12T00:18:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~6FZHPOH5UZIA.2 size=79910 2024-09-12T00:18:08.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.868+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=6FZHPOH5UZIA tag=8XORWYOWV4P1 type=write size=3225638 2024-09-12T00:18:08.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.872+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~J54B1IMFKD2D.0 size=43429 2024-09-12T00:18:08.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.876+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=J54B1IMFKD2D tag=ME6Z6X0GL2SO type=write size=1092005 2024-09-12T00:18:08.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.880+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=0IM67DBVC4Z0 type=del size=1870501 2024-09-12T00:18:08.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.884+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~ZXVXHWB1SKD8.0 size=1048576 2024-09-12T00:18:08.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.888+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~ZXVXHWB1SKD8.1 size=1048576 2024-09-12T00:18:08.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.892+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~ZXVXHWB1SKD8.2 size=1025867 2024-09-12T00:18:08.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.896+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=ZXVXHWB1SKD8 tag=WP0EL22EZ2EV type=write size=4171595 2024-09-12T00:18:08.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.904+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=C8M0M7R03HCT type=del size=612402 2024-09-12T00:18:08.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.912+0000 7f69cdea98c0 1 < suggested update operation key=0EALARW4O3OB tag=JTRI2N4AIVIC type=del size=1554633 2024-09-12T00:18:08.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.916+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=J6TH7SXHKDRJ type=del size=585490 2024-09-12T00:18:08.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.920+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=G9WJY241804C type=del 2024-09-12T00:18:08.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.924+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=4IW4TC6RX3FF type=del size=1319964 2024-09-12T00:18:08.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.928+0000 7f69cdea98c0 -1 < failed to complete operation key=0EALARW4O3OB tag=QAFO81O6HQAV type=del size=201548: (22) Invalid argument 2024-09-12T00:18:08.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.936+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~GPQYEBT33X7H.0 size=1048576 2024-09-12T00:18:08.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.940+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~GPQYEBT33X7H.1 size=788527 2024-09-12T00:18:08.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.940+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=GPQYEBT33X7H tag=O978FMN4WNWY type=write size=2885679 2024-09-12T00:18:08.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.944+0000 7f69cdea98c0 1 < completed delete operation key=YS23U9GQS7SJ tag=236ZRA2NAD8W type=del 2024-09-12T00:18:08.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.948+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=N80QO3CO1FFV type=write size=82727 2024-09-12T00:18:08.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.952+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~93P9YFDGJJH2.0 size=1048576 2024-09-12T00:18:08.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.956+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~93P9YFDGJJH2.1 size=764051 2024-09-12T00:18:08.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.960+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=93P9YFDGJJH2 tag=W25C8J14HV65 type=write size=2861203 2024-09-12T00:18:08.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.968+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=TNLOUX2DX66W type=del size=2341207 2024-09-12T00:18:08.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.972+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~MORYDZH9JWY9.0 size=840458 2024-09-12T00:18:08.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.976+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=MORYDZH9JWY9 tag=V4VF3VI2AJTR type=write size=1889034 2024-09-12T00:18:08.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.980+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=CY2SFEXAG1SR type=del size=4153413 2024-09-12T00:18:08.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.984+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~CIWENR4UJOD6.0 size=840779 2024-09-12T00:18:08.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.992+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=CIWENR4UJOD6 tag=G8LZ2XQ7UP5R type=write size=1889355 2024-09-12T00:18:08.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.996+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~OTPA9OJPS245.0 size=828595 2024-09-12T00:18:08.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:08.996+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=OTPA9OJPS245 tag=IMI71M9R9EZS type=write size=1877171 2024-09-12T00:18:09.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.000+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=2SY01KZ1DK0B type=del 2024-09-12T00:18:09.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.004+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=2G8GZRFBFM5L type=del size=215814 2024-09-12T00:18:09.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.008+0000 7f69cdea98c0 1 < canceled operation key=SP2KVAO82MQ0 tag=3N2AU7GZ2XO6 type=del size=3861359 2024-09-12T00:18:09.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.012+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=67F6TSBF1EPH type=del size=3105929 2024-09-12T00:18:09.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.016+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=IS4PAM581M1S type=del 2024-09-12T00:18:09.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.024+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=37LEQHJQC2CV type=del size=2454586 2024-09-12T00:18:09.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.028+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=W9AQTF028SWC type=del 2024-09-12T00:18:09.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.032+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=RXGYFLROMOQD type=write size=1024803 2024-09-12T00:18:09.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.036+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=YF4CM54IZXPX type=del 2024-09-12T00:18:09.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~T8CIW11HEFOW.0 size=1048576 2024-09-12T00:18:09.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~T8CIW11HEFOW.1 size=387556 2024-09-12T00:18:09.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.044+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=T8CIW11HEFOW tag=JAALPD4NNQN3 type=write size=2484708 2024-09-12T00:18:09.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.048+0000 7f69cdea98c0 1 < canceled operation key=7UFADFUXL28I tag=3261W2FOCOR5 type=del size=2332328 2024-09-12T00:18:09.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.056+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~B6CMDYLITMLX.0 size=1048576 2024-09-12T00:18:09.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.060+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~B6CMDYLITMLX.1 size=1048576 2024-09-12T00:18:09.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.060+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~B6CMDYLITMLX.2 size=842066 2024-09-12T00:18:09.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.060+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=B6CMDYLITMLX tag=V01B1ILMDFBS type=write size=3987794 2024-09-12T00:18:09.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.064+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~6FZHPOH5UZIA.0 size=1048576 2024-09-12T00:18:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.068+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~6FZHPOH5UZIA.1 size=1048576 2024-09-12T00:18:09.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.072+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~6FZHPOH5UZIA.2 size=79910 2024-09-12T00:18:09.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.080+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=6FZHPOH5UZIA tag=8XORWYOWV4P1 type=write size=3225638 2024-09-12T00:18:09.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.084+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=OOUKQXYM6AVV type=del size=3492274 2024-09-12T00:18:09.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.092+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=0IM67DBVC4Z0 type=del 2024-09-12T00:18:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.096+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~XPMYOGJ7FD5H.0 size=1048576 2024-09-12T00:18:09.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_0HAUC4BDL9VR.2~XPMYOGJ7FD5H.1 size=962516 2024-09-12T00:18:09.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.100+0000 7f69cdea98c0 1 > prepared multipart upload key=0HAUC4BDL9VR upload=XPMYOGJ7FD5H tag=KNY4NVSNAM07 type=write size=3059668 2024-09-12T00:18:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.104+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=C8M0M7R03HCT type=del 2024-09-12T00:18:09.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.108+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=19IALASSN02L type=del size=1526222 2024-09-12T00:18:09.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.112+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=J6TH7SXHKDRJ type=del 2024-09-12T00:18:09.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.116+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=E7OCA44WH12Q type=del size=3528467 2024-09-12T00:18:09.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.120+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=4IW4TC6RX3FF type=del 2024-09-12T00:18:09.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.124+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~E7U76L7KJFAA.0 size=1048576 2024-09-12T00:18:09.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.128+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~E7U76L7KJFAA.1 size=1048576 2024-09-12T00:18:09.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~E7U76L7KJFAA.2 size=103038 2024-09-12T00:18:09.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.132+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=E7U76L7KJFAA tag=N531GWSBIEA4 type=write size=3248766 2024-09-12T00:18:09.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.136+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~GPQYEBT33X7H.0 size=1048576 2024-09-12T00:18:09.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.136+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~GPQYEBT33X7H.1 size=788527 2024-09-12T00:18:09.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.144+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=GPQYEBT33X7H tag=O978FMN4WNWY type=write size=2885679 2024-09-12T00:18:09.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.152+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~CZQV1RBZZMWN.0 size=1048576 2024-09-12T00:18:09.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.152+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~CZQV1RBZZMWN.1 size=846540 2024-09-12T00:18:09.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.152+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=CZQV1RBZZMWN tag=ZFKWFFRK6UMB type=write size=2943692 2024-09-12T00:18:09.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.156+0000 7f69cdea98c0 1 < completed write operation key=SP2KVAO82MQ0 tag=N80QO3CO1FFV type=write size=82727 2024-09-12T00:18:09.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.160+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=2ZEHUPNRTKCO type=del size=3970776 2024-09-12T00:18:09.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.168+0000 7f69cdea98c0 1 < suggested remove operation key=K0HNNMX7CDGC tag=TNLOUX2DX66W type=del 2024-09-12T00:18:09.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.172+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=QHICVAAB9T02 type=del size=1088976 2024-09-12T00:18:09.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.180+0000 7f69cdea98c0 1 < suggested update operation key=0J667VAQGMTX tag=CY2SFEXAG1SR type=del size=4153413 2024-09-12T00:18:09.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.188+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~2OOEIOW44S27.0 size=1048576 2024-09-12T00:18:09.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.192+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~2OOEIOW44S27.1 size=1048576 2024-09-12T00:18:09.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.192+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~2OOEIOW44S27.2 size=631566 2024-09-12T00:18:09.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.192+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=2OOEIOW44S27 tag=WPBI46A3LBDK type=write size=3777294 2024-09-12T00:18:09.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.196+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~OTPA9OJPS245.0 size=828595 2024-09-12T00:18:09.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.204+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=OTPA9OJPS245 tag=IMI71M9R9EZS type=write size=1877171 2024-09-12T00:18:09.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.208+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=4XA67B08ZI0T type=del size=809048 2024-09-12T00:18:09.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.212+0000 7f69cdea98c0 -1 < failed to complete operation key=K0HNNMX7CDGC tag=2G8GZRFBFM5L type=del size=215814: (22) Invalid argument 2024-09-12T00:18:09.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.216+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=WJGDKQJ3CTNQ type=del size=1430799 2024-09-12T00:18:09.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.224+0000 7f69cdea98c0 1 < suggested update operation key=YS23U9GQS7SJ tag=67F6TSBF1EPH type=del size=3105929 2024-09-12T00:18:09.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.228+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~HKSTMJABIW5V.0 size=766169 2024-09-12T00:18:09.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.228+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=HKSTMJABIW5V tag=06YUPILQOR4A type=write size=1814745 2024-09-12T00:18:09.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.232+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=37LEQHJQC2CV type=del 2024-09-12T00:18:09.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.240+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~D3OOJYMKUP3P.0 size=1048576 2024-09-12T00:18:09.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~D3OOJYMKUP3P.1 size=1048576 2024-09-12T00:18:09.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~D3OOJYMKUP3P.2 size=558698 2024-09-12T00:18:09.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.248+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=D3OOJYMKUP3P tag=K6UGAJVNS0GB type=write size=3704426 2024-09-12T00:18:09.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.252+0000 7f69cdea98c0 -1 < failed to complete operation key=YS23U9GQS7SJ tag=RXGYFLROMOQD type=write size=1024803: (22) Invalid argument 2024-09-12T00:18:09.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.256+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=204EH2SIVRSV type=write size=99763 2024-09-12T00:18:09.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.260+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~T8CIW11HEFOW.0 size=1048576 2024-09-12T00:18:09.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.260+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~T8CIW11HEFOW.1 size=387556 2024-09-12T00:18:09.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.268+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=T8CIW11HEFOW tag=JAALPD4NNQN3 type=write size=2484708 2024-09-12T00:18:09.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.272+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=LDKMM4JGAP73 type=del size=1063972 2024-09-12T00:18:09.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.276+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~B6CMDYLITMLX.0 size=1048576 2024-09-12T00:18:09.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.276+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~B6CMDYLITMLX.1 size=1048576 2024-09-12T00:18:09.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.276+0000 7f69cdea98c0 1 < canceled part key=_multipart_H91UXKWAJ3K8.2~B6CMDYLITMLX.2 size=842066 2024-09-12T00:18:09.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.284+0000 7f69cdea98c0 1 < canceled multipart upload key=H91UXKWAJ3K8 upload=B6CMDYLITMLX tag=V01B1ILMDFBS type=write size=3987794 2024-09-12T00:18:09.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.288+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=EK7YNK6MSXL6 type=write size=189816 2024-09-12T00:18:09.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.296+0000 7f69cdea98c0 1 < suggested update operation key=1CZXUEJLQ8FM tag=OOUKQXYM6AVV type=del size=3492274 2024-09-12T00:18:09.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.300+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=9GX23BQ4X411 type=del size=474378 2024-09-12T00:18:09.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.304+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~XPMYOGJ7FD5H.0 size=1048576 2024-09-12T00:18:09.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.308+0000 7f69cdea98c0 1 < completed part key=_multipart_0HAUC4BDL9VR.2~XPMYOGJ7FD5H.1 size=962516 2024-09-12T00:18:09.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.316+0000 7f69cdea98c0 1 < completed multipart upload key=0HAUC4BDL9VR upload=XPMYOGJ7FD5H tag=KNY4NVSNAM07 type=write size=3059668 2024-09-12T00:18:09.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.320+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=4OPH39FWIZH6 type=write size=809820 2024-09-12T00:18:09.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.324+0000 7f69cdea98c0 -1 < failed to complete operation key=0J667VAQGMTX tag=19IALASSN02L type=del size=1526222: (22) Invalid argument 2024-09-12T00:18:09.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~DXEE7YCDNHXK.0 size=1048576 2024-09-12T00:18:09.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.332+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~DXEE7YCDNHXK.1 size=1048576 2024-09-12T00:18:09.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.336+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~DXEE7YCDNHXK.2 size=447650 2024-09-12T00:18:09.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.336+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=DXEE7YCDNHXK tag=STKWZJW21Z8P type=write size=3593378 2024-09-12T00:18:09.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.340+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=E7OCA44WH12Q type=del 2024-09-12T00:18:09.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.344+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=J476IH9XEOUO type=del size=3098878 2024-09-12T00:18:09.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.348+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~E7U76L7KJFAA.0 size=1048576 2024-09-12T00:18:09.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.352+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~E7U76L7KJFAA.1 size=1048576 2024-09-12T00:18:09.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.352+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~E7U76L7KJFAA.2 size=103038 2024-09-12T00:18:09.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.360+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=E7U76L7KJFAA tag=N531GWSBIEA4 type=write size=3248766 2024-09-12T00:18:09.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.368+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~8Y6UYIVN5USG.0 size=189488 2024-09-12T00:18:09.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.368+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=8Y6UYIVN5USG tag=9VYF3GENA0ZT type=write size=1238064 2024-09-12T00:18:09.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.372+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~CZQV1RBZZMWN.0 size=1048576 2024-09-12T00:18:09.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.372+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~CZQV1RBZZMWN.1 size=846540 2024-09-12T00:18:09.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.380+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=CZQV1RBZZMWN tag=ZFKWFFRK6UMB type=write size=2943692 2024-09-12T00:18:09.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.384+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=D6XLY1PAWQ7S type=write size=15784 2024-09-12T00:18:09.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.392+0000 7f69cdea98c0 1 < suggested update operation key=4O5U4WX3N4SA tag=2ZEHUPNRTKCO type=del size=3970776 2024-09-12T00:18:09.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.396+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=LD0OYM9QU34F type=write size=879958 2024-09-12T00:18:09.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.404+0000 7f69cdea98c0 1 < suggested update operation key=K4LNDJJUA1RZ tag=QHICVAAB9T02 type=del size=1088976 2024-09-12T00:18:09.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.412+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~0050JBANG3A4.0 size=1048576 2024-09-12T00:18:09.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.416+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~0050JBANG3A4.1 size=656199 2024-09-12T00:18:09.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.416+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=0050JBANG3A4 tag=EDDCUCIY69GB type=write size=2753351 2024-09-12T00:18:09.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.420+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~2OOEIOW44S27.0 size=1048576 2024-09-12T00:18:09.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.424+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~2OOEIOW44S27.1 size=1048576 2024-09-12T00:18:09.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.428+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~2OOEIOW44S27.2 size=631566 2024-09-12T00:18:09.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.432+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=2OOEIOW44S27 tag=WPBI46A3LBDK type=write size=3777294 2024-09-12T00:18:09.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.440+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=6GNJAP6TQ0ZY type=del size=2374901 2024-09-12T00:18:09.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.444+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=4XA67B08ZI0T type=del 2024-09-12T00:18:09.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.452+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~NM8NE3FFFXJH.0 size=518145 2024-09-12T00:18:09.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.452+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=NM8NE3FFFXJH tag=V3YWRWPPD7H1 type=write size=1566721 2024-09-12T00:18:09.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.456+0000 7f69cdea98c0 1 < completed delete operation key=O5WBNND16BFN tag=WJGDKQJ3CTNQ type=del 2024-09-12T00:18:09.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.460+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=MYO58P216PW2 type=del size=269223 2024-09-12T00:18:09.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.464+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~HKSTMJABIW5V.0 size=766169 2024-09-12T00:18:09.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.468+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=HKSTMJABIW5V tag=06YUPILQOR4A type=write size=1814745 2024-09-12T00:18:09.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.472+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=EPALIBBV98AW type=del size=3652313 2024-09-12T00:18:09.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.476+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~D3OOJYMKUP3P.0 size=1048576 2024-09-12T00:18:09.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.480+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~D3OOJYMKUP3P.1 size=1048576 2024-09-12T00:18:09.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.484+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~D3OOJYMKUP3P.2 size=558698 2024-09-12T00:18:09.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.488+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=D3OOJYMKUP3P tag=K6UGAJVNS0GB type=write size=3704426 2024-09-12T00:18:09.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.492+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=T5D4SF6CGO3Y type=del size=3507788 2024-09-12T00:18:09.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.496+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=204EH2SIVRSV type=write size=99763 2024-09-12T00:18:09.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.500+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=W0L1UKNM0VU6 type=write size=198243 2024-09-12T00:18:09.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.504+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=LDKMM4JGAP73 type=del 2024-09-12T00:18:09.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.508+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=ITD0KOVHRCRN type=del size=134434 2024-09-12T00:18:09.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.512+0000 7f69cdea98c0 1 < completed write operation key=RDGRKQQH4B8C tag=EK7YNK6MSXL6 type=write size=189816 2024-09-12T00:18:09.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.516+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=50S47HYCEOQZ type=write size=12726 2024-09-12T00:18:09.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.520+0000 7f69cdea98c0 1 < completed delete operation key=Z6MH459BTZ6K tag=9GX23BQ4X411 type=del 2024-09-12T00:18:09.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.528+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~WKGYUQ05OU7F.0 size=351309 2024-09-12T00:18:09.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.528+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=WKGYUQ05OU7F tag=S7OSLSTHETW0 type=write size=1399885 2024-09-12T00:18:09.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.532+0000 7f69cdea98c0 1 < completed write operation key=HSQZYI0SNZP1 tag=4OPH39FWIZH6 type=write size=809820 2024-09-12T00:18:09.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.536+0000 7f69cdea98c0 1 > prepared part key=_multipart_H91UXKWAJ3K8.2~1MTE0CGIVM2T.0 size=680375 2024-09-12T00:18:09.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.536+0000 7f69cdea98c0 1 > prepared multipart upload key=H91UXKWAJ3K8 upload=1MTE0CGIVM2T tag=BR2FF8JOSEOT type=write size=1728951 2024-09-12T00:18:09.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.540+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~DXEE7YCDNHXK.0 size=1048576 2024-09-12T00:18:09.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.544+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~DXEE7YCDNHXK.1 size=1048576 2024-09-12T00:18:09.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.548+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~DXEE7YCDNHXK.2 size=447650 2024-09-12T00:18:09.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.552+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=DXEE7YCDNHXK tag=STKWZJW21Z8P type=write size=3593378 2024-09-12T00:18:09.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.556+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=DEZ7C5AK2QKS type=del size=2288459 2024-09-12T00:18:09.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.564+0000 7f69cdea98c0 1 < suggested update operation key=9K3HLTD6DMSC tag=J476IH9XEOUO type=del size=3098878 2024-09-12T00:18:09.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.572+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~8GSUGGQ5ALQQ.0 size=1048576 2024-09-12T00:18:09.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.576+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~8GSUGGQ5ALQQ.1 size=1048576 2024-09-12T00:18:09.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.580+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~8GSUGGQ5ALQQ.2 size=552493 2024-09-12T00:18:09.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.580+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=8GSUGGQ5ALQQ tag=9OX3XXAY57WL type=write size=3698221 2024-09-12T00:18:09.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.580+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~8Y6UYIVN5USG.0 size=189488 2024-09-12T00:18:09.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.588+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=8Y6UYIVN5USG tag=9VYF3GENA0ZT type=write size=1238064 2024-09-12T00:18:09.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.592+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=8EVD688UQPTA type=del size=2584864 2024-09-12T00:18:09.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.596+0000 7f69cdea98c0 1 < completed write operation key=IXB6WLN5M81C tag=D6XLY1PAWQ7S type=write size=15784 2024-09-12T00:18:09.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.600+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=C7TH449EQX89 type=del size=3606083 2024-09-12T00:18:09.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.604+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=LD0OYM9QU34F type=write size=879958 2024-09-12T00:18:09.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.608+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=I4INM1J14G4T type=del size=2356080 2024-09-12T00:18:09.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.612+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~0050JBANG3A4.0 size=1048576 2024-09-12T00:18:09.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.612+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~0050JBANG3A4.1 size=656199 2024-09-12T00:18:09.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.620+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=0050JBANG3A4 tag=EDDCUCIY69GB type=write size=2753351 2024-09-12T00:18:09.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.624+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=G3R4H5B17ACP type=del size=2646175 2024-09-12T00:18:09.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.628+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=6GNJAP6TQ0ZY type=del 2024-09-12T00:18:09.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.632+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~G9AXOZ7AGZE5.0 size=1048576 2024-09-12T00:18:09.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.636+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~G9AXOZ7AGZE5.1 size=1048576 2024-09-12T00:18:09.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.640+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~G9AXOZ7AGZE5.2 size=810313 2024-09-12T00:18:09.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.640+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=G9AXOZ7AGZE5 tag=9I3YMEMWWQIM type=write size=3956041 2024-09-12T00:18:09.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.644+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~NM8NE3FFFXJH.0 size=518145 2024-09-12T00:18:09.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.648+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=NM8NE3FFFXJH tag=V3YWRWPPD7H1 type=write size=1566721 2024-09-12T00:18:09.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.656+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~LKTY66HJ9C1S.0 size=1048576 2024-09-12T00:18:09.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~LKTY66HJ9C1S.1 size=1048576 2024-09-12T00:18:09.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.660+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~LKTY66HJ9C1S.2 size=839167 2024-09-12T00:18:09.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.660+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=LKTY66HJ9C1S tag=T1QRLKN5XX4O type=write size=3984895 2024-09-12T00:18:09.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.664+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=MYO58P216PW2 type=del 2024-09-12T00:18:09.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.672+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~ZWHRZJCUDG0Y.0 size=1048576 2024-09-12T00:18:09.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.676+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~ZWHRZJCUDG0Y.1 size=453255 2024-09-12T00:18:09.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.676+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=ZWHRZJCUDG0Y tag=JY6C6OR264X5 type=write size=2550407 2024-09-12T00:18:09.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.680+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=EPALIBBV98AW type=del 2024-09-12T00:18:09.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.684+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=3CH3WEIYXG3H type=del size=397868 2024-09-12T00:18:09.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.688+0000 7f69cdea98c0 1 < suggested update operation key=RDGRKQQH4B8C tag=T5D4SF6CGO3Y type=del size=3507788 2024-09-12T00:18:09.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.692+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=MCF9G0FYVR66 type=del size=4168725 2024-09-12T00:18:09.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.696+0000 7f69cdea98c0 1 < completed write operation key=IXB6WLN5M81C tag=W0L1UKNM0VU6 type=write size=198243 2024-09-12T00:18:09.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.704+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~5JXVRFS07L6D.0 size=1048576 2024-09-12T00:18:09.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.708+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~5JXVRFS07L6D.1 size=1048576 2024-09-12T00:18:09.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.708+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~5JXVRFS07L6D.2 size=571133 2024-09-12T00:18:09.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.708+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=5JXVRFS07L6D tag=ZJCBDKTXHSO0 type=write size=3716861 2024-09-12T00:18:09.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.712+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=ITD0KOVHRCRN type=del 2024-09-12T00:18:09.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.716+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=216BW15J2PK4 type=write size=31937 2024-09-12T00:18:09.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.720+0000 7f69cdea98c0 1 < completed write operation key=I23GNCI98JHU tag=50S47HYCEOQZ type=write size=12726 2024-09-12T00:18:09.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.724+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=9RNMMN8008BY type=del size=3761041 2024-09-12T00:18:09.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.728+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~WKGYUQ05OU7F.0 size=351309 2024-09-12T00:18:09.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.736+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=WKGYUQ05OU7F tag=S7OSLSTHETW0 type=write size=1399885 2024-09-12T00:18:09.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.744+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~X7YFDTXT1ZVN.0 size=1048576 2024-09-12T00:18:09.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.744+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~X7YFDTXT1ZVN.1 size=65837 2024-09-12T00:18:09.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.744+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=X7YFDTXT1ZVN tag=AZVJ2S7ZZQ1Z type=write size=2162989 2024-09-12T00:18:09.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.748+0000 7f69cdea98c0 1 < completed part key=_multipart_H91UXKWAJ3K8.2~1MTE0CGIVM2T.0 size=680375 2024-09-12T00:18:09.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.756+0000 7f69cdea98c0 1 < completed multipart upload key=H91UXKWAJ3K8 upload=1MTE0CGIVM2T tag=BR2FF8JOSEOT type=write size=1728951 2024-09-12T00:18:09.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.760+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=A2EMQKKE3VH3 type=del size=1810304 2024-09-12T00:18:09.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.764+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=DEZ7C5AK2QKS type=del 2024-09-12T00:18:09.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.772+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~SRJLWWM8LRXQ.0 size=506345 2024-09-12T00:18:09.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.772+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=SRJLWWM8LRXQ tag=CTKK0A9ZSBDN type=write size=1554921 2024-09-12T00:18:09.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.776+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~8GSUGGQ5ALQQ.0 size=1048576 2024-09-12T00:18:09.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.776+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~8GSUGGQ5ALQQ.1 size=1048576 2024-09-12T00:18:09.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.780+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~8GSUGGQ5ALQQ.2 size=552493 2024-09-12T00:18:09.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.792+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=8GSUGGQ5ALQQ tag=9OX3XXAY57WL type=write size=3698221 2024-09-12T00:18:09.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.796+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=32PPWYVNT6KQ type=del size=2521343 2024-09-12T00:18:09.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.800+0000 7f69cdea98c0 1 < completed delete operation key=4O5U4WX3N4SA tag=8EVD688UQPTA type=del 2024-09-12T00:18:09.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.804+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=BM57EL0HV2RR type=del size=3184879 2024-09-12T00:18:09.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.812+0000 7f69cdea98c0 1 < suggested remove operation key=Q0L8J0BYRFDQ tag=C7TH449EQX89 type=del 2024-09-12T00:18:09.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.816+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~CNCJ2YCX70N9.0 size=1048576 2024-09-12T00:18:09.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~CNCJ2YCX70N9.1 size=374598 2024-09-12T00:18:09.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.820+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=CNCJ2YCX70N9 tag=JJ2HL4BCCCHV type=write size=2471750 2024-09-12T00:18:09.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.828+0000 7f69cdea98c0 1 < suggested remove operation key=4O5U4WX3N4SA tag=I4INM1J14G4T type=del 2024-09-12T00:18:09.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.832+0000 7f69cdea98c0 1 > prepared operation key=HSQZYI0SNZP1 tag=WXIW4TECV978 type=del size=1871993 2024-09-12T00:18:09.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.836+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=G3R4H5B17ACP type=del 2024-09-12T00:18:09.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~ST541YSHXKAQ.0 size=1048576 2024-09-12T00:18:09.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.844+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~ST541YSHXKAQ.1 size=14045 2024-09-12T00:18:09.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.844+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=ST541YSHXKAQ tag=1IOAINS2OQJU type=write size=2111197 2024-09-12T00:18:09.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.848+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~G9AXOZ7AGZE5.0 size=1048576 2024-09-12T00:18:09.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.852+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~G9AXOZ7AGZE5.1 size=1048576 2024-09-12T00:18:09.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.856+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~G9AXOZ7AGZE5.2 size=810313 2024-09-12T00:18:09.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.860+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=G9AXOZ7AGZE5 tag=9I3YMEMWWQIM type=write size=3956041 2024-09-12T00:18:09.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.868+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~JIRIVRJMV600.0 size=1048576 2024-09-12T00:18:09.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~JIRIVRJMV600.1 size=781159 2024-09-12T00:18:09.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.872+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=JIRIVRJMV600 tag=DDGV26VSY8V0 type=write size=2878311 2024-09-12T00:18:09.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.876+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~LKTY66HJ9C1S.0 size=1048576 2024-09-12T00:18:09.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.880+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~LKTY66HJ9C1S.1 size=1048576 2024-09-12T00:18:09.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.880+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~LKTY66HJ9C1S.2 size=839167 2024-09-12T00:18:09.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.888+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=LKTY66HJ9C1S tag=T1QRLKN5XX4O type=write size=3984895 2024-09-12T00:18:09.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.892+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=G1EBOUKXFMSO type=write size=299370 2024-09-12T00:18:09.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.896+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~ZWHRZJCUDG0Y.0 size=1048576 2024-09-12T00:18:09.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.900+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~ZWHRZJCUDG0Y.1 size=453255 2024-09-12T00:18:09.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.904+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=ZWHRZJCUDG0Y tag=JY6C6OR264X5 type=write size=2550407 2024-09-12T00:18:09.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.908+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=JYV8Q3BM1IGD type=del size=354261 2024-09-12T00:18:09.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.912+0000 7f69cdea98c0 -1 < failed to complete operation key=4O5U4WX3N4SA tag=3CH3WEIYXG3H type=del size=397868: (22) Invalid argument 2024-09-12T00:18:09.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.916+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=5GWL2RQRZQ4L type=write size=965291 2024-09-12T00:18:09.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.920+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=MCF9G0FYVR66 type=del 2024-09-12T00:18:09.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.924+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=STJ8OT3KJX32 type=write size=921343 2024-09-12T00:18:09.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.928+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~5JXVRFS07L6D.0 size=1048576 2024-09-12T00:18:09.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.928+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~5JXVRFS07L6D.1 size=1048576 2024-09-12T00:18:09.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.932+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~5JXVRFS07L6D.2 size=571133 2024-09-12T00:18:09.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.940+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=5JXVRFS07L6D tag=ZJCBDKTXHSO0 type=write size=3716861 2024-09-12T00:18:09.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.944+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=659SNZQA9EL9 type=del size=993315 2024-09-12T00:18:09.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.948+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=216BW15J2PK4 type=write size=31937 2024-09-12T00:18:09.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.956+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~7F021BKREP70.0 size=1048576 2024-09-12T00:18:09.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.956+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~7F021BKREP70.1 size=986787 2024-09-12T00:18:09.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.956+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=7F021BKREP70 tag=3N0UZEUDL3F8 type=write size=3083939 2024-09-12T00:18:09.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.960+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=9RNMMN8008BY type=del 2024-09-12T00:18:09.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.964+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=ZHTZR9VM8LHJ type=del size=660472 2024-09-12T00:18:09.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.968+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~X7YFDTXT1ZVN.0 size=1048576 2024-09-12T00:18:09.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.972+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~X7YFDTXT1ZVN.1 size=65837 2024-09-12T00:18:09.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.976+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=X7YFDTXT1ZVN tag=AZVJ2S7ZZQ1Z type=write size=2162989 2024-09-12T00:18:09.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.980+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=3ER19RQMGC2F type=del size=1282745 2024-09-12T00:18:09.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.984+0000 7f69cdea98c0 1 < canceled operation key=IXB6WLN5M81C tag=A2EMQKKE3VH3 type=del size=1810304 2024-09-12T00:18:09.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.988+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~6ZOTLO81WZZZ.0 size=1048576 2024-09-12T00:18:09.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.992+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~6ZOTLO81WZZZ.1 size=432115 2024-09-12T00:18:09.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.992+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=6ZOTLO81WZZZ tag=PW9CKG06MOXN type=write size=2529267 2024-09-12T00:18:09.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:09.996+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~SRJLWWM8LRXQ.0 size=506345 2024-09-12T00:18:09.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.000+0000 7f69cdea98c0 1 < completed multipart upload key=AWZ03VE7D86K upload=SRJLWWM8LRXQ tag=CTKK0A9ZSBDN type=write size=1554921 2024-09-12T00:18:10.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.004+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=ENJWHRIYQWV9 type=del size=2656018 2024-09-12T00:18:10.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.008+0000 7f69cdea98c0 1 < suggested update operation key=IXB6WLN5M81C tag=32PPWYVNT6KQ type=del size=2521343 2024-09-12T00:18:10.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~LQ3ZFD2EZJ6X.0 size=21603 2024-09-12T00:18:10.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.012+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=LQ3ZFD2EZJ6X tag=ON617XW0WR4R type=write size=1070179 2024-09-12T00:18:10.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.016+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=BM57EL0HV2RR type=del 2024-09-12T00:18:10.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.016+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=I63OM5VWNM81 type=del size=3715409 2024-09-12T00:18:10.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.020+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~CNCJ2YCX70N9.0 size=1048576 2024-09-12T00:18:10.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.020+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~CNCJ2YCX70N9.1 size=374598 2024-09-12T00:18:10.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.024+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=CNCJ2YCX70N9 tag=JJ2HL4BCCCHV type=write size=2471750 2024-09-12T00:18:10.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.028+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=VTM9LWWINASO type=del size=3096144 2024-09-12T00:18:10.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.032+0000 7f69cdea98c0 1 < completed delete operation key=HSQZYI0SNZP1 tag=WXIW4TECV978 type=del 2024-09-12T00:18:10.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.036+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~4HVXCG4DCLDK.0 size=723170 2024-09-12T00:18:10.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.036+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=4HVXCG4DCLDK tag=UZT04QAKLMWF type=write size=1771746 2024-09-12T00:18:10.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.040+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~ST541YSHXKAQ.0 size=1048576 2024-09-12T00:18:10.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.040+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~ST541YSHXKAQ.1 size=14045 2024-09-12T00:18:10.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.044+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=ST541YSHXKAQ tag=1IOAINS2OQJU type=write size=2111197 2024-09-12T00:18:10.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.052+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~79OIMMSQJDBQ.0 size=1048576 2024-09-12T00:18:10.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.052+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~79OIMMSQJDBQ.1 size=1048576 2024-09-12T00:18:10.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.056+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~79OIMMSQJDBQ.2 size=968424 2024-09-12T00:18:10.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.056+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=79OIMMSQJDBQ tag=N6HFL3X0YLZ6 type=write size=4114152 2024-09-12T00:18:10.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.056+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~JIRIVRJMV600.0 size=1048576 2024-09-12T00:18:10.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.060+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~JIRIVRJMV600.1 size=781159 2024-09-12T00:18:10.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.064+0000 7f69cdea98c0 1 < completed multipart upload key=T9OJXTZNRQJB upload=JIRIVRJMV600 tag=DDGV26VSY8V0 type=write size=2878311 2024-09-12T00:18:10.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.068+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~NVE3OQCCCIA7.0 size=1048576 2024-09-12T00:18:10.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.068+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~NVE3OQCCCIA7.1 size=1048576 2024-09-12T00:18:10.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.068+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~NVE3OQCCCIA7.2 size=413021 2024-09-12T00:18:10.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.068+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=NVE3OQCCCIA7 tag=KFIPHYFQWMX8 type=write size=3558749 2024-09-12T00:18:10.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.072+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=G1EBOUKXFMSO type=write size=299370 2024-09-12T00:18:10.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.076+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=31SCYEU0YGQO type=del size=621120 2024-09-12T00:18:10.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.080+0000 7f69cdea98c0 1 < canceled operation key=VYYY8MF0P3Q7 tag=JYV8Q3BM1IGD type=del size=354261 2024-09-12T00:18:10.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.084+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~NTLHL1ZU936G.0 size=1048576 2024-09-12T00:18:10.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.084+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~NTLHL1ZU936G.1 size=884376 2024-09-12T00:18:10.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.084+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=NTLHL1ZU936G tag=IEXM6ESH3UMS type=write size=2981528 2024-09-12T00:18:10.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.092+0000 7f69cdea98c0 1 < completed write operation key=0EALARW4O3OB tag=5GWL2RQRZQ4L type=write size=965291 2024-09-12T00:18:10.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~XFWNCFMZK71Q.0 size=1048576 2024-09-12T00:18:10.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~XFWNCFMZK71Q.1 size=760706 2024-09-12T00:18:10.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.100+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=XFWNCFMZK71Q tag=5PWUVNTV93FL type=write size=2857858 2024-09-12T00:18:10.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.104+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=STJ8OT3KJX32 type=write size=921343 2024-09-12T00:18:10.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.108+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~XA3JA6T4TXOA.0 size=1024763 2024-09-12T00:18:10.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.108+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=XA3JA6T4TXOA tag=1N02R07OJZKX type=write size=2073339 2024-09-12T00:18:10.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.112+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=659SNZQA9EL9 type=del 2024-09-12T00:18:10.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.116+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=6WQ84O9KK95G type=del size=1374462 2024-09-12T00:18:10.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.120+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~7F021BKREP70.0 size=1048576 2024-09-12T00:18:10.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.124+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~7F021BKREP70.1 size=986787 2024-09-12T00:18:10.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.128+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=7F021BKREP70 tag=3N0UZEUDL3F8 type=write size=3083939 2024-09-12T00:18:10.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.132+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~O98S73F2H9TF.0 size=1048576 2024-09-12T00:18:10.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_AWZ03VE7D86K.2~O98S73F2H9TF.1 size=18516 2024-09-12T00:18:10.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.136+0000 7f69cdea98c0 1 > prepared multipart upload key=AWZ03VE7D86K upload=O98S73F2H9TF tag=RFE2BK9RN7PT type=write size=2115668 2024-09-12T00:18:10.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.140+0000 7f69cdea98c0 1 < suggested update operation key=1CZXUEJLQ8FM tag=ZHTZR9VM8LHJ type=del size=660472 2024-09-12T00:18:10.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.144+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=2CQT1FEPB5WK type=del size=1060395 2024-09-12T00:18:10.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.148+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=3ER19RQMGC2F type=del 2024-09-12T00:18:10.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.152+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=BG0V6Y8A3PAA type=del size=3318176 2024-09-12T00:18:10.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.156+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~6ZOTLO81WZZZ.0 size=1048576 2024-09-12T00:18:10.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.156+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~6ZOTLO81WZZZ.1 size=432115 2024-09-12T00:18:10.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.164+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=6ZOTLO81WZZZ tag=PW9CKG06MOXN type=write size=2529267 2024-09-12T00:18:10.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.168+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~GLK8FX3IIJ71.0 size=1048576 2024-09-12T00:18:10.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.172+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~GLK8FX3IIJ71.1 size=552289 2024-09-12T00:18:10.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.172+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=GLK8FX3IIJ71 tag=NQX3SXRO3TT5 type=write size=2649441 2024-09-12T00:18:10.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.176+0000 7f69cdea98c0 1 < completed delete operation key=VYYY8MF0P3Q7 tag=ENJWHRIYQWV9 type=del 2024-09-12T00:18:10.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.180+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~XGJN7TZTLKUQ.0 size=1048576 2024-09-12T00:18:10.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.184+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~XGJN7TZTLKUQ.1 size=955350 2024-09-12T00:18:10.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.184+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=XGJN7TZTLKUQ tag=YWT2MKNJ1FIG type=write size=3052502 2024-09-12T00:18:10.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.188+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~LQ3ZFD2EZJ6X.0 size=21603 2024-09-12T00:18:10.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.192+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=LQ3ZFD2EZJ6X tag=ON617XW0WR4R type=write size=1070179 2024-09-12T00:18:10.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.196+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=1TXMWHDNDA24 type=del size=1462926 2024-09-12T00:18:10.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.196+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=I63OM5VWNM81 type=del 2024-09-12T00:18:10.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.200+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=ANJH9Z28Y5XW type=del size=2030430 2024-09-12T00:18:10.207 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.208+0000 7f69cdea98c0 1 < suggested remove operation key=SCFIVX3IHERR tag=VTM9LWWINASO type=del 2024-09-12T00:18:10.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.212+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=BKO1C3P2SJ9M type=write size=974057 2024-09-12T00:18:10.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.216+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~4HVXCG4DCLDK.0 size=723170 2024-09-12T00:18:10.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.220+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=4HVXCG4DCLDK tag=UZT04QAKLMWF type=write size=1771746 2024-09-12T00:18:10.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.224+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=SERKKZ351HF8 type=del size=3557001 2024-09-12T00:18:10.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.228+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~79OIMMSQJDBQ.0 size=1048576 2024-09-12T00:18:10.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.228+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~79OIMMSQJDBQ.1 size=1048576 2024-09-12T00:18:10.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.232+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~79OIMMSQJDBQ.2 size=968424 2024-09-12T00:18:10.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.236+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=79OIMMSQJDBQ tag=N6HFL3X0YLZ6 type=write size=4114152 2024-09-12T00:18:10.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.240+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=UENLNE7OPABY type=del size=1330952 2024-09-12T00:18:10.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.240+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~NVE3OQCCCIA7.0 size=1048576 2024-09-12T00:18:10.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.244+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~NVE3OQCCCIA7.1 size=1048576 2024-09-12T00:18:10.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.248+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~NVE3OQCCCIA7.2 size=413021 2024-09-12T00:18:10.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.252+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=NVE3OQCCCIA7 tag=KFIPHYFQWMX8 type=write size=3558749 2024-09-12T00:18:10.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.256+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=W203VW8XR4A6 type=del size=1165305 2024-09-12T00:18:10.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.260+0000 7f69cdea98c0 1 < completed delete operation key=0J667VAQGMTX tag=31SCYEU0YGQO type=del 2024-09-12T00:18:10.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.260+0000 7f69cdea98c0 1 > prepared operation key=LRHZKCU22AIX tag=AF6RFR7N07A7 type=del size=1385580 2024-09-12T00:18:10.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.264+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~NTLHL1ZU936G.0 size=1048576 2024-09-12T00:18:10.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.268+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~NTLHL1ZU936G.1 size=884376 2024-09-12T00:18:10.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.272+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=NTLHL1ZU936G tag=IEXM6ESH3UMS type=write size=2981528 2024-09-12T00:18:10.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.280+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~YZOWX0QTU4C4.0 size=418942 2024-09-12T00:18:10.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.280+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=YZOWX0QTU4C4 tag=JGRVKY2E25FW type=write size=1467518 2024-09-12T00:18:10.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.280+0000 7f69cdea98c0 1 < canceled part key=_multipart_O5WBNND16BFN.2~XFWNCFMZK71Q.0 size=1048576 2024-09-12T00:18:10.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.280+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~XFWNCFMZK71Q.1 size=760706 2024-09-12T00:18:10.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.288+0000 7f69cdea98c0 1 < canceled multipart upload key=O5WBNND16BFN upload=XFWNCFMZK71Q tag=5PWUVNTV93FL type=write size=2857858 2024-09-12T00:18:10.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.292+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~TWJVXQDE4WTK.0 size=1048576 2024-09-12T00:18:10.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~TWJVXQDE4WTK.1 size=1048576 2024-09-12T00:18:10.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.296+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~TWJVXQDE4WTK.2 size=754205 2024-09-12T00:18:10.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.296+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=TWJVXQDE4WTK tag=0Z6Q2QPH8PV6 type=write size=3899933 2024-09-12T00:18:10.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.300+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~XA3JA6T4TXOA.0 size=1024763 2024-09-12T00:18:10.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.304+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=XA3JA6T4TXOA tag=1N02R07OJZKX type=write size=2073339 2024-09-12T00:18:10.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.308+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~VD93ZHMDAXE3.0 size=1048576 2024-09-12T00:18:10.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_O5WBNND16BFN.2~VD93ZHMDAXE3.1 size=300491 2024-09-12T00:18:10.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.312+0000 7f69cdea98c0 1 > prepared multipart upload key=O5WBNND16BFN upload=VD93ZHMDAXE3 tag=BXTE2BLJ1LN0 type=write size=2397643 2024-09-12T00:18:10.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.316+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=6WQ84O9KK95G type=del 2024-09-12T00:18:10.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.316+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=2AIXP0W30HQR type=write size=252812 2024-09-12T00:18:10.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.320+0000 7f69cdea98c0 1 < canceled part key=_multipart_AWZ03VE7D86K.2~O98S73F2H9TF.0 size=1048576 2024-09-12T00:18:10.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.320+0000 7f69cdea98c0 1 < completed part key=_multipart_AWZ03VE7D86K.2~O98S73F2H9TF.1 size=18516 2024-09-12T00:18:10.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.324+0000 7f69cdea98c0 1 < canceled multipart upload key=AWZ03VE7D86K upload=O98S73F2H9TF tag=RFE2BK9RN7PT type=write size=2115668 2024-09-12T00:18:10.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.328+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~RZG3BHOLB3ED.0 size=1048576 2024-09-12T00:18:10.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.332+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~RZG3BHOLB3ED.1 size=952775 2024-09-12T00:18:10.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.332+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=RZG3BHOLB3ED tag=ISMJ8NOHWYQD type=write size=3049927 2024-09-12T00:18:10.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.332+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=2CQT1FEPB5WK type=del 2024-09-12T00:18:10.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.336+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=WF0S5M4TQZZ0 type=del size=1581002 2024-09-12T00:18:10.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.340+0000 7f69cdea98c0 1 < completed delete operation key=1CZXUEJLQ8FM tag=BG0V6Y8A3PAA type=del 2024-09-12T00:18:10.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.340+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=TKG8G2FF17VU type=del size=3739822 2024-09-12T00:18:10.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.344+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~GLK8FX3IIJ71.0 size=1048576 2024-09-12T00:18:10.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.344+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~GLK8FX3IIJ71.1 size=552289 2024-09-12T00:18:10.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.348+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=GLK8FX3IIJ71 tag=NQX3SXRO3TT5 type=write size=2649441 2024-09-12T00:18:10.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.356+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~2335EPE54OZL.0 size=294366 2024-09-12T00:18:10.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.356+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=2335EPE54OZL tag=N8JCJCF9NMH0 type=write size=1342942 2024-09-12T00:18:10.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.356+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~XGJN7TZTLKUQ.0 size=1048576 2024-09-12T00:18:10.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.360+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~XGJN7TZTLKUQ.1 size=955350 2024-09-12T00:18:10.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.364+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=XGJN7TZTLKUQ tag=YWT2MKNJ1FIG type=write size=3052502 2024-09-12T00:18:10.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.372+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=G3P79BLKN6HH type=del size=4070452 2024-09-12T00:18:10.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.372+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=1TXMWHDNDA24 type=del 2024-09-12T00:18:10.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.376+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=EWETTE6T5A4S type=del size=1092884 2024-09-12T00:18:10.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.380+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=ANJH9Z28Y5XW type=del 2024-09-12T00:18:10.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.384+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~LET1EDWYO9NF.0 size=1048576 2024-09-12T00:18:10.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.388+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~LET1EDWYO9NF.1 size=1048576 2024-09-12T00:18:10.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.388+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~LET1EDWYO9NF.2 size=366948 2024-09-12T00:18:10.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.388+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=LET1EDWYO9NF tag=INYUTXMSE21I type=write size=3512676 2024-09-12T00:18:10.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.396+0000 7f69cdea98c0 1 < suggested update operation key=7UFADFUXL28I tag=BKO1C3P2SJ9M type=write size=974057 2024-09-12T00:18:10.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.400+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~H46ZUHM5WHV7.0 size=1048576 2024-09-12T00:18:10.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~H46ZUHM5WHV7.1 size=871922 2024-09-12T00:18:10.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.404+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=H46ZUHM5WHV7 tag=3APAS3GRRFYI type=write size=2969074 2024-09-12T00:18:10.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.412+0000 7f69cdea98c0 1 < suggested update operation key=IXB6WLN5M81C tag=SERKKZ351HF8 type=del size=3557001 2024-09-12T00:18:10.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.412+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=LUYWEGFNHMSX type=write size=818884 2024-09-12T00:18:10.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.416+0000 7f69cdea98c0 1 < completed delete operation key=K4LNDJJUA1RZ tag=UENLNE7OPABY type=del 2024-09-12T00:18:10.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.420+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=UGXJFVFIB3B4 type=del size=2852194 2024-09-12T00:18:10.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.424+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=W203VW8XR4A6 type=del 2024-09-12T00:18:10.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.432+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~RE3DGSKTTXHR.0 size=1048576 2024-09-12T00:18:10.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.436+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~RE3DGSKTTXHR.1 size=1009594 2024-09-12T00:18:10.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.436+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=RE3DGSKTTXHR tag=BKKE8PGDVCR4 type=write size=3106746 2024-09-12T00:18:10.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.440+0000 7f69cdea98c0 1 < completed delete operation key=LRHZKCU22AIX tag=AF6RFR7N07A7 type=del 2024-09-12T00:18:10.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.440+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=L9IPRTIMV43F type=del size=690670 2024-09-12T00:18:10.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.444+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~YZOWX0QTU4C4.0 size=418942 2024-09-12T00:18:10.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.452+0000 7f69cdea98c0 1 < completed multipart upload key=4O5U4WX3N4SA upload=YZOWX0QTU4C4 tag=JGRVKY2E25FW type=write size=1467518 2024-09-12T00:18:10.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.456+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=D04YH5E1X773 type=del size=4043582 2024-09-12T00:18:10.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.460+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~TWJVXQDE4WTK.0 size=1048576 2024-09-12T00:18:10.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.460+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~TWJVXQDE4WTK.1 size=1048576 2024-09-12T00:18:10.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.464+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~TWJVXQDE4WTK.2 size=754205 2024-09-12T00:18:10.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.472+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=TWJVXQDE4WTK tag=0Z6Q2QPH8PV6 type=write size=3899933 2024-09-12T00:18:10.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.476+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=OET82C0M7K0T type=del size=2843131 2024-09-12T00:18:10.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.480+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~VD93ZHMDAXE3.0 size=1048576 2024-09-12T00:18:10.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.480+0000 7f69cdea98c0 1 < completed part key=_multipart_O5WBNND16BFN.2~VD93ZHMDAXE3.1 size=300491 2024-09-12T00:18:10.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.488+0000 7f69cdea98c0 1 < completed multipart upload key=O5WBNND16BFN upload=VD93ZHMDAXE3 tag=BXTE2BLJ1LN0 type=write size=2397643 2024-09-12T00:18:10.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.492+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=1N3GXQYADBPF type=del size=4163457 2024-09-12T00:18:10.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.496+0000 7f69cdea98c0 1 < completed write operation key=AQY7MM3OX3GW tag=2AIXP0W30HQR type=write size=252812 2024-09-12T00:18:10.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.496+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=6JF0WKF8NKXR type=del size=2877107 2024-09-12T00:18:10.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.500+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~RZG3BHOLB3ED.0 size=1048576 2024-09-12T00:18:10.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.504+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~RZG3BHOLB3ED.1 size=952775 2024-09-12T00:18:10.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.512+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=RZG3BHOLB3ED tag=ISMJ8NOHWYQD type=write size=3049927 2024-09-12T00:18:10.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.520+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~LFZA05DXWDPN.0 size=1048576 2024-09-12T00:18:10.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.524+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~LFZA05DXWDPN.1 size=721264 2024-09-12T00:18:10.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.524+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=LFZA05DXWDPN tag=WM2OZMWHF65J type=write size=2818416 2024-09-12T00:18:10.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.528+0000 7f69cdea98c0 -1 < failed to complete operation key=7UFADFUXL28I tag=WF0S5M4TQZZ0 type=del size=1581002: (22) Invalid argument 2024-09-12T00:18:10.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.532+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=QMPO2A226HO7 type=write size=422694 2024-09-12T00:18:10.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.536+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=TKG8G2FF17VU type=del 2024-09-12T00:18:10.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.540+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=MMQRX6AED7TY type=write size=513116 2024-09-12T00:18:10.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.540+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~2335EPE54OZL.0 size=294366 2024-09-12T00:18:10.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.544+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=2335EPE54OZL tag=N8JCJCF9NMH0 type=write size=1342942 2024-09-12T00:18:10.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.552+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~FF90X1S53L8K.0 size=1048576 2024-09-12T00:18:10.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.556+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~FF90X1S53L8K.1 size=379266 2024-09-12T00:18:10.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.556+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=FF90X1S53L8K tag=IV55Q6UF1QMM type=write size=2476418 2024-09-12T00:18:10.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.560+0000 7f69cdea98c0 -1 < failed to complete operation key=7UFADFUXL28I tag=G3P79BLKN6HH type=del size=4070452: (22) Invalid argument 2024-09-12T00:18:10.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.564+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=PA2TQHV0ZSIE type=del size=2169433 2024-09-12T00:18:10.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.568+0000 7f69cdea98c0 1 < suggested update operation key=O5WBNND16BFN tag=EWETTE6T5A4S type=del size=1092884 2024-09-12T00:18:10.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.572+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=XYRNB4IZ0MOG type=del size=1863855 2024-09-12T00:18:10.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.576+0000 7f69cdea98c0 1 < canceled part key=_multipart_YS23U9GQS7SJ.2~LET1EDWYO9NF.0 size=1048576 2024-09-12T00:18:10.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.576+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~LET1EDWYO9NF.1 size=1048576 2024-09-12T00:18:10.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.580+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~LET1EDWYO9NF.2 size=366948 2024-09-12T00:18:10.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.588+0000 7f69cdea98c0 1 < canceled multipart upload key=YS23U9GQS7SJ upload=LET1EDWYO9NF tag=INYUTXMSE21I type=write size=3512676 2024-09-12T00:18:10.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.592+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~6UUC56HK58IH.0 size=1048576 2024-09-12T00:18:10.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.596+0000 7f69cdea98c0 1 > prepared part key=_multipart_2ENKC4QT2BFS.2~6UUC56HK58IH.1 size=314372 2024-09-12T00:18:10.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.596+0000 7f69cdea98c0 1 > prepared multipart upload key=2ENKC4QT2BFS upload=6UUC56HK58IH tag=3HL80W2ELE04 type=write size=2411524 2024-09-12T00:18:10.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.600+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~H46ZUHM5WHV7.0 size=1048576 2024-09-12T00:18:10.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.600+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~H46ZUHM5WHV7.1 size=871922 2024-09-12T00:18:10.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.608+0000 7f69cdea98c0 1 < completed multipart upload key=LRHZKCU22AIX upload=H46ZUHM5WHV7 tag=3APAS3GRRFYI type=write size=2969074 2024-09-12T00:18:10.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.616+0000 7f69cdea98c0 1 > prepared part key=_multipart_K4LNDJJUA1RZ.2~VFMKWBUH0K2E.0 size=195915 2024-09-12T00:18:10.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.616+0000 7f69cdea98c0 1 > prepared multipart upload key=K4LNDJJUA1RZ upload=VFMKWBUH0K2E tag=D1CXE85JJI02 type=write size=1244491 2024-09-12T00:18:10.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.620+0000 7f69cdea98c0 1 < canceled operation key=RDGRKQQH4B8C tag=LUYWEGFNHMSX type=write size=818884 2024-09-12T00:18:10.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.620+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=FG4R6B2HZHFK type=del size=1631001 2024-09-12T00:18:10.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.624+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=UGXJFVFIB3B4 type=del 2024-09-12T00:18:10.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.628+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=AW98JT44FG3E type=del size=3883436 2024-09-12T00:18:10.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.636+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~RE3DGSKTTXHR.0 size=1048576 2024-09-12T00:18:10.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.636+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~RE3DGSKTTXHR.1 size=1009594 2024-09-12T00:18:10.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.644+0000 7f69cdea98c0 1 < completed multipart upload key=UTZNJQJQMXJS upload=RE3DGSKTTXHR tag=BKKE8PGDVCR4 type=write size=3106746 2024-09-12T00:18:10.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.648+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~3JW3Y7LS1L67.0 size=572791 2024-09-12T00:18:10.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.648+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=3JW3Y7LS1L67 tag=NM3JLS0UYCCZ type=write size=1621367 2024-09-12T00:18:10.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.656+0000 7f69cdea98c0 1 < suggested remove operation key=I23GNCI98JHU tag=L9IPRTIMV43F type=del 2024-09-12T00:18:10.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.664+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~FC7YZPDA15IH.0 size=1048576 2024-09-12T00:18:10.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~FC7YZPDA15IH.1 size=1048576 2024-09-12T00:18:10.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.668+0000 7f69cdea98c0 1 > prepared part key=_multipart_YS23U9GQS7SJ.2~FC7YZPDA15IH.2 size=874967 2024-09-12T00:18:10.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.668+0000 7f69cdea98c0 1 > prepared multipart upload key=YS23U9GQS7SJ upload=FC7YZPDA15IH tag=HRJJR2T3HE33 type=write size=4020695 2024-09-12T00:18:10.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.672+0000 7f69cdea98c0 -1 < failed to complete operation key=I23GNCI98JHU tag=D04YH5E1X773 type=del size=4043582: (22) Invalid argument 2024-09-12T00:18:10.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.680+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~GRUIPM1VHH07.0 size=1048576 2024-09-12T00:18:10.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~GRUIPM1VHH07.1 size=427754 2024-09-12T00:18:10.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.684+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=GRUIPM1VHH07 tag=J2RE5H0NDAJQ type=write size=2524906 2024-09-12T00:18:10.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.688+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=OET82C0M7K0T type=del 2024-09-12T00:18:10.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.692+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=PKOCZQD6E12D type=write size=858038 2024-09-12T00:18:10.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.696+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=1N3GXQYADBPF type=del 2024-09-12T00:18:10.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.696+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=P92PS75QOSRR type=del size=3594037 2024-09-12T00:18:10.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.700+0000 7f69cdea98c0 1 < completed delete operation key=H91UXKWAJ3K8 tag=6JF0WKF8NKXR type=del 2024-09-12T00:18:10.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.708+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=OAYQ87VEC2EL type=del size=4157015 2024-09-12T00:18:10.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.712+0000 7f69cdea98c0 1 < canceled part key=_multipart_Z6MH459BTZ6K.2~LFZA05DXWDPN.0 size=1048576 2024-09-12T00:18:10.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.712+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~LFZA05DXWDPN.1 size=721264 2024-09-12T00:18:10.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.720+0000 7f69cdea98c0 1 < canceled multipart upload key=Z6MH459BTZ6K upload=LFZA05DXWDPN tag=WM2OZMWHF65J type=write size=2818416 2024-09-12T00:18:10.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~C56K68K1N4PJ.0 size=1048576 2024-09-12T00:18:10.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.728+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~C56K68K1N4PJ.1 size=268606 2024-09-12T00:18:10.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.728+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=C56K68K1N4PJ tag=TQLXSKCCENKY type=write size=2365758 2024-09-12T00:18:10.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.736+0000 7f69cdea98c0 1 < completed write operation key=2YYP9NOUAJD0 tag=QMPO2A226HO7 type=write size=422694 2024-09-12T00:18:10.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.740+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=R4XWM59LMP71 type=del size=921601 2024-09-12T00:18:10.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.744+0000 7f69cdea98c0 1 < completed write operation key=AKWTTXH2P254 tag=MMQRX6AED7TY type=write size=513116 2024-09-12T00:18:10.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.744+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=BLNHG9UJZM8T type=del size=1387520 2024-09-12T00:18:10.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.748+0000 7f69cdea98c0 1 < canceled part key=_multipart_K4LNDJJUA1RZ.2~FF90X1S53L8K.0 size=1048576 2024-09-12T00:18:10.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.752+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~FF90X1S53L8K.1 size=379266 2024-09-12T00:18:10.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.756+0000 7f69cdea98c0 1 < canceled multipart upload key=K4LNDJJUA1RZ upload=FF90X1S53L8K tag=IV55Q6UF1QMM type=write size=2476418 2024-09-12T00:18:10.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.764+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~P2RK6SR7IBI2.0 size=1048576 2024-09-12T00:18:10.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.768+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~P2RK6SR7IBI2.1 size=1048576 2024-09-12T00:18:10.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.772+0000 7f69cdea98c0 1 > prepared part key=_multipart_UTZNJQJQMXJS.2~P2RK6SR7IBI2.2 size=570022 2024-09-12T00:18:10.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.772+0000 7f69cdea98c0 1 > prepared multipart upload key=UTZNJQJQMXJS upload=P2RK6SR7IBI2 tag=0Q615KBWS411 type=write size=3715750 2024-09-12T00:18:10.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.776+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=PA2TQHV0ZSIE type=del 2024-09-12T00:18:10.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.784+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~ODSUDIM86IXZ.0 size=1048576 2024-09-12T00:18:10.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.784+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~ODSUDIM86IXZ.1 size=356595 2024-09-12T00:18:10.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.784+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=ODSUDIM86IXZ tag=CA37SBHZI2PD type=write size=2453747 2024-09-12T00:18:10.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.792+0000 7f69cdea98c0 1 < suggested remove operation key=UTZNJQJQMXJS tag=XYRNB4IZ0MOG type=del 2024-09-12T00:18:10.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.800+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=PEZY7MYJONQ6 type=del size=3798049 2024-09-12T00:18:10.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.804+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~6UUC56HK58IH.0 size=1048576 2024-09-12T00:18:10.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.804+0000 7f69cdea98c0 1 < completed part key=_multipart_2ENKC4QT2BFS.2~6UUC56HK58IH.1 size=314372 2024-09-12T00:18:10.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.812+0000 7f69cdea98c0 1 < completed multipart upload key=2ENKC4QT2BFS upload=6UUC56HK58IH tag=3HL80W2ELE04 type=write size=2411524 2024-09-12T00:18:10.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~VG5NK4E9YTLW.0 size=1048576 2024-09-12T00:18:10.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~VG5NK4E9YTLW.1 size=1048576 2024-09-12T00:18:10.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.824+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~VG5NK4E9YTLW.2 size=353232 2024-09-12T00:18:10.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.824+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=VG5NK4E9YTLW tag=SIMJN8C1AJ7P type=write size=3498960 2024-09-12T00:18:10.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.828+0000 7f69cdea98c0 1 < completed part key=_multipart_K4LNDJJUA1RZ.2~VFMKWBUH0K2E.0 size=195915 2024-09-12T00:18:10.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.832+0000 7f69cdea98c0 1 < completed multipart upload key=K4LNDJJUA1RZ upload=VFMKWBUH0K2E tag=D1CXE85JJI02 type=write size=1244491 2024-09-12T00:18:10.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.840+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=VN8T2HGF7NPX type=del size=3099096 2024-09-12T00:18:10.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.844+0000 7f69cdea98c0 1 < suggested update operation key=IXWX7S5NWJS3 tag=FG4R6B2HZHFK type=del size=1631001 2024-09-12T00:18:10.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.852+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~VAYBLKNPCMNW.0 size=1048576 2024-09-12T00:18:10.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.856+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~VAYBLKNPCMNW.1 size=1048576 2024-09-12T00:18:10.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.860+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~VAYBLKNPCMNW.2 size=240630 2024-09-12T00:18:10.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.860+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=VAYBLKNPCMNW tag=KWRRBV64G9B9 type=write size=3386358 2024-09-12T00:18:10.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.864+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=AW98JT44FG3E type=del 2024-09-12T00:18:10.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~63ENBD1GYMA6.0 size=1048576 2024-09-12T00:18:10.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~63ENBD1GYMA6.1 size=1048576 2024-09-12T00:18:10.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~63ENBD1GYMA6.2 size=164548 2024-09-12T00:18:10.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.876+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=63ENBD1GYMA6 tag=JBCR65Q3BK90 type=write size=3310276 2024-09-12T00:18:10.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.880+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~3JW3Y7LS1L67.0 size=572791 2024-09-12T00:18:10.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.884+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=3JW3Y7LS1L67 tag=NM3JLS0UYCCZ type=write size=1621367 2024-09-12T00:18:10.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.892+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~UX0OWEJDGYR0.0 size=1048576 2024-09-12T00:18:10.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.896+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~UX0OWEJDGYR0.1 size=853568 2024-09-12T00:18:10.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.896+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=UX0OWEJDGYR0 tag=SRK9LV54RZGI type=write size=2950720 2024-09-12T00:18:10.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.900+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~FC7YZPDA15IH.0 size=1048576 2024-09-12T00:18:10.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.904+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~FC7YZPDA15IH.1 size=1048576 2024-09-12T00:18:10.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.904+0000 7f69cdea98c0 1 < completed part key=_multipart_YS23U9GQS7SJ.2~FC7YZPDA15IH.2 size=874967 2024-09-12T00:18:10.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.912+0000 7f69cdea98c0 1 < completed multipart upload key=YS23U9GQS7SJ upload=FC7YZPDA15IH tag=HRJJR2T3HE33 type=write size=4020695 2024-09-12T00:18:10.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.920+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~5GHYS12BAXHY.0 size=1048576 2024-09-12T00:18:10.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.924+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~5GHYS12BAXHY.1 size=705712 2024-09-12T00:18:10.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.924+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=5GHYS12BAXHY tag=9G1KTKMJ6O39 type=write size=2802864 2024-09-12T00:18:10.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.928+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~GRUIPM1VHH07.0 size=1048576 2024-09-12T00:18:10.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.932+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~GRUIPM1VHH07.1 size=427754 2024-09-12T00:18:10.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.940+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=GRUIPM1VHH07 tag=J2RE5H0NDAJQ type=write size=2524906 2024-09-12T00:18:10.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~N5FFPF4GQ7LP.0 size=1048576 2024-09-12T00:18:10.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.948+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~N5FFPF4GQ7LP.1 size=1048576 2024-09-12T00:18:10.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.952+0000 7f69cdea98c0 1 > prepared part key=_multipart_HSQZYI0SNZP1.2~N5FFPF4GQ7LP.2 size=171040 2024-09-12T00:18:10.952 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.952+0000 7f69cdea98c0 1 > prepared multipart upload key=HSQZYI0SNZP1 upload=N5FFPF4GQ7LP tag=XOI5DV9HE8GA type=write size=3316768 2024-09-12T00:18:10.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.956+0000 7f69cdea98c0 1 < completed write operation key=7UFADFUXL28I tag=PKOCZQD6E12D type=write size=858038 2024-09-12T00:18:10.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.964+0000 7f69cdea98c0 1 > prepared operation key=Z6MH459BTZ6K tag=XHGMC36ZVIVY type=write size=962968 2024-09-12T00:18:10.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.972+0000 7f69cdea98c0 1 < suggested update operation key=IXB6WLN5M81C tag=P92PS75QOSRR type=del size=3594037 2024-09-12T00:18:10.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.976+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=DN28GJH399LG type=del size=163001 2024-09-12T00:18:10.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.980+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=OAYQ87VEC2EL type=del 2024-09-12T00:18:10.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.984+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=TZ4N2T085HOO type=del size=3773373 2024-09-12T00:18:10.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.992+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~C56K68K1N4PJ.0 size=1048576 2024-09-12T00:18:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:10.992+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~C56K68K1N4PJ.1 size=268606 2024-09-12T00:18:10.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.000+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=C56K68K1N4PJ tag=TQLXSKCCENKY type=write size=2365758 2024-09-12T00:18:11.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.008+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~9MFPB9180EXZ.0 size=1048576 2024-09-12T00:18:11.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.008+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~9MFPB9180EXZ.1 size=1048576 2024-09-12T00:18:11.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~9MFPB9180EXZ.2 size=651197 2024-09-12T00:18:11.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.012+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=9MFPB9180EXZ tag=6861W1VU45Z7 type=write size=3796925 2024-09-12T00:18:11.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.016+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=R4XWM59LMP71 type=del 2024-09-12T00:18:11.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.020+0000 7f69cdea98c0 1 > prepared operation key=RDGRKQQH4B8C tag=WIA2NWPX4M92 type=del size=1855345 2024-09-12T00:18:11.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.024+0000 7f69cdea98c0 -1 < failed to complete operation key=IXWX7S5NWJS3 tag=BLNHG9UJZM8T type=del size=1387520: (22) Invalid argument 2024-09-12T00:18:11.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.028+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=IO9VRUFVERNJ type=del size=3550414 2024-09-12T00:18:11.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.028+0000 7f69cdea98c0 1 < canceled part key=_multipart_UTZNJQJQMXJS.2~P2RK6SR7IBI2.0 size=1048576 2024-09-12T00:18:11.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.032+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~P2RK6SR7IBI2.1 size=1048576 2024-09-12T00:18:11.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.036+0000 7f69cdea98c0 1 < completed part key=_multipart_UTZNJQJQMXJS.2~P2RK6SR7IBI2.2 size=570022 2024-09-12T00:18:11.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.044+0000 7f69cdea98c0 1 < canceled multipart upload key=UTZNJQJQMXJS upload=P2RK6SR7IBI2 tag=0Q615KBWS411 type=write size=3715750 2024-09-12T00:18:11.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.048+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=TTRHVFURVKG6 type=del size=3236933 2024-09-12T00:18:11.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.048+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~ODSUDIM86IXZ.0 size=1048576 2024-09-12T00:18:11.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.052+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~ODSUDIM86IXZ.1 size=356595 2024-09-12T00:18:11.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.060+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=ODSUDIM86IXZ tag=CA37SBHZI2PD type=write size=2453747 2024-09-12T00:18:11.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.064+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~UFHG9ORB5YLR.0 size=1048576 2024-09-12T00:18:11.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_VYYY8MF0P3Q7.2~UFHG9ORB5YLR.1 size=941775 2024-09-12T00:18:11.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.072+0000 7f69cdea98c0 1 > prepared multipart upload key=VYYY8MF0P3Q7 upload=UFHG9ORB5YLR tag=HED9P7FG030H type=write size=3038927 2024-09-12T00:18:11.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.076+0000 7f69cdea98c0 1 < completed delete operation key=AKWTTXH2P254 tag=PEZY7MYJONQ6 type=del 2024-09-12T00:18:11.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.080+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=9SN0X3RNVDEU type=del size=3472949 2024-09-12T00:18:11.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.084+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~VG5NK4E9YTLW.0 size=1048576 2024-09-12T00:18:11.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.084+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~VG5NK4E9YTLW.1 size=1048576 2024-09-12T00:18:11.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.088+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~VG5NK4E9YTLW.2 size=353232 2024-09-12T00:18:11.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.092+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=VG5NK4E9YTLW tag=SIMJN8C1AJ7P type=write size=3498960 2024-09-12T00:18:11.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~0GP8VK3QPHCS.0 size=1048576 2024-09-12T00:18:11.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.104+0000 7f69cdea98c0 1 > prepared part key=_multipart_AQY7MM3OX3GW.2~0GP8VK3QPHCS.1 size=289671 2024-09-12T00:18:11.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.104+0000 7f69cdea98c0 1 > prepared multipart upload key=AQY7MM3OX3GW upload=0GP8VK3QPHCS tag=KAQBLKWIS9JC type=write size=2386823 2024-09-12T00:18:11.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.104+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=VN8T2HGF7NPX type=del 2024-09-12T00:18:11.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.108+0000 7f69cdea98c0 1 > prepared operation key=Q0L8J0BYRFDQ tag=Y54WA5QEM9AE type=del size=1389180 2024-09-12T00:18:11.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.112+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~VAYBLKNPCMNW.0 size=1048576 2024-09-12T00:18:11.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.116+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~VAYBLKNPCMNW.1 size=1048576 2024-09-12T00:18:11.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.116+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~VAYBLKNPCMNW.2 size=240630 2024-09-12T00:18:11.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.124+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=VAYBLKNPCMNW tag=KWRRBV64G9B9 type=write size=3386358 2024-09-12T00:18:11.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.128+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=P8BFQNYK6493 type=write size=324578 2024-09-12T00:18:11.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.128+0000 7f69cdea98c0 1 < canceled part key=_multipart_Q0L8J0BYRFDQ.2~63ENBD1GYMA6.0 size=1048576 2024-09-12T00:18:11.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.132+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~63ENBD1GYMA6.1 size=1048576 2024-09-12T00:18:11.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.132+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~63ENBD1GYMA6.2 size=164548 2024-09-12T00:18:11.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.140+0000 7f69cdea98c0 1 < canceled multipart upload key=Q0L8J0BYRFDQ upload=63ENBD1GYMA6 tag=JBCR65Q3BK90 type=write size=3310276 2024-09-12T00:18:11.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.148+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~SX30AHY2Z43T.0 size=1048576 2024-09-12T00:18:11.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.148+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~SX30AHY2Z43T.1 size=1048576 2024-09-12T00:18:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.152+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~SX30AHY2Z43T.2 size=424381 2024-09-12T00:18:11.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.152+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=SX30AHY2Z43T tag=N609OVL3Y4M8 type=write size=3570109 2024-09-12T00:18:11.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.156+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~UX0OWEJDGYR0.0 size=1048576 2024-09-12T00:18:11.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.160+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~UX0OWEJDGYR0.1 size=853568 2024-09-12T00:18:11.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.164+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=UX0OWEJDGYR0 tag=SRK9LV54RZGI type=write size=2950720 2024-09-12T00:18:11.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.168+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=7O7DFVKDJRTT type=del size=709305 2024-09-12T00:18:11.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.172+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~5GHYS12BAXHY.0 size=1048576 2024-09-12T00:18:11.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.176+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~5GHYS12BAXHY.1 size=705712 2024-09-12T00:18:11.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.180+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=5GHYS12BAXHY tag=9G1KTKMJ6O39 type=write size=2802864 2024-09-12T00:18:11.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.188+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~S3SMCRKPP4M2.0 size=1048576 2024-09-12T00:18:11.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.192+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~S3SMCRKPP4M2.1 size=1048576 2024-09-12T00:18:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.196+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~S3SMCRKPP4M2.2 size=846714 2024-09-12T00:18:11.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.196+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=S3SMCRKPP4M2 tag=P7TGCKBBIC3Q type=write size=3992442 2024-09-12T00:18:11.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.200+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~N5FFPF4GQ7LP.0 size=1048576 2024-09-12T00:18:11.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.200+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~N5FFPF4GQ7LP.1 size=1048576 2024-09-12T00:18:11.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.204+0000 7f69cdea98c0 1 < completed part key=_multipart_HSQZYI0SNZP1.2~N5FFPF4GQ7LP.2 size=171040 2024-09-12T00:18:11.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.212+0000 7f69cdea98c0 1 < completed multipart upload key=HSQZYI0SNZP1 upload=N5FFPF4GQ7LP tag=XOI5DV9HE8GA type=write size=3316768 2024-09-12T00:18:11.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.216+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=AMHMSNINLO6F type=del size=1734249 2024-09-12T00:18:11.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.220+0000 7f69cdea98c0 1 < completed write operation key=Z6MH459BTZ6K tag=XHGMC36ZVIVY type=write size=962968 2024-09-12T00:18:11.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.224+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=4JBKS9XXA5N1 type=write size=774417 2024-09-12T00:18:11.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.232+0000 7f69cdea98c0 1 < suggested update operation key=AKWTTXH2P254 tag=DN28GJH399LG type=del size=163001 2024-09-12T00:18:11.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.232+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=2XAI7GMJ0TDR type=del size=2638420 2024-09-12T00:18:11.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.236+0000 7f69cdea98c0 1 < completed delete operation key=7UFADFUXL28I tag=TZ4N2T085HOO type=del 2024-09-12T00:18:11.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.244+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~61QIC5XYVE0L.0 size=1048576 2024-09-12T00:18:11.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.248+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~61QIC5XYVE0L.1 size=854553 2024-09-12T00:18:11.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.248+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=61QIC5XYVE0L tag=7NWFHMG59QRU type=write size=2951705 2024-09-12T00:18:11.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.252+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~9MFPB9180EXZ.0 size=1048576 2024-09-12T00:18:11.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.256+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~9MFPB9180EXZ.1 size=1048576 2024-09-12T00:18:11.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.256+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~9MFPB9180EXZ.2 size=651197 2024-09-12T00:18:11.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.264+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=9MFPB9180EXZ tag=6861W1VU45Z7 type=write size=3796925 2024-09-12T00:18:11.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.272+0000 7f69cdea98c0 1 > prepared part key=_multipart_2YYP9NOUAJD0.2~GKUAZB727PHI.0 size=92624 2024-09-12T00:18:11.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.272+0000 7f69cdea98c0 1 > prepared multipart upload key=2YYP9NOUAJD0 upload=GKUAZB727PHI tag=VCX8T2H3QEGF type=write size=1141200 2024-09-12T00:18:11.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.272+0000 7f69cdea98c0 1 < completed delete operation key=RDGRKQQH4B8C tag=WIA2NWPX4M92 type=del 2024-09-12T00:18:11.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.276+0000 7f69cdea98c0 1 > prepared operation key=1CZXUEJLQ8FM tag=WZ9PR88NQHGZ type=write size=275244 2024-09-12T00:18:11.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.280+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=IO9VRUFVERNJ type=del 2024-09-12T00:18:11.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.288+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~DKU97MUGNFDU.0 size=1048576 2024-09-12T00:18:11.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.288+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~DKU97MUGNFDU.1 size=1048576 2024-09-12T00:18:11.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.292+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~DKU97MUGNFDU.2 size=902668 2024-09-12T00:18:11.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.292+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=DKU97MUGNFDU tag=0J7Z2V3QHQY4 type=write size=4048396 2024-09-12T00:18:11.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.296+0000 7f69cdea98c0 1 < completed delete operation key=9K3HLTD6DMSC tag=TTRHVFURVKG6 type=del 2024-09-12T00:18:11.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.304+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~YOZS9N2PF98S.0 size=1048576 2024-09-12T00:18:11.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.304+0000 7f69cdea98c0 1 > prepared part key=_multipart_0EALARW4O3OB.2~YOZS9N2PF98S.1 size=531449 2024-09-12T00:18:11.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.304+0000 7f69cdea98c0 1 > prepared multipart upload key=0EALARW4O3OB upload=YOZS9N2PF98S tag=ZHBU1FT8R0JP type=write size=2628601 2024-09-12T00:18:11.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.308+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~UFHG9ORB5YLR.0 size=1048576 2024-09-12T00:18:11.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.312+0000 7f69cdea98c0 1 < completed part key=_multipart_VYYY8MF0P3Q7.2~UFHG9ORB5YLR.1 size=941775 2024-09-12T00:18:11.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.316+0000 7f69cdea98c0 1 < completed multipart upload key=VYYY8MF0P3Q7 upload=UFHG9ORB5YLR tag=HED9P7FG030H type=write size=3038927 2024-09-12T00:18:11.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.320+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=L1MNX8FY771V type=write size=396270 2024-09-12T00:18:11.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.324+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=9SN0X3RNVDEU type=del 2024-09-12T00:18:11.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.332+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~Q43OIIAPHH1I.0 size=281828 2024-09-12T00:18:11.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.332+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=Q43OIIAPHH1I tag=JZPX5Z2790ZY type=write size=1330404 2024-09-12T00:18:11.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.336+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~0GP8VK3QPHCS.0 size=1048576 2024-09-12T00:18:11.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.340+0000 7f69cdea98c0 1 < completed part key=_multipart_AQY7MM3OX3GW.2~0GP8VK3QPHCS.1 size=289671 2024-09-12T00:18:11.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.344+0000 7f69cdea98c0 1 < completed multipart upload key=AQY7MM3OX3GW upload=0GP8VK3QPHCS tag=KAQBLKWIS9JC type=write size=2386823 2024-09-12T00:18:11.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.348+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=C5T822CYXC3S type=del size=3623372 2024-09-12T00:18:11.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.352+0000 7f69cdea98c0 1 < completed delete operation key=Q0L8J0BYRFDQ tag=Y54WA5QEM9AE type=del 2024-09-12T00:18:11.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.356+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=MHH0A7Z8RWM2 type=del size=3069849 2024-09-12T00:18:11.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.364+0000 7f69cdea98c0 1 < suggested update operation key=1CZXUEJLQ8FM tag=P8BFQNYK6493 type=write size=324578 2024-09-12T00:18:11.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.372+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~DVMSONVA099B.0 size=1048576 2024-09-12T00:18:11.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~DVMSONVA099B.1 size=1048576 2024-09-12T00:18:11.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_9K3HLTD6DMSC.2~DVMSONVA099B.2 size=667605 2024-09-12T00:18:11.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.376+0000 7f69cdea98c0 1 > prepared multipart upload key=9K3HLTD6DMSC upload=DVMSONVA099B tag=3QK8LGJ3EFY0 type=write size=3813333 2024-09-12T00:18:11.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.380+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~SX30AHY2Z43T.0 size=1048576 2024-09-12T00:18:11.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.384+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~SX30AHY2Z43T.1 size=1048576 2024-09-12T00:18:11.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.384+0000 7f69cdea98c0 1 < canceled part key=_multipart_Q0L8J0BYRFDQ.2~SX30AHY2Z43T.2 size=424381 2024-09-12T00:18:11.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.392+0000 7f69cdea98c0 1 < canceled multipart upload key=Q0L8J0BYRFDQ upload=SX30AHY2Z43T tag=N609OVL3Y4M8 type=write size=3570109 2024-09-12T00:18:11.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.396+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~H5T2ERKU9E33.0 size=1048576 2024-09-12T00:18:11.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.404+0000 7f69cdea98c0 1 > prepared part key=_multipart_LRHZKCU22AIX.2~H5T2ERKU9E33.1 size=922704 2024-09-12T00:18:11.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.404+0000 7f69cdea98c0 1 > prepared multipart upload key=LRHZKCU22AIX upload=H5T2ERKU9E33 tag=FTDCGQIR4ZAO type=write size=3019856 2024-09-12T00:18:11.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.412+0000 7f69cdea98c0 1 < suggested remove operation key=2ENKC4QT2BFS tag=7O7DFVKDJRTT type=del 2024-09-12T00:18:11.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.416+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=410I4GBU4EKG type=write size=966490 2024-09-12T00:18:11.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.420+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~S3SMCRKPP4M2.0 size=1048576 2024-09-12T00:18:11.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.424+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~S3SMCRKPP4M2.1 size=1048576 2024-09-12T00:18:11.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.424+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~S3SMCRKPP4M2.2 size=846714 2024-09-12T00:18:11.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.432+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=S3SMCRKPP4M2 tag=P7TGCKBBIC3Q type=write size=3992442 2024-09-12T00:18:11.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.440+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~8KQETIC1N3NB.0 size=1048576 2024-09-12T00:18:11.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~8KQETIC1N3NB.1 size=1048576 2024-09-12T00:18:11.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.444+0000 7f69cdea98c0 1 > prepared part key=_multipart_4O5U4WX3N4SA.2~8KQETIC1N3NB.2 size=367455 2024-09-12T00:18:11.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.444+0000 7f69cdea98c0 1 > prepared multipart upload key=4O5U4WX3N4SA upload=8KQETIC1N3NB tag=4ZJP0CVWN9GU type=write size=3513183 2024-09-12T00:18:11.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.452+0000 7f69cdea98c0 1 < suggested update operation key=AWZ03VE7D86K tag=AMHMSNINLO6F type=del size=1734249 2024-09-12T00:18:11.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.460+0000 7f69cdea98c0 1 > prepared part key=_multipart_SP2KVAO82MQ0.2~P5S0AFVAGU1P.0 size=950240 2024-09-12T00:18:11.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.460+0000 7f69cdea98c0 1 > prepared multipart upload key=SP2KVAO82MQ0 upload=P5S0AFVAGU1P tag=1AZTVFFK3YV9 type=write size=1998816 2024-09-12T00:18:11.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.464+0000 7f69cdea98c0 1 < completed write operation key=0J667VAQGMTX tag=4JBKS9XXA5N1 type=write size=774417 2024-09-12T00:18:11.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.468+0000 7f69cdea98c0 1 > prepared operation key=H91UXKWAJ3K8 tag=W7BVT0P2A3QM type=del size=1483042 2024-09-12T00:18:11.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.472+0000 7f69cdea98c0 1 < canceled operation key=7UFADFUXL28I tag=2XAI7GMJ0TDR type=del size=2638420 2024-09-12T00:18:11.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.480+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~WQ135EX8IVUM.0 size=1048576 2024-09-12T00:18:11.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.484+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~WQ135EX8IVUM.1 size=1048576 2024-09-12T00:18:11.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.488+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~WQ135EX8IVUM.2 size=176055 2024-09-12T00:18:11.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.488+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=WQ135EX8IVUM tag=VCW2PV4GU6X5 type=write size=3321783 2024-09-12T00:18:11.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.492+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~61QIC5XYVE0L.0 size=1048576 2024-09-12T00:18:11.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.492+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~61QIC5XYVE0L.1 size=854553 2024-09-12T00:18:11.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.500+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=61QIC5XYVE0L tag=7NWFHMG59QRU type=write size=2951705 2024-09-12T00:18:11.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.500+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=SB809LTWN0BS type=del size=1375965 2024-09-12T00:18:11.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.504+0000 7f69cdea98c0 1 < completed part key=_multipart_2YYP9NOUAJD0.2~GKUAZB727PHI.0 size=92624 2024-09-12T00:18:11.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.512+0000 7f69cdea98c0 1 < completed multipart upload key=2YYP9NOUAJD0 upload=GKUAZB727PHI tag=VCX8T2H3QEGF type=write size=1141200 2024-09-12T00:18:11.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.516+0000 7f69cdea98c0 1 > prepared operation key=IXB6WLN5M81C tag=ROY0VU9JO350 type=del size=3757298 2024-09-12T00:18:11.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.520+0000 7f69cdea98c0 -1 < failed to complete operation key=1CZXUEJLQ8FM tag=WZ9PR88NQHGZ type=write size=275244: (22) Invalid argument 2024-09-12T00:18:11.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.524+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=NO4OBKPE71TB type=write size=355664 2024-09-12T00:18:11.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.528+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~DKU97MUGNFDU.0 size=1048576 2024-09-12T00:18:11.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.528+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~DKU97MUGNFDU.1 size=1048576 2024-09-12T00:18:11.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.532+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~DKU97MUGNFDU.2 size=902668 2024-09-12T00:18:11.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.540+0000 7f69cdea98c0 1 < completed multipart upload key=0J667VAQGMTX upload=DKU97MUGNFDU tag=0J7Z2V3QHQY4 type=write size=4048396 2024-09-12T00:18:11.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.544+0000 7f69cdea98c0 1 > prepared operation key=SCFIVX3IHERR tag=V96GINFEE23A type=del size=1484826 2024-09-12T00:18:11.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.548+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~YOZS9N2PF98S.0 size=1048576 2024-09-12T00:18:11.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.548+0000 7f69cdea98c0 1 < completed part key=_multipart_0EALARW4O3OB.2~YOZS9N2PF98S.1 size=531449 2024-09-12T00:18:11.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.556+0000 7f69cdea98c0 1 < completed multipart upload key=0EALARW4O3OB upload=YOZS9N2PF98S tag=ZHBU1FT8R0JP type=write size=2628601 2024-09-12T00:18:11.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.560+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=RISLZU6M3VFC type=del size=1257604 2024-09-12T00:18:11.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.564+0000 7f69cdea98c0 1 < completed write operation key=9K3HLTD6DMSC tag=L1MNX8FY771V type=write size=396270 2024-09-12T00:18:11.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.564+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=TP82AYWSFWOT type=del size=2894522 2024-09-12T00:18:11.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.568+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~Q43OIIAPHH1I.0 size=281828 2024-09-12T00:18:11.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.576+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=Q43OIIAPHH1I tag=JZPX5Z2790ZY type=write size=1330404 2024-09-12T00:18:11.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.580+0000 7f69cdea98c0 1 > prepared operation key=SP2KVAO82MQ0 tag=0BXGJHKFAFOH type=del size=3200200 2024-09-12T00:18:11.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.584+0000 7f69cdea98c0 1 < completed delete operation key=T9OJXTZNRQJB tag=C5T822CYXC3S type=del 2024-09-12T00:18:11.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.588+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=LO4JWRQN4F7L type=del size=555232 2024-09-12T00:18:11.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.592+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=MHH0A7Z8RWM2 type=del 2024-09-12T00:18:11.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.596+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=V25ZCQM469AL type=del size=684864 2024-09-12T00:18:11.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.600+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~DVMSONVA099B.0 size=1048576 2024-09-12T00:18:11.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.604+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~DVMSONVA099B.1 size=1048576 2024-09-12T00:18:11.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.604+0000 7f69cdea98c0 1 < completed part key=_multipart_9K3HLTD6DMSC.2~DVMSONVA099B.2 size=667605 2024-09-12T00:18:11.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.612+0000 7f69cdea98c0 1 < completed multipart upload key=9K3HLTD6DMSC upload=DVMSONVA099B tag=3QK8LGJ3EFY0 type=write size=3813333 2024-09-12T00:18:11.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.620+0000 7f69cdea98c0 1 > prepared part key=_multipart_SCFIVX3IHERR.2~TKVTXA3VEK13.0 size=977057 2024-09-12T00:18:11.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.620+0000 7f69cdea98c0 1 > prepared multipart upload key=SCFIVX3IHERR upload=TKVTXA3VEK13 tag=KM96PS0XEX7T type=write size=2025633 2024-09-12T00:18:11.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.620+0000 7f69cdea98c0 1 < canceled part key=_multipart_LRHZKCU22AIX.2~H5T2ERKU9E33.0 size=1048576 2024-09-12T00:18:11.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.620+0000 7f69cdea98c0 1 < completed part key=_multipart_LRHZKCU22AIX.2~H5T2ERKU9E33.1 size=922704 2024-09-12T00:18:11.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.628+0000 7f69cdea98c0 1 < canceled multipart upload key=LRHZKCU22AIX upload=H5T2ERKU9E33 tag=FTDCGQIR4ZAO type=write size=3019856 2024-09-12T00:18:11.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.632+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=019PJR0FI142 type=del size=645588 2024-09-12T00:18:11.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.636+0000 7f69cdea98c0 1 < completed write operation key=0EALARW4O3OB tag=410I4GBU4EKG type=write size=966490 2024-09-12T00:18:11.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.644+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~34YM2S1YDFJC.0 size=1048576 2024-09-12T00:18:11.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.648+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~34YM2S1YDFJC.1 size=1048576 2024-09-12T00:18:11.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.652+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~34YM2S1YDFJC.2 size=115802 2024-09-12T00:18:11.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.652+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=34YM2S1YDFJC tag=O1AU1BZ5HLIL type=write size=3261530 2024-09-12T00:18:11.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.656+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~8KQETIC1N3NB.0 size=1048576 2024-09-12T00:18:11.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.656+0000 7f69cdea98c0 1 < completed part key=_multipart_4O5U4WX3N4SA.2~8KQETIC1N3NB.1 size=1048576 2024-09-12T00:18:11.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.656+0000 7f69cdea98c0 1 < canceled part key=_multipart_4O5U4WX3N4SA.2~8KQETIC1N3NB.2 size=367455 2024-09-12T00:18:11.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.664+0000 7f69cdea98c0 1 < canceled multipart upload key=4O5U4WX3N4SA upload=8KQETIC1N3NB tag=4ZJP0CVWN9GU type=write size=3513183 2024-09-12T00:18:11.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.668+0000 7f69cdea98c0 1 > prepared operation key=AKWTTXH2P254 tag=0LS2RWM2I677 type=del size=273918 2024-09-12T00:18:11.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.672+0000 7f69cdea98c0 1 < completed part key=_multipart_SP2KVAO82MQ0.2~P5S0AFVAGU1P.0 size=950240 2024-09-12T00:18:11.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.676+0000 7f69cdea98c0 1 < completed multipart upload key=SP2KVAO82MQ0 upload=P5S0AFVAGU1P tag=1AZTVFFK3YV9 type=write size=1998816 2024-09-12T00:18:11.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.684+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~5CDRJU65N7ZN.0 size=1048576 2024-09-12T00:18:11.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.688+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~5CDRJU65N7ZN.1 size=473081 2024-09-12T00:18:11.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.688+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=5CDRJU65N7ZN tag=5XU6QQ8EES1Y type=write size=2570233 2024-09-12T00:18:11.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.692+0000 7f69cdea98c0 1 < canceled operation key=H91UXKWAJ3K8 tag=W7BVT0P2A3QM type=del size=1483042 2024-09-12T00:18:11.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.696+0000 7f69cdea98c0 1 > prepared operation key=2YYP9NOUAJD0 tag=C0O8VCE4RWK8 type=del size=1277905 2024-09-12T00:18:11.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.700+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~WQ135EX8IVUM.0 size=1048576 2024-09-12T00:18:11.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.704+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~WQ135EX8IVUM.1 size=1048576 2024-09-12T00:18:11.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.708+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~WQ135EX8IVUM.2 size=176055 2024-09-12T00:18:11.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.712+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=WQ135EX8IVUM tag=VCW2PV4GU6X5 type=write size=3321783 2024-09-12T00:18:11.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.720+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=6TQ20V8XHHO3 type=del size=3520169 2024-09-12T00:18:11.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.728+0000 7f69cdea98c0 1 < suggested update operation key=T9OJXTZNRQJB tag=SB809LTWN0BS type=del size=1375965 2024-09-12T00:18:11.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~22RP1MITMX7K.0 size=1048576 2024-09-12T00:18:11.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.736+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~22RP1MITMX7K.1 size=1048576 2024-09-12T00:18:11.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.740+0000 7f69cdea98c0 1 > prepared part key=_multipart_1CZXUEJLQ8FM.2~22RP1MITMX7K.2 size=335105 2024-09-12T00:18:11.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.740+0000 7f69cdea98c0 1 > prepared multipart upload key=1CZXUEJLQ8FM upload=22RP1MITMX7K tag=WV92PKHAU7VW type=write size=3480833 2024-09-12T00:18:11.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.744+0000 7f69cdea98c0 1 < completed delete operation key=IXB6WLN5M81C tag=ROY0VU9JO350 type=del 2024-09-12T00:18:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.748+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=74I8TRJWU74D type=del size=2376235 2024-09-12T00:18:11.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.764+0000 7f69cdea98c0 1 < suggested remove operation key=9K3HLTD6DMSC tag=NO4OBKPE71TB type=write 2024-09-12T00:18:11.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.764+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=XAZOUDCC2YTR type=del size=3922804 2024-09-12T00:18:11.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.768+0000 7f69cdea98c0 1 < completed delete operation key=SCFIVX3IHERR tag=V96GINFEE23A type=del 2024-09-12T00:18:11.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.772+0000 7f69cdea98c0 1 > prepared operation key=2X78JWLK876H tag=1NA9M0U3BOC7 type=del size=3921886 2024-09-12T00:18:11.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.776+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=RISLZU6M3VFC type=del 2024-09-12T00:18:11.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.780+0000 7f69cdea98c0 1 > prepared operation key=0HAUC4BDL9VR tag=SYVTTI7CY3NQ type=del size=3409367 2024-09-12T00:18:11.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.784+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=TP82AYWSFWOT type=del 2024-09-12T00:18:11.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.788+0000 7f69cdea98c0 1 > prepared operation key=AWZ03VE7D86K tag=4EYHTD1YJ3SR type=del size=3345249 2024-09-12T00:18:11.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.792+0000 7f69cdea98c0 1 < completed delete operation key=SP2KVAO82MQ0 tag=0BXGJHKFAFOH type=del 2024-09-12T00:18:11.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.796+0000 7f69cdea98c0 1 > prepared operation key=AQY7MM3OX3GW tag=8KEL6JXDOQF3 type=del size=4051116 2024-09-12T00:18:11.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.800+0000 7f69cdea98c0 -1 < failed to complete operation key=T9OJXTZNRQJB tag=LO4JWRQN4F7L type=del size=555232: (22) Invalid argument 2024-09-12T00:18:11.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.808+0000 7f69cdea98c0 1 > prepared part key=_multipart_Z6MH459BTZ6K.2~G4W5RR00HCLR.0 size=277422 2024-09-12T00:18:11.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.808+0000 7f69cdea98c0 1 > prepared multipart upload key=Z6MH459BTZ6K upload=G4W5RR00HCLR tag=HOYT67YYJ73V type=write size=1325998 2024-09-12T00:18:11.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.812+0000 7f69cdea98c0 1 < canceled operation key=UTZNJQJQMXJS tag=V25ZCQM469AL type=del size=684864 2024-09-12T00:18:11.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.820+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~YCUF6G0SBR55.0 size=1048576 2024-09-12T00:18:11.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.824+0000 7f69cdea98c0 1 > prepared part key=_multipart_T9OJXTZNRQJB.2~YCUF6G0SBR55.1 size=963331 2024-09-12T00:18:11.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.824+0000 7f69cdea98c0 1 > prepared multipart upload key=T9OJXTZNRQJB upload=YCUF6G0SBR55 tag=IDN9ZGA3TFLB type=write size=3060483 2024-09-12T00:18:11.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.828+0000 7f69cdea98c0 1 < completed part key=_multipart_SCFIVX3IHERR.2~TKVTXA3VEK13.0 size=977057 2024-09-12T00:18:11.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.832+0000 7f69cdea98c0 1 < completed multipart upload key=SCFIVX3IHERR upload=TKVTXA3VEK13 tag=KM96PS0XEX7T type=write size=2025633 2024-09-12T00:18:11.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.836+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=Y9DLREOWMDO6 type=del size=1038952 2024-09-12T00:18:11.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.844+0000 7f69cdea98c0 1 < canceled operation key=YS23U9GQS7SJ tag=019PJR0FI142 type=del size=645588 2024-09-12T00:18:11.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.848+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=HWGH0I314B9Y type=del size=2721937 2024-09-12T00:18:11.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.852+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~34YM2S1YDFJC.0 size=1048576 2024-09-12T00:18:11.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.852+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~34YM2S1YDFJC.1 size=1048576 2024-09-12T00:18:11.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.856+0000 7f69cdea98c0 1 < completed part key=_multipart_IXB6WLN5M81C.2~34YM2S1YDFJC.2 size=115802 2024-09-12T00:18:11.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.864+0000 7f69cdea98c0 1 < completed multipart upload key=IXB6WLN5M81C upload=34YM2S1YDFJC tag=O1AU1BZ5HLIL type=write size=3261530 2024-09-12T00:18:11.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.872+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~VRURCJQF4VDP.0 size=1048576 2024-09-12T00:18:11.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.876+0000 7f69cdea98c0 1 > prepared part key=_multipart_AKWTTXH2P254.2~VRURCJQF4VDP.1 size=431349 2024-09-12T00:18:11.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.876+0000 7f69cdea98c0 1 > prepared multipart upload key=AKWTTXH2P254 upload=VRURCJQF4VDP tag=NXGBPJLKKGRK type=write size=2528501 2024-09-12T00:18:11.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.880+0000 7f69cdea98c0 1 < suggested update operation key=AKWTTXH2P254 tag=0LS2RWM2I677 type=del size=273918 2024-09-12T00:18:11.885 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.884+0000 7f69cdea98c0 1 > prepared operation key=2ENKC4QT2BFS tag=649TDBTXQB6V type=del size=1645175 2024-09-12T00:18:11.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.888+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~5CDRJU65N7ZN.0 size=1048576 2024-09-12T00:18:11.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.892+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~5CDRJU65N7ZN.1 size=473081 2024-09-12T00:18:11.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.900+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=5CDRJU65N7ZN tag=5XU6QQ8EES1Y type=write size=2570233 2024-09-12T00:18:11.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.908+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~T6GF81H3IE89.0 size=1048576 2024-09-12T00:18:11.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.908+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~T6GF81H3IE89.1 size=1048576 2024-09-12T00:18:11.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.912+0000 7f69cdea98c0 1 > prepared part key=_multipart_0J667VAQGMTX.2~T6GF81H3IE89.2 size=355793 2024-09-12T00:18:11.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.912+0000 7f69cdea98c0 1 > prepared multipart upload key=0J667VAQGMTX upload=T6GF81H3IE89 tag=LN59PMBSYWGG type=write size=3501521 2024-09-12T00:18:11.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.916+0000 7f69cdea98c0 1 < completed delete operation key=2YYP9NOUAJD0 tag=C0O8VCE4RWK8 type=del 2024-09-12T00:18:11.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.920+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=7LPLR5L4HO6L type=del size=3094655 2024-09-12T00:18:11.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.924+0000 7f69cdea98c0 1 < completed delete operation key=K0HNNMX7CDGC tag=6TQ20V8XHHO3 type=del 2024-09-12T00:18:11.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.928+0000 7f69cdea98c0 1 > prepared operation key=I23GNCI98JHU tag=ESOU8HLQ70I8 type=del size=1109044 2024-09-12T00:18:11.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.932+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~22RP1MITMX7K.0 size=1048576 2024-09-12T00:18:11.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.936+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~22RP1MITMX7K.1 size=1048576 2024-09-12T00:18:11.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.936+0000 7f69cdea98c0 1 < completed part key=_multipart_1CZXUEJLQ8FM.2~22RP1MITMX7K.2 size=335105 2024-09-12T00:18:11.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.944+0000 7f69cdea98c0 1 < completed multipart upload key=1CZXUEJLQ8FM upload=22RP1MITMX7K tag=WV92PKHAU7VW type=write size=3480833 2024-09-12T00:18:11.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.948+0000 7f69cdea98c0 1 > prepared operation key=UTZNJQJQMXJS tag=ELUFFS82W7YF type=write size=697193 2024-09-12T00:18:11.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.956+0000 7f69cdea98c0 1 < suggested remove operation key=O5WBNND16BFN tag=74I8TRJWU74D type=del 2024-09-12T00:18:11.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~2X61Q2G24SJ2.0 size=1048576 2024-09-12T00:18:11.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.964+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~2X61Q2G24SJ2.1 size=1048576 2024-09-12T00:18:11.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.968+0000 7f69cdea98c0 1 > prepared part key=_multipart_K0HNNMX7CDGC.2~2X61Q2G24SJ2.2 size=434320 2024-09-12T00:18:11.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.968+0000 7f69cdea98c0 1 > prepared multipart upload key=K0HNNMX7CDGC upload=2X61Q2G24SJ2 tag=81XPUWA27G1Q type=write size=3580048 2024-09-12T00:18:11.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.972+0000 7f69cdea98c0 1 < completed delete operation key=UTZNJQJQMXJS tag=XAZOUDCC2YTR type=del 2024-09-12T00:18:11.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.976+0000 7f69cdea98c0 1 > prepared operation key=O5WBNND16BFN tag=AUZ6I5JZRPRC type=write size=76707 2024-09-12T00:18:11.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.980+0000 7f69cdea98c0 1 < completed delete operation key=2X78JWLK876H tag=1NA9M0U3BOC7 type=del 2024-09-12T00:18:11.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.984+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=7FLV85OR5RGE type=del size=13940 2024-09-12T00:18:11.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.984+0000 7f69cdea98c0 1 < completed delete operation key=0HAUC4BDL9VR tag=SYVTTI7CY3NQ type=del 2024-09-12T00:18:11.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.992+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=50L5LCAZ83QM type=del size=2316798 2024-09-12T00:18:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:11.996+0000 7f69cdea98c0 1 < completed delete operation key=AWZ03VE7D86K tag=4EYHTD1YJ3SR type=del 2024-09-12T00:18:11.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.000+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~ZU2CD2W8NN48.0 size=1048576 2024-09-12T00:18:12.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.004+0000 7f69cdea98c0 1 > prepared part key=_multipart_I23GNCI98JHU.2~ZU2CD2W8NN48.1 size=73100 2024-09-12T00:18:12.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.004+0000 7f69cdea98c0 1 > prepared multipart upload key=I23GNCI98JHU upload=ZU2CD2W8NN48 tag=WHJX35KL18XC type=write size=2170252 2024-09-12T00:18:12.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.008+0000 7f69cdea98c0 1 < completed delete operation key=AQY7MM3OX3GW tag=8KEL6JXDOQF3 type=del 2024-09-12T00:18:12.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.012+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~3W893TLXQK5W.0 size=1048576 2024-09-12T00:18:12.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.016+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~3W893TLXQK5W.1 size=35952 2024-09-12T00:18:12.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.016+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=3W893TLXQK5W tag=CAI7ARM93DGM type=write size=2133104 2024-09-12T00:18:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.020+0000 7f69cdea98c0 1 < completed part key=_multipart_Z6MH459BTZ6K.2~G4W5RR00HCLR.0 size=277422 2024-09-12T00:18:12.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.024+0000 7f69cdea98c0 1 < completed multipart upload key=Z6MH459BTZ6K upload=G4W5RR00HCLR tag=HOYT67YYJ73V type=write size=1325998 2024-09-12T00:18:12.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.028+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=KR70Y2W4XL2W type=write size=8083 2024-09-12T00:18:12.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.032+0000 7f69cdea98c0 1 < completed part key=_multipart_T9OJXTZNRQJB.2~YCUF6G0SBR55.0 size=1048576 2024-09-12T00:18:12.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.032+0000 7f69cdea98c0 1 < canceled part key=_multipart_T9OJXTZNRQJB.2~YCUF6G0SBR55.1 size=963331 2024-09-12T00:18:12.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.040+0000 7f69cdea98c0 1 < canceled multipart upload key=T9OJXTZNRQJB upload=YCUF6G0SBR55 tag=IDN9ZGA3TFLB type=write size=3060483 2024-09-12T00:18:12.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.044+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~PJ77C6V9LJ77.0 size=1048576 2024-09-12T00:18:12.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.048+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~PJ77C6V9LJ77.1 size=1048576 2024-09-12T00:18:12.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.052+0000 7f69cdea98c0 1 > prepared part key=_multipart_5453GP1H3OFQ.2~PJ77C6V9LJ77.2 size=704981 2024-09-12T00:18:12.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.052+0000 7f69cdea98c0 1 > prepared multipart upload key=5453GP1H3OFQ upload=PJ77C6V9LJ77 tag=ZR0E783986V5 type=write size=3850709 2024-09-12T00:18:12.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.052+0000 7f69cdea98c0 1 < canceled operation key=9K3HLTD6DMSC tag=Y9DLREOWMDO6 type=del size=1038952 2024-09-12T00:18:12.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.056+0000 7f69cdea98c0 1 > prepared operation key=K0HNNMX7CDGC tag=O9M64219PKK0 type=write size=934733 2024-09-12T00:18:12.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.064+0000 7f69cdea98c0 1 < suggested remove operation key=0J667VAQGMTX tag=HWGH0I314B9Y type=del 2024-09-12T00:18:12.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~2Z1GRWYFNIRU.0 size=1048576 2024-09-12T00:18:12.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.072+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~2Z1GRWYFNIRU.1 size=1048576 2024-09-12T00:18:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.076+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~2Z1GRWYFNIRU.2 size=60200 2024-09-12T00:18:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.076+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=2Z1GRWYFNIRU tag=XURS7YVS0CHT type=write size=3205928 2024-09-12T00:18:12.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.080+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~VRURCJQF4VDP.0 size=1048576 2024-09-12T00:18:12.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.080+0000 7f69cdea98c0 1 < completed part key=_multipart_AKWTTXH2P254.2~VRURCJQF4VDP.1 size=431349 2024-09-12T00:18:12.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.088+0000 7f69cdea98c0 1 < completed multipart upload key=AKWTTXH2P254 upload=VRURCJQF4VDP tag=NXGBPJLKKGRK type=write size=2528501 2024-09-12T00:18:12.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.092+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~J21TTNHJQHU6.0 size=1048576 2024-09-12T00:18:12.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.096+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~J21TTNHJQHU6.1 size=1048576 2024-09-12T00:18:12.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.100+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~J21TTNHJQHU6.2 size=937885 2024-09-12T00:18:12.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.100+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=J21TTNHJQHU6 tag=OR6LKZ5UE0OJ type=write size=4083613 2024-09-12T00:18:12.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.104+0000 7f69cdea98c0 1 < completed delete operation key=2ENKC4QT2BFS tag=649TDBTXQB6V type=del 2024-09-12T00:18:12.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.116+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~TZBIVR7WBVZP.0 size=1048576 2024-09-12T00:18:12.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.116+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~TZBIVR7WBVZP.1 size=1048576 2024-09-12T00:18:12.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.120+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~TZBIVR7WBVZP.2 size=169484 2024-09-12T00:18:12.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.120+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=TZBIVR7WBVZP tag=YSKF5UNAG1LW type=write size=3315212 2024-09-12T00:18:12.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.124+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~T6GF81H3IE89.0 size=1048576 2024-09-12T00:18:12.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.128+0000 7f69cdea98c0 1 < completed part key=_multipart_0J667VAQGMTX.2~T6GF81H3IE89.1 size=1048576 2024-09-12T00:18:12.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.128+0000 7f69cdea98c0 1 < canceled part key=_multipart_0J667VAQGMTX.2~T6GF81H3IE89.2 size=355793 2024-09-12T00:18:12.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.132+0000 7f69cdea98c0 1 < canceled multipart upload key=0J667VAQGMTX upload=T6GF81H3IE89 tag=LN59PMBSYWGG type=write size=3501521 2024-09-12T00:18:12.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.136+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~CJQMFJAR0OUJ.0 size=1048576 2024-09-12T00:18:12.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.140+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXWX7S5NWJS3.2~CJQMFJAR0OUJ.1 size=251620 2024-09-12T00:18:12.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.140+0000 7f69cdea98c0 1 > prepared multipart upload key=IXWX7S5NWJS3 upload=CJQMFJAR0OUJ tag=0KNV2ZLOB0XR type=write size=2348772 2024-09-12T00:18:12.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.144+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=7LPLR5L4HO6L type=del 2024-09-12T00:18:12.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.148+0000 7f69cdea98c0 1 > prepared operation key=0EALARW4O3OB tag=LQR5X2YS3NIC type=del size=3032233 2024-09-12T00:18:12.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.152+0000 7f69cdea98c0 1 < completed delete operation key=I23GNCI98JHU tag=ESOU8HLQ70I8 type=del 2024-09-12T00:18:12.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.156+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~PD64332RE8ZC.0 size=1048576 2024-09-12T00:18:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.160+0000 7f69cdea98c0 1 > prepared part key=_multipart_Q0L8J0BYRFDQ.2~PD64332RE8ZC.1 size=922018 2024-09-12T00:18:12.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.160+0000 7f69cdea98c0 1 > prepared multipart upload key=Q0L8J0BYRFDQ upload=PD64332RE8ZC tag=37S3DOMLKZ9P type=write size=3019170 2024-09-12T00:18:12.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.164+0000 7f69cdea98c0 1 < completed write operation key=UTZNJQJQMXJS tag=ELUFFS82W7YF type=write size=697193 2024-09-12T00:18:12.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.168+0000 7f69cdea98c0 1 > prepared operation key=4O5U4WX3N4SA tag=7Y2R9JOYTYMS type=del size=522979 2024-09-12T00:18:12.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.172+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~2X61Q2G24SJ2.0 size=1048576 2024-09-12T00:18:12.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.176+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~2X61Q2G24SJ2.1 size=1048576 2024-09-12T00:18:12.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.176+0000 7f69cdea98c0 1 < completed part key=_multipart_K0HNNMX7CDGC.2~2X61Q2G24SJ2.2 size=434320 2024-09-12T00:18:12.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.184+0000 7f69cdea98c0 1 < completed multipart upload key=K0HNNMX7CDGC upload=2X61Q2G24SJ2 tag=81XPUWA27G1Q type=write size=3580048 2024-09-12T00:18:12.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.188+0000 7f69cdea98c0 1 > prepared operation key=9K3HLTD6DMSC tag=LLGBKYEKRFSC type=del size=2130236 2024-09-12T00:18:12.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.188+0000 7f69cdea98c0 1 < completed write operation key=O5WBNND16BFN tag=AUZ6I5JZRPRC type=write size=76707 2024-09-12T00:18:12.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.192+0000 7f69cdea98c0 1 > prepared operation key=5453GP1H3OFQ tag=CE4UGNP6AJK4 type=del size=98785 2024-09-12T00:18:12.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.196+0000 7f69cdea98c0 1 < canceled operation key=7UFADFUXL28I tag=7FLV85OR5RGE type=del size=13940 2024-09-12T00:18:12.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.200+0000 7f69cdea98c0 1 > prepared operation key=IXWX7S5NWJS3 tag=F7SITLB1USF5 type=del size=2028775 2024-09-12T00:18:12.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.204+0000 7f69cdea98c0 1 < completed delete operation key=5453GP1H3OFQ tag=50L5LCAZ83QM type=del 2024-09-12T00:18:12.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.208+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=2CL6A9S1DRHT type=write size=76317 2024-09-12T00:18:12.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.212+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~ZU2CD2W8NN48.0 size=1048576 2024-09-12T00:18:12.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.216+0000 7f69cdea98c0 1 < completed part key=_multipart_I23GNCI98JHU.2~ZU2CD2W8NN48.1 size=73100 2024-09-12T00:18:12.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.224+0000 7f69cdea98c0 1 < completed multipart upload key=I23GNCI98JHU upload=ZU2CD2W8NN48 tag=WHJX35KL18XC type=write size=2170252 2024-09-12T00:18:12.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.232+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~M0W3MG1LQC86.0 size=1048576 2024-09-12T00:18:12.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.236+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~M0W3MG1LQC86.1 size=1048576 2024-09-12T00:18:12.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.236+0000 7f69cdea98c0 1 > prepared part key=_multipart_2X78JWLK876H.2~M0W3MG1LQC86.2 size=658878 2024-09-12T00:18:12.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.236+0000 7f69cdea98c0 1 > prepared multipart upload key=2X78JWLK876H upload=M0W3MG1LQC86 tag=OP0XWBJ6W2S2 type=write size=3804606 2024-09-12T00:18:12.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.240+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~3W893TLXQK5W.0 size=1048576 2024-09-12T00:18:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.244+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~3W893TLXQK5W.1 size=35952 2024-09-12T00:18:12.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.252+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=3W893TLXQK5W tag=CAI7ARM93DGM type=write size=2133104 2024-09-12T00:18:12.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.256+0000 7f69cdea98c0 1 > prepared operation key=T9OJXTZNRQJB tag=99Q3LDA3QZLJ type=write size=399680 2024-09-12T00:18:12.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.256+0000 7f69cdea98c0 1 < completed write operation key=T9OJXTZNRQJB tag=KR70Y2W4XL2W type=write size=8083 2024-09-12T00:18:12.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.260+0000 7f69cdea98c0 1 > prepared operation key=YS23U9GQS7SJ tag=3VL7LYWHNKI0 type=write size=245165 2024-09-12T00:18:12.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.264+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~PJ77C6V9LJ77.0 size=1048576 2024-09-12T00:18:12.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.268+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~PJ77C6V9LJ77.1 size=1048576 2024-09-12T00:18:12.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.272+0000 7f69cdea98c0 1 < completed part key=_multipart_5453GP1H3OFQ.2~PJ77C6V9LJ77.2 size=704981 2024-09-12T00:18:12.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.276+0000 7f69cdea98c0 1 < completed multipart upload key=5453GP1H3OFQ upload=PJ77C6V9LJ77 tag=ZR0E783986V5 type=write size=3850709 2024-09-12T00:18:12.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.280+0000 7f69cdea98c0 1 > prepared operation key=0J667VAQGMTX tag=6ITDXRSC9D3R type=del size=1549429 2024-09-12T00:18:12.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.284+0000 7f69cdea98c0 1 < completed write operation key=K0HNNMX7CDGC tag=O9M64219PKK0 type=write size=934733 2024-09-12T00:18:12.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.288+0000 7f69cdea98c0 1 > prepared operation key=7UFADFUXL28I tag=51IOGQ8OJV1E type=del size=3448781 2024-09-12T00:18:12.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.292+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~2Z1GRWYFNIRU.0 size=1048576 2024-09-12T00:18:12.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.296+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~2Z1GRWYFNIRU.1 size=1048576 2024-09-12T00:18:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.300+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~2Z1GRWYFNIRU.2 size=60200 2024-09-12T00:18:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.304+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=2Z1GRWYFNIRU tag=XURS7YVS0CHT type=write size=3205928 2024-09-12T00:18:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.312+0000 7f69cdea98c0 1 > prepared part key=_multipart_RDGRKQQH4B8C.2~52CA0B2QOP15.0 size=556200 2024-09-12T00:18:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.312+0000 7f69cdea98c0 1 > prepared multipart upload key=RDGRKQQH4B8C upload=52CA0B2QOP15 tag=VAD9G8SW2DYP type=write size=1604776 2024-09-12T00:18:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.316+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~J21TTNHJQHU6.0 size=1048576 2024-09-12T00:18:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.316+0000 7f69cdea98c0 1 < canceled part key=_multipart_Q0L8J0BYRFDQ.2~J21TTNHJQHU6.1 size=1048576 2024-09-12T00:18:12.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.320+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~J21TTNHJQHU6.2 size=937885 2024-09-12T00:18:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.328+0000 7f69cdea98c0 1 < canceled multipart upload key=Q0L8J0BYRFDQ upload=J21TTNHJQHU6 tag=OR6LKZ5UE0OJ type=write size=4083613 2024-09-12T00:18:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.332+0000 7f69cdea98c0 1 > prepared operation key=VYYY8MF0P3Q7 tag=4H5O10KGR12B type=del size=3833798 2024-09-12T00:18:12.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.336+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~TZBIVR7WBVZP.0 size=1048576 2024-09-12T00:18:12.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.340+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~TZBIVR7WBVZP.1 size=1048576 2024-09-12T00:18:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.344+0000 7f69cdea98c0 1 < completed part key=_multipart_2X78JWLK876H.2~TZBIVR7WBVZP.2 size=169484 2024-09-12T00:18:12.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.348+0000 7f69cdea98c0 1 < completed multipart upload key=2X78JWLK876H upload=TZBIVR7WBVZP tag=YSKF5UNAG1LW type=write size=3315212 2024-09-12T00:18:12.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.352+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=4F7JBHI70A3D type=del size=2888401 2024-09-12T00:18:12.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.360+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~CJQMFJAR0OUJ.0 size=1048576 2024-09-12T00:18:12.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.364+0000 7f69cdea98c0 1 < completed part key=_multipart_IXWX7S5NWJS3.2~CJQMFJAR0OUJ.1 size=251620 2024-09-12T00:18:12.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.368+0000 7f69cdea98c0 1 < completed multipart upload key=IXWX7S5NWJS3 upload=CJQMFJAR0OUJ tag=0KNV2ZLOB0XR type=write size=2348772 2024-09-12T00:18:12.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.376+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~TYIS4EBRCKPV.0 size=1048576 2024-09-12T00:18:12.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.380+0000 7f69cdea98c0 1 > prepared part key=_multipart_IXB6WLN5M81C.2~TYIS4EBRCKPV.1 size=895637 2024-09-12T00:18:12.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.380+0000 7f69cdea98c0 1 > prepared multipart upload key=IXB6WLN5M81C upload=TYIS4EBRCKPV tag=XCH0JICIVDME type=write size=2992789 2024-09-12T00:18:12.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.384+0000 7f69cdea98c0 1 < completed delete operation key=0EALARW4O3OB tag=LQR5X2YS3NIC type=del 2024-09-12T00:18:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.392+0000 7f69cdea98c0 1 > prepared part key=_multipart_7UFADFUXL28I.2~V210ZAYUXQOG.0 size=587872 2024-09-12T00:18:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.392+0000 7f69cdea98c0 1 > prepared multipart upload key=7UFADFUXL28I upload=V210ZAYUXQOG tag=5GCGA25II1T2 type=write size=1636448 2024-09-12T00:18:12.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.396+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~PD64332RE8ZC.0 size=1048576 2024-09-12T00:18:12.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.396+0000 7f69cdea98c0 1 < completed part key=_multipart_Q0L8J0BYRFDQ.2~PD64332RE8ZC.1 size=922018 2024-09-12T00:18:12.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.404+0000 7f69cdea98c0 1 < completed multipart upload key=Q0L8J0BYRFDQ upload=PD64332RE8ZC tag=37S3DOMLKZ9P type=write size=3019170 2024-09-12T00:18:12.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:18:12.408+0000 7f69cdea98c0 1 > prepared operation key=K4LNDJJUA1RZ tag=0TENG5UQ3Z09 type=del size=160353 2024-09-12T00:18:12.408 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] cls_rgw_stats.simulate (28330 ms) 2024-09-12T00:18:12.408 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 1 test from cls_rgw_stats (28330 ms total) 2024-09-12T00:18:12.409 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:18:12.409 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:18:13.059 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 1 test from 1 test suite ran. (30869 ms total) 2024-09-12T00:18:13.059 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 1 test. 2024-09-12T00:18:13.068 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:18:13.069 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:18:13.126 INFO:tasks.workunit:Running workunits matching cls/test_cls_cmpomap.sh on client.0... 2024-09-12T00:18:13.127 INFO:tasks.workunit:Running workunit cls/test_cls_cmpomap.sh... 2024-09-12T00:18:13.128 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_cmpomap.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_cmpomap.sh 2024-09-12T00:18:13.191 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:18:13.191 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 31 tests from 1 test suite. 2024-09-12T00:18:13.191 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:18:15.078 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 31 tests from CmpOmap 2024-09-12T00:18:15.078 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str 2024-09-12T00:18:15.118 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str (39 ms) 2024-09-12T00:18:15.118 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_str_default 2024-09-12T00:18:15.123 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_str_default (6 ms) 2024-09-12T00:18:15.123 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64 2024-09-12T00:18:15.127 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64 (4 ms) 2024-09-12T00:18:15.127 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_noexist_u64_default 2024-09-12T00:18:15.134 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_noexist_u64_default (7 ms) 2024-09-12T00:18:15.135 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_str 2024-09-12T00:18:15.143 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_str (9 ms) 2024-09-12T00:18:15.143 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64 2024-09-12T00:18:15.161 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64 (18 ms) 2024-09-12T00:18:15.162 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_input 2024-09-12T00:18:15.168 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_input (7 ms) 2024-09-12T00:18:15.169 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_default 2024-09-12T00:18:15.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_default (5 ms) 2024-09-12T00:18:15.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_empty_default 2024-09-12T00:18:15.177 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_empty_default (4 ms) 2024-09-12T00:18:15.178 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_u64_invalid_value 2024-09-12T00:18:15.184 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_u64_invalid_value (7 ms) 2024-09-12T00:18:15.184 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_at_max_keys 2024-09-12T00:18:15.185 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_at_max_keys (1 ms) 2024-09-12T00:18:15.185 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_vals_over_max_keys 2024-09-12T00:18:15.186 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_vals_over_max_keys (1 ms) 2024-09-12T00:18:15.186 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str 2024-09-12T00:18:15.197 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str (11 ms) 2024-09-12T00:18:15.197 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_str_default 2024-09-12T00:18:15.213 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_str_default (16 ms) 2024-09-12T00:18:15.213 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64 2024-09-12T00:18:15.230 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64 (16 ms) 2024-09-12T00:18:15.230 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_noexist_u64_default 2024-09-12T00:18:15.250 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_noexist_u64_default (20 ms) 2024-09-12T00:18:15.250 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_str 2024-09-12T00:18:15.272 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_str (22 ms) 2024-09-12T00:18:15.272 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64 2024-09-12T00:18:15.292 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_u64 (20 ms) 2024-09-12T00:18:15.292 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_einval 2024-09-12T00:18:15.298 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_einval (6 ms) 2024-09-12T00:18:15.298 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_u64_eio 2024-09-12T00:18:15.305 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_u64_eio (7 ms) 2024-09-12T00:18:15.305 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_at_max_keys 2024-09-12T00:18:15.308 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_at_max_keys (3 ms) 2024-09-12T00:18:15.308 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_set_vals_over_max_keys 2024-09-12T00:18:15.310 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_set_vals_over_max_keys (2 ms) 2024-09-12T00:18:15.310 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_str 2024-09-12T00:18:15.328 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_str (18 ms) 2024-09-12T00:18:15.328 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_noexist_u64 2024-09-12T00:18:15.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_noexist_u64 (17 ms) 2024-09-12T00:18:15.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_str 2024-09-12T00:18:15.366 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_str (20 ms) 2024-09-12T00:18:15.366 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64 2024-09-12T00:18:15.385 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64 (19 ms) 2024-09-12T00:18:15.385 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_einval 2024-09-12T00:18:15.390 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_einval (5 ms) 2024-09-12T00:18:15.391 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_eio 2024-09-12T00:18:15.397 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_eio (6 ms) 2024-09-12T00:18:15.398 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_at_max_keys 2024-09-12T00:18:15.400 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_at_max_keys (3 ms) 2024-09-12T00:18:15.400 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_over_max_keys 2024-09-12T00:18:15.402 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_over_max_keys (2 ms) 2024-09-12T00:18:15.402 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] CmpOmap.cmp_rm_keys_u64_empty 2024-09-12T00:18:15.426 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] CmpOmap.cmp_rm_keys_u64_empty (24 ms) 2024-09-12T00:18:15.427 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 31 tests from CmpOmap (348 ms total) 2024-09-12T00:18:15.427 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:18:15.427 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:18:16.087 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 31 tests from 1 test suite ran. (2896 ms total) 2024-09-12T00:18:16.088 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 31 tests. 2024-09-12T00:18:16.094 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:18:16.094 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:18:16.149 INFO:tasks.workunit:Running workunits matching cls/test_cls_2pc_queue.sh on client.0... 2024-09-12T00:18:16.151 INFO:tasks.workunit:Running workunit cls/test_cls_2pc_queue.sh... 2024-09-12T00:18:16.151 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_2pc_queue.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_2pc_queue.sh 2024-09-12T00:18:16.219 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:18:16.219 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:18:16.220 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:18:16.220 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from TestCls2PCQueue 2024-09-12T00:18:16.220 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.GetCapacity 2024-09-12T00:18:19.131 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.GetCapacity (2912 ms) 2024-09-12T00:18:19.131 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AsyncGetCapacity 2024-09-12T00:18:22.181 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AsyncGetCapacity (3046 ms) 2024-09-12T00:18:22.181 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Reserve 2024-09-12T00:18:25.211 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Reserve (3034 ms) 2024-09-12T00:18:25.211 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AsyncReserve 2024-09-12T00:18:28.275 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AsyncReserve (3064 ms) 2024-09-12T00:18:28.275 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Commit 2024-09-12T00:18:32.323 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Commit (4048 ms) 2024-09-12T00:18:32.324 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Stats 2024-09-12T00:18:36.370 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Stats (4047 ms) 2024-09-12T00:18:36.370 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.UpgradeFromReef 2024-09-12T00:18:41.433 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.UpgradeFromReef (5063 ms) 2024-09-12T00:18:41.434 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Abort 2024-09-12T00:18:44.473 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Abort (3036 ms) 2024-09-12T00:18:44.473 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveError 2024-09-12T00:18:47.516 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveError (3046 ms) 2024-09-12T00:18:47.516 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.CommitError 2024-09-12T00:18:50.559 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.CommitError (3043 ms) 2024-09-12T00:18:50.559 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AbortError 2024-09-12T00:18:53.573 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AbortError (3014 ms) 2024-09-12T00:18:53.573 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiReserve 2024-09-12T00:18:56.657 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiReserve (3082 ms) 2024-09-12T00:18:56.657 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiCommit 2024-09-12T00:18:59.673 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiCommit (3018 ms) 2024-09-12T00:18:59.673 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiAbort 2024-09-12T00:19:02.733 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiAbort (3059 ms) 2024-09-12T00:19:02.733 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveCommit 2024-09-12T00:19:05.770 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveCommit (3038 ms) 2024-09-12T00:19:05.770 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveAbort 2024-09-12T00:19:08.823 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveAbort (3053 ms) 2024-09-12T00:19:08.823 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ManualCleanup 2024-09-12T00:19:11.862 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ManualCleanup (3039 ms) 2024-09-12T00:19:11.863 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.Cleanup 2024-09-12T00:19:14.921 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.Cleanup (3056 ms) 2024-09-12T00:19:14.921 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiProducer 2024-09-12T00:19:30.069 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiProducer (15150 ms) 2024-09-12T00:19:30.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AsyncConsumer 2024-09-12T00:19:35.131 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AsyncConsumer (5062 ms) 2024-09-12T00:19:35.132 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.MultiProducerConsumer 2024-09-12T00:19:49.069 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.MultiProducerConsumer (13934 ms) 2024-09-12T00:19:49.069 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.ReserveSpillover 2024-09-12T00:19:56.069 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.ReserveSpillover (7005 ms) 2024-09-12T00:19:56.070 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.CommitSpillover 2024-09-12T00:20:03.134 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.CommitSpillover (7064 ms) 2024-09-12T00:20:03.135 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestCls2PCQueue.AbortSpillover 2024-09-12T00:20:11.077 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestCls2PCQueue.AbortSpillover (7939 ms) 2024-09-12T00:20:11.077 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from TestCls2PCQueue (114854 ms total) 2024-09-12T00:20:11.078 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:20:11.078 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:11.078 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (114854 ms total) 2024-09-12T00:20:11.078 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-12T00:20:11.081 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:20:11.082 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:20:11.137 INFO:tasks.workunit:Running workunits matching cls/test_cls_user.sh on client.0... 2024-09-12T00:20:11.138 INFO:tasks.workunit:Running workunit cls/test_cls_user.sh... 2024-09-12T00:20:11.138 DEBUG:teuthology.orchestra.run.smithi078:workunit test cls/test_cls_user.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_user.sh 2024-09-12T00:20:11.215 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:11.215 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:11.216 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:20:11.216 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:13.122 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from ClsAccount 2024-09-12T00:20:13.122 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.add 2024-09-12T00:20:13.151 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.add (29 ms) 2024-09-12T00:20:13.151 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.get 2024-09-12T00:20:13.162 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.get (12 ms) 2024-09-12T00:20:13.162 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.rm 2024-09-12T00:20:13.179 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.rm (16 ms) 2024-09-12T00:20:13.179 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] ClsAccount.list 2024-09-12T00:20:13.210 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] ClsAccount.list (31 ms) 2024-09-12T00:20:13.210 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from ClsAccount (88 ms total) 2024-09-12T00:20:13.210 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:20:13.210 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:14.106 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 4 tests from 1 test suite ran. (2891 ms total) 2024-09-12T00:20:14.106 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 4 tests. 2024-09-12T00:20:14.112 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:20:14.112 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:20:14.169 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_gc_log.sh on client.0... 2024-09-12T00:20:14.171 INFO:tasks.workunit:Running workunit rgw/test_rgw_gc_log.sh... 2024-09-12T00:20:14.171 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_rgw_gc_log.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_gc_log.sh 2024-09-12T00:20:14.253 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:14.253 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:14.253 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 6 tests from 1 test suite. 2024-09-12T00:20:14.254 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:16.145 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 6 tests from rgw_gc_log 2024-09-12T00:20:16.145 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.init_existing_queue 2024-09-12T00:20:16.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.init_existing_queue (31 ms) 2024-09-12T00:20:16.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.init_existing_omap 2024-09-12T00:20:16.183 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.init_existing_omap (7 ms) 2024-09-12T00:20:16.183 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.enqueue1_after_init 2024-09-12T00:20:16.245 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.enqueue1_after_init (62 ms) 2024-09-12T00:20:16.245 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.enqueue2_before_init 2024-09-12T00:20:16.247 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.enqueue2_before_init (3 ms) 2024-09-12T00:20:16.247 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.defer1_after_init 2024-09-12T00:20:16.254 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.defer1_after_init (7 ms) 2024-09-12T00:20:16.254 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] rgw_gc_log.defer2_before_init 2024-09-12T00:20:16.258 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] rgw_gc_log.defer2_before_init (4 ms) 2024-09-12T00:20:16.258 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 6 tests from rgw_gc_log (114 ms total) 2024-09-12T00:20:16.258 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:20:16.258 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:17.159 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 6 tests from 1 test suite ran. (2905 ms total) 2024-09-12T00:20:17.159 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 6 tests. 2024-09-12T00:20:17.165 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:20:17.165 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:20:17.222 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_obj.sh on client.0... 2024-09-12T00:20:17.224 INFO:tasks.workunit:Running workunit rgw/test_rgw_obj.sh... 2024-09-12T00:20:17.224 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_rgw_obj.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_obj.sh 2024-09-12T00:20:17.304 INFO:tasks.workunit.client.0.smithi078.stdout:Running main() from gmock_main.cc 2024-09-12T00:20:17.305 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 4 tests from 1 test suite. 2024-09-12T00:20:17.305 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:17.305 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from TestRGWObj 2024-09-12T00:20:17.305 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.underscore 2024-09-12T00:20:17.305 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.305 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.305 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i= 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i= 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i= 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.306 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.307 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.308 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.309 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.310 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.310 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.310 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.310 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.310 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.311 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.312 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.313 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i= 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i= 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i= 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.314 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.315 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.316 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.317 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.318 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.319 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.319 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.319 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.319 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.319 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.319 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.319 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.320 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i=v1 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i=v1 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns= i=v1 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.321 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.322 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.323 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.324 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.325 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.326 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:20:17.327 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.328 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.328 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:20:17.328 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.328 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: _obj[v1] 2024-09-12T00:20:17.328 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: _obj ns=ns i=v1 2024-09-12T00:20:17.328 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.328 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.329 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.330 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.331 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.332 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.333 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_obj", 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.underscore (1 ms) 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.no_underscore 2024-09-12T00:20:17.334 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i= 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i= 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i= 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.335 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.336 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.337 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.338 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.339 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.340 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i= 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i= 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i= 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.341 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.342 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.343 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.344 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.345 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.346 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.347 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i=v1 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i=v1 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns= i=v1 2024-09-12T00:20:17.348 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.349 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.350 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.351 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.352 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.353 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.354 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout:parsed: obj[v1] 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout:stripped: obj ns=ns i=v1 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "obj1": { 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.355 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "obj2": { 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.356 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.357 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3": { 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.358 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "obj3-2": { 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.359 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "obj", 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "v1", 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.no_underscore (0 ms) 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.obj_to_raw 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.360 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.361 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.362 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.363 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.364 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.365 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.366 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.367 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.368 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.369 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.370 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.371 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.372 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.373 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.374 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.375 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.376 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.377 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.378 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.378 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.378 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.378 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.378 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.378 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.379 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.380 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.380 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.380 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.380 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.380 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.380 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.381 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.382 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.383 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.384 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.385 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.386 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.387 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.388 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.389 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.390 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.391 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.392 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.393 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.394 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.395 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.396 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.397 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.398 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.399 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.400 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.401 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.402 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.403 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.404 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.405 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.406 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.407 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.408 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.409 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.410 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.411 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.412 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.413 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.414 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.415 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.416 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.417 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.418 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.419 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.420 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.421 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.422 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.423 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.424 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.425 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.426 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.427 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.428 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.429 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.430 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.431 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.432 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.433 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.434 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.435 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.436 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.436 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.436 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:20:17.436 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.436 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.436 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.437 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.437 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.437 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.437 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.438 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.438 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.438 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.438 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.438 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.438 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.438 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.439 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.439 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.439 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.439 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.439 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.439 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.440 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.440 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.440 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.440 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.440 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.441 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.441 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.441 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.441 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.441 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.441 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.442 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.442 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.442 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.442 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.442 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.443 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.443 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.443 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.443 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.443 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.443 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.444 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.444 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.444 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.444 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.444 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.445 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.445 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.445 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.445 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.445 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.445 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.446 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.446 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.446 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.446 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.446 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.446 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.447 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-12T00:20:17.447 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.447 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.447 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.447 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.447 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.448 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.448 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.448 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.448 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.448 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.448 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.449 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.449 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.449 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.449 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.449 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.449 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.450 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.450 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.450 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.450 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.450 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.450 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.451 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.451 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.451 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.451 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.451 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.451 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.452 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.452 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.452 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.452 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.452 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.452 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.453 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.453 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.453 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.453 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.453 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.454 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.454 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.454 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.454 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.454 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.454 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.455 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.455 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.455 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.455 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.455 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.455 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.456 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.456 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.456 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.456 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.456 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.457 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.457 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.457 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-12T00:20:17.457 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.458 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.458 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.458 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.458 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.458 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.458 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.459 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.459 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.459 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.459 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.459 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.459 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.460 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.460 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.460 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.460 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.460 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.460 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.461 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.461 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.461 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.461 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.461 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.461 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.462 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.462 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.462 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.462 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.462 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.462 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.463 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.463 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.463 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.463 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.463 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.463 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.464 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.464 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.464 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.464 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.464 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.464 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.465 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.465 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.465 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.465 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.465 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.466 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.466 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.466 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.466 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.466 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.466 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.467 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.467 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.467 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.467 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.467 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.467 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:20:17.468 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.468 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.468 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.468 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.468 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.468 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.469 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.469 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.469 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.469 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.469 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.469 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.470 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.470 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.470 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.470 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.470 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.470 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.471 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.471 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.471 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.471 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.471 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.471 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.472 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.472 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.472 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.472 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.472 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.472 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.473 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.473 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.473 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.473 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.473 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.473 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.474 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.474 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.474 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.474 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.474 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.474 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.475 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.475 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.475 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.475 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.475 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.475 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.476 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.476 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.476 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.476 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.476 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.476 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.477 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.477 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.477 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.477 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.477 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.477 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:20:17.477 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.478 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.479 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.480 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.481 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.482 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.483 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.484 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.485 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.486 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.487 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.487 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.487 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.487 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.487 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.487 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.487 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.488 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.488 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.488 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.488 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.488 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.488 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.489 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.489 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.489 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.489 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.489 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.489 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.490 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.490 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.490 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.490 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.490 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.490 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.491 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.491 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.491 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.491 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.491 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.491 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.492 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.492 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.492 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.492 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.492 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.492 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.492 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.493 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.493 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.493 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.493 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.493 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.493 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.496 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.496 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.496 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.496 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.496 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.497 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.497 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.497 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.497 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.497 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.497 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.498 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.498 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": "default-placement.data", 2024-09-12T00:20:17.498 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:20:17.498 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.498 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.498 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.498 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "test", 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.499 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": "", 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": "" 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.500 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.501 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.501 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.501 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.501 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.501 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.501 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.502 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.502 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.502 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.502 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.502 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.502 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.502 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.503 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.503 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.503 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.503 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.503 INFO:tasks.workunit.client.0.smithi078.stdout: "obj": { 2024-09-12T00:20:17.503 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.504 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.504 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.504 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.504 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.504 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.504 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.505 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.505 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.505 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.505 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.505 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.506 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.506 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.506 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.506 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.506 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.506 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.507 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.507 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.507 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.507 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:20:17.507 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.507 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.508 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.508 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.508 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.508 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.508 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.508 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.508 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.509 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.obj_to_raw (0 ms) 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] TestRGWObj.old_to_raw 2024-09-12T00:20:17.510 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.511 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.511 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.511 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-12T00:20:17.511 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.511 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.511 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.511 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.512 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.512 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.512 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.512 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.512 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.512 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker_myobj 2024-09-12T00:20:17.513 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker_myobj", 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.514 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker_myobj 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.515 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.516 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns_myobj 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.517 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns_myobj", 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.518 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns_myobj 2024-09-12T00:20:17.519 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.520 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.521 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__:inst_myobj 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst_myobj", 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.522 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.523 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__:inst_myobj 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.524 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns:inst_myobj 2024-09-12T00:20:17.525 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst_myobj", 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.526 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "myobj", 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns:inst_myobj 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.527 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.528 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker___myobj 2024-09-12T00:20:17.529 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj", 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.530 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker___myobj 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.531 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.532 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns__myobj 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.533 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj", 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.534 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns__myobj 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.535 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__:inst__myobj 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.537 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj", 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj" 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.538 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__:inst__myobj 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.539 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.540 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns:inst__myobj 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.541 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj", 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.542 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj", 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns:inst__myobj 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.543 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.544 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker___myobj_ 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.545 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker___myobj_", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.546 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker___myobj_ 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.547 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.548 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns__myobj_ 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns__myobj_", 2024-09-12T00:20:17.549 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.550 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "", 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns__myobj_ 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.551 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.552 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__:inst__myobj_ 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__:inst__myobj_", 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "marker__myobj_" 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.553 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.554 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "" 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__:inst__myobj_ 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj": { 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.555 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj": { 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.556 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout:raw=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: "raw_obj2": { 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: "pool": ".data-pool", 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: "oid": "marker__ns:inst__myobj_", 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: "loc": "" 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: "new_obj2": { 2024-09-12T00:20:17.557 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket": { 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "ebtest", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "marker": "marker", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_id": "bucket-id", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "tenant": "", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "explicit_placement": { 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "data_pool": ".data-pool", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "data_extra_pool": "", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "index_pool": ".index-pool" 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "key": { 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "name": "_myobj_", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "instance": "inst", 2024-09-12T00:20:17.558 INFO:tasks.workunit.client.0.smithi078.stdout: "ns": "ns" 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout:raw2=.data-pool:marker__ns:inst__myobj_ 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] TestRGWObj.old_to_raw (1 ms) 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 4 tests from TestRGWObj (2 ms total) 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 4 tests from 1 test suite ran. (2 ms total) 2024-09-12T00:20:17.559 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 4 tests. 2024-09-12T00:20:17.559 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:20:17.560 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:20:17.574 INFO:tasks.workunit:Running workunits matching rgw/test_librgw_file.sh on client.0... 2024-09-12T00:20:17.575 INFO:tasks.workunit:Running workunit rgw/test_librgw_file.sh... 2024-09-12T00:20:17.576 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_librgw_file.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_librgw_file.sh 2024-09-12T00:20:17.710 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:17.711 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:17.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.763+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:17.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.763+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:17.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.763+0000 7fbd312369c0 20 realm 2024-09-12T00:20:17.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.763+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:17.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:17.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:20:17.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:17.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:17.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:17.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:17.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:17.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:20:17.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.767+0000 7fbd312369c0 20 searching for the correct realm 2024-09-12T00:20:17.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:17.775+0000 7fbd2f53d640 0 -- 172.21.15.78:0/3586296985 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fbd200de410 msgr2=0x7fbd200de870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:20:18.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.007+0000 7fbd2ed3c640 0 -- 172.21.15.78:0/3586296985 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559a54578fb0 msgr2=0x559a5457b3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:20:18.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:20:18.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:20:18.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:20:18.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:20:18.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:20:18.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:20:18.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:18.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:20:18.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 zone default found 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 4 Realm: () 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 zonegroup default 2024-09-12T00:20:18.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:18.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.019+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.023+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:18.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.023+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.023+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:18.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.023+0000 7fbd312369c0 20 started sync module instance, tier type = 2024-09-12T00:20:18.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.023+0000 7fbd312369c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:20:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.047+0000 7fbd312369c0 20 add_watcher() i=0 2024-09-12T00:20:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.047+0000 7fbd312369c0 20 add_watcher() i=1 2024-09-12T00:20:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.047+0000 7fbd312369c0 20 add_watcher() i=2 2024-09-12T00:20:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.047+0000 7fbd312369c0 20 add_watcher() i=3 2024-09-12T00:20:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.047+0000 7fbd312369c0 20 add_watcher() i=4 2024-09-12T00:20:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.047+0000 7fbd312369c0 20 add_watcher() i=5 2024-09-12T00:20:18.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.047+0000 7fbd312369c0 20 add_watcher() i=6 2024-09-12T00:20:18.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.051+0000 7fbd312369c0 20 add_watcher() i=7 2024-09-12T00:20:18.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.051+0000 7fbd312369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:20:18.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.055+0000 7fbbe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:18.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.055+0000 7fbd312369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:20:18.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.055+0000 7fbd312369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:20:18.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.055+0000 7fbd312369c0 5 note: GC not initialized 2024-09-12T00:20:18.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.055+0000 7fbb5ffff640 20 reqs_thread_entry: start 2024-09-12T00:20:18.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.055+0000 7fbd312369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:20:18.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.055+0000 7fbd312369c0 20 Filter name: none 2024-09-12T00:20:18.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbb5dffb640 20 reqs_thread_entry: start 2024-09-12T00:20:18.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-librgw-file : miss 2024-09-12T00:20:18.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:18.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x0 2024-09-12T00:20:18.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 adding default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:20:18.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache get: name=default.rgw.meta+users.email+librgw@example.com : miss 2024-09-12T00:20:18.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:18.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x0 2024-09-12T00:20:18.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 adding default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:20:18.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache get: name=default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= : miss 2024-09-12T00:20:18.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 20 rados->read ofs=0 len=0 2024-09-12T00:20:18.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:20:18.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache put: name=default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= info.flags=0x0 2024-09-12T00:20:18.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 adding default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= to cache LRU end 2024-09-12T00:20:18.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache get: name=default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= : hit (negative entry) 2024-09-12T00:20:18.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.059+0000 7fbd312369c0 10 cache get: name=default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= : hit (negative entry) 2024-09-12T00:20:18.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.063+0000 7fbd312369c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:20:18.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.063+0000 7fbd312369c0 10 moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:20:18.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.063+0000 7fbd312369c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-librgw-file, ofs0, ns] 2024-09-12T00:20:18.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.063+0000 7fbc127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693185 cookie 94121328415200 notifier 5300 bl.length()=697 2024-09-12T00:20:18.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.063+0000 7fbc127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-librgw-file info.flags=0x17 2024-09-12T00:20:18.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.063+0000 7fbc127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-librgw-file to cache LRU end 2024-09-12T00:20:18.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.067+0000 7fbd312369c0 10 cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:20:18.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.067+0000 7fbd312369c0 10 moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:20:18.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.067+0000 7fbd312369c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:librgw@example.com, ofs0, ns] 2024-09-12T00:20:18.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.067+0000 7fbc11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693187 cookie 94121328356112 notifier 5300 bl.length()=194 2024-09-12T00:20:18.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.067+0000 7fbc11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+librgw@example.com info.flags=0x7 2024-09-12T00:20:18.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.067+0000 7fbc11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+librgw@example.com to cache LRU end 2024-09-12T00:20:18.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.071+0000 7fbd312369c0 10 cache put: name=default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= info.flags=0x7 2024-09-12T00:20:18.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.071+0000 7fbd312369c0 10 moving default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= to cache LRU end 2024-09-12T00:20:18.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.071+0000 7fbd312369c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:Uvqg0HF62B6rnr5jSGKbc80QUwY=, ofs0, ns] 2024-09-12T00:20:18.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.071+0000 7fbc11ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693186 cookie 94121328417904 notifier 5300 bl.length()=203 2024-09-12T00:20:18.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.071+0000 7fbc11ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= info.flags=0x7 2024-09-12T00:20:18.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.071+0000 7fbc11ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+Uvqg0HF62B6rnr5jSGKbc80QUwY= to cache LRU end 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "user_id": "ceph-test-librgw-file", 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "display_name": "librgw test user", 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "email": "librgw@example.com", 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "suspended": 0, 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "subusers": [], 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "keys": [ 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: { 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "user": "ceph-test-librgw-file", 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "access_key": "Uvqg0HF62B6rnr5jSGKbc80QUwY=", 2024-09-12T00:20:18.072 INFO:tasks.workunit.client.0.smithi078.stdout: "secret_key": "Kdls3x3vNoUY5RdaZGm1fT/Ybvy0c7/DK91/Q3DggVIkgZ2so7JUvQ==", 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "active": true, 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-12T00:20:18.064730Z" 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: ], 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "swift_keys": [], 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "caps": [], 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "default_placement": "", 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "placement_tags": [], 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_quota": { 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:20:18.073 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "user_quota": { 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "type": "rgw", 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "account_id": "", 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "path": "/", 2024-09-12T00:20:18.074 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-12T00:20:18.064695Z", 2024-09-12T00:20:18.075 INFO:tasks.workunit.client.0.smithi078.stdout: "tags": [], 2024-09-12T00:20:18.075 INFO:tasks.workunit.client.0.smithi078.stdout: "group_ids": [] 2024-09-12T00:20:18.075 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:20:18.075 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:20:18.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.075+0000 7fbbe57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:20:18.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.079+0000 7fbd312369c0 20 remove_watcher() i=0 2024-09-12T00:20:18.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.079+0000 7fbd312369c0 2 removed watcher, disabling cache 2024-09-12T00:20:18.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.083+0000 7fbd312369c0 20 remove_watcher() i=1 2024-09-12T00:20:18.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.083+0000 7fbd312369c0 20 remove_watcher() i=2 2024-09-12T00:20:18.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.087+0000 7fbd312369c0 20 remove_watcher() i=3 2024-09-12T00:20:18.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.087+0000 7fbd312369c0 20 remove_watcher() i=4 2024-09-12T00:20:18.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.091+0000 7fbd312369c0 20 remove_watcher() i=5 2024-09-12T00:20:18.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.091+0000 7fbd312369c0 20 remove_watcher() i=6 2024-09-12T00:20:18.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:18.095+0000 7fbd312369c0 20 remove_watcher() i=7 2024-09-12T00:20:18.113 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1.1 2024-09-12T00:20:18.134 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:20:18.135 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:18.135 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:20:18.135 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:20:18.148 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:18.148 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:18.712 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (578 ms) 2024-09-12T00:20:18.712 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:20:18.714 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:20:18.714 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:20:18.714 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:20:18.714 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:20:18.733 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/quux 2024-09-12T00:20:18.741 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/f1 2024-09-12T00:20:18.745 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/f2 2024-09-12T00:20:18.752 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/f1 2024-09-12T00:20:18.758 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/d1/ 2024-09-12T00:20:18.766 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/hungry 2024-09-12T00:20:18.773 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/hungry/ 2024-09-12T00:20:18.778 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/momma 2024-09-12T00:20:18.783 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/bear/ 2024-09-12T00:20:18.791 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/sasquatch 2024-09-12T00:20:18.796 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/sasquatch/ 2024-09-12T00:20:18.800 INFO:tasks.workunit.client.0.smithi078.stdout:creating: nfsroot:foo/bar/baz/frobozz 2024-09-12T00:20:18.806 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_HIER1 (92 ms) 2024-09-12T00:20:18.806 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:20:19.026 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_DIRS1 (219 ms) 2024-09-12T00:20:19.026 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:20:19.026 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:20:19.026 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:20:19.068 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (42 ms) 2024-09-12T00:20:19.068 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:20:19.169 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (102 ms) 2024-09-12T00:20:19.169 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:20:19.170 INFO:tasks.workunit.client.0.smithi078.stdout:rename file rfile_0 to rfile_r0 (bucket brename0) 2024-09-12T00:20:19.184 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (15 ms) 2024-09-12T00:20:19.184 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:20:19.184 INFO:tasks.workunit.client.0.smithi078.stdout:rename file rfile_1 (bucket brename0) to rfile_rhilldog (bucket brename1) 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (15 ms) 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:20:19.200 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:20:19.201 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:20:19.205 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:20:19.205 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:20:19.209 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:20:19.209 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:20:19.209 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:20:19.212 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:20:19.213 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:20:19.217 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:20:19.217 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:20:19.217 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:20:19.220 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:20:19.220 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:20:19.224 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:20:19.224 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READ_DIRS1 (24 ms) 2024-09-12T00:20:19.224 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:20:19.443 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_SETUP1 (219 ms) 2024-09-12T00:20:19.443 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:20:19.443 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:20:19.443 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:20:19.443 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:20:19.443 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:20:19.443 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:20:19.444 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:20:19.459 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:20:19.460 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:20:19.468 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:20:19.472 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:20:19.479 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:20:19.479 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:20:19.480 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:20:19.481 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:20:19.483 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:20:19.484 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:20:19.485 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.HIER1 (47 ms) 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:20:19.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:20:19.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:20:19.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:19.491+0000 7f9068179a80 -1 shutting down 2024-09-12T00:20:19.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:19.491+0000 7f8f41ecb640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 55687, si_uid : 1000, si_addr0x3e80000d987, si_status0 2024-09-12T00:20:48.911 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29420 ms) 2024-09-12T00:20:48.911 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW (30775 ms total) 2024-09-12T00:20:48.911 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:20:48.911 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:20:48.912 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (30775 ms total) 2024-09-12T00:20:48.912 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-12T00:20:48.919 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1.2 2024-09-12T00:20:48.941 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:20:48.941 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:20:48.941 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:20:48.941 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:20:48.951 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:20:48.952 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:20:49.488 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (546 ms) 2024-09-12T00:20:49.488 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_HIER1 (0 ms) 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_DIRS1 (0 ms) 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:20:49.490 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (0 ms) 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READ_DIRS1 (0 ms) 2024-09-12T00:20:49.491 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.HIER1 (0 ms) 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:20:49.492 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:49.490+0000 7f014b55fa80 -1 shutting down 2024-09-12T00:20:49.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:20:49.490+0000 7f00252b1640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56333, si_uid : 1000, si_addr0x3e80000dc0d, si_status0 2024-09-12T00:21:19.559 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30069 ms) 2024-09-12T00:21:19.559 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW (30617 ms total) 2024-09-12T00:21:19.559 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:21:19.560 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:19.560 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (30617 ms total) 2024-09-12T00:21:19.560 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-12T00:21:19.573 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1.3 2024-09-12T00:21:19.596 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 24 tests from 1 test suite. 2024-09-12T00:21:19.596 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:19.596 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW 2024-09-12T00:21:19.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:21:19.609 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:19.609 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:20.161 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (565 ms) 2024-09-12T00:21:20.162 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT_NOROOT 2024-09-12T00:21:20.163 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT_NOROOT (2 ms) 2024-09-12T00:21:20.163 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:21:20.163 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (0 ms) 2024-09-12T00:21:20.163 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_HIER1 2024-09-12T00:21:20.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_HIER1 (10 ms) 2024-09-12T00:21:20.173 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETUP_DIRS1 2024-09-12T00:21:20.287 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETUP_DIRS1 (113 ms) 2024-09-12T00:21:20.287 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SETATTR 2024-09-12T00:21:20.287 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SETATTR (0 ms) 2024-09-12T00:21:20.287 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CREATE_DIRS1 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CREATE_DIRS1 (0 ms) 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_SETUP_RENAME1 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_SETUP_RENAME1 (0 ms) 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_INTRABUCKET_RENAME1 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_INTRABUCKET_RENAME1 (0 ms) 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RGW_CROSSBUCKET_RENAME1 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RGW_CROSSBUCKET_RENAME1 (0 ms) 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GETATTR_DIRS1 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_0 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:20.288 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_0/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_1 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_1/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout:scanning objects in /bdirs1/dir_2 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_0 (sdir_0): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_0 (sfile_0): FILE mode: 33412 size: 16 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sdir_1 (sdir_1): DIR mode: 17139 nlinks: 1 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout: /bdirs1/dir_2/sfile_1 (sfile_1): FILE mode: 33412 size: 16 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GETATTR_DIRS1 (1 ms) 2024-09-12T00:21:20.289 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READ_DIRS1 2024-09-12T00:21:20.290 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_0 2024-09-12T00:21:20.290 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_0 2024-09-12T00:21:20.291 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:21:20.291 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_0/sfile_1 2024-09-12T00:21:20.292 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:21:20.292 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_1 2024-09-12T00:21:20.292 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_0 2024-09-12T00:21:20.295 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:21:20.295 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_1/sfile_1 2024-09-12T00:21:20.298 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:21:20.298 INFO:tasks.workunit.client.0.smithi078.stdout:read back objects in /bdirs1/dir_2 2024-09-12T00:21:20.299 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_0 2024-09-12T00:21:20.300 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_0 : "data for sfile_0" 2024-09-12T00:21:20.300 INFO:tasks.workunit.client.0.smithi078.stdout:reading 0,256 dir_2/sfile_1 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout: read back from sfile_1 : "data for sfile_1" 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READ_DIRS1 (14 ms) 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_SETUP1 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_SETUP1 (0 ms) 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READF_DIRS1 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READF_DIRS1 (0 ms) 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEF_DIRS1 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEF_DIRS1 (0 ms) 2024-09-12T00:21:20.302 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.RELEASE_DIRS1 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_0 type: DIR refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_0 type: FILE refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sdir_1 type: DIR refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:release sfile_1 type: FILE refs: 2 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.RELEASE_DIRS1 (0 ms) 2024-09-12T00:21:20.303 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.HIER1 2024-09-12T00:21:20.317 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f2 (f2): FILE 2024-09-12T00:21:20.317 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/f1 (f1): FILE 2024-09-12T00:21:20.324 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/f1 (f1): FILE 2024-09-12T00:21:20.328 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/d1 (d1): DIR 2024-09-12T00:21:20.335 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:21:20.336 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/sasquatch (sasquatch): FILE 2024-09-12T00:21:20.337 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/quux (quux): FILE 2024-09-12T00:21:20.337 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/momma (momma): FILE 2024-09-12T00:21:20.338 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:21:20.340 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/hungry (hungry): FILE 2024-09-12T00:21:20.340 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/frobozz (frobozz): FILE 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz/bear (bear): DIR 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar/baz (baz): DIR 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo/bar (bar): DIR 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot/foo (foo): DIR 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:/nfsroot (nfsroot): DIR 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.HIER1 (43 ms) 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (0 ms) 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:21:20.345 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:21:20.346+0000 7f71f345ea80 -1 shutting down 2024-09-12T00:21:20.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:21:20.346+0000 7f70cd1b0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 56978, si_uid : 1000, si_addr0x3e80000de92, si_status0 2024-09-12T00:21:50.413 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30068 ms) 2024-09-12T00:21:50.414 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 24 tests from LibRGW (30816 ms total) 2024-09-12T00:21:50.414 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:21:50.414 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:21:50.414 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 24 tests from 1 test suite ran. (30816 ms total) 2024-09-12T00:21:50.414 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 24 tests. 2024-09-12T00:21:50.426 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2.1 2024-09-12T00:21:50.449 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:21:50.449 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:21:50.449 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:21:50.449 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:21:50.460 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:21:50.460 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:21:50.984 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (536 ms) 2024-09-12T00:21:50.985 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:21:50.986 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:21:50.986 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:21:51.003 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-12T00:21:51.003 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:21:51.003 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:21:51.003 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:21:51.021 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave0 2024-09-12T00:21:51.036 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave1 2024-09-12T00:21:51.052 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave2 2024-09-12T00:21:51.072 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave3 2024-09-12T00:21:51.090 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave4 2024-09-12T00:21:51.108 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave5 2024-09-12T00:21:51.125 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave6 2024-09-12T00:21:51.144 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave7 2024-09-12T00:21:51.162 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave8 2024-09-12T00:21:51.183 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave9 2024-09-12T00:21:51.183 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (180 ms) 2024-09-12T00:21:51.183 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:21:51.903 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (721 ms) 2024-09-12T00:21:51.904 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:21:51.904 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:21:51.904 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:21:51.904 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:21:51.904 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:21:51.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:21:51.905+0000 7fe5557cda80 -1 shutting down 2024-09-12T00:21:51.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:21:51.909+0000 7fe42f51f640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 57623, si_uid : 1000, si_addr0x3e80000e117, si_status0 2024-09-12T00:22:21.000 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29096 ms) 2024-09-12T00:22:21.000 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW (30551 ms total) 2024-09-12T00:22:21.001 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:22:21.001 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:21.001 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 9 tests from 1 test suite ran. (30551 ms total) 2024-09-12T00:22:21.001 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 9 tests. 2024-09-12T00:22:21.016 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2.2 2024-09-12T00:22:21.037 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 9 tests from 1 test suite. 2024-09-12T00:22:21.037 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:21.037 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW 2024-09-12T00:22:21.037 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:22:21.048 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:21.048 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:21.598 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (562 ms) 2024-09-12T00:22:21.598 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:22:21.600 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:22:21.600 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:22:21.600 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:22:21.600 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:22:21.660 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (61 ms) 2024-09-12T00:22:21.661 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET_MULTI 2024-09-12T00:22:21.679 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave0 2024-09-12T00:22:21.696 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave1 2024-09-12T00:22:21.714 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave2 2024-09-12T00:22:21.732 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave3 2024-09-12T00:22:21.751 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave4 2024-09-12T00:22:21.770 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave5 2024-09-12T00:22:21.789 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave6 2024-09-12T00:22:21.809 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave7 2024-09-12T00:22:21.829 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave8 2024-09-12T00:22:21.851 INFO:tasks.workunit.client.0.smithi078.stdout:created: sorrydave9 2024-09-12T00:22:21.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET_MULTI (191 ms) 2024-09-12T00:22:21.852 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET_MULTI 2024-09-12T00:22:22.529 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET_MULTI (677 ms) 2024-09-12T00:22:22.529 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:22:22.529 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:22:22.529 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:22:22.529 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:22:22.529 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:22:22.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:22:22.533+0000 7f83ed115a80 -1 shutting down 2024-09-12T00:22:22.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:22:22.533+0000 7f82c6e67640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58269, si_uid : 1000, si_addr0x3e80000e39d, si_status0 2024-09-12T00:22:51.712 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29182 ms) 2024-09-12T00:22:51.713 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 9 tests from LibRGW (30674 ms total) 2024-09-12T00:22:51.713 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:22:51.713 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:22:51.713 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 9 tests from 1 test suite ran. (30674 ms total) 2024-09-12T00:22:51.714 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 9 tests. 2024-09-12T00:22:51.725 INFO:tasks.workunit.client.0.smithi078.stdout:phase 3.1 2024-09-12T00:22:52.071 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:22:52.071 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:22:52.071 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:22:52.071 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:22:52.081 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:22:52.081 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:22:52.626 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (555 ms) 2024-09-12T00:22:52.626 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:22:52.627 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:22:52.627 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:22:52.641 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (14 ms) 2024-09-12T00:22:52.641 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:22:52.645 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (4 ms) 2024-09-12T00:22:52.645 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:22:52.649 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (4 ms) 2024-09-12T00:22:52.649 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:22:52.741 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE1 (92 ms) 2024-09-12T00:22:52.742 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:22:52.826 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE2 (84 ms) 2024-09-12T00:22:52.826 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:22:52.826 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:22:52.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:22:52.828+0000 7efd3c9bba80 -1 shutting down 2024-09-12T00:22:52.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:22:52.832+0000 7efc1670d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 58914, si_uid : 1000, si_addr0x3e80000e622, si_status0 2024-09-12T00:23:22.792 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29965 ms) 2024-09-12T00:23:22.793 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW (30721 ms total) 2024-09-12T00:23:22.793 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:23:22.793 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:23:22.793 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 13 tests from 1 test suite ran. (30721 ms total) 2024-09-12T00:23:22.793 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 13 tests. 2024-09-12T00:23:22.810 INFO:tasks.workunit.client.0.smithi078.stdout:phase 3.2 2024-09-12T00:23:23.152 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 13 tests from 1 test suite. 2024-09-12T00:23:23.152 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:23.152 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW 2024-09-12T00:23:23.152 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:23:23.161 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:23.161 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:23.726 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (575 ms) 2024-09-12T00:23:23.726 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:23:23.727 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:23:23.727 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:23:23.728 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:23:23.728 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:23:23.735 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (8 ms) 2024-09-12T00:23:23.735 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:23:23.742 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (7 ms) 2024-09-12T00:23:23.742 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE1 2024-09-12T00:23:23.844 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE1 (101 ms) 2024-09-12T00:23:23.844 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LARGE2 2024-09-12T00:23:23.844 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LARGE2 (0 ms) 2024-09-12T00:23:23.844 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:23:23.844 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:23:23.844 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:23:23.856 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (13 ms) 2024-09-12T00:23:23.857 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:23:23.928 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (72 ms) 2024-09-12T00:23:23.928 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:23:23.929 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:23:23.929 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:23:23.929 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:23:23.929 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:23:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:23:23.932+0000 7f422b60ba80 -1 shutting down 2024-09-12T00:23:23.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:23:23.932+0000 7f410535d640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 59559, si_uid : 1000, si_addr0x3e80000e8a7, si_status0 2024-09-12T00:23:53.834 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29905 ms) 2024-09-12T00:23:53.834 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 13 tests from LibRGW (30682 ms total) 2024-09-12T00:23:53.834 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:23:53.835 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:23:53.835 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 13 tests from 1 test suite ran. (30682 ms total) 2024-09-12T00:23:53.835 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 13 tests. 2024-09-12T00:23:53.845 INFO:tasks.workunit.client.0.smithi078.stdout:phase 4.1 2024-09-12T00:23:53.868 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:23:53.868 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:23:53.868 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:23:53.868 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:23:53.868 INFO:tasks.workunit.client.0.smithi078.stdout:read i1: 64001 2024-09-12T00:23:53.868 INFO:tasks.workunit.client.0.smithi078.stdout:read s1: blunderbuss 2024-09-12T00:23:53.868 INFO:tasks.workunit.client.0.smithi078.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:23:53.869 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:23:53.881 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:23:53.881 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:23:54.439 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (572 ms) 2024-09-12T00:23:54.439 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:23:54.440 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:23:54.440 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:23:54.471 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (30 ms) 2024-09-12T00:23:54.471 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:23:55.572 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_0 2024-09-12T00:23:55.572 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_1 2024-09-12T00:23:55.572 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_2 2024-09-12T00:23:55.572 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_3 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_4 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_5 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_6 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_7 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_8 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_9 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_10 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_11 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_12 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_13 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_14 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_15 2024-09-12T00:23:55.573 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_16 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_17 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_18 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_19 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_20 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_21 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_22 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_23 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_24 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_25 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_26 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_27 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_28 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_29 2024-09-12T00:23:55.574 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_30 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_31 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_32 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_33 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_34 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_35 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_36 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_37 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_38 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_39 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_40 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_41 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_42 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_43 2024-09-12T00:23:55.575 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_44 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_45 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_46 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_47 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_48 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_49 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_50 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_51 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_52 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_53 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_54 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_55 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_56 2024-09-12T00:23:55.576 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_57 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_58 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_59 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_60 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_61 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_62 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_63 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_64 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_65 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_66 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_67 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_68 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_69 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_70 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_71 2024-09-12T00:23:55.577 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_72 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_73 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_74 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_75 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_76 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_77 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_78 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_79 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_80 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_81 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_82 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_83 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_84 2024-09-12T00:23:55.578 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_85 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_86 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_87 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_88 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_89 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_90 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_91 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_92 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_93 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_94 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_95 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_96 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_97 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_98 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:created: dmarker:f_99 2024-09-12T00:23:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (1102 ms) 2024-09-12T00:23:55.580 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=. flags=4 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=.. flags=4 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:23:55.581 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:23:55.582 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:23:55.583 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:23:55.584 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:23:55.585 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:23:55.586 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:23:55.587 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (9 ms) 2024-09-12T00:23:55.588 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:23:55.589 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:23:55.589 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:23:55.589 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:23:55.590 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:23:55.591 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:23:55.592 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:23:55.593 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:23:55.594 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:23:55.595 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:23:55.596 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER2_READDIR (4 ms) 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (1 ms) 2024-09-12T00:23:55.597 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:23:55.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:23:55.587+0000 7f455a885a80 -1 shutting down 2024-09-12T00:23:55.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:23:55.591+0000 7f44345d7640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60204, si_uid : 1000, si_addr0x3e80000eb2c, si_status0 2024-09-12T00:24:24.661 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29073 ms) 2024-09-12T00:24:24.661 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW (30792 ms total) 2024-09-12T00:24:24.661 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:24:24.661 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:24.661 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 11 tests from 1 test suite ran. (30792 ms total) 2024-09-12T00:24:24.661 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 11 tests. 2024-09-12T00:24:24.675 INFO:tasks.workunit.client.0.smithi078.stdout:phase 4.2 2024-09-12T00:24:24.699 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 11 tests from 1 test suite. 2024-09-12T00:24:24.699 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:24.700 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW 2024-09-12T00:24:24.700 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.TVAR 2024-09-12T00:24:24.700 INFO:tasks.workunit.client.0.smithi078.stdout:read i1: 64001 2024-09-12T00:24:24.700 INFO:tasks.workunit.client.0.smithi078.stdout:read s1: blunderbuss 2024-09-12T00:24:24.700 INFO:tasks.workunit.client.0.smithi078.stdout:read s3: [ OK ] LibRGW.TVAR (0 ms) 2024-09-12T00:24:24.700 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:24.709 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:24.709 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:25.256 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (556 ms) 2024-09-12T00:24:25.256 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:24:25.257 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:24:25.257 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_BUCKET 2024-09-12T00:24:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_BUCKET (15 ms) 2024-09-12T00:24:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_SETUP_OBJECTS 2024-09-12T00:24:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_SETUP_OBJECTS (0 ms) 2024-09-12T00:24:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_READDIR 2024-09-12T00:24:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_READDIR (0 ms) 2024-09-12T00:24:25.273 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER2_READDIR 2024-09-12T00:24:25.278 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_0 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_1 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_10 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_11 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_12 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_13 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_14 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_15 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_16 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_17 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_18 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_19 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_2 flags=8 2024-09-12T00:24:25.279 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_20 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_21 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_22 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_23 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_24 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_25 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_26 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_27 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_28 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_29 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_3 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_30 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_31 flags=8 2024-09-12T00:24:25.280 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_32 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_33 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_34 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_35 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_36 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_37 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_38 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_39 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_4 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_40 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_41 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_42 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_43 flags=8 2024-09-12T00:24:25.281 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_44 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_45 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_46 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_47 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_48 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_49 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_5 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_50 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_51 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_52 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_53 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_54 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_55 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_56 flags=8 2024-09-12T00:24:25.282 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_57 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_58 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_59 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_6 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_60 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_61 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_62 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_63 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_64 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_65 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_66 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_67 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_68 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_69 flags=8 2024-09-12T00:24:25.283 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_7 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_70 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_71 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_72 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_73 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_74 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_75 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_76 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_77 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_78 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_79 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_8 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_80 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_81 flags=8 2024-09-12T00:24:25.284 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_82 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_83 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_84 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_85 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_86 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_87 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_88 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_89 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_9 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_90 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_91 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_92 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_93 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_94 flags=8 2024-09-12T00:24:25.285 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_95 flags=8 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_96 flags=8 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_97 flags=8 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_98 flags=8 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:r2_cb bucket=dmarker dir=nfs_marker iv count=0 called back name=f_99 flags=8 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER2_READDIR (6 ms) 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MARKER1_OBJ_CLEANUP 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MARKER1_OBJ_CLEANUP (0 ms) 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:24:25.286 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:24:25.287 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:24:25.287 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:24:25.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:24:25.279+0000 7feedb73ca80 -1 shutting down 2024-09-12T00:24:25.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:24:25.279+0000 7fedb548e640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 60850, si_uid : 1000, si_addr0x3e80000edb2, si_status0 2024-09-12T00:24:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30219 ms) 2024-09-12T00:24:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 11 tests from LibRGW (30798 ms total) 2024-09-12T00:24:55.498 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:24:55.498 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:24:55.499 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 11 tests from 1 test suite ran. (30798 ms total) 2024-09-12T00:24:55.499 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 11 tests. 2024-09-12T00:24:55.511 INFO:tasks.workunit.client.0.smithi078.stdout:phase 5.1 2024-09-12T00:24:55.546 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:24:55.546 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:24:55.546 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:24:55.546 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:24:55.557 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:24:55.558 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:24:56.061 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (514 ms) 2024-09-12T00:24:56.061 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:24:56.062 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:24:56.062 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:24:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (17 ms) 2024-09-12T00:24:56.079 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:24:56.084 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (5 ms) 2024-09-12T00:24:56.084 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:24:56.084 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:24:56.084 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:24:56.087 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (3 ms) 2024-09-12T00:24:56.087 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:24:56.087 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:24:56.087 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:24:56.092 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.PUT_OBJECT (4 ms) 2024-09-12T00:24:56.092 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:24:56.095 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GET_OBJECT (4 ms) 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:24:56.096 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (0 ms) 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (0 ms) 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:24:56.095+0000 7fa705c02a80 -1 shutting down 2024-09-12T00:24:56.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:24:56.099+0000 7fa5df954640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 61495, si_uid : 1000, si_addr0x3e80000f037, si_status0 2024-09-12T00:25:26.428 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30331 ms) 2024-09-12T00:25:26.428 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW (30880 ms total) 2024-09-12T00:25:26.428 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:25:26.429 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:26.429 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 19 tests from 1 test suite ran. (30880 ms total) 2024-09-12T00:25:26.429 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 19 tests. 2024-09-12T00:25:26.439 INFO:tasks.workunit.client.0.smithi078.stdout:phase 5.2 2024-09-12T00:25:26.473 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 19 tests from 1 test suite. 2024-09-12T00:25:26.473 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:26.473 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW 2024-09-12T00:25:26.473 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:25:26.481 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:26.481 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:27.106 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (634 ms) 2024-09-12T00:25:27.106 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:27.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (1 ms) 2024-09-12T00:25:27.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKET 2024-09-12T00:25:27.108 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKET (0 ms) 2024-09-12T00:25:27.108 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKET 2024-09-12T00:25:27.114 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKET (7 ms) 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LIST_OBJECTS 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LIST_OBJECTS (0 ms) 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_OBJECT 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_OBJECT (0 ms) 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.OBJ_OPEN 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.OBJ_OPEN (0 ms) 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.PUT_OBJECT 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.PUT_OBJECT (0 ms) 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.GET_OBJECT 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.GET_OBJECT (0 ms) 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.STAT_OBJECT 2024-09-12T00:25:27.115 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.STAT_OBJECT (0 ms) 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITE_READ_VERIFY 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITE_READ_VERIFY (0 ms) 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.WRITEV 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.WRITEV (0 ms) 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV (0 ms) 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.READV_AFTER_WRITEV 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.READV_AFTER_WRITEV (0 ms) 2024-09-12T00:25:27.116 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_OBJECT 2024-09-12T00:25:27.119 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_OBJECT (4 ms) 2024-09-12T00:25:27.119 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.DELETE_BUCKET 2024-09-12T00:25:27.174 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.DELETE_BUCKET (56 ms) 2024-09-12T00:25:27.174 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:27.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:27.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:27.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:27.175 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:25:27.174+0000 7f7425f26a80 -1 shutting down 2024-09-12T00:25:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:25:27.174+0000 7f72ffc78640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62145, si_uid : 1000, si_addr0x3e80000f2c1, si_status0 2024-09-12T00:25:57.107 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (29932 ms) 2024-09-12T00:25:57.108 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 19 tests from LibRGW (30634 ms total) 2024-09-12T00:25:57.108 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:25:57.108 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:25:57.108 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 19 tests from 1 test suite ran. (30634 ms total) 2024-09-12T00:25:57.108 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 19 tests. 2024-09-12T00:25:57.121 INFO:tasks.workunit.client.0.smithi078.stdout:phase 6.1 2024-09-12T00:25:57.145 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] Running 10 tests from 1 test suite. 2024-09-12T00:25:57.145 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment set-up. 2024-09-12T00:25:57.145 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from LibRGW 2024-09-12T00:25:57.145 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.INIT 2024-09-12T00:25:57.154 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:25:57.154 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:25:57.674 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.INIT (529 ms) 2024-09-12T00:25:57.674 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.MOUNT 2024-09-12T00:25:57.675 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.MOUNT (2 ms) 2024-09-12T00:25:57.675 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CREATE_BUCKETS 2024-09-12T00:25:57.707 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CREATE_BUCKETS (32 ms) 2024-09-12T00:25:57.708 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.LOOKUP_BUCKETS 2024-09-12T00:25:57.719 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.LOOKUP_BUCKETS (11 ms) 2024-09-12T00:25:57.719 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.TOPDIR_RENAME 2024-09-12T00:25:57.748 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.TOPDIR_RENAME (29 ms) 2024-09-12T00:25:57.748 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SUBDIR_RENAME 2024-09-12T00:25:57.792 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SUBDIR_RENAME (44 ms) 2024-09-12T00:25:57.792 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CROSS_BUCKET_RENAME 2024-09-12T00:25:57.838 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CROSS_BUCKET_RENAME (46 ms) 2024-09-12T00:25:57.838 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.CLEANUP 2024-09-12T00:25:57.838 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.CLEANUP (0 ms) 2024-09-12T00:25:57.838 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.UMOUNT 2024-09-12T00:25:57.838 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.UMOUNT (0 ms) 2024-09-12T00:25:57.838 INFO:tasks.workunit.client.0.smithi078.stdout:[ RUN ] LibRGW.SHUTDOWN 2024-09-12T00:25:57.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:25:57.841+0000 7f1b9a89ea80 -1 shutting down 2024-09-12T00:25:57.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:25:57.841+0000 7f1a745f0640 -1 received signal: User defined signal 1, si_code : -6, si_value (int): 0, si_value (ptr): 0, si_errno: 0, si_pid : 62791, si_uid : 1000, si_addr0x3e80000f547, si_status0 2024-09-12T00:26:27.889 INFO:tasks.workunit.client.0.smithi078.stdout:[ OK ] LibRGW.SHUTDOWN (30050 ms) 2024-09-12T00:26:27.890 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] 10 tests from LibRGW (30743 ms total) 2024-09-12T00:26:27.890 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:26:27.890 INFO:tasks.workunit.client.0.smithi078.stdout:[----------] Global test environment tear-down 2024-09-12T00:26:27.890 INFO:tasks.workunit.client.0.smithi078.stdout:[==========] 10 tests from 1 test suite ran. (30743 ms total) 2024-09-12T00:26:27.890 INFO:tasks.workunit.client.0.smithi078.stdout:[ PASSED ] 10 tests. 2024-09-12T00:26:27.903 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:26:27.903 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:26:27.919 INFO:tasks.workunit:Running workunits matching rgw/test_awssdkv4_sig.sh on client.0... 2024-09-12T00:26:27.920 INFO:tasks.workunit:Running workunit rgw/test_awssdkv4_sig.sh... 2024-09-12T00:26:27.920 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_awssdkv4_sig.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_awssdkv4_sig.sh 2024-09-12T00:26:27.969 INFO:tasks.workunit.client.0.smithi078.stderr:+ [ -z ] 2024-09-12T00:26:27.969 INFO:tasks.workunit.client.0.smithi078.stderr:+ export AWS_ACCESS_KEY_ID=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:26:27.969 INFO:tasks.workunit.client.0.smithi078.stderr:+ export AWS_SECRET_ACCESS_KEY=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:26:27.969 INFO:tasks.workunit.client.0.smithi078.stderr:+ radosgw-admin user create --uid ceph-test-maven --access-key lNCnR47C2g+ZidCWBAUuwfSAA7Q= --secret tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== --display-name maven test user --email sigv4@example.com 2024-09-12T00:26:28.011 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:26:28.011 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:26:28.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.057+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 realm 2024-09-12T00:26:28.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:26:28.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:28.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.061+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.065+0000 7f0bdc84d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:26:28.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.065+0000 7f0bdc84d9c0 20 searching for the correct realm 2024-09-12T00:26:28.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.065+0000 7f0bd9b52640 0 -- 172.21.15.78:0/1688899153 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f0bd4067760 msgr2=0x7f0bd40709e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:26:28.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.281+0000 7f0bda353640 0 -- 172.21.15.78:0/1688899153 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f0bd0044070 msgr2=0x7f0bd005e440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:26:28.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:26:28.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:26:28.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:26:28.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:26:28.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:26:28.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:26:28.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:26:28.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:26:28.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 zone default found 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 4 Realm: () 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 zonegroup default 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.501+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.505+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.505+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.505+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.505+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.505+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.505+0000 7f0bdc84d9c0 20 started sync module instance, tier type = 2024-09-12T00:26:28.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.505+0000 7f0bdc84d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:26:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.529+0000 7f0bdc84d9c0 20 add_watcher() i=0 2024-09-12T00:26:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.529+0000 7f0bdc84d9c0 20 add_watcher() i=1 2024-09-12T00:26:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.529+0000 7f0bdc84d9c0 20 add_watcher() i=2 2024-09-12T00:26:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.529+0000 7f0bdc84d9c0 20 add_watcher() i=3 2024-09-12T00:26:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.529+0000 7f0bdc84d9c0 20 add_watcher() i=4 2024-09-12T00:26:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.529+0000 7f0bdc84d9c0 20 add_watcher() i=5 2024-09-12T00:26:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.529+0000 7f0bdc84d9c0 20 add_watcher() i=6 2024-09-12T00:26:28.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.533+0000 7f0bdc84d9c0 20 add_watcher() i=7 2024-09-12T00:26:28.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.533+0000 7f0bdc84d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:26:28.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0a90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:28.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0bdc84d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:26:28.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0bdc84d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:26:28.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0bdc84d9c0 5 note: GC not initialized 2024-09-12T00:26:28.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0a0b7fe640 20 reqs_thread_entry: start 2024-09-12T00:26:28.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0bdc84d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:26:28.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0bdc84d9c0 20 Filter name: none 2024-09-12T00:26:28.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0a097fa640 20 reqs_thread_entry: start 2024-09-12T00:26:28.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0bdc84d9c0 10 cache get: name=default.rgw.meta+users.uid+ceph-test-maven : miss 2024-09-12T00:26:28.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.537+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x0 2024-09-12T00:26:28.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 adding default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:26:28.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 cache get: name=default.rgw.meta+users.email+sigv4@example.com : miss 2024-09-12T00:26:28.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x0 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 adding default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : miss 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x0 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 adding default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:26:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.541+0000 7f0bdc84d9c0 10 cache get: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= : hit (negative entry) 2024-09-12T00:26:28.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.545+0000 7f0bdc84d9c0 10 cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:26:28.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.545+0000 7f0bdc84d9c0 10 moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:26:28.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.545+0000 7f0bdc84d9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:ceph-test-maven, ofs0, ns] 2024-09-12T00:26:28.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.545+0000 7f0abdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693249 cookie 94091498786976 notifier 5519 bl.length()=677 2024-09-12T00:26:28.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.545+0000 7f0abdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ceph-test-maven info.flags=0x17 2024-09-12T00:26:28.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.545+0000 7f0abdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ceph-test-maven to cache LRU end 2024-09-12T00:26:28.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.549+0000 7f0bdc84d9c0 10 cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:26:28.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.549+0000 7f0bdc84d9c0 10 moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:26:28.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.549+0000 7f0bdc84d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:sigv4@example.com, ofs0, ns] 2024-09-12T00:26:28.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.549+0000 7f0abdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693191 cookie 94091498770368 notifier 5519 bl.length()=187 2024-09-12T00:26:28.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.549+0000 7f0abdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sigv4@example.com info.flags=0x7 2024-09-12T00:26:28.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.549+0000 7f0abdffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+sigv4@example.com to cache LRU end 2024-09-12T00:26:28.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.553+0000 7f0bdc84d9c0 10 cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:26:28.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.553+0000 7f0bdc84d9c0 10 moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:26:28.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.553+0000 7f0bdc84d9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:lNCnR47C2g+ZidCWBAUuwfSAA7Q=, ofs0, ns] 2024-09-12T00:26:28.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.553+0000 7f0abd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1090921693192 cookie 94091498770368 notifier 5519 bl.length()=197 2024-09-12T00:26:28.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.553+0000 7f0abd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= info.flags=0x7 2024-09-12T00:26:28.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.553+0000 7f0abd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+lNCnR47C2g+ZidCWBAUuwfSAA7Q= to cache LRU end 2024-09-12T00:26:28.551 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:26:28.551 INFO:tasks.workunit.client.0.smithi078.stdout: "user_id": "ceph-test-maven", 2024-09-12T00:26:28.551 INFO:tasks.workunit.client.0.smithi078.stdout: "display_name": "maven test user", 2024-09-12T00:26:28.551 INFO:tasks.workunit.client.0.smithi078.stdout: "email": "sigv4@example.com", 2024-09-12T00:26:28.551 INFO:tasks.workunit.client.0.smithi078.stdout: "suspended": 0, 2024-09-12T00:26:28.552 INFO:tasks.workunit.client.0.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:26:28.552 INFO:tasks.workunit.client.0.smithi078.stdout: "subusers": [], 2024-09-12T00:26:28.552 INFO:tasks.workunit.client.0.smithi078.stdout: "keys": [ 2024-09-12T00:26:28.552 INFO:tasks.workunit.client.0.smithi078.stdout: { 2024-09-12T00:26:28.552 INFO:tasks.workunit.client.0.smithi078.stdout: "user": "ceph-test-maven", 2024-09-12T00:26:28.553 INFO:tasks.workunit.client.0.smithi078.stdout: "access_key": "lNCnR47C2g+ZidCWBAUuwfSAA7Q=", 2024-09-12T00:26:28.553 INFO:tasks.workunit.client.0.smithi078.stdout: "secret_key": "tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g==", 2024-09-12T00:26:28.553 INFO:tasks.workunit.client.0.smithi078.stdout: "active": true, 2024-09-12T00:26:28.553 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-12T00:26:28.543792Z" 2024-09-12T00:26:28.553 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:26:28.553 INFO:tasks.workunit.client.0.smithi078.stdout: ], 2024-09-12T00:26:28.553 INFO:tasks.workunit.client.0.smithi078.stdout: "swift_keys": [], 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "caps": [], 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "default_placement": "", 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "placement_tags": [], 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_quota": { 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-12T00:26:28.554 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:26:28.555 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-12T00:26:28.555 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:26:28.555 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-12T00:26:28.555 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:26:28.555 INFO:tasks.workunit.client.0.smithi078.stdout: "user_quota": { 2024-09-12T00:26:28.555 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-12T00:26:28.555 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:26:28.556 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-12T00:26:28.556 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:26:28.556 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-12T00:26:28.556 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:26:28.556 INFO:tasks.workunit.client.0.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:26:28.556 INFO:tasks.workunit.client.0.smithi078.stdout: "type": "rgw", 2024-09-12T00:26:28.556 INFO:tasks.workunit.client.0.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:26:28.557 INFO:tasks.workunit.client.0.smithi078.stdout: "account_id": "", 2024-09-12T00:26:28.557 INFO:tasks.workunit.client.0.smithi078.stdout: "path": "/", 2024-09-12T00:26:28.557 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-12T00:26:28.543760Z", 2024-09-12T00:26:28.557 INFO:tasks.workunit.client.0.smithi078.stdout: "tags": [], 2024-09-12T00:26:28.557 INFO:tasks.workunit.client.0.smithi078.stdout: "group_ids": [] 2024-09-12T00:26:28.557 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:26:28.558 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:26:28.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.553+0000 7f0a90fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:26:28.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.557+0000 7f0bdc84d9c0 20 remove_watcher() i=0 2024-09-12T00:26:28.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.557+0000 7f0bdc84d9c0 2 removed watcher, disabling cache 2024-09-12T00:26:28.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.561+0000 7f0bdc84d9c0 20 remove_watcher() i=1 2024-09-12T00:26:28.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.561+0000 7f0bdc84d9c0 20 remove_watcher() i=2 2024-09-12T00:26:28.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.565+0000 7f0bdc84d9c0 20 remove_watcher() i=3 2024-09-12T00:26:28.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.565+0000 7f0bdc84d9c0 20 remove_watcher() i=4 2024-09-12T00:26:28.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.569+0000 7f0bdc84d9c0 20 remove_watcher() i=5 2024-09-12T00:26:28.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.573+0000 7f0bdc84d9c0 20 remove_watcher() i=6 2024-09-12T00:26:28.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:26:28.573+0000 7f0bdc84d9c0 20 remove_watcher() i=7 2024-09-12T00:26:28.587 INFO:tasks.workunit.client.0.smithi078.stderr:+ [ -z ] 2024-09-12T00:26:28.587 INFO:tasks.workunit.client.0.smithi078.stderr:+ [ -z /home/ubuntu/cephtest ] 2024-09-12T00:26:28.588 INFO:tasks.workunit.client.0.smithi078.stderr:+ cat /home/ubuntu/cephtest/url_file 2024-09-12T00:26:28.588 INFO:tasks.workunit.client.0.smithi078.stderr:+ export RGW_HTTP_ENDPOINT_URL=http://smithi078.front.sepia.ceph.com:80 2024-09-12T00:26:28.588 INFO:tasks.workunit.client.0.smithi078.stderr:+ [ -z /home/ubuntu/cephtest/clone.client.0 ] 2024-09-12T00:26:28.588 INFO:tasks.workunit.client.0.smithi078.stderr:+ cd /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum 2024-09-12T00:26:28.589 INFO:tasks.workunit.client.0.smithi078.stderr:+ ./mvnw clean package 2024-09-12T00:26:28.595 INFO:tasks.workunit.client.0.smithi078.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:26:33.057 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Scanning for projects... 2024-09-12T00:26:33.218 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom 2024-09-12T00:26:33.345 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/5.6 kB Progress (1): 2.8/5.6 kB Progress (1): 4.1/5.6 kB Progress (1): 5.5/5.6 kB Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.1/junit-bom-5.10.1.pom (5.6 kB at 43 kB/s) 2024-09-12T00:26:33.366 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom 2024-09-12T00:26:33.408 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/83 kB Progress (1): 2.8/83 kB Progress (1): 4.1/83 kB Progress (1): 5.5/83 kB Progress (1): 6.9/83 kB Progress (1): 8.3/83 kB Progress (1): 9.7/83 kB Progress (1): 11/83 kB Progress (1): 12/83 kB Progress (1): 14/83 kB Progress (1): 15/83 kB Progress (1): 16/83 kB Progress (1): 32/83 kB Progress (1): 49/83 kB Progress (1): 65/83 kB Progress (1): 81/83 kB Progress (1): 83 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom/2.20.43/bom-2.20.43.pom (83 kB at 2.0 MB/s) 2024-09-12T00:26:33.424 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom 2024-09-12T00:26:33.447 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/77 kB Progress (1): 32/77 kB Progress (1): 49/77 kB Progress (1): 65/77 kB Progress (1): 77 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-sdk-java-pom/2.20.43/aws-sdk-java-pom-2.20.43.pom (77 kB at 3.2 MB/s) 2024-09-12T00:26:33.483 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:33.483 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:26:33.483 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:26:33.483 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] from pom.xml 2024-09-12T00:26:33.483 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:26:33.486 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom 2024-09-12T00:26:33.504 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.pom (5.3 kB at 312 kB/s) 2024-09-12T00:26:33.510 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom 2024-09-12T00:26:33.534 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/35/maven-plugins-35.pom (9.9 kB at 413 kB/s) 2024-09-12T00:26:33.538 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom 2024-09-12T00:26:33.555 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/35/maven-parent-35.pom (45 kB at 2.5 MB/s) 2024-09-12T00:26:33.563 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom 2024-09-12T00:26:33.581 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/25/apache-25.pom (21 kB at 1.1 MB/s) 2024-09-12T00:26:33.597 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar 2024-09-12T00:26:33.614 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-clean-plugin/3.2.0/maven-clean-plugin-3.2.0.jar (36 kB at 2.2 MB/s) 2024-09-12T00:26:33.621 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom 2024-09-12T00:26:33.638 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.pom (8.2 kB at 453 kB/s) 2024-09-12T00:26:33.641 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom 2024-09-12T00:26:33.657 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/39/maven-plugins-39.pom (8.1 kB at 539 kB/s) 2024-09-12T00:26:33.659 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom 2024-09-12T00:26:33.678 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/48 kB Progress (1): 32/48 kB Progress (1): 48 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/39/maven-parent-39.pom (48 kB at 2.5 MB/s) 2024-09-12T00:26:33.682 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom 2024-09-12T00:26:33.702 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/29/apache-29.pom (21 kB at 987 kB/s) 2024-09-12T00:26:33.710 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar 2024-09-12T00:26:33.731 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-resources-plugin/3.3.1/maven-resources-plugin-3.3.1.jar (31 kB at 1.4 MB/s) 2024-09-12T00:26:33.742 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom 2024-09-12T00:26:33.768 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 9.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.pom (9.8 kB at 378 kB/s) 2024-09-12T00:26:33.778 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar 2024-09-12T00:26:33.805 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/66 kB Progress (1): 33/66 kB Progress (1): 49/66 kB Progress (1): 66/66 kB Progress (1): 66 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-compiler-plugin/3.11.0/maven-compiler-plugin-3.11.0.jar (66 kB at 2.4 MB/s) 2024-09-12T00:26:33.816 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom 2024-09-12T00:26:33.833 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.pom (5.3 kB at 296 kB/s) 2024-09-12T00:26:33.837 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom 2024-09-12T00:26:33.855 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire/3.2.3/surefire-3.2.3.pom (22 kB at 1.3 MB/s) 2024-09-12T00:26:33.859 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom 2024-09-12T00:26:33.877 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/50 kB Progress (1): 33/50 kB Progress (1): 49/50 kB Progress (1): 50 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/41/maven-parent-41.pom (50 kB at 2.8 MB/s) 2024-09-12T00:26:33.882 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom 2024-09-12T00:26:33.897 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/31/apache-31.pom (24 kB at 1.6 MB/s) 2024-09-12T00:26:33.906 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom 2024-09-12T00:26:33.924 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.3/junit-bom-5.9.3.pom (5.6 kB at 313 kB/s) 2024-09-12T00:26:33.928 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar 2024-09-12T00:26:33.950 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-surefire-plugin/3.2.3/maven-surefire-plugin-3.2.3.jar (45 kB at 1.9 MB/s) 2024-09-12T00:26:33.962 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom 2024-09-12T00:26:33.977 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.pom (6.8 kB at 398 kB/s) 2024-09-12T00:26:33.981 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom 2024-09-12T00:26:34.000 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 9.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-plugins/37/maven-plugins-37.pom (9.9 kB at 521 kB/s) 2024-09-12T00:26:34.003 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom 2024-09-12T00:26:34.022 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/46 kB Progress (1): 32/46 kB Progress (1): 46 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/37/maven-parent-37.pom (46 kB at 2.4 MB/s) 2024-09-12T00:26:34.025 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom 2024-09-12T00:26:34.046 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/27/apache-27.pom (20 kB at 970 kB/s) 2024-09-12T00:26:34.051 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar 2024-09-12T00:26:34.071 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/plugins/maven-jar-plugin/3.3.0/maven-jar-plugin-3.3.0.jar (27 kB at 1.3 MB/s) 2024-09-12T00:26:34.097 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom 2024-09-12T00:26:34.117 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.pom (6.1 kB at 304 kB/s) 2024-09-12T00:26:34.121 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom 2024-09-12T00:26:34.138 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/services/2.20.43/services-2.20.43.pom (21 kB at 1.3 MB/s) 2024-09-12T00:26:34.147 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom 2024-09-12T00:26:34.164 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/bom-internal/2.20.43/bom-internal-2.20.43.pom (20 kB at 1.1 MB/s) 2024-09-12T00:26:34.182 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom 2024-09-12T00:26:34.202 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.pom (4.0 kB at 200 kB/s) 2024-09-12T00:26:34.206 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom 2024-09-12T00:26:34.227 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocols/2.20.43/protocols-2.20.43.pom (1.6 kB at 71 kB/s) 2024-09-12T00:26:34.231 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom 2024-09-12T00:26:34.251 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/core/2.20.43/core-2.20.43.pom (2.2 kB at 111 kB/s) 2024-09-12T00:26:34.258 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom 2024-09-12T00:26:34.278 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.pom (3.6 kB at 182 kB/s) 2024-09-12T00:26:34.289 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom 2024-09-12T00:26:34.308 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.pom (3.2 kB at 170 kB/s) 2024-09-12T00:26:34.319 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom 2024-09-12T00:26:34.338 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.pom (11 kB at 548 kB/s) 2024-09-12T00:26:34.349 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom 2024-09-12T00:26:34.367 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.pom (1.7 kB at 89 kB/s) 2024-09-12T00:26:34.376 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom 2024-09-12T00:26:34.397 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.pom (3.8 kB at 182 kB/s) 2024-09-12T00:26:34.407 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom 2024-09-12T00:26:34.426 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.pom (4.9 kB at 246 kB/s) 2024-09-12T00:26:34.435 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom 2024-09-12T00:26:34.454 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.pom (1.2 kB at 61 kB/s) 2024-09-12T00:26:34.460 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom 2024-09-12T00:26:34.483 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.30/slf4j-api-1.7.30.pom (3.8 kB at 160 kB/s) 2024-09-12T00:26:34.489 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom 2024-09-12T00:26:34.507 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.30/slf4j-parent-1.7.30.pom (14 kB at 767 kB/s) 2024-09-12T00:26:34.514 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom 2024-09-12T00:26:34.534 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.pom (3.7 kB at 193 kB/s) 2024-09-12T00:26:34.543 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom 2024-09-12T00:26:34.561 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.pom (2.5 kB at 129 kB/s) 2024-09-12T00:26:34.570 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom 2024-09-12T00:26:34.591 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.pom (2.9 kB at 146 kB/s) 2024-09-12T00:26:34.600 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom 2024-09-12T00:26:34.622 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.pom (7.4 kB at 337 kB/s) 2024-09-12T00:26:34.631 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom 2024-09-12T00:26:34.663 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.pom (5.5 kB at 170 kB/s) 2024-09-12T00:26:34.673 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom 2024-09-12T00:26:34.691 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.pom (3.5 kB at 184 kB/s) 2024-09-12T00:26:34.701 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom 2024-09-12T00:26:34.723 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.pom (4.4 kB at 200 kB/s) 2024-09-12T00:26:34.728 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom 2024-09-12T00:26:34.747 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party/2.20.43/third-party-2.20.43.pom (2.4 kB at 127 kB/s) 2024-09-12T00:26:34.755 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom 2024-09-12T00:26:34.773 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.pom (6.4 kB at 358 kB/s) 2024-09-12T00:26:34.783 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom 2024-09-12T00:26:34.802 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.pom (6.1 kB at 319 kB/s) 2024-09-12T00:26:34.811 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom 2024-09-12T00:26:34.828 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.pom (3.0 kB at 165 kB/s) 2024-09-12T00:26:34.837 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom 2024-09-12T00:26:34.856 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.pom (3.5 kB at 174 kB/s) 2024-09-12T00:26:34.866 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom 2024-09-12T00:26:34.884 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.pom (4.1 kB at 227 kB/s) 2024-09-12T00:26:34.888 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom 2024-09-12T00:26:34.908 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-clients/2.20.43/http-clients-2.20.43.pom (1.8 kB at 89 kB/s) 2024-09-12T00:26:34.918 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom 2024-09-12T00:26:34.938 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.pom (6.6 kB at 315 kB/s) 2024-09-12T00:26:34.943 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom 2024-09-12T00:26:34.961 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-client/4.5.13/httpcomponents-client-4.5.13.pom (16 kB at 862 kB/s) 2024-09-12T00:26:34.966 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom 2024-09-12T00:26:34.985 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/35 kB Progress (1): 32/35 kB Progress (1): 35 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-parent/11/httpcomponents-parent-11.pom (35 kB at 1.8 MB/s) 2024-09-12T00:26:34.992 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom 2024-09-12T00:26:35.011 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/21/apache-21.pom (17 kB at 900 kB/s) 2024-09-12T00:26:35.020 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom 2024-09-12T00:26:35.040 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.pom (5.0 kB at 248 kB/s) 2024-09-12T00:26:35.044 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom 2024-09-12T00:26:35.064 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcomponents-core/4.4.13/httpcomponents-core-4.4.13.pom (13 kB at 658 kB/s) 2024-09-12T00:26:35.073 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom 2024-09-12T00:26:35.091 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.11/commons-codec-1.11.pom (14 kB at 822 kB/s) 2024-09-12T00:26:35.096 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom 2024-09-12T00:26:35.115 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/68 kB Progress (1): 33/68 kB Progress (1): 49/68 kB Progress (1): 66/68 kB Progress (1): 68 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/42/commons-parent-42.pom (68 kB at 3.4 MB/s) 2024-09-12T00:26:35.131 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom 2024-09-12T00:26:35.148 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/18/apache-18.pom (16 kB at 922 kB/s) 2024-09-12T00:26:35.158 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom 2024-09-12T00:26:35.174 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.pom (15 kB at 908 kB/s) 2024-09-12T00:26:35.179 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom 2024-09-12T00:26:35.200 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/79 kB Progress (1): 33/79 kB Progress (1): 37/79 kB Progress (1): 53/79 kB Progress (1): 69/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/52/commons-parent-52.pom (79 kB at 4.0 MB/s) 2024-09-12T00:26:35.211 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom 2024-09-12T00:26:35.233 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/18 kB Progress (1): 18 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/23/apache-23.pom (18 kB at 837 kB/s) 2024-09-12T00:26:35.241 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom 2024-09-12T00:26:35.260 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.pom (20 kB at 1.1 MB/s) 2024-09-12T00:26:35.265 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom 2024-09-12T00:26:35.287 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/78 kB Progress (1): 32/78 kB Progress (1): 49/78 kB Progress (1): 65/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/65/commons-parent-65.pom (78 kB at 3.7 MB/s) 2024-09-12T00:26:35.301 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom 2024-09-12T00:26:35.321 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.pom (3.8 kB at 192 kB/s) 2024-09-12T00:26:35.326 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom 2024-09-12T00:26:35.343 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.28/slf4j-parent-1.7.28.pom (14 kB at 767 kB/s) 2024-09-12T00:26:35.350 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom 2024-09-12T00:26:35.368 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.pom (3.2 kB at 178 kB/s) 2024-09-12T00:26:35.373 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom 2024-09-12T00:26:35.390 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.pom (3.2 kB at 177 kB/s) 2024-09-12T00:26:35.395 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom 2024-09-12T00:26:35.411 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.pom (2.0 kB at 127 kB/s) 2024-09-12T00:26:35.416 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom 2024-09-12T00:26:35.435 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.pom (2.8 kB at 142 kB/s) 2024-09-12T00:26:35.440 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom 2024-09-12T00:26:35.457 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.pom (1.5 kB at 95 kB/s) 2024-09-12T00:26:35.462 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom 2024-09-12T00:26:35.482 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.pom (3.0 kB at 143 kB/s) 2024-09-12T00:26:35.489 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom 2024-09-12T00:26:35.513 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.pom (3.2 kB at 133 kB/s) 2024-09-12T00:26:35.518 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom 2024-09-12T00:26:35.539 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.pom (3.2 kB at 153 kB/s) 2024-09-12T00:26:35.545 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom 2024-09-12T00:26:35.564 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.pom (1.0 kB at 54 kB/s) 2024-09-12T00:26:35.574 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom 2024-09-12T00:26:35.600 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 964 B Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.pom (964 B at 37 kB/s) 2024-09-12T00:26:35.606 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom 2024-09-12T00:26:35.624 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.pom (3.1 kB at 170 kB/s) 2024-09-12T00:26:35.629 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom 2024-09-12T00:26:35.648 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.pom (3.0 kB at 168 kB/s) 2024-09-12T00:26:35.653 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom 2024-09-12T00:26:35.670 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:26:35.676 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom 2024-09-12T00:26:35.694 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.pom (3.4 kB at 191 kB/s) 2024-09-12T00:26:35.699 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom 2024-09-12T00:26:35.720 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.pom (3.0 kB at 144 kB/s) 2024-09-12T00:26:35.768 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar 2024-09-12T00:26:35.928 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.1/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.2/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.3/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.4/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.5/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.6/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.7/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.8/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 0.9/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.0/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.1/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.2/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.3/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.4/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.5/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.6/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.7/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.8/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 1.9/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.0/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.1/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.2/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.3/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.4/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.5/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.6/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.7/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.8/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 2.9/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.0/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.1/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.2/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3/3.3 MB Progress (1): 3.3 MB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/s3/2.20.43/s3-2.20.43.jar (3.3 MB at 20 MB/s) 2024-09-12T00:26:35.931 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar 2024-09-12T00:26:35.931 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar 2024-09-12T00:26:35.932 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar 2024-09-12T00:26:35.932 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar 2024-09-12T00:26:35.932 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar 2024-09-12T00:26:35.967 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/71 kB Progress (1): 32/71 kB Progress (1): 49/71 kB Progress (1): 65/71 kB Progress (1): 71 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-query-protocol/2.20.43/aws-query-protocol-2.20.43.jar (71 kB at 1.9 MB/s) 2024-09-12T00:26:35.967 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar 2024-09-12T00:26:35.984 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/16 kB Progress (1): 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/crt-core/2.20.43/crt-core-2.20.43.jar (16 kB at 308 kB/s) 2024-09-12T00:26:35.984 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar 2024-09-12T00:26:36.007 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/49 kB Progress (1): 2.8/49 kB Progress (1): 4.1/49 kB Progress (1): 5.5/49 kB Progress (1): 6.9/49 kB Progress (1): 8.3/49 kB Progress (1): 9.7/49 kB Progress (1): 11/49 kB Progress (1): 12/49 kB Progress (1): 14/49 kB Progress (1): 15/49 kB Progress (1): 16/49 kB Progress (1): 17/49 kB Progress (1): 19/49 kB Progress (1): 20/49 kB Progress (1): 21/49 kB Progress (1): 23/49 kB Progress (1): 24/49 kB Progress (1): 25/49 kB Progress (1): 27/49 kB Progress (1): 28/49 kB Progress (1): 30/49 kB Progress (1): 31/49 kB Progress (1): 32/49 kB Progress (1): 34/49 kB Progress (2): 34/49 kB | 1.4/98 kB Progress (2): 34/49 kB | 2.8/98 kB Progress (2): 34/49 kB | 4.1/98 kB Progress (2): 35/49 kB | 4.1/98 kB Progress (2): 35/49 kB | 5.5/98 kB Progress (2): 36/49 kB | 5.5/98 kB Progress (2): 36/49 kB | 6.9/98 kB Progress (2): 36/49 kB | 8.3/98 kB Progress (2): 36/49 kB | 9.7/98 kB Progress (2): 36/49 kB | 11/98 kB Progress (2): 36/49 kB | 12/98 kB Progress (2): 38/49 kB | 12/98 kB Progress (2): 38/49 kB | 14/98 kB Progress (2): 39/49 kB | 14/98 kB Progress (2): 39/49 kB | 15/98 kB Progress (2): 39/49 kB | 16/98 kB Progress (3): 39/49 kB | 16/98 kB | 16/782 kB Progress (3): 39/49 kB | 16/98 kB | 32/782 kB Progress (3): 39/49 kB | 16/98 kB | 49/782 kB Progress (3): 39/49 kB | 16/98 kB | 65/782 kB Progress (3): 39/49 kB | 16/98 kB | 81/782 kB Progress (3): 39/49 kB | 16/98 kB | 98/782 kB Progress (3): 39/49 kB | 16/98 kB | 114/782 kB Progress (3): 41/49 kB | 16/98 kB | 114/782 kB Progress (3): 41/49 kB | 16/98 kB | 130/782 kB Progress (3): 42/49 kB | 16/98 kB | 130/782 kB Progress (3): 43/49 kB | 16/98 kB | 130/782 kB Progress (3): 45/49 kB | 16/98 kB | 130/782 kB Progress (3): 45/49 kB | 16/98 kB | 147/782 kB Progress (3): 45/49 kB | 16/98 kB | 163/782 kB Progress (3): 46/49 kB | 16/98 kB | 163/782 kB Progress (3): 46/49 kB | 16/98 kB | 180/782 kB Progress (4): 46/49 kB | 16/98 kB | 180/782 kB | 1.4/16 kB Progress (4): 46/49 kB | 32/98 kB | 180/782 kB | 1.4/16 kB Progress (4): 46/49 kB | 32/98 kB | 180/782 kB | 2.8/16 kB Progress (4): 48/49 kB | 32/98 kB | 180/782 kB | 2.8/16 kB Progress (4): 48/49 kB | 32/98 kB | 180/782 kB | 4.1/16 kB Progress (4): 48/49 kB | 32/98 kB | 196/782 kB | 4.1/16 kB Progress (4): 49/49 kB | 32/98 kB | 196/782 kB | 4.1/16 kB Progress (4): 49/49 kB | 32/98 kB | 196/782 kB | 5.5/16 kB Progress (4): 49 kB | 32/98 kB | 196/782 kB | 5.5/16 kB Progress (4): 49 kB | 32/98 kB | 212/782 kB | 5.5/16 kB Progress (4): 49 kB | 32/98 kB | 212/782 kB | 6.9/16 kB Progress (4): 49 kB | 32/98 kB | 212/782 kB | 8.3/16 kB Progress (4): 49 kB | 32/98 kB | 229/782 kB | 8.3/16 kB Progress (4): 49 kB | 32/98 kB | 229/782 kB | 9.7/16 kB Progress (4): 49 kB | 32/98 kB | 229/782 kB | 11/16 kB Progress (4): 49 kB | 32/98 kB | 245/782 kB | 11/16 kB Progress (4): 49 kB | 32/98 kB | 245/782 kB | 12/16 kB Progress (4): 49 kB | 32/98 kB | 245/782 kB | 14/16 kB Progress (4): 49 kB | 32/98 kB | 245/782 kB | 15/16 kB Progress (4): 49 kB | 32/98 kB | 262/782 kB | 15/16 kB Progress (4): 49 kB | 32/98 kB | 262/782 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/profiles/2.20.43/profiles-2.20.43.jar (49 kB at 656 kB/s) 2024-09-12T00:26:36.007 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar 2024-09-12T00:26:36.008 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 32/98 kB | 278/782 kB | 16 kB Progress (3): 32/98 kB | 292/782 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/arns/2.20.43/arns-2.20.43.jar (16 kB at 205 kB/s) 2024-09-12T00:26:36.008 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar 2024-09-12T00:26:36.017 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 32/98 kB | 309/782 kB Progress (2): 32/98 kB | 325/782 kB Progress (2): 32/98 kB | 342/782 kB Progress (2): 32/98 kB | 358/782 kB Progress (2): 32/98 kB | 374/782 kB Progress (2): 32/98 kB | 391/782 kB Progress (2): 32/98 kB | 407/782 kB Progress (2): 32/98 kB | 423/782 kB Progress (2): 49/98 kB | 423/782 kB Progress (2): 49/98 kB | 440/782 kB Progress (2): 49/98 kB | 456/782 kB Progress (2): 49/98 kB | 473/782 kB Progress (2): 49/98 kB | 489/782 kB Progress (2): 49/98 kB | 505/782 kB Progress (2): 49/98 kB | 522/782 kB Progress (2): 49/98 kB | 538/782 kB Progress (2): 49/98 kB | 554/782 kB Progress (2): 49/98 kB | 571/782 kB Progress (2): 49/98 kB | 587/782 kB Progress (2): 65/98 kB | 587/782 kB Progress (2): 65/98 kB | 604/782 kB Progress (2): 65/98 kB | 620/782 kB Progress (2): 65/98 kB | 636/782 kB Progress (2): 65/98 kB | 653/782 kB Progress (2): 65/98 kB | 669/782 kB Progress (2): 65/98 kB | 686/782 kB Progress (2): 65/98 kB | 702/782 kB Progress (2): 65/98 kB | 718/782 kB Progress (2): 65/98 kB | 735/782 kB Progress (2): 65/98 kB | 751/782 kB Progress (2): 65/98 kB | 767/782 kB Progress (2): 81/98 kB | 767/782 kB Progress (2): 81/98 kB | 782 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/sdk-core/2.20.43/sdk-core-2.20.43.jar (782 kB at 9.2 MB/s) 2024-09-12T00:26:36.017 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar 2024-09-12T00:26:36.022 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 98/98 kB Progress (1): 98 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-xml-protocol/2.20.43/aws-xml-protocol-2.20.43.jar (98 kB at 1.1 MB/s) 2024-09-12T00:26:36.022 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar 2024-09-12T00:26:36.025 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/11 kB Progress (1): 2.8/11 kB Progress (1): 4.1/11 kB Progress (1): 5.5/11 kB Progress (1): 6.9/11 kB Progress (1): 8.3/11 kB Progress (1): 9.7/11 kB Progress (1): 11/11 kB Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/reactivestreams/reactive-streams/1.0.3/reactive-streams-1.0.3.jar (11 kB at 122 kB/s) 2024-09-12T00:26:36.025 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar 2024-09-12T00:26:36.032 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/35 kB Progress (1): 2.8/35 kB Progress (1): 4.1/35 kB Progress (1): 5.5/35 kB Progress (1): 6.9/35 kB Progress (1): 8.3/35 kB Progress (1): 9.7/35 kB Progress (1): 11/35 kB Progress (1): 12/35 kB Progress (1): 14/35 kB Progress (1): 15/35 kB Progress (1): 16/35 kB Progress (1): 17/35 kB Progress (1): 19/35 kB Progress (1): 20/35 kB Progress (1): 21/35 kB Progress (1): 23/35 kB Progress (1): 24/35 kB Progress (1): 25/35 kB Progress (1): 27/35 kB Progress (2): 27/35 kB | 16/205 kB Progress (2): 28/35 kB | 16/205 kB Progress (2): 30/35 kB | 16/205 kB Progress (2): 31/35 kB | 16/205 kB Progress (2): 32/35 kB | 16/205 kB Progress (2): 32/35 kB | 32/205 kB Progress (2): 34/35 kB | 32/205 kB Progress (2): 35/35 kB | 32/205 kB Progress (2): 35 kB | 32/205 kB Progress (2): 35 kB | 49/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/protocol-core/2.20.43/protocol-core-2.20.43.jar (35 kB at 348 kB/s) 2024-09-12T00:26:36.032 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar 2024-09-12T00:26:36.033 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 49/205 kB | 16/30 kB Progress (2): 49/205 kB | 30 kB Progress (2): 65/205 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/eventstream/eventstream/1.0.1/eventstream-1.0.1.jar (30 kB at 302 kB/s) 2024-09-12T00:26:36.033 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar 2024-09-12T00:26:36.043 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 65/205 kB | 16/81 kB Progress (2): 65/205 kB | 32/81 kB Progress (2): 65/205 kB | 49/81 kB Progress (2): 81/205 kB | 49/81 kB Progress (2): 98/205 kB | 49/81 kB Progress (2): 98/205 kB | 65/81 kB Progress (2): 98/205 kB | 81 kB Progress (2): 114/205 kB | 81 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/http-client-spi/2.20.43/http-client-spi-2.20.43.jar (81 kB at 739 kB/s) 2024-09-12T00:26:36.043 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 130/205 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar 2024-09-12T00:26:36.047 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 130/205 kB | 16/798 kB Progress (2): 147/205 kB | 16/798 kB Progress (2): 163/205 kB | 16/798 kB Progress (2): 180/205 kB | 16/798 kB Progress (2): 180/205 kB | 33/798 kB Progress (2): 196/205 kB | 33/798 kB Progress (2): 205 kB | 33/798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/auth/2.20.43/auth-2.20.43.jar (205 kB at 1.8 MB/s) 2024-09-12T00:26:36.047 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar 2024-09-12T00:26:36.052 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 33/798 kB | 1.4/13 kB Progress (2): 33/798 kB | 2.8/13 kB Progress (2): 33/798 kB | 4.1/13 kB Progress (2): 33/798 kB | 5.5/13 kB Progress (2): 33/798 kB | 6.9/13 kB Progress (2): 33/798 kB | 8.3/13 kB Progress (2): 33/798 kB | 9.7/13 kB Progress (2): 33/798 kB | 11/13 kB Progress (2): 33/798 kB | 12/13 kB Progress (2): 33/798 kB | 13 kB Progress (3): 33/798 kB | 13 kB | 16/182 kB Progress (3): 33/798 kB | 13 kB | 32/182 kB Progress (3): 33/798 kB | 13 kB | 49/182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/annotations/2.20.43/annotations-2.20.43.jar (13 kB at 111 kB/s) 2024-09-12T00:26:36.052 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar 2024-09-12T00:26:36.055 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 33/798 kB | 65/182 kB Progress (2): 33/798 kB | 81/182 kB Progress (2): 33/798 kB | 98/182 kB Progress (2): 33/798 kB | 114/182 kB Progress (2): 33/798 kB | 130/182 kB Progress (2): 33/798 kB | 147/182 kB Progress (2): 33/798 kB | 163/182 kB Progress (2): 49/798 kB | 163/182 kB Progress (2): 49/798 kB | 180/182 kB Progress (2): 49/798 kB | 182 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/utils/2.20.43/utils-2.20.43.jar (182 kB at 1.5 MB/s) 2024-09-12T00:26:36.055 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar 2024-09-12T00:26:36.065 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 66/798 kB Progress (1): 82/798 kB Progress (1): 98/798 kB Progress (2): 98/798 kB | 16/151 kB Progress (2): 98/798 kB | 32/151 kB Progress (2): 98/798 kB | 49/151 kB Progress (2): 98/798 kB | 65/151 kB Progress (2): 98/798 kB | 81/151 kB Progress (2): 98/798 kB | 98/151 kB Progress (2): 98/798 kB | 114/151 kB Progress (3): 98/798 kB | 114/151 kB | 16/27 kB Progress (3): 98/798 kB | 130/151 kB | 16/27 kB Progress (3): 98/798 kB | 130/151 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/metrics-spi/2.20.43/metrics-spi-2.20.43.jar (27 kB at 207 kB/s) 2024-09-12T00:26:36.065 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 98/798 kB | 147/151 kB Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar 2024-09-12T00:26:36.066 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 98/798 kB | 151 kB Progress (2): 115/798 kB | 151 kB Progress (2): 131/798 kB | 151 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/aws-core/2.20.43/aws-core-2.20.43.jar (151 kB at 1.1 MB/s) 2024-09-12T00:26:36.066 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar 2024-09-12T00:26:36.072 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 147/798 kB Progress (1): 164/798 kB Progress (1): 180/798 kB Progress (1): 197/798 kB Progress (1): 213/798 kB Progress (2): 213/798 kB | 16/30 kB Progress (2): 229/798 kB | 16/30 kB Progress (2): 229/798 kB | 30 kB Progress (2): 246/798 kB | 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/json-utils/2.20.43/json-utils-2.20.43.jar (30 kB at 216 kB/s) 2024-09-12T00:26:36.072 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar 2024-09-12T00:26:36.088 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 256/798 kB Progress (2): 256/798 kB | 16/385 kB Progress (2): 272/798 kB | 16/385 kB Progress (2): 272/798 kB | 32/385 kB Progress (3): 272/798 kB | 32/385 kB | 13 kB Progress (3): 289/798 kB | 32/385 kB | 13 kB Progress (4): 289/798 kB | 32/385 kB | 13 kB | 16/75 kB Progress (4): 289/798 kB | 49/385 kB | 13 kB | 16/75 kB Progress (4): 305/798 kB | 49/385 kB | 13 kB | 16/75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/endpoints-spi/2.20.43/endpoints-spi-2.20.43.jar (13 kB at 85 kB/s) 2024-09-12T00:26:36.088 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 305/798 kB | 49/385 kB | 33/75 kB Progress (3): 305/798 kB | 65/385 kB | 33/75 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar 2024-09-12T00:26:36.090 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 321/798 kB | 65/385 kB | 33/75 kB Progress (3): 321/798 kB | 65/385 kB | 49/75 kB Progress (3): 321/798 kB | 81/385 kB | 49/75 kB Progress (3): 338/798 kB | 81/385 kB | 49/75 kB Progress (3): 338/798 kB | 81/385 kB | 66/75 kB Progress (3): 338/798 kB | 98/385 kB | 66/75 kB Progress (3): 338/798 kB | 98/385 kB | 75 kB Progress (3): 354/798 kB | 98/385 kB | 75 kB Progress (3): 354/798 kB | 114/385 kB | 75 kB Progress (3): 370/798 kB | 114/385 kB | 75 kB Progress (3): 370/798 kB | 130/385 kB | 75 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/apache-client/2.20.43/apache-client-2.20.43.jar (75 kB at 478 kB/s) 2024-09-12T00:26:36.090 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar 2024-09-12T00:26:36.094 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 387/798 kB | 130/385 kB Progress (2): 387/798 kB | 147/385 kB Progress (2): 403/798 kB | 147/385 kB Progress (2): 403/798 kB | 163/385 kB Progress (2): 420/798 kB | 163/385 kB Progress (2): 420/798 kB | 180/385 kB Progress (2): 436/798 kB | 180/385 kB Progress (2): 436/798 kB | 196/385 kB Progress (2): 436/798 kB | 212/385 kB Progress (2): 452/798 kB | 212/385 kB Progress (2): 452/798 kB | 229/385 kB Progress (2): 469/798 kB | 229/385 kB Progress (2): 475/798 kB | 229/385 kB Progress (2): 475/798 kB | 245/385 kB Progress (2): 491/798 kB | 245/385 kB Progress (2): 491/798 kB | 262/385 kB Progress (2): 508/798 kB | 262/385 kB Progress (2): 508/798 kB | 278/385 kB Progress (2): 524/798 kB | 278/385 kB Progress (2): 524/798 kB | 294/385 kB Progress (2): 541/798 kB | 294/385 kB Progress (2): 541/798 kB | 311/385 kB Progress (2): 557/798 kB | 311/385 kB Progress (2): 557/798 kB | 327/385 kB Progress (2): 573/798 kB | 327/385 kB Progress (2): 573/798 kB | 343/385 kB Progress (2): 590/798 kB | 343/385 kB Progress (2): 590/798 kB | 360/385 kB Progress (2): 606/798 kB | 360/385 kB Progress (2): 606/798 kB | 376/385 kB Progress (2): 606/798 kB | 385 kB Progress (2): 623/798 kB | 385 kB Progress (2): 639/798 kB | 385 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/third-party-jackson-core/2.20.43/third-party-jackson-core-2.20.43.jar (385 kB at 2.4 MB/s) 2024-09-12T00:26:36.095 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar 2024-09-12T00:26:36.100 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 655/798 kB Progress (1): 672/798 kB Progress (1): 688/798 kB Progress (1): 704/798 kB Progress (1): 721/798 kB Progress (1): 731/798 kB Progress (1): 747/798 kB Progress (1): 764/798 kB Progress (1): 780/798 kB Progress (1): 796/798 kB Progress (1): 798 kB Downloaded from central: https://repo.maven.apache.org/maven2/software/amazon/awssdk/regions/2.20.43/regions-2.20.43.jar (798 kB at 4.8 MB/s) 2024-09-12T00:26:36.100 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar 2024-09-12T00:26:36.118 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/780 kB Progress (1): 32/780 kB Progress (2): 32/780 kB | 16/329 kB Progress (2): 32/780 kB | 32/329 kB Progress (2): 32/780 kB | 49/329 kB Progress (2): 49/780 kB | 49/329 kB Progress (2): 49/780 kB | 65/329 kB Progress (2): 49/780 kB | 81/329 kB Progress (2): 49/780 kB | 98/329 kB Progress (2): 49/780 kB | 114/329 kB Progress (2): 49/780 kB | 130/329 kB Progress (2): 49/780 kB | 147/329 kB Progress (2): 49/780 kB | 163/329 kB Progress (2): 65/780 kB | 163/329 kB Progress (2): 65/780 kB | 180/329 kB Progress (2): 65/780 kB | 196/329 kB Progress (2): 65/780 kB | 212/329 kB Progress (3): 65/780 kB | 212/329 kB | 16/501 kB Progress (3): 65/780 kB | 229/329 kB | 16/501 kB Progress (3): 65/780 kB | 229/329 kB | 33/501 kB Progress (4): 65/780 kB | 229/329 kB | 33/501 kB | 16/354 kB Progress (4): 65/780 kB | 245/329 kB | 33/501 kB | 16/354 kB Progress (4): 65/780 kB | 245/329 kB | 49/501 kB | 16/354 kB Progress (4): 65/780 kB | 245/329 kB | 49/501 kB | 33/354 kB Progress (4): 65/780 kB | 262/329 kB | 49/501 kB | 33/354 kB Progress (4): 65/780 kB | 262/329 kB | 49/501 kB | 49/354 kB Progress (4): 65/780 kB | 262/329 kB | 66/501 kB | 49/354 kB Progress (4): 65/780 kB | 278/329 kB | 66/501 kB | 49/354 kB Progress (4): 65/780 kB | 278/329 kB | 66/501 kB | 66/354 kB Progress (4): 65/780 kB | 294/329 kB | 66/501 kB | 66/354 kB Progress (4): 65/780 kB | 294/329 kB | 82/501 kB | 66/354 kB Progress (4): 65/780 kB | 294/329 kB | 82/501 kB | 82/354 kB Progress (4): 65/780 kB | 311/329 kB | 82/501 kB | 82/354 kB Progress (4): 65/780 kB | 311/329 kB | 98/501 kB | 82/354 kB Progress (4): 65/780 kB | 311/329 kB | 98/501 kB | 98/354 kB Progress (4): 65/780 kB | 311/329 kB | 98/501 kB | 115/354 kB Progress (4): 65/780 kB | 311/329 kB | 115/501 kB | 115/354 kB Progress (4): 65/780 kB | 311/329 kB | 115/501 kB | 131/354 kB Progress (4): 65/780 kB | 311/329 kB | 131/501 kB | 131/354 kB Progress (4): 65/780 kB | 311/329 kB | 131/501 kB | 147/354 kB Progress (4): 65/780 kB | 311/329 kB | 147/501 kB | 147/354 kB Progress (4): 65/780 kB | 311/329 kB | 147/501 kB | 164/354 kB Progress (4): 65/780 kB | 311/329 kB | 147/501 kB | 180/354 kB Progress (4): 65/780 kB | 311/329 kB | 164/501 kB | 180/354 kB Progress (4): 65/780 kB | 311/329 kB | 164/501 kB | 197/354 kB Progress (4): 65/780 kB | 311/329 kB | 180/501 kB | 197/354 kB Progress (4): 65/780 kB | 311/329 kB | 180/501 kB | 213/354 kB Progress (4): 65/780 kB | 311/329 kB | 197/501 kB | 213/354 kB Progress (4): 65/780 kB | 311/329 kB | 197/501 kB | 229/354 kB Progress (4): 65/780 kB | 311/329 kB | 197/501 kB | 246/354 kB Progress (4): 65/780 kB | 311/329 kB | 213/501 kB | 246/354 kB Progress (4): 65/780 kB | 311/329 kB | 213/501 kB | 262/354 kB Progress (4): 65/780 kB | 311/329 kB | 229/501 kB | 262/354 kB Progress (4): 65/780 kB | 311/329 kB | 229/501 kB | 279/354 kB Progress (4): 65/780 kB | 311/329 kB | 229/501 kB | 295/354 kB Progress (4): 81/780 kB | 311/329 kB | 229/501 kB | 295/354 kB Progress (4): 81/780 kB | 311/329 kB | 246/501 kB | 295/354 kB Progress (4): 81/780 kB | 311/329 kB | 246/501 kB | 311/354 kB Progress (4): 81/780 kB | 311/329 kB | 256/501 kB | 311/354 kB Progress (4): 81/780 kB | 311/329 kB | 256/501 kB | 328/354 kB Progress (4): 81/780 kB | 311/329 kB | 272/501 kB | 328/354 kB Progress (4): 81/780 kB | 311/329 kB | 272/501 kB | 344/354 kB Progress (4): 98/780 kB | 311/329 kB | 272/501 kB | 344/354 kB Progress (4): 98/780 kB | 311/329 kB | 272/501 kB | 354 kB Progress (4): 98/780 kB | 311/329 kB | 289/501 kB | 354 kB Progress (4): 114/780 kB | 311/329 kB | 289/501 kB | 354 kB Progress (4): 114/780 kB | 327/329 kB | 289/501 kB | 354 kB Progress (5): 114/780 kB | 327/329 kB | 289/501 kB | 354 kB | 16/41 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-codec/commons-codec/1.15/commons-codec-1.15.jar (354 kB at 1.9 MB/s) 2024-09-12T00:26:36.118 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (4): 114/780 kB | 329 kB | 289/501 kB | 16/41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar 2024-09-12T00:26:36.118 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (4): 114/780 kB | 329 kB | 289/501 kB | 33/41 kB Progress (4): 114/780 kB | 329 kB | 289/501 kB | 41 kB Progress (4): 130/780 kB | 329 kB | 289/501 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpcore/4.4.13/httpcore-4.4.13.jar (329 kB at 1.8 MB/s) 2024-09-12T00:26:36.118 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar 2024-09-12T00:26:36.118 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.28/slf4j-api-1.7.28.jar (41 kB at 223 kB/s) 2024-09-12T00:26:36.118 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar 2024-09-12T00:26:36.124 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 147/780 kB | 289/501 kB Progress (2): 163/780 kB | 289/501 kB Progress (2): 163/780 kB | 305/501 kB Progress (2): 180/780 kB | 305/501 kB Progress (2): 180/780 kB | 321/501 kB Progress (2): 196/780 kB | 321/501 kB Progress (2): 196/780 kB | 338/501 kB Progress (2): 196/780 kB | 354/501 kB Progress (2): 212/780 kB | 354/501 kB Progress (2): 212/780 kB | 370/501 kB Progress (2): 212/780 kB | 387/501 kB Progress (2): 212/780 kB | 403/501 kB Progress (2): 212/780 kB | 420/501 kB Progress (2): 212/780 kB | 436/501 kB Progress (2): 212/780 kB | 452/501 kB Progress (2): 212/780 kB | 469/501 kB Progress (2): 212/780 kB | 485/501 kB Progress (2): 212/780 kB | 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.1/commons-io-2.15.1.jar (501 kB at 2.6 MB/s) 2024-09-12T00:26:36.124 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar 2024-09-12T00:26:36.133 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 229/780 kB Progress (1): 245/780 kB Progress (1): 262/780 kB Progress (1): 278/780 kB Progress (1): 294/780 kB Progress (1): 311/780 kB Progress (1): 327/780 kB Progress (1): 343/780 kB Progress (1): 360/780 kB Progress (1): 376/780 kB Progress (1): 393/780 kB Progress (1): 402/780 kB Progress (2): 402/780 kB | 6.4 kB Progress (2): 418/780 kB | 6.4 kB Progress (2): 435/780 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter/5.10.1/junit-jupiter-5.10.1.jar (6.4 kB at 32 kB/s) 2024-09-12T00:26:36.133 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 451/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar 2024-09-12T00:26:36.139 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 468/780 kB Progress (2): 468/780 kB | 16/586 kB Progress (2): 484/780 kB | 16/586 kB Progress (2): 484/780 kB | 32/586 kB Progress (3): 484/780 kB | 32/586 kB | 16/211 kB Progress (3): 484/780 kB | 49/586 kB | 16/211 kB Progress (3): 500/780 kB | 49/586 kB | 16/211 kB Progress (3): 500/780 kB | 65/586 kB | 16/211 kB Progress (3): 500/780 kB | 65/586 kB | 33/211 kB Progress (3): 500/780 kB | 81/586 kB | 33/211 kB Progress (3): 500/780 kB | 81/586 kB | 37/211 kB Progress (3): 500/780 kB | 98/586 kB | 37/211 kB Progress (3): 517/780 kB | 98/586 kB | 37/211 kB Progress (3): 517/780 kB | 114/586 kB | 37/211 kB Progress (3): 517/780 kB | 114/586 kB | 53/211 kB Progress (3): 517/780 kB | 130/586 kB | 53/211 kB Progress (3): 517/780 kB | 147/586 kB | 53/211 kB Progress (3): 517/780 kB | 147/586 kB | 69/211 kB Progress (3): 517/780 kB | 163/586 kB | 69/211 kB Progress (3): 517/780 kB | 163/586 kB | 86/211 kB Progress (3): 517/780 kB | 180/586 kB | 86/211 kB Progress (3): 517/780 kB | 196/586 kB | 86/211 kB Progress (3): 517/780 kB | 196/586 kB | 102/211 kB Progress (3): 517/780 kB | 212/586 kB | 102/211 kB Progress (3): 517/780 kB | 212/586 kB | 118/211 kB Progress (3): 517/780 kB | 229/586 kB | 118/211 kB Progress (3): 517/780 kB | 245/586 kB | 118/211 kB Progress (3): 533/780 kB | 245/586 kB | 118/211 kB Progress (3): 533/780 kB | 245/586 kB | 135/211 kB Progress (3): 533/780 kB | 262/586 kB | 135/211 kB Progress (3): 533/780 kB | 278/586 kB | 135/211 kB Progress (3): 549/780 kB | 278/586 kB | 135/211 kB Progress (4): 549/780 kB | 278/586 kB | 135/211 kB | 14 kB Progress (4): 549/780 kB | 278/586 kB | 151/211 kB | 14 kB Progress (4): 549/780 kB | 294/586 kB | 151/211 kB | 14 kB Progress (4): 566/780 kB | 294/586 kB | 151/211 kB | 14 kB Progress (4): 566/780 kB | 311/586 kB | 151/211 kB | 14 kB Progress (4): 566/780 kB | 311/586 kB | 168/211 kB | 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.3.0/opentest4j-1.3.0.jar (14 kB at 69 kB/s) 2024-09-12T00:26:36.140 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar 2024-09-12T00:26:36.142 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 582/780 kB | 311/586 kB | 168/211 kB Progress (3): 582/780 kB | 327/586 kB | 168/211 kB Progress (3): 582/780 kB | 327/586 kB | 184/211 kB Progress (3): 582/780 kB | 343/586 kB | 184/211 kB Progress (3): 599/780 kB | 343/586 kB | 184/211 kB Progress (3): 599/780 kB | 360/586 kB | 184/211 kB Progress (3): 599/780 kB | 360/586 kB | 200/211 kB Progress (3): 599/780 kB | 376/586 kB | 200/211 kB Progress (3): 615/780 kB | 376/586 kB | 200/211 kB Progress (3): 615/780 kB | 376/586 kB | 211 kB Progress (3): 615/780 kB | 393/586 kB | 211 kB Progress (3): 615/780 kB | 402/586 kB | 211 kB Progress (3): 631/780 kB | 402/586 kB | 211 kB Progress (3): 631/780 kB | 418/586 kB | 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-api/5.10.1/junit-jupiter-api-5.10.1.jar (211 kB at 1.0 MB/s) 2024-09-12T00:26:36.142 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 648/780 kB | 418/586 kB Progress (2): 648/780 kB | 435/586 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar 2024-09-12T00:26:36.145 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 648/780 kB | 451/586 kB Progress (2): 658/780 kB | 451/586 kB Progress (2): 658/780 kB | 468/586 kB Progress (2): 658/780 kB | 484/586 kB Progress (2): 674/780 kB | 484/586 kB Progress (2): 674/780 kB | 500/586 kB Progress (2): 691/780 kB | 500/586 kB Progress (2): 691/780 kB | 517/586 kB Progress (2): 691/780 kB | 533/586 kB Progress (2): 707/780 kB | 533/586 kB Progress (2): 707/780 kB | 549/586 kB Progress (2): 723/780 kB | 549/586 kB Progress (2): 723/780 kB | 566/586 kB Progress (2): 740/780 kB | 566/586 kB Progress (2): 740/780 kB | 582/586 kB Progress (2): 740/780 kB | 586 kB Progress (2): 756/780 kB | 586 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-params/5.10.1/junit-jupiter-params-5.10.1.jar (586 kB at 2.8 MB/s) 2024-09-12T00:26:36.145 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 772/780 kB Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar 2024-09-12T00:26:36.146 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 780 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/httpcomponents/httpclient/4.5.13/httpclient-4.5.13.jar (780 kB at 3.6 MB/s) 2024-09-12T00:26:36.146 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar 2024-09-12T00:26:36.154 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/106 kB Progress (1): 32/106 kB Progress (1): 49/106 kB Progress (1): 65/106 kB Progress (1): 81/106 kB Progress (1): 98/106 kB Progress (1): 106 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.10.1/junit-platform-commons-1.10.1.jar (106 kB at 483 kB/s) 2024-09-12T00:26:36.154 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:26:36.155 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apiguardian/apiguardian-api/1.1.2/apiguardian-api-1.1.2.jar (6.8 kB at 31 kB/s) 2024-09-12T00:26:36.155 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar 2024-09-12T00:26:36.162 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Progress (2): 15 kB | 16/205 kB Progress (2): 15 kB | 33/205 kB Progress (2): 15 kB | 49/205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-simple/1.7.28/slf4j-simple-1.7.28.jar (15 kB at 67 kB/s) 2024-09-12T00:26:36.162 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar 2024-09-12T00:26:36.164 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 66/205 kB Progress (1): 82/205 kB Progress (1): 98/205 kB Progress (1): 115/205 kB Progress (1): 131/205 kB Progress (1): 147/205 kB Progress (1): 164/205 kB Progress (1): 180/205 kB Progress (1): 197/205 kB Progress (1): 205 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.10.1/junit-platform-engine-1.10.1.jar (205 kB at 891 kB/s) 2024-09-12T00:26:36.164 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar 2024-09-12T00:26:36.169 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/245 kB Progress (1): 32/245 kB Progress (1): 49/245 kB Progress (1): 65/245 kB Progress (1): 81/245 kB Progress (1): 98/245 kB Progress (1): 114/245 kB Progress (1): 130/245 kB Progress (1): 147/245 kB Progress (1): 163/245 kB Progress (2): 163/245 kB | 6.4 kB Progress (2): 180/245 kB | 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite/1.10.1/junit-platform-suite-1.10.1.jar (6.4 kB at 27 kB/s) 2024-09-12T00:26:36.169 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar 2024-09-12T00:26:36.171 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 196/245 kB Progress (1): 212/245 kB Progress (1): 229/245 kB Progress (2): 229/245 kB | 16/16 kB Progress (2): 245 kB | 16/16 kB Progress (2): 245 kB | 16 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/jcl-over-slf4j/1.7.28/jcl-over-slf4j-1.7.28.jar (16 kB at 69 kB/s) 2024-09-12T00:26:36.171 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar 2024-09-12T00:26:36.171 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/jupiter/junit-jupiter-engine/5.10.1/junit-jupiter-engine-5.10.1.jar (245 kB at 1.0 MB/s) 2024-09-12T00:26:36.177 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-api/1.10.1/junit-platform-suite-api-1.10.1.jar (23 kB at 93 kB/s) 2024-09-12T00:26:36.182 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/24 kB Progress (1): 24 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-engine/1.10.1/junit-platform-suite-engine-1.10.1.jar (24 kB at 97 kB/s) 2024-09-12T00:26:36.195 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/184 kB Progress (1): 32/184 kB Progress (1): 49/184 kB Progress (1): 65/184 kB Progress (1): 81/184 kB Progress (1): 98/184 kB Progress (1): 114/184 kB Progress (1): 130/184 kB Progress (1): 147/184 kB Progress (1): 163/184 kB Progress (1): 180/184 kB Progress (1): 184 kB Progress (2): 184 kB | 16/17 kB Progress (2): 184 kB | 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.10.1/junit-platform-launcher-1.10.1.jar (184 kB at 702 kB/s) 2024-09-12T00:26:36.195 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-suite-commons/1.10.1/junit-platform-suite-commons-1.10.1.jar (17 kB at 66 kB/s) 2024-09-12T00:26:36.220 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:36.220 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- clean:3.2.0:clean (default-clean) @ jcksum --- 2024-09-12T00:26:36.228 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom 2024-09-12T00:26:36.245 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.pom (5.8 kB at 343 kB/s) 2024-09-12T00:26:36.248 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom 2024-09-12T00:26:36.263 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/34/maven-shared-components-34.pom (5.1 kB at 340 kB/s) 2024-09-12T00:26:36.266 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom 2024-09-12T00:26:36.283 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/43 kB Progress (1): 32/43 kB Progress (1): 43 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/34/maven-parent-34.pom (43 kB at 2.5 MB/s) 2024-09-12T00:26:36.288 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom 2024-09-12T00:26:36.304 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.pom (14 kB at 839 kB/s) 2024-09-12T00:26:36.311 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar 2024-09-12T00:26:36.334 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/153 kB Progress (1): 32/153 kB Progress (1): 49/153 kB Progress (1): 65/153 kB Progress (1): 81/153 kB Progress (1): 98/153 kB Progress (1): 114/153 kB Progress (1): 130/153 kB Progress (1): 147/153 kB Progress (1): 153 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-utils/3.3.4/maven-shared-utils-3.3.4.jar (153 kB at 6.4 MB/s) 2024-09-12T00:26:36.334 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar 2024-09-12T00:26:36.355 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/215 kB Progress (1): 32/215 kB Progress (1): 49/215 kB Progress (1): 65/215 kB Progress (1): 79/215 kB Progress (1): 96/215 kB Progress (1): 112/215 kB Progress (1): 128/215 kB Progress (1): 145/215 kB Progress (1): 161/215 kB Progress (1): 178/215 kB Progress (1): 194/215 kB Progress (1): 210/215 kB Progress (1): 215 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.6/commons-io-2.6.jar (215 kB at 11 MB/s) 2024-09-12T00:26:36.459 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:36.460 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:26:36.466 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom 2024-09-12T00:26:36.482 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.pom (2.7 kB at 166 kB/s) 2024-09-12T00:26:36.485 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom 2024-09-12T00:26:36.504 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/5.1/plexus-5.1.pom (23 kB at 1.2 MB/s) 2024-09-12T00:26:36.509 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom 2024-09-12T00:26:36.530 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.pom (8.8 kB at 418 kB/s) 2024-09-12T00:26:36.534 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom 2024-09-12T00:26:36.552 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/10/plexus-10.pom (25 kB at 1.5 MB/s) 2024-09-12T00:26:36.557 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom 2024-09-12T00:26:36.577 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.pom (6.0 kB at 318 kB/s) 2024-09-12T00:26:36.580 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom 2024-09-12T00:26:36.599 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/39/maven-shared-components-39.pom (3.2 kB at 169 kB/s) 2024-09-12T00:26:36.605 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom 2024-09-12T00:26:36.620 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 612 B Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.pom (612 B at 41 kB/s) 2024-09-12T00:26:36.624 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom 2024-09-12T00:26:36.639 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.pom (2.7 kB at 183 kB/s) 2024-09-12T00:26:36.642 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom 2024-09-12T00:26:36.658 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-parent/1.7.36/slf4j-parent-1.7.36.pom (14 kB at 881 kB/s) 2024-09-12T00:26:36.662 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom 2024-09-12T00:26:36.677 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.pom (3.2 kB at 214 kB/s) 2024-09-12T00:26:36.680 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom 2024-09-12T00:26:36.695 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/15/spice-parent-15.pom (8.4 kB at 557 kB/s) 2024-09-12T00:26:36.698 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom 2024-09-12T00:26:36.713 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/5/forge-parent-5.pom (8.4 kB at 523 kB/s) 2024-09-12T00:26:36.718 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom 2024-09-12T00:26:36.735 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.pom (8.0 kB at 471 kB/s) 2024-09-12T00:26:36.740 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom 2024-09-12T00:26:36.756 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.pom (20 kB at 1.2 MB/s) 2024-09-12T00:26:36.765 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom 2024-09-12T00:26:36.781 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.2/junit-bom-5.7.2.pom (5.1 kB at 319 kB/s) 2024-09-12T00:26:36.786 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom 2024-09-12T00:26:36.803 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/31 kB Progress (1): 31 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.pom (31 kB at 1.7 MB/s) 2024-09-12T00:26:36.814 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom 2024-09-12T00:26:36.830 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.7.1/junit-bom-5.7.1.pom (5.1 kB at 319 kB/s) 2024-09-12T00:26:36.839 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar 2024-09-12T00:26:36.862 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/85 kB Progress (1): 33/85 kB Progress (1): 49/85 kB Progress (1): 66/85 kB Progress (1): 82/85 kB Progress (1): 85 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.26/plexus-interpolation-1.26.jar (85 kB at 3.6 MB/s) 2024-09-12T00:26:36.863 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar 2024-09-12T00:26:36.863 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar 2024-09-12T00:26:36.864 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar 2024-09-12T00:26:36.864 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar 2024-09-12T00:26:36.865 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar 2024-09-12T00:26:36.879 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/inject/javax.inject/1/javax.inject-1.jar (2.5 kB at 166 kB/s) 2024-09-12T00:26:36.879 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar 2024-09-12T00:26:36.881 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 8.5 kB Progress (3): 16/55 kB | 8.5 kB | 16/41 kB Progress (3): 32/55 kB | 8.5 kB | 16/41 kB Progress (3): 32/55 kB | 8.5 kB | 33/41 kB Progress (3): 49/55 kB | 8.5 kB | 33/41 kB Progress (3): 49/55 kB | 8.5 kB | 41 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-build-api/0.0.7/plexus-build-api-0.0.7.jar (8.5 kB at 530 kB/s) 2024-09-12T00:26:36.881 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 55 kB | 41 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar 2024-09-12T00:26:36.882 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 55 kB | 41 kB | 16/269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/slf4j/slf4j-api/1.7.36/slf4j-api-1.7.36.jar (41 kB at 2.3 MB/s) 2024-09-12T00:26:36.882 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-filtering/3.3.1/maven-filtering-3.3.1.jar (55 kB at 2.9 MB/s) 2024-09-12T00:26:36.888 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 33/269 kB Progress (1): 49/269 kB Progress (1): 66/269 kB Progress (1): 82/269 kB Progress (1): 98/269 kB Progress (1): 115/269 kB Progress (1): 131/269 kB Progress (1): 147/269 kB Progress (1): 164/269 kB Progress (1): 180/269 kB Progress (1): 197/269 kB Progress (1): 213/269 kB Progress (1): 229/269 kB Progress (1): 246/269 kB Progress (1): 256/269 kB Progress (1): 269 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.1/plexus-utils-3.5.1.jar (269 kB at 11 MB/s) 2024-09-12T00:26:36.900 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/327 kB Progress (1): 33/327 kB Progress (1): 49/327 kB Progress (1): 64/327 kB Progress (1): 81/327 kB Progress (1): 97/327 kB Progress (1): 114/327 kB Progress (1): 130/327 kB Progress (1): 146/327 kB Progress (1): 163/327 kB Progress (1): 179/327 kB Progress (1): 195/327 kB Progress (1): 212/327 kB Progress (1): 224/327 kB Progress (1): 241/327 kB Progress (2): 241/327 kB | 16/587 kB Progress (2): 257/327 kB | 16/587 kB Progress (2): 261/327 kB | 16/587 kB Progress (2): 277/327 kB | 16/587 kB Progress (2): 277/327 kB | 32/587 kB Progress (2): 294/327 kB | 32/587 kB Progress (2): 294/327 kB | 49/587 kB Progress (2): 310/327 kB | 49/587 kB Progress (2): 327/327 kB | 49/587 kB Progress (2): 327 kB | 49/587 kB Progress (2): 327 kB | 65/587 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.11.0/commons-io-2.11.0.jar (327 kB at 9.1 MB/s) 2024-09-12T00:26:36.918 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 81/587 kB Progress (1): 98/587 kB Progress (1): 114/587 kB Progress (1): 130/587 kB Progress (1): 147/587 kB Progress (1): 163/587 kB Progress (1): 180/587 kB Progress (1): 196/587 kB Progress (1): 212/587 kB Progress (1): 229/587 kB Progress (1): 245/587 kB Progress (1): 262/587 kB Progress (1): 278/587 kB Progress (1): 294/587 kB Progress (1): 311/587 kB Progress (1): 327/587 kB Progress (1): 343/587 kB Progress (1): 360/587 kB Progress (1): 376/587 kB Progress (1): 393/587 kB Progress (1): 402/587 kB Progress (1): 418/587 kB Progress (1): 435/587 kB Progress (1): 451/587 kB Progress (1): 468/587 kB Progress (1): 484/587 kB Progress (1): 500/587 kB Progress (1): 517/587 kB Progress (1): 533/587 kB Progress (1): 549/587 kB Progress (1): 566/587 kB Progress (1): 582/587 kB Progress (1): 587 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-lang3/3.12.0/commons-lang3-3.12.0.jar (587 kB at 11 MB/s) 2024-09-12T00:26:36.963 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:26:36.963 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:36.963 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:26:36.968 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom 2024-09-12T00:26:36.983 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.pom (4.7 kB at 316 kB/s) 2024-09-12T00:26:36.986 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom 2024-09-12T00:26:37.002 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/19/maven-shared-components-19.pom (6.4 kB at 397 kB/s) 2024-09-12T00:26:37.004 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom 2024-09-12T00:26:37.019 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/33 kB Progress (1): 33 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/23/maven-parent-23.pom (33 kB at 2.3 MB/s) 2024-09-12T00:26:37.022 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom 2024-09-12T00:26:37.038 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/13/apache-13.pom (14 kB at 822 kB/s) 2024-09-12T00:26:37.042 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom 2024-09-12T00:26:37.080 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 815 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.pom (815 B at 21 kB/s) 2024-09-12T00:26:37.082 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom 2024-09-12T00:26:37.099 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/1.5.5/plexus-containers-1.5.5.pom (4.2 kB at 249 kB/s) 2024-09-12T00:26:37.102 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom 2024-09-12T00:26:37.118 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/2.0.7/plexus-2.0.7.pom (17 kB at 1.0 MB/s) 2024-09-12T00:26:37.123 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom 2024-09-12T00:26:37.140 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.pom (5.0 kB at 292 kB/s) 2024-09-12T00:26:37.143 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom 2024-09-12T00:26:37.160 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.1.2/plexus-languages-1.1.2.pom (4.1 kB at 244 kB/s) 2024-09-12T00:26:37.165 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom 2024-09-12T00:26:37.182 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.pom (2.4 kB at 148 kB/s) 2024-09-12T00:26:37.185 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom 2024-09-12T00:26:37.202 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/ow2/1.5.1/ow2-1.5.1.pom (11 kB at 664 kB/s) 2024-09-12T00:26:37.206 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom 2024-09-12T00:26:37.226 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.pom (17 kB at 821 kB/s) 2024-09-12T00:26:37.232 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom 2024-09-12T00:26:37.250 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/9/oss-parent-9.pom (6.6 kB at 386 kB/s) 2024-09-12T00:26:37.253 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom 2024-09-12T00:26:37.270 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.pom (1.1 kB at 62 kB/s) 2024-09-12T00:26:37.274 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom 2024-09-12T00:26:37.294 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler/2.13.0/plexus-compiler-2.13.0.pom (8.4 kB at 419 kB/s) 2024-09-12T00:26:37.298 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom 2024-09-12T00:26:37.314 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/10.0/plexus-components-10.0.pom (2.7 kB at 158 kB/s) 2024-09-12T00:26:37.320 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom 2024-09-12T00:26:37.339 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.9.1/junit-bom-5.9.1.pom (5.6 kB at 282 kB/s) 2024-09-12T00:26:37.345 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom 2024-09-12T00:26:37.367 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.pom (1.1 kB at 49 kB/s) 2024-09-12T00:26:37.374 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom 2024-09-12T00:26:37.392 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 770 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.1/plexus-component-annotations-2.1.1.pom (770 B at 43 kB/s) 2024-09-12T00:26:37.395 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom 2024-09-12T00:26:37.412 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.1/plexus-containers-2.1.1.pom (6.0 kB at 377 kB/s) 2024-09-12T00:26:37.416 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom 2024-09-12T00:26:37.434 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/26 kB Progress (1): 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/6.5/plexus-6.5.pom (26 kB at 1.4 MB/s) 2024-09-12T00:26:37.441 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom 2024-09-12T00:26:37.460 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.pom (1.2 kB at 60 kB/s) 2024-09-12T00:26:37.464 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom 2024-09-12T00:26:37.481 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compilers/2.13.0/plexus-compilers-2.13.0.pom (1.3 kB at 78 kB/s) 2024-09-12T00:26:37.500 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar 2024-09-12T00:26:37.519 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-incremental/1.1/maven-shared-incremental-1.1.jar (14 kB at 713 kB/s) 2024-09-12T00:26:37.519 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar 2024-09-12T00:26:37.520 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar 2024-09-12T00:26:37.520 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar 2024-09-12T00:26:37.520 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar 2024-09-12T00:26:37.520 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar 2024-09-12T00:26:37.535 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/55 kB Progress (2): 16/55 kB | 4.2 kB Progress (2): 33/55 kB | 4.2 kB Progress (2): 49/55 kB | 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/1.5.5/plexus-component-annotations-1.5.5.jar (4.2 kB at 263 kB/s) 2024-09-12T00:26:37.535 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar 2024-09-12T00:26:37.536 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 55 kB Progress (2): 55 kB | 16/27 kB Progress (2): 55 kB | 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.1.2/plexus-java-1.1.2.jar (55 kB at 3.4 MB/s) 2024-09-12T00:26:37.537 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar 2024-09-12T00:26:37.539 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 27 kB | 16/334 kB Progress (2): 27 kB | 20/334 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-api/2.13.0/plexus-compiler-api-2.13.0.jar (27 kB at 1.7 MB/s) 2024-09-12T00:26:37.539 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar 2024-09-12T00:26:37.540 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 37/334 kB Progress (1): 53/334 kB Progress (1): 69/334 kB Progress (2): 69/334 kB | 16/122 kB Progress (2): 86/334 kB | 16/122 kB Progress (2): 102/334 kB | 16/122 kB Progress (2): 102/334 kB | 32/122 kB Progress (2): 119/334 kB | 32/122 kB Progress (2): 119/334 kB | 49/122 kB Progress (2): 135/334 kB | 49/122 kB Progress (2): 135/334 kB | 65/122 kB Progress (2): 151/334 kB | 65/122 kB Progress (2): 151/334 kB | 81/122 kB Progress (2): 168/334 kB | 81/122 kB Progress (2): 168/334 kB | 98/122 kB Progress (2): 184/334 kB | 98/122 kB Progress (2): 184/334 kB | 114/122 kB Progress (2): 200/334 kB | 114/122 kB Progress (2): 200/334 kB | 122 kB Progress (2): 217/334 kB | 122 kB Progress (2): 233/334 kB | 122 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.4/asm-9.4.jar (122 kB at 5.8 MB/s) 2024-09-12T00:26:37.543 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 250/334 kB Progress (1): 266/334 kB Progress (1): 282/334 kB Progress (1): 299/334 kB Progress (1): 315/334 kB Progress (1): 332/334 kB Progress (1): 334 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/thoughtworks/qdox/qdox/2.0.3/qdox-2.0.3.jar (334 kB at 15 MB/s) 2024-09-12T00:26:37.550 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-javac/2.13.0/plexus-compiler-javac-2.13.0.jar (23 kB at 786 kB/s) 2024-09-12T00:26:37.551 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.7 kB Progress (2): 4.7 kB | 16/267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-compiler-manager/2.13.0/plexus-compiler-manager-2.13.0.jar (4.7 kB at 155 kB/s) 2024-09-12T00:26:37.556 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 33/267 kB Progress (1): 49/267 kB Progress (1): 66/267 kB Progress (1): 82/267 kB Progress (1): 98/267 kB Progress (1): 115/267 kB Progress (1): 131/267 kB Progress (1): 147/267 kB Progress (1): 164/267 kB Progress (1): 180/267 kB Progress (1): 197/267 kB Progress (1): 213/267 kB Progress (1): 229/267 kB Progress (1): 246/267 kB Progress (1): 262/267 kB Progress (1): 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.5.0/plexus-utils-3.5.0.jar (267 kB at 7.6 MB/s) 2024-09-12T00:26:37.675 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Changes detected - recompiling the module! :source 2024-09-12T00:26:37.677 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/classes 2024-09-12T00:26:39.140 INFO:tasks.workunit.client.0.smithi078.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:26:39.140 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:39.140 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:26:39.144 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:26:39.144 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:39.144 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:26:39.152 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Changes detected - recompiling the module! :dependency 2024-09-12T00:26:39.152 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Compiling 1 source file with javac [debug target 1.9] to target/test-classes 2024-09-12T00:26:39.393 INFO:tasks.workunit.client.0.smithi078.stdout:[WARNING] bootstrap class path not set in conjunction with -source 9 2024-09-12T00:26:39.393 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:39.393 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:26:39.398 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom 2024-09-12T00:26:39.454 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.pom (6.2 kB at 113 kB/s) 2024-09-12T00:26:39.457 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom 2024-09-12T00:26:39.476 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.pom (3.5 kB at 176 kB/s) 2024-09-12T00:26:39.482 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom 2024-09-12T00:26:39.498 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.pom (3.3 kB at 204 kB/s) 2024-09-12T00:26:39.503 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom 2024-09-12T00:26:39.520 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.pom (4.1 kB at 254 kB/s) 2024-09-12T00:26:39.524 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom 2024-09-12T00:26:39.541 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.pom (3.3 kB at 184 kB/s) 2024-09-12T00:26:39.546 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom 2024-09-12T00:26:39.562 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.pom (4.5 kB at 262 kB/s) 2024-09-12T00:26:39.566 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom 2024-09-12T00:26:39.583 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.pom (1.8 kB at 104 kB/s) 2024-09-12T00:26:39.587 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom 2024-09-12T00:26:39.605 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.pom (2.2 kB at 129 kB/s) 2024-09-12T00:26:39.607 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom 2024-09-12T00:26:39.622 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/30 kB Progress (1): 30 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether/1.0.0.v20140518/aether-1.0.0.v20140518.pom (30 kB at 1.9 MB/s) 2024-09-12T00:26:39.625 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom 2024-09-12T00:26:39.639 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.pom (1.9 kB at 126 kB/s) 2024-09-12T00:26:39.642 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom 2024-09-12T00:26:39.657 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.pom (5.8 kB at 414 kB/s) 2024-09-12T00:26:39.660 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom 2024-09-12T00:26:39.675 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-artifact/3.2.5/maven-artifact-3.2.5.pom (2.3 kB at 157 kB/s) 2024-09-12T00:26:39.677 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom 2024-09-12T00:26:39.691 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven/3.2.5/maven-3.2.5.pom (22 kB at 1.5 MB/s) 2024-09-12T00:26:39.694 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom 2024-09-12T00:26:39.708 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/37 kB Progress (1): 33/37 kB Progress (1): 37 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/25/maven-parent-25.pom (37 kB at 2.5 MB/s) 2024-09-12T00:26:39.712 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom 2024-09-12T00:26:39.727 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/15/apache-15.pom (15 kB at 1.0 MB/s) 2024-09-12T00:26:39.730 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom 2024-09-12T00:26:39.750 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/4.0.0/plexus-utils-4.0.0.pom (8.7 kB at 456 kB/s) 2024-09-12T00:26:39.752 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom 2024-09-12T00:26:39.769 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/13/plexus-13.pom (27 kB at 1.6 MB/s) 2024-09-12T00:26:39.774 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom 2024-09-12T00:26:39.789 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-core/3.2.5/maven-core-3.2.5.pom (8.1 kB at 538 kB/s) 2024-09-12T00:26:39.792 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom 2024-09-12T00:26:39.807 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings/3.2.5/maven-settings-3.2.5.pom (2.2 kB at 155 kB/s) 2024-09-12T00:26:39.810 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom 2024-09-12T00:26:39.825 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-settings-builder/3.2.5/maven-settings-builder-3.2.5.pom (2.6 kB at 185 kB/s) 2024-09-12T00:26:39.828 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom 2024-09-12T00:26:39.843 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-interpolation/1.21/plexus-interpolation-1.21.pom (1.5 kB at 96 kB/s) 2024-09-12T00:26:39.845 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom 2024-09-12T00:26:39.859 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-components/1.3.1/plexus-components-1.3.1.pom (3.1 kB at 219 kB/s) 2024-09-12T00:26:39.860 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom 2024-09-12T00:26:39.879 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/3.3.1/plexus-3.3.1.pom (20 kB at 1.1 MB/s) 2024-09-12T00:26:39.882 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom 2024-09-12T00:26:39.897 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/17/spice-parent-17.pom (6.8 kB at 422 kB/s) 2024-09-12T00:26:39.900 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom 2024-09-12T00:26:39.916 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/10/forge-parent-10.pom (14 kB at 848 kB/s) 2024-09-12T00:26:39.918 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom 2024-09-12T00:26:39.933 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-sec-dispatcher/1.3/plexus-sec-dispatcher-1.3.pom (3.0 kB at 212 kB/s) 2024-09-12T00:26:39.935 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom 2024-09-12T00:26:39.958 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/spice/spice-parent/12/spice-parent-12.pom (6.8 kB at 296 kB/s) 2024-09-12T00:26:39.960 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom 2024-09-12T00:26:39.974 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/4/forge-parent-4.pom (8.4 kB at 560 kB/s) 2024-09-12T00:26:39.977 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom 2024-09-12T00:26:39.991 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/plexus/plexus-cipher/1.4/plexus-cipher-1.4.pom (2.1 kB at 138 kB/s) 2024-09-12T00:26:39.994 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom 2024-09-12T00:26:40.009 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-repository-metadata/3.2.5/maven-repository-metadata-3.2.5.pom (2.2 kB at 149 kB/s) 2024-09-12T00:26:40.012 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom 2024-09-12T00:26:40.026 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-plugin-api/3.2.5/maven-plugin-api-3.2.5.pom (3.0 kB at 216 kB/s) 2024-09-12T00:26:40.030 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom 2024-09-12T00:26:40.052 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.plexus/0.9.0.M2/org.eclipse.sisu.plexus-0.9.0.M2.pom (15 kB at 680 kB/s) 2024-09-12T00:26:40.054 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom 2024-09-12T00:26:40.079 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-plexus/0.9.0.M2/sisu-plexus-0.9.0.M2.pom (15 kB at 580 kB/s) 2024-09-12T00:26:40.081 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom 2024-09-12T00:26:40.104 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/annotation/javax.annotation-api/1.2/javax.annotation-api-1.2.pom (13 kB at 584 kB/s) 2024-09-12T00:26:40.106 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom 2024-09-12T00:26:40.126 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/net/java/jvnet-parent/3/jvnet-parent-3.pom (4.8 kB at 228 kB/s) 2024-09-12T00:26:40.129 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom 2024-09-12T00:26:40.146 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/javax/enterprise/cdi-api/1.2/cdi-api-1.2.pom (6.3 kB at 349 kB/s) 2024-09-12T00:26:40.149 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom 2024-09-12T00:26:40.168 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/32 kB Progress (1): 32/32 kB Progress (1): 32 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/jboss/weld/weld-parent/26/weld-parent-26.pom (32 kB at 1.7 MB/s) 2024-09-12T00:26:40.172 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom 2024-09-12T00:26:40.192 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/17 kB Progress (1): 17 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/org.eclipse.sisu.inject/0.9.0.M2/org.eclipse.sisu.inject-0.9.0.M2.pom (17 kB at 867 kB/s) 2024-09-12T00:26:40.194 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom 2024-09-12T00:26:40.217 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/sisu/sisu-inject/0.9.0.M2/sisu-inject-0.9.0.M2.pom (15 kB at 673 kB/s) 2024-09-12T00:26:40.220 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom 2024-09-12T00:26:40.236 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 750 B Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-component-annotations/2.1.0/plexus-component-annotations-2.1.0.pom (750 B at 47 kB/s) 2024-09-12T00:26:40.244 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom 2024-09-12T00:26:40.263 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-containers/2.1.0/plexus-containers-2.1.0.pom (4.8 kB at 192 kB/s) 2024-09-12T00:26:40.268 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom 2024-09-12T00:26:40.285 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.6.0/plexus-classworlds-2.6.0.pom (7.9 kB at 494 kB/s) 2024-09-12T00:26:40.290 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom 2024-09-12T00:26:40.307 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-model-builder/3.2.5/maven-model-builder-3.2.5.pom (3.0 kB at 176 kB/s) 2024-09-12T00:26:40.313 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom 2024-09-12T00:26:40.330 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-aether-provider/3.2.5/maven-aether-provider-3.2.5.pom (4.2 kB at 250 kB/s) 2024-09-12T00:26:40.336 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom 2024-09-12T00:26:40.353 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-spi/1.0.0.v20140518/aether-spi-1.0.0.v20140518.pom (2.1 kB at 128 kB/s) 2024-09-12T00:26:40.358 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom 2024-09-12T00:26:40.373 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-impl/1.0.0.v20140518/aether-impl-1.0.0.v20140518.pom (3.5 kB at 217 kB/s) 2024-09-12T00:26:40.379 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom 2024-09-12T00:26:40.395 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 11 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/sisu-guice/3.2.3/sisu-guice-3.2.3.pom (11 kB at 729 kB/s) 2024-09-12T00:26:40.399 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom 2024-09-12T00:26:40.415 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 13 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/sisu/inject/guice-parent/3.2.3/guice-parent-3.2.3.pom (13 kB at 793 kB/s) 2024-09-12T00:26:40.419 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom 2024-09-12T00:26:40.435 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/19 kB Progress (1): 19 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/forge/forge-parent/38/forge-parent-38.pom (19 kB at 1.2 MB/s) 2024-09-12T00:26:40.440 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom 2024-09-12T00:26:40.456 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 363 B Downloaded from central: https://repo.maven.apache.org/maven2/aopalliance/aopalliance/1.0/aopalliance-1.0.pom (363 B at 23 kB/s) 2024-09-12T00:26:40.460 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom 2024-09-12T00:26:40.476 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.1 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava/16.0.1/guava-16.0.1.pom (6.1 kB at 381 kB/s) 2024-09-12T00:26:40.479 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom 2024-09-12T00:26:40.495 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/com/google/guava/guava-parent/16.0.1/guava-parent-16.0.1.pom (7.3 kB at 489 kB/s) 2024-09-12T00:26:40.499 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom 2024-09-12T00:26:40.515 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/sonatype/oss/oss-parent/7/oss-parent-7.pom (4.8 kB at 322 kB/s) 2024-09-12T00:26:40.520 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom 2024-09-12T00:26:40.537 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 7.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-classworlds/2.5.2/plexus-classworlds-2.5.2.pom (7.3 kB at 430 kB/s) 2024-09-12T00:26:40.543 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom 2024-09-12T00:26:40.561 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/22 kB Progress (1): 22 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.pom (22 kB at 1.1 MB/s) 2024-09-12T00:26:40.566 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom 2024-09-12T00:26:40.584 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/78 kB Progress (1): 33/78 kB Progress (1): 49/78 kB Progress (1): 66/78 kB Progress (1): 78 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-parent/64/commons-parent-64.pom (78 kB at 4.3 MB/s) 2024-09-12T00:26:40.591 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom 2024-09-12T00:26:40.607 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/23 kB Progress (1): 23 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/30/apache-30.pom (23 kB at 1.5 MB/s) 2024-09-12T00:26:40.614 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom 2024-09-12T00:26:40.631 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/junit-bom/5.10.0/junit-bom-5.10.0.pom (5.6 kB at 314 kB/s) 2024-09-12T00:26:40.636 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom 2024-09-12T00:26:40.654 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.pom (4.3 kB at 225 kB/s) 2024-09-12T00:26:40.658 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom 2024-09-12T00:26:40.674 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-languages/1.2.0/plexus-languages-1.2.0.pom (3.2 kB at 200 kB/s) 2024-09-12T00:26:40.677 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom 2024-09-12T00:26:40.695 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/28 kB Progress (1): 28 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/15/plexus-15.pom (28 kB at 1.5 MB/s) 2024-09-12T00:26:40.701 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom 2024-09-12T00:26:40.721 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.4 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.pom (2.4 kB at 118 kB/s) 2024-09-12T00:26:40.733 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar 2024-09-12T00:26:40.763 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/308 kB Progress (1): 33/308 kB Progress (1): 49/308 kB Progress (1): 66/308 kB Progress (1): 82/308 kB Progress (1): 98/308 kB Progress (1): 115/308 kB Progress (1): 131/308 kB Progress (1): 147/308 kB Progress (1): 164/308 kB Progress (1): 180/308 kB Progress (1): 197/308 kB Progress (1): 213/308 kB Progress (1): 229/308 kB Progress (1): 246/308 kB Progress (1): 256/308 kB Progress (1): 272/308 kB Progress (1): 289/308 kB Progress (1): 305/308 kB Progress (1): 308 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/maven-surefire-common/3.2.3/maven-surefire-common-3.2.3.jar (308 kB at 11 MB/s) 2024-09-12T00:26:40.763 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar 2024-09-12T00:26:40.764 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar 2024-09-12T00:26:40.764 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar 2024-09-12T00:26:40.765 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar 2024-09-12T00:26:40.765 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar 2024-09-12T00:26:40.782 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 14 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-logger-api/3.2.3/surefire-logger-api-3.2.3.jar (14 kB at 755 kB/s) 2024-09-12T00:26:40.782 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/118 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar 2024-09-12T00:26:40.785 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 32/118 kB Progress (1): 49/118 kB Progress (1): 65/118 kB Progress (1): 81/118 kB Progress (1): 98/118 kB Progress (1): 114/118 kB Progress (1): 118 kB Progress (2): 118 kB | 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-booter/3.2.3/surefire-booter-3.2.3.jar (118 kB at 5.9 MB/s) 2024-09-12T00:26:40.786 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 8.2 kB | 16/171 kB Downloading from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar 2024-09-12T00:26:40.786 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-spi/3.2.3/surefire-extensions-spi-3.2.3.jar (8.2 kB at 409 kB/s) 2024-09-12T00:26:40.786 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar 2024-09-12T00:26:40.788 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 32/171 kB Progress (1): 49/171 kB Progress (1): 65/171 kB Progress (1): 81/171 kB Progress (1): 98/171 kB Progress (2): 98/171 kB | 16/26 kB Progress (2): 114/171 kB | 16/26 kB Progress (2): 114/171 kB | 26 kB Progress (2): 130/171 kB | 26 kB Progress (2): 147/171 kB | 26 kB Progress (2): 163/171 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-extensions-api/3.2.3/surefire-extensions-api-3.2.3.jar (26 kB at 1.1 MB/s) 2024-09-12T00:26:40.789 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar 2024-09-12T00:26:40.789 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 171 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-api/3.2.3/surefire-api-3.2.3.jar (171 kB at 6.6 MB/s) 2024-09-12T00:26:40.789 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar 2024-09-12T00:26:40.803 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/61 kB Progress (1): 33/61 kB Progress (1): 49/61 kB Progress (1): 61 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-common-artifact-filters/3.1.1/maven-common-artifact-filters-3.1.1.jar (61 kB at 1.6 MB/s) 2024-09-12T00:26:40.803 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar 2024-09-12T00:26:40.806 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/146 kB Progress (2): 16/146 kB | 16/58 kB Progress (2): 32/146 kB | 16/58 kB Progress (2): 32/146 kB | 32/58 kB Progress (2): 49/146 kB | 32/58 kB Progress (2): 49/146 kB | 49/58 kB Progress (2): 65/146 kB | 49/58 kB Progress (2): 65/146 kB | 58 kB Progress (2): 81/146 kB | 58 kB Progress (3): 81/146 kB | 58 kB | 16/136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-java/1.2.0/plexus-java-1.2.0.jar (58 kB at 1.4 MB/s) 2024-09-12T00:26:40.806 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 81/146 kB | 33/136 kB Progress (2): 98/146 kB | 33/136 kB Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar 2024-09-12T00:26:40.807 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 98/146 kB | 49/136 kB Progress (2): 98/146 kB | 66/136 kB Progress (2): 114/146 kB | 66/136 kB Progress (2): 114/146 kB | 82/136 kB Progress (2): 130/146 kB | 82/136 kB Progress (2): 130/146 kB | 98/136 kB Progress (2): 130/146 kB | 115/136 kB Progress (2): 146 kB | 115/136 kB Progress (2): 146 kB | 131/136 kB Progress (2): 146 kB | 136 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-util/1.0.0.v20140518/aether-util-1.0.0.v20140518.jar (146 kB at 3.4 MB/s) 2024-09-12T00:26:40.807 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/eclipse/aether/aether-api/1.0.0.v20140518/aether-api-1.0.0.v20140518.jar (136 kB at 3.2 MB/s) 2024-09-12T00:26:40.820 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/501 kB Progress (1): 32/501 kB Progress (1): 49/501 kB Progress (1): 65/501 kB Progress (1): 81/501 kB Progress (1): 98/501 kB Progress (1): 114/501 kB Progress (1): 130/501 kB Progress (1): 147/501 kB Progress (1): 163/501 kB Progress (1): 180/501 kB Progress (1): 196/501 kB Progress (1): 212/501 kB Progress (1): 229/501 kB Progress (1): 245/501 kB Progress (1): 262/501 kB Progress (1): 278/501 kB Progress (1): 294/501 kB Progress (1): 311/501 kB Progress (1): 327/501 kB Progress (1): 343/501 kB Progress (1): 360/501 kB Progress (1): 376/501 kB Progress (1): 393/501 kB Progress (2): 393/501 kB | 16/124 kB Progress (2): 402/501 kB | 16/124 kB Progress (2): 402/501 kB | 32/124 kB Progress (2): 418/501 kB | 32/124 kB Progress (2): 418/501 kB | 49/124 kB Progress (2): 418/501 kB | 65/124 kB Progress (2): 435/501 kB | 65/124 kB Progress (2): 435/501 kB | 81/124 kB Progress (2): 451/501 kB | 81/124 kB Progress (2): 451/501 kB | 98/124 kB Progress (2): 451/501 kB | 114/124 kB Progress (2): 468/501 kB | 114/124 kB Progress (2): 468/501 kB | 124 kB Progress (2): 484/501 kB | 124 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/ow2/asm/asm/9.6/asm-9.6.jar (124 kB at 2.2 MB/s) 2024-09-12T00:26:40.820 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 500/501 kB Progress (1): 501 kB Downloaded from central: https://repo.maven.apache.org/maven2/commons-io/commons-io/2.15.0/commons-io-2.15.0.jar (501 kB at 8.9 MB/s) 2024-09-12T00:26:40.878 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.1/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.2/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.3/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.4/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.5/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.6/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.7/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.8/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 0.9/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.0/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.1/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.2/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.3/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.4/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.5/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.6/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.7/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.8/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 1.9/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.0/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.1/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.2/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.3/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4/2.4 MB Progress (1): 2.4 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-shared-utils/3.2.3/surefire-shared-utils-3.2.3.jar (2.4 MB at 22 MB/s) 2024-09-12T00:26:40.989 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:40.990 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- jar:3.3.0:jar (default-jar) @ jcksum --- 2024-09-12T00:26:40.993 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom 2024-09-12T00:26:41.010 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.5 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.pom (4.5 kB at 249 kB/s) 2024-09-12T00:26:41.013 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom 2024-09-12T00:26:41.032 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 4.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/maven-shared-components/36/maven-shared-components-36.pom (4.9 kB at 245 kB/s) 2024-09-12T00:26:41.034 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom 2024-09-12T00:26:41.050 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/45 kB Progress (1): 33/45 kB Progress (1): 45 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-parent/36/maven-parent-36.pom (45 kB at 3.0 MB/s) 2024-09-12T00:26:41.053 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom 2024-09-12T00:26:41.068 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/21 kB Progress (1): 21 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/apache/26/apache-26.pom (21 kB at 1.4 MB/s) 2024-09-12T00:26:41.072 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom 2024-09-12T00:26:41.087 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 5.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.3.0/plexus-utils-3.3.0.pom (5.2 kB at 345 kB/s) 2024-09-12T00:26:41.089 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom 2024-09-12T00:26:41.116 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 3.9 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.pom (3.9 kB at 151 kB/s) 2024-09-12T00:26:41.119 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom 2024-09-12T00:26:41.136 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.pom (6.0 kB at 354 kB/s) 2024-09-12T00:26:41.140 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom 2024-09-12T00:26:41.155 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 6.3 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.pom (6.3 kB at 417 kB/s) 2024-09-12T00:26:41.158 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom 2024-09-12T00:26:41.172 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/20 kB Progress (1): 20 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.pom (20 kB at 1.4 MB/s) 2024-09-12T00:26:41.177 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom 2024-09-12T00:26:41.193 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 15 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.pom (15 kB at 909 kB/s) 2024-09-12T00:26:41.196 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom 2024-09-12T00:26:41.211 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 2.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.pom (2.0 kB at 128 kB/s) 2024-09-12T00:26:41.215 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom 2024-09-12T00:26:41.233 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 8.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.pom (8.2 kB at 483 kB/s) 2024-09-12T00:26:41.237 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom 2024-09-12T00:26:41.254 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/25 kB Progress (1): 25 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus/8/plexus-8.pom (25 kB at 1.5 MB/s) 2024-09-12T00:26:41.265 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar 2024-09-12T00:26:41.282 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/36 kB Progress (1): 33/36 kB Progress (1): 36 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/shared/file-management/3.1.0/file-management-3.1.0.jar (36 kB at 2.1 MB/s) 2024-09-12T00:26:41.283 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar 2024-09-12T00:26:41.283 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar 2024-09-12T00:26:41.283 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar 2024-09-12T00:26:41.284 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar 2024-09-12T00:26:41.284 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar 2024-09-12T00:26:41.302 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/58 kB Progress (1): 32/58 kB Progress (1): 49/58 kB Progress (1): 58 kB Progress (2): 58 kB | 16/211 kB Progress (3): 58 kB | 16/211 kB | 16/26 kB Progress (3): 58 kB | 33/211 kB | 16/26 kB Progress (3): 58 kB | 33/211 kB | 26 kB Progress (3): 58 kB | 49/211 kB | 26 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/iq80/snappy/snappy/0.4/snappy-0.4.jar (58 kB at 3.6 MB/s) 2024-09-12T00:26:41.302 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 66/211 kB | 26 kB Downloading from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar 2024-09-12T00:26:41.302 INFO:tasks.workunit.client.0.smithi078.stdout:Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/maven-archiver/3.6.0/maven-archiver-3.6.0.jar (26 kB at 1.5 MB/s) 2024-09-12T00:26:41.303 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar 2024-09-12T00:26:41.303 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 82/211 kB Progress (1): 98/211 kB Progress (1): 115/211 kB Progress (1): 131/211 kB Progress (1): 147/211 kB Progress (1): 164/211 kB Progress (1): 180/211 kB Progress (1): 197/211 kB Progress (1): 211 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-archiver/4.4.0/plexus-archiver-4.4.0.jar (211 kB at 11 MB/s) 2024-09-12T00:26:41.309 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 16/79 kB Progress (1): 32/79 kB Progress (1): 49/79 kB Progress (1): 65/79 kB Progress (1): 79 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-io/3.4.0/plexus-io-3.4.0.jar (79 kB at 2.9 MB/s) 2024-09-12T00:26:41.318 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0/1.0 MB Progress (2): 0/1.0 MB | 16/116 kB Progress (2): 0/1.0 MB | 16/116 kB Progress (2): 0/1.0 MB | 33/116 kB Progress (2): 0/1.0 MB | 37/116 kB Progress (2): 0/1.0 MB | 37/116 kB Progress (2): 0.1/1.0 MB | 37/116 kB Progress (2): 0.1/1.0 MB | 53/116 kB Progress (2): 0.1/1.0 MB | 53/116 kB Progress (2): 0.1/1.0 MB | 69/116 kB Progress (2): 0.1/1.0 MB | 69/116 kB Progress (2): 0.1/1.0 MB | 69/116 kB Progress (2): 0.1/1.0 MB | 86/116 kB Progress (2): 0.1/1.0 MB | 86/116 kB Progress (2): 0.1/1.0 MB | 102/116 kB Progress (2): 0.1/1.0 MB | 102/116 kB Progress (2): 0.1/1.0 MB | 116 kB Progress (2): 0.2/1.0 MB | 116 kB Progress (2): 0.2/1.0 MB | 116 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/tukaani/xz/1.9/xz-1.9.jar (116 kB at 3.4 MB/s) 2024-09-12T00:26:41.326 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.2/1.0 MB Progress (1): 0.3/1.0 MB Progress (2): 0.3/1.0 MB | 16/267 kB Progress (2): 0.3/1.0 MB | 16/267 kB Progress (2): 0.3/1.0 MB | 16/267 kB Progress (2): 0.3/1.0 MB | 32/267 kB Progress (2): 0.3/1.0 MB | 32/267 kB Progress (2): 0.3/1.0 MB | 32/267 kB Progress (2): 0.3/1.0 MB | 49/267 kB Progress (2): 0.3/1.0 MB | 49/267 kB Progress (2): 0.3/1.0 MB | 65/267 kB Progress (2): 0.4/1.0 MB | 65/267 kB Progress (2): 0.4/1.0 MB | 81/267 kB Progress (2): 0.4/1.0 MB | 81/267 kB Progress (2): 0.4/1.0 MB | 81/267 kB Progress (2): 0.4/1.0 MB | 98/267 kB Progress (2): 0.4/1.0 MB | 98/267 kB Progress (2): 0.4/1.0 MB | 98/267 kB Progress (2): 0.4/1.0 MB | 114/267 kB Progress (2): 0.4/1.0 MB | 114/267 kB Progress (2): 0.4/1.0 MB | 130/267 kB Progress (2): 0.5/1.0 MB | 130/267 kB Progress (2): 0.5/1.0 MB | 130/267 kB Progress (2): 0.5/1.0 MB | 147/267 kB Progress (2): 0.5/1.0 MB | 147/267 kB Progress (2): 0.5/1.0 MB | 163/267 kB Progress (2): 0.5/1.0 MB | 163/267 kB Progress (2): 0.5/1.0 MB | 163/267 kB Progress (2): 0.5/1.0 MB | 180/267 kB Progress (2): 0.5/1.0 MB | 180/267 kB Progress (2): 0.5/1.0 MB | 196/267 kB Progress (2): 0.5/1.0 MB | 196/267 kB Progress (2): 0.6/1.0 MB | 196/267 kB Progress (2): 0.6/1.0 MB | 212/267 kB Progress (2): 0.6/1.0 MB | 212/267 kB Progress (2): 0.6/1.0 MB | 229/267 kB Progress (2): 0.6/1.0 MB | 229/267 kB Progress (2): 0.6/1.0 MB | 229/267 kB Progress (2): 0.6/1.0 MB | 245/267 kB Progress (2): 0.6/1.0 MB | 245/267 kB Progress (2): 0.6/1.0 MB | 245/267 kB Progress (2): 0.6/1.0 MB | 262/267 kB Progress (2): 0.7/1.0 MB | 262/267 kB Progress (2): 0.7/1.0 MB | 267 kB Progress (2): 0.7/1.0 MB | 267 kB Progress (2): 0.7/1.0 MB | 267 kB Progress (2): 0.7/1.0 MB | 267 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/codehaus/plexus/plexus-utils/3.4.2/plexus-utils-3.4.2.jar (267 kB at 6.4 MB/s) 2024-09-12T00:26:41.331 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 0.7/1.0 MB Progress (1): 0.7/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.8/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 0.9/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0/1.0 MB Progress (1): 1.0 MB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/commons/commons-compress/1.21/commons-compress-1.21.jar (1.0 MB at 21 MB/s) 2024-09-12T00:26:41.512 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Building jar: /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/target/jcksum-1.0.jar 2024-09-12T00:26:41.553 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:26:41.553 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:26:41.553 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:26:41.554 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Total time: 8.548 s 2024-09-12T00:26:41.554 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Finished at: 2024-09-12T00:26:41Z 2024-09-12T00:26:41.554 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:26:41.584 INFO:tasks.workunit.client.0.smithi078.stderr:+ ./mvnw test -Dtest=PutObjects 2024-09-12T00:26:41.590 INFO:tasks.workunit.client.0.smithi078.stdout:Warning: JAVA_HOME environment variable is not set. 2024-09-12T00:26:42.705 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Scanning for projects... 2024-09-12T00:26:42.787 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:42.787 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ---------------------------< io.ceph:jcksum >--------------------------- 2024-09-12T00:26:42.787 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Building jcksum 1.0 2024-09-12T00:26:42.788 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] from pom.xml 2024-09-12T00:26:42.788 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --------------------------------[ jar ]--------------------------------- 2024-09-12T00:26:43.075 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:43.075 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:resources (default-resources) @ jcksum --- 2024-09-12T00:26:43.239 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/main/resources 2024-09-12T00:26:43.240 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:43.240 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:compile (default-compile) @ jcksum --- 2024-09-12T00:26:43.374 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:26:43.374 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:43.374 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- resources:3.3.1:testResources (default-testResources) @ jcksum --- 2024-09-12T00:26:43.377 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] skip non existing resourceDirectory /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/jcksum/src/test/resources 2024-09-12T00:26:43.378 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:43.378 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- compiler:3.11.0:testCompile (default-testCompile) @ jcksum --- 2024-09-12T00:26:43.385 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Nothing to compile - all classes are up to date 2024-09-12T00:26:43.385 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:43.385 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] --- surefire:3.2.3:test (default-test) @ jcksum --- 2024-09-12T00:26:43.601 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Using auto detected provider org.apache.maven.surefire.junitplatform.JUnitPlatformProvider 2024-09-12T00:26:43.839 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom 2024-09-12T00:26:44.061 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/4.7 kB Progress (1): 2.8/4.7 kB Progress (1): 4.1/4.7 kB Progress (1): 4.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.pom (4.7 kB at 21 kB/s) 2024-09-12T00:26:44.070 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom 2024-09-12T00:26:44.089 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/2.6 kB Progress (1): 2.6 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-providers/3.2.3/surefire-providers-3.2.3.pom (2.6 kB at 137 kB/s) 2024-09-12T00:26:44.097 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom 2024-09-12T00:26:44.115 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.pom (2.8 kB at 156 kB/s) 2024-09-12T00:26:44.121 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom 2024-09-12T00:26:44.141 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/3.0 kB Progress (1): 2.8/3.0 kB Progress (1): 3.0 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.pom (3.0 kB at 144 kB/s) 2024-09-12T00:26:44.144 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom 2024-09-12T00:26:44.162 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/3.2 kB Progress (1): 2.8/3.2 kB Progress (1): 3.2 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.pom (3.2 kB at 188 kB/s) 2024-09-12T00:26:44.165 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom 2024-09-12T00:26:44.182 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/1.7 kB Progress (1): 1.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.pom (1.7 kB at 99 kB/s) 2024-09-12T00:26:44.185 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom 2024-09-12T00:26:44.204 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/2.8 kB Progress (1): 2.8/2.8 kB Progress (1): 2.8 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.pom (2.8 kB at 149 kB/s) 2024-09-12T00:26:44.212 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar 2024-09-12T00:26:44.240 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/27 kB Progress (1): 2.8/27 kB Progress (1): 4.1/27 kB Progress (1): 5.5/27 kB Progress (1): 6.9/27 kB Progress (1): 8.3/27 kB Progress (1): 9.7/27 kB Progress (1): 11/27 kB Progress (1): 12/27 kB Progress (1): 14/27 kB Progress (1): 15/27 kB Progress (1): 17/27 kB Progress (1): 18/27 kB Progress (1): 19/27 kB Progress (1): 21/27 kB Progress (1): 22/27 kB Progress (1): 23/27 kB Progress (1): 25/27 kB Progress (1): 26/27 kB Progress (1): 27 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/surefire-junit-platform/3.2.3/surefire-junit-platform-3.2.3.jar (27 kB at 1.0 MB/s) 2024-09-12T00:26:44.242 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar 2024-09-12T00:26:44.242 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar 2024-09-12T00:26:44.242 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar 2024-09-12T00:26:44.243 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar 2024-09-12T00:26:44.243 INFO:tasks.workunit.client.0.smithi078.stdout:Downloading from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar 2024-09-12T00:26:44.266 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/7.7 kB Progress (1): 2.8/7.7 kB Progress (1): 4.1/7.7 kB Progress (1): 5.5/7.7 kB Progress (1): 6.9/7.7 kB Progress (1): 7.7 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/opentest4j/opentest4j/1.2.0/opentest4j-1.2.0.jar (7.7 kB at 306 kB/s) 2024-09-12T00:26:44.304 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 1.4/18 kB Progress (1): 2.8/18 kB Progress (1): 4.1/18 kB Progress (1): 5.5/18 kB Progress (1): 6.9/18 kB Progress (1): 8.3/18 kB Progress (1): 9.7/18 kB Progress (2): 9.7/18 kB | 16/189 kB Progress (3): 9.7/18 kB | 16/189 kB | 1.4/103 kB Progress (4): 9.7/18 kB | 16/189 kB | 1.4/103 kB | 16/169 kB Progress (4): 11/18 kB | 16/189 kB | 1.4/103 kB | 16/169 kB Progress (4): 11/18 kB | 16/189 kB | 2.8/103 kB | 16/169 kB Progress (4): 12/18 kB | 16/189 kB | 2.8/103 kB | 16/169 kB Progress (4): 12/18 kB | 16/189 kB | 4.1/103 kB | 16/169 kB Progress (4): 14/18 kB | 16/189 kB | 4.1/103 kB | 16/169 kB Progress (4): 14/18 kB | 16/189 kB | 5.5/103 kB | 16/169 kB Progress (4): 14/18 kB | 33/189 kB | 5.5/103 kB | 16/169 kB Progress (4): 15/18 kB | 33/189 kB | 5.5/103 kB | 16/169 kB Progress (4): 15/18 kB | 33/189 kB | 6.9/103 kB | 16/169 kB Progress (4): 15/18 kB | 33/189 kB | 6.9/103 kB | 33/169 kB Progress (4): 15/18 kB | 33/189 kB | 8.3/103 kB | 33/169 kB Progress (4): 17/18 kB | 33/189 kB | 8.3/103 kB | 33/169 kB Progress (4): 17/18 kB | 33/189 kB | 9.7/103 kB | 33/169 kB Progress (4): 18 kB | 33/189 kB | 9.7/103 kB | 33/169 kB Progress (4): 18 kB | 33/189 kB | 11/103 kB | 33/169 kB Progress (4): 18 kB | 33/189 kB | 12/103 kB | 33/169 kB Progress (4): 18 kB | 33/189 kB | 14/103 kB | 33/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/apache/maven/surefire/common-java5/3.2.3/common-java5-3.2.3.jar (18 kB at 274 kB/s) 2024-09-12T00:26:44.326 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (3): 33/189 kB | 15/103 kB | 33/169 kB Progress (3): 33/189 kB | 16/103 kB | 33/169 kB Progress (3): 33/189 kB | 32/103 kB | 33/169 kB Progress (3): 33/189 kB | 32/103 kB | 49/169 kB Progress (3): 49/189 kB | 32/103 kB | 49/169 kB Progress (3): 49/189 kB | 32/103 kB | 66/169 kB Progress (3): 49/189 kB | 49/103 kB | 66/169 kB Progress (3): 66/189 kB | 49/103 kB | 66/169 kB Progress (3): 66/189 kB | 49/103 kB | 82/169 kB Progress (3): 66/189 kB | 65/103 kB | 82/169 kB Progress (3): 82/189 kB | 65/103 kB | 82/169 kB Progress (3): 82/189 kB | 65/103 kB | 98/169 kB Progress (3): 98/189 kB | 65/103 kB | 98/169 kB Progress (3): 98/189 kB | 81/103 kB | 98/169 kB Progress (3): 98/189 kB | 81/103 kB | 115/169 kB Progress (3): 115/189 kB | 81/103 kB | 115/169 kB Progress (3): 115/189 kB | 98/103 kB | 115/169 kB Progress (3): 115/189 kB | 98/103 kB | 131/169 kB Progress (3): 115/189 kB | 103 kB | 131/169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-commons/1.9.3/junit-platform-commons-1.9.3.jar (103 kB at 1.2 MB/s) 2024-09-12T00:26:44.327 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (2): 115/189 kB | 147/169 kB Progress (2): 131/189 kB | 147/169 kB Progress (2): 131/189 kB | 164/169 kB Progress (2): 131/189 kB | 169 kB Progress (2): 147/189 kB | 169 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-launcher/1.9.3/junit-platform-launcher-1.9.3.jar (169 kB at 1.9 MB/s) 2024-09-12T00:26:44.329 INFO:tasks.workunit.client.0.smithi078.stdout:Progress (1): 164/189 kB Progress (1): 180/189 kB Progress (1): 189 kB Downloaded from central: https://repo.maven.apache.org/maven2/org/junit/platform/junit-platform-engine/1.9.3/junit-platform-engine-1.9.3.jar (189 kB at 2.2 MB/s) 2024-09-12T00:26:44.353 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:26:44.353 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:26:44.353 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] T E S T S 2024-09-12T00:26:44.353 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------- 2024-09-12T00:26:44.988 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Running io.ceph.jcksum.PutObjects 2024-09-12T00:26:45.035 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjects.java: starting test run: 2024-09-12T00:26:45.035 INFO:tasks.workunit.client.0.smithi078.stdout: AccessKey=lNCnR47C2g+ZidCWBAUuwfSAA7Q= 2024-09-12T00:26:45.035 INFO:tasks.workunit.client.0.smithi078.stdout: SecretKey=tYuA2Y+Uu1ow2l9Xe59tWKVml3gMuVfyhUjjJwfwEI0vFFONIcqf4g== 2024-09-12T00:26:45.035 INFO:tasks.workunit.client.0.smithi078.stdout: EndpointUrl=http://smithi078.front.sepia.ceph.com:80 2024-09-12T00:26:45.131 INFO:tasks.workunit.client.0.smithi078.stderr:[main] WARN software.amazon.awssdk.http.apache.ApacheHttpClient - SSL Certificate verification is disabled. This is not a safe setting and should only be used for testing. 2024-09-12T00:26:45.231 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Environment Variables Read 2024-09-12T00:26:45.633 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: S3 Client Initialized 2024-09-12T00:26:45.633 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-12T00:26:45.633 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-12T00:26:45.633 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-12T00:26:45.634 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generating File 2024-09-12T00:26:45.732 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: File Generated 2024-09-12T00:26:45.733 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Generated Big Files 2024-09-12T00:26:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:HeadBucketResponse() 2024-09-12T00:26:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:sheik is ready 2024-09-12T00:26:45.901 INFO:tasks.workunit.client.0.smithi078.stdout:DEBUG: Test Bucket Created 2024-09-12T00:26:45.932 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-0b 2024-09-12T00:26:46.122 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-8b 2024-09-12T00:26:46.133 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-200b 2024-09-12T00:26:46.233 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-21983b 2024-09-12T00:26:46.334 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-5519b 2024-09-12T00:26:46.434 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-204329b 2024-09-12T00:26:46.531 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-256k 2024-09-12T00:26:46.534 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-1m 2024-09-12T00:26:46.722 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileNoCksum called with file-1038757b 2024-09-12T00:26:46.734 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileNoCksum called with file-5m 2024-09-12T00:26:49.140 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileNoCksum called with file-10m 2024-09-12T00:26:49.741 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileNoCksum called with file-100m 2024-09-12T00:26:55.520 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-0b 2024-09-12T00:26:55.521 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-8b 2024-09-12T00:26:55.522 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-200b 2024-09-12T00:26:55.524 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-21983b 2024-09-12T00:26:55.525 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-5519b 2024-09-12T00:26:55.526 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-204329b 2024-09-12T00:26:55.528 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-256k 2024-09-12T00:26:55.529 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-1m 2024-09-12T00:26:55.530 INFO:tasks.workunit.client.0.smithi078.stdout:arg: file-1038757b 2024-09-12T00:26:55.553 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-0b 2024-09-12T00:26:55.579 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:55.651 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-8b 2024-09-12T00:26:55.651 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:55.653 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-200b 2024-09-12T00:26:55.722 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:55.754 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-21983b 2024-09-12T00:26:55.754 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:55.854 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-5519b 2024-09-12T00:26:55.854 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:55.933 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-204329b 2024-09-12T00:26:55.933 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:55.954 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-256k 2024-09-12T00:26:55.984 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:56.055 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-1m 2024-09-12T00:26:56.055 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:56.155 INFO:tasks.workunit.client.0.smithi078.stdout:putObjectFromFileCksum called with file-1038757b 2024-09-12T00:26:56.197 INFO:tasks.workunit.client.0.smithi078.stdout:PutObjectResponse 2024-09-12T00:26:56.255 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileCksum called with file-5m 2024-09-12T00:26:56.656 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileCksum called with file-10m 2024-09-12T00:26:57.457 INFO:tasks.workunit.client.0.smithi078.stdout:mpuObjectFromFileCksum called with file-100m 2024-09-12T00:27:01.456 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0, Time elapsed: 16.45 s -- in io.ceph.jcksum.PutObjects 2024-09-12T00:27:01.515 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:27:01.516 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Results: 2024-09-12T00:27:01.516 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:27:01.516 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Tests run: 33, Failures: 0, Errors: 0, Skipped: 0 2024-09-12T00:27:01.516 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] 2024-09-12T00:27:01.518 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:27:01.518 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] BUILD SUCCESS 2024-09-12T00:27:01.518 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:27:01.519 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Total time: 18.837 s 2024-09-12T00:27:01.519 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] Finished at: 2024-09-12T00:27:01Z 2024-09-12T00:27:01.520 INFO:tasks.workunit.client.0.smithi078.stdout:[INFO] ------------------------------------------------------------------------ 2024-09-12T00:27:01.550 INFO:tasks.workunit.client.0.smithi078.stderr:+ exit 2024-09-12T00:27:01.550 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:27:01.550 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:27:01.602 INFO:tasks.workunit:Stopping ['cls/test_cls_lock.sh', 'cls/test_cls_log.sh', 'cls/test_cls_refcount.sh', 'cls/test_cls_rgw.sh', 'cls/test_cls_rgw_gc.sh', 'cls/test_cls_rgw_stats.sh', 'cls/test_cls_cmpomap.sh', 'cls/test_cls_2pc_queue.sh', 'cls/test_cls_user.sh', 'rgw/test_rgw_gc_log.sh', 'rgw/test_rgw_obj.sh', 'rgw/test_librgw_file.sh', 'rgw/test_awssdkv4_sig.sh'] on client.0... 2024-09-12T00:27:01.602 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:27:02.001 DEBUG:teuthology.parallel:result is None 2024-09-12T00:27:02.002 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:02.015 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:02.015 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:02.061 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:02.062 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:27:02.075 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:27:02.075 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:27:02.076 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:02.109 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:27:02.109 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:27:02.110 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:02.157 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:02.158 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:27:02.205 INFO:tasks.workunit:timeout=3h 2024-09-12T00:27:02.206 INFO:tasks.workunit:cleanup=True 2024-09-12T00:27:02.206 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:27:02.255 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:27:44.495 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-12T00:27:44.496 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:27:44.497 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-12T00:27:44.497 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:27:44.497 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-12T00:27:44.497 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:27:44.497 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:27:44.497 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:27:44.497 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:27:44.503 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:27:44.549 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:27:44.553 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:27:44.553 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:27:44.608 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:27:44.661 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:27:44.709 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:27:44.710 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:27:44.710 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:27:44.753 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:27:44.756 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:27:44.756 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:27:44.805 INFO:tasks.workunit:Running workunits matching rgw/test_rgw_s3_mp_reupload.sh on client.0... 2024-09-12T00:27:44.807 INFO:tasks.workunit:Running workunit rgw/test_rgw_s3_mp_reupload.sh... 2024-09-12T00:27:44.807 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/test_rgw_s3_mp_reupload.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_s3_mp_reupload.sh 2024-09-12T00:27:44.860 INFO:tasks.workunit.client.0.smithi078.stdout:INFO: fully qualified domain name: smithi078.front.sepia.ceph.com 2024-09-12T00:27:44.860 INFO:tasks.workunit.client.0.smithi078.stdout:== TESTING *COMPLETING* MULTIPART UPLOAD WITH RE-UPLOADS == 2024-09-12T00:27:44.860 INFO:tasks.workunit.client.0.smithi078.stdout:== TESTING NON-VERSIONED BUCKET == 2024-09-12T00:27:48.065 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:27:48.271 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-12T00:27:48.277 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:27:48.311 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-12T00:27:48.311 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-12T00:27:48.311 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:27:48.568 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:27:48.573 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:27:49.486 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-12T00:27:50.512 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-12T00:27:50.513 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:27:51.010 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:27:51.011 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:27:51.056 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:27:51.057 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:27:51.095 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:27:51.096 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:27:51.148 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:27:51.149 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:27:51.235 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:27:51.236 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:27:51.384 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:27:51.385 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:27:51.389 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:27:51.390 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:27:51.399 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:27:51.400 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:27:51.402 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:27:51.403 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:27:51.404 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:27:51.471 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:27:52.615 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:27:53.205 INFO:tasks.workunit.client.0.smithi078.stdout:INFO: creating user 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout:{ 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "user_id": "testid", 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "display_name": "M. Tester", 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "email": "tester@ceph.com", 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "suspended": 0, 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "subusers": [], 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "keys": [ 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: { 2024-09-12T00:27:53.777 INFO:tasks.workunit.client.0.smithi078.stdout: "user": "testid", 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "access_key": "0555b35654ad1656d804", 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "secret_key": "h7GhxuBLTrlhVUyxSPUKUV8r/2EI4ngqJxD7iBdBYLhwluN30JaT3Q==", 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "active": true, 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-12T00:27:53.769918Z" 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: } 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: ], 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "swift_keys": [], 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "caps": [], 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "default_placement": "", 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "placement_tags": [], 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "bucket_quota": { 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-12T00:27:53.778 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "user_quota": { 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "enabled": false, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size": -1, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "max_objects": -1 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: }, 2024-09-12T00:27:53.779 INFO:tasks.workunit.client.0.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: "type": "rgw", 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: "account_id": "", 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: "path": "/", 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: "create_date": "2024-09-12T00:27:53.769884Z", 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: "tags": [], 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: "group_ids": [] 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout:} 2024-09-12T00:27:53.780 INFO:tasks.workunit.client.0.smithi078.stdout: 2024-09-12T00:27:54.074 INFO:tasks.workunit.client.0.smithi078.stderr:5+0 records in 2024-09-12T00:27:54.074 INFO:tasks.workunit.client.0.smithi078.stderr:5+0 records out 2024-09-12T00:27:54.075 INFO:tasks.workunit.client.0.smithi078.stderr:5242880 bytes (5.2 MB, 5.0 MiB) copied, 0.0213449 s, 246 MB/s 2024-09-12T00:27:56.372 INFO:tasks.workunit.client.0.smithi078.stdout:bucket nams is reupload-bkt-100179 2024-09-12T00:27:56.372 INFO:tasks.workunit.client.0.smithi078.stdout:endpoint is http://smithi078.front.sepia.ceph.com:80 2024-09-12T00:27:56.372 INFO:tasks.workunit.client.0.smithi078.stdout:start UploadId=2~ZilWXX3ahq4B544yr8LHHo8NXNSownc 2024-09-12T00:27:56.372 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.372 INFO:tasks.workunit.client.0.smithi078.stdout:phase 1 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 2} 2024-09-12T00:27:56.372 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:phase 2 uploaded part {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1} 2024-09-12T00:27:56.373 INFO:tasks.workunit.client.0.smithi078.stdout:completing multipart upload, parts=[{'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 1}, {'ETag': '"170ffb159801f5b899b8f216c20d5613"', 'PartNumber': 2}] 2024-09-12T00:27:58.011 INFO:tasks.workunit.client.0.smithi078.stdout:radosgw-admin bucket radoslist: 2024-09-12T00:27:58.012 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3_mpu_test4 2024-09-12T00:27:58.012 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__multipart_mpu_test4.2~ZilWXX3ahq4B544yr8LHHo8NXNSownc.2 2024-09-12T00:27:58.012 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__multipart_mpu_test4.6GF_xE_nkKqzwCU4uUjkaCcqGROYCPoH.1 2024-09-12T00:27:58.012 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__shadow_mpu_test4.2~ZilWXX3ahq4B544yr8LHHo8NXNSownc.2_1 2024-09-12T00:27:58.012 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__shadow_mpu_test4.6GF_xE_nkKqzwCU4uUjkaCcqGROYCPoH.1_1 2024-09-12T00:27:58.095 INFO:tasks.workunit.client.0.smithi078.stdout:rados ls: 2024-09-12T00:27:58.096 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3_mpu_test4 2024-09-12T00:27:58.096 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__multipart_mpu_test4.2~ZilWXX3ahq4B544yr8LHHo8NXNSownc.2 2024-09-12T00:27:58.096 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__multipart_mpu_test4.6GF_xE_nkKqzwCU4uUjkaCcqGROYCPoH.1 2024-09-12T00:27:58.096 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__shadow_mpu_test4.2~ZilWXX3ahq4B544yr8LHHo8NXNSownc.2_1 2024-09-12T00:27:58.096 INFO:tasks.workunit.client.0.smithi078.stdout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3__shadow_mpu_test4.6GF_xE_nkKqzwCU4uUjkaCcqGROYCPoH.1_1 2024-09-12T00:27:58.109 INFO:tasks.workunit.client.0.smithi078.stdout:== PASSED == 2024-09-12T00:27:58.109 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:27:58.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:27:58.164 INFO:tasks.workunit:Stopping ['rgw/test_rgw_s3_mp_reupload.sh'] on client.0... 2024-09-12T00:27:58.164 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:27:58.577 DEBUG:teuthology.parallel:result is None 2024-09-12T00:27:58.577 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:58.593 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:58.593 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:27:58.641 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:27:58.641 INFO:teuthology.run_tasks:Running task ragweed... 2024-09-12T00:27:58.656 DEBUG:tasks.ragweed:ragweed config is {'client.0': {'force-branch': 'wip-67986', 'rgw_server': 'client.0', 'stages': 'prepare,check'}} 2024-09-12T00:27:58.657 INFO:tasks.ragweed:Downloading ragweed... 2024-09-12T00:27:58.657 INFO:tasks.ragweed:Using branch 'wip-67986' for ragweed 2024-09-12T00:27:58.657 DEBUG:teuthology.orchestra.run.smithi078:> git clone -b wip-67986 https://git.ceph.com/ragweed.git /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:27:58.689 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/ragweed.client.0'... 2024-09-12T00:27:58.885 INFO:tasks.ragweed:Creating rgw users... 2024-09-12T00:27:58.886 DEBUG:tasks.ragweed:Creating user ragweed.client.0 on client.0 2024-09-12T00:27:58.886 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid ragweed.client.0 --display-name 'Mr. ragweed.client.0' --access-key ZSNJCAYTDCYWFRIRHZLL --secret 8z8RplCkHJluP/igW7bHQI8F6jLnID0yr3T/AzTCysAmP0Em5EX33A== --email ragweed.client.0+test@test.test --system false 2024-09-12T00:27:58.980 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:58.980 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:59.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.023+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.023+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.023+0000 7efd77af89c0 20 realm 2024-09-12T00:27:59.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.023+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.023+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.023+0000 7efd77af89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:59.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.023+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.027+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.027+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.027+0000 7efd77af89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.027+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.027+0000 7efd77af89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:59.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.027+0000 7efd77af89c0 20 searching for the correct realm 2024-09-12T00:27:59.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.031+0000 7efd755fe640 0 -- 172.21.15.78:0/36560325 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55b074996d30 msgr2=0x55b0749991f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:59.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.039+0000 7efd74dfd640 0 -- 172.21.15.78:0/36560325 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7efd68090b70 msgr2=0x7efd68041a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.255+0000 7efd77af89c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:27:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.255+0000 7efd77af89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.255+0000 7efd77af89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.255+0000 7efd77af89c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:27:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.255+0000 7efd77af89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:59.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 zone default found 2024-09-12T00:27:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 4 Realm: () 2024-09-12T00:27:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:27:59.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:27:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 zonegroup default 2024-09-12T00:27:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.259+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.263+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.263+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.263+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.263+0000 7efd77af89c0 20 started sync module instance, tier type = 2024-09-12T00:27:59.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.263+0000 7efd77af89c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:27:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=0 2024-09-12T00:27:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=1 2024-09-12T00:27:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=2 2024-09-12T00:27:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=3 2024-09-12T00:27:59.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=4 2024-09-12T00:27:59.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=5 2024-09-12T00:27:59.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=6 2024-09-12T00:27:59.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 20 add_watcher() i=7 2024-09-12T00:27:59.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.287+0000 7efd77af89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efc2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:59.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 5 note: GC not initialized 2024-09-12T00:27:59.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efc2a7e4640 20 reqs_thread_entry: start 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 Filter name: none 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efb9bfff640 20 reqs_thread_entry: start 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x0 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache get: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test : miss 2024-09-12T00:27:59.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x0 2024-09-12T00:27:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 adding default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:27:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache get: name=default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL : miss 2024-09-12T00:27:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache put: name=default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL info.flags=0x0 2024-09-12T00:27:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 adding default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL to cache LRU end 2024-09-12T00:27:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache get: name=default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL : hit (negative entry) 2024-09-12T00:27:59.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.295+0000 7efd77af89c0 10 cache get: name=default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL : hit (negative entry) 2024-09-12T00:27:59.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.299+0000 7efd77af89c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:27:59.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.299+0000 7efd77af89c0 10 moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:27:59.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.299+0000 7efd77af89c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:27:59.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.299+0000 7efc58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595129 cookie 94216358823152 notifier 5910 bl.length()=675 2024-09-12T00:27:59.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.299+0000 7efc58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x17 2024-09-12T00:27:59.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.299+0000 7efc58ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:27:59.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.303+0000 7efd77af89c0 10 cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:27:59.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.303+0000 7efd77af89c0 10 moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:27:59.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.303+0000 7efd77af89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:27:59.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.303+0000 7efc47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595081 cookie 94216358834912 notifier 5910 bl.length()=202 2024-09-12T00:27:59.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.303+0000 7efc47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+ragweed.client.0+test@test.test info.flags=0x7 2024-09-12T00:27:59.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.303+0000 7efc47fff640 10 rgw watcher librados: moving default.rgw.meta+users.email+ragweed.client.0+test@test.test to cache LRU end 2024-09-12T00:27:59.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.307+0000 7efd77af89c0 10 cache put: name=default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL info.flags=0x7 2024-09-12T00:27:59.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.307+0000 7efd77af89c0 10 moving default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL to cache LRU end 2024-09-12T00:27:59.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.307+0000 7efd77af89c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:ZSNJCAYTDCYWFRIRHZLL, ofs0, ns] 2024-09-12T00:27:59.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.307+0000 7efc47fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595082 cookie 94216358834912 notifier 5910 bl.length()=190 2024-09-12T00:27:59.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.307+0000 7efc47fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL info.flags=0x7 2024-09-12T00:27:59.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.307+0000 7efc47fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZSNJCAYTDCYWFRIRHZLL to cache LRU end 2024-09-12T00:27:59.306 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:27:59.306 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "ragweed.client.0", 2024-09-12T00:27:59.306 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr. ragweed.client.0", 2024-09-12T00:27:59.306 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "ragweed.client.0+test@test.test", 2024-09-12T00:27:59.306 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "ragweed.client.0", 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "ZSNJCAYTDCYWFRIRHZLL", 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "8z8RplCkHJluP/igW7bHQI8F6jLnID0yr3T/AzTCysAmP0Em5EX33A==", 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:27:59.301555Z" 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:27:59.307 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:27:59.308 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:27:59.301521Z", 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:27:59.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:27:59.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.307+0000 7efc2b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.311+0000 7efd77af89c0 20 remove_watcher() i=0 2024-09-12T00:27:59.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.311+0000 7efd77af89c0 2 removed watcher, disabling cache 2024-09-12T00:27:59.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.315+0000 7efd77af89c0 20 remove_watcher() i=1 2024-09-12T00:27:59.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.315+0000 7efd77af89c0 20 remove_watcher() i=2 2024-09-12T00:27:59.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.319+0000 7efd77af89c0 20 remove_watcher() i=3 2024-09-12T00:27:59.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.319+0000 7efd77af89c0 20 remove_watcher() i=4 2024-09-12T00:27:59.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.323+0000 7efd77af89c0 20 remove_watcher() i=5 2024-09-12T00:27:59.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.327+0000 7efd77af89c0 20 remove_watcher() i=6 2024-09-12T00:27:59.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.331+0000 7efd77af89c0 20 remove_watcher() i=7 2024-09-12T00:27:59.344 DEBUG:tasks.ragweed:Creating user sysuser.client.0 on client.0 2024-09-12T00:27:59.345 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid sysuser.client.0 --display-name 'Mr. sysuser.client.0' --access-key ULGYDYSOMIHSEFAFQWNU --secret thqZjQnif2VDfBZ8aAgESqgh1eAKx1tUcqjdtteG3oqNbaBkvWI4Mg== --email sysuser.client.0+test@test.test --system true 2024-09-12T00:27:59.387 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:27:59.387 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:27:59.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.427+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 20 realm 2024-09-12T00:27:59.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:27:59.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.431+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.435+0000 7f551cafe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:59.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.435+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.435+0000 7f551cafe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:27:59.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.435+0000 7f551cafe9c0 20 searching for the correct realm 2024-09-12T00:27:59.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.439+0000 7f551ae05640 0 -- 172.21.15.78:0/727299497 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f550c107f70 msgr2=0x7f550c0b7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:59.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.655+0000 7f551a604640 0 -- 172.21.15.78:0/727299497 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x556f2a8d19b0 msgr2=0x556f2a8d3e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:27:59.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.663+0000 7f551cafe9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:27:59.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.663+0000 7f551cafe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:27:59.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.663+0000 7f551cafe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:27:59.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.663+0000 7f551cafe9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:27:59.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.663+0000 7f551cafe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:27:59.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.663+0000 7f551cafe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:27:59.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.663+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:27:59.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 zone default found 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 4 Realm: () 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 zonegroup default 2024-09-12T00:27:59.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.667+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.671+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.671+0000 7f551cafe9c0 20 started sync module instance, tier type = 2024-09-12T00:27:59.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.671+0000 7f551cafe9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:27:59.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.691+0000 7f551cafe9c0 20 add_watcher() i=0 2024-09-12T00:27:59.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.691+0000 7f551cafe9c0 20 add_watcher() i=1 2024-09-12T00:27:59.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.691+0000 7f551cafe9c0 20 add_watcher() i=2 2024-09-12T00:27:59.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.691+0000 7f551cafe9c0 20 add_watcher() i=3 2024-09-12T00:27:59.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.691+0000 7f551cafe9c0 20 add_watcher() i=4 2024-09-12T00:27:59.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.691+0000 7f551cafe9c0 20 add_watcher() i=5 2024-09-12T00:27:59.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.691+0000 7f551cafe9c0 20 add_watcher() i=6 2024-09-12T00:27:59.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.695+0000 7f551cafe9c0 20 add_watcher() i=7 2024-09-12T00:27:59.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.695+0000 7f551cafe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:27:59.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f53d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:59.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:27:59.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:27:59.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 5 note: GC not initialized 2024-09-12T00:27:59.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f534b7fe640 20 reqs_thread_entry: start 2024-09-12T00:27:59.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:27:59.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 20 Filter name: none 2024-09-12T00:27:59.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f53497fa640 20 reqs_thread_entry: start 2024-09-12T00:27:59.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:27:59.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x0 2024-09-12T00:27:59.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:27:59.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 10 cache get: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test : miss 2024-09-12T00:27:59.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.699+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x0 2024-09-12T00:27:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 adding default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:27:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 cache get: name=default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU : miss 2024-09-12T00:27:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:27:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:27:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 cache put: name=default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU info.flags=0x0 2024-09-12T00:27:59.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 adding default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU to cache LRU end 2024-09-12T00:27:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 cache get: name=default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU : hit (negative entry) 2024-09-12T00:27:59.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 cache get: name=default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU : hit (negative entry) 2024-09-12T00:27:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:27:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:27:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f551cafe9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:27:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f53fdffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595083 cookie 93935943689232 notifier 5648 bl.length()=675 2024-09-12T00:27:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f53fdffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x17 2024-09-12T00:27:59.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.703+0000 7f53fdffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:27:59.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.707+0000 7f551cafe9c0 10 cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:27:59.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.707+0000 7f551cafe9c0 10 moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:27:59.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.707+0000 7f551cafe9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:27:59.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.707+0000 7f53fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595130 cookie 93935943693056 notifier 5648 bl.length()=202 2024-09-12T00:27:59.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.707+0000 7f53fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+sysuser.client.0+test@test.test info.flags=0x7 2024-09-12T00:27:59.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.707+0000 7f53fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+sysuser.client.0+test@test.test to cache LRU end 2024-09-12T00:27:59.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.711+0000 7f551cafe9c0 10 cache put: name=default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU info.flags=0x7 2024-09-12T00:27:59.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.711+0000 7f551cafe9c0 10 moving default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU to cache LRU end 2024-09-12T00:27:59.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.711+0000 7f551cafe9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.keys:ULGYDYSOMIHSEFAFQWNU, ofs0, ns] 2024-09-12T00:27:59.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.715+0000 7f53fd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1103806595139 cookie 93935943704512 notifier 5648 bl.length()=190 2024-09-12T00:27:59.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.715+0000 7f53fd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU info.flags=0x7 2024-09-12T00:27:59.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.715+0000 7f53fd7fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ULGYDYSOMIHSEFAFQWNU to cache LRU end 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "sysuser.client.0", 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr. sysuser.client.0", 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "sysuser.client.0+test@test.test", 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:27:59.714 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "sysuser.client.0", 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "ULGYDYSOMIHSEFAFQWNU", 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "thqZjQnif2VDfBZ8aAgESqgh1eAKx1tUcqjdtteG3oqNbaBkvWI4Mg==", 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:27:59.706803Z" 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "system": true, 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:27:59.715 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:27:59.716 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:27:59.706768Z", 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:27:59.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.715+0000 7f53d0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:27:59.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.719+0000 7f551cafe9c0 20 remove_watcher() i=0 2024-09-12T00:27:59.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.719+0000 7f551cafe9c0 2 removed watcher, disabling cache 2024-09-12T00:27:59.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.723+0000 7f551cafe9c0 20 remove_watcher() i=1 2024-09-12T00:27:59.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.723+0000 7f551cafe9c0 20 remove_watcher() i=2 2024-09-12T00:27:59.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.727+0000 7f551cafe9c0 20 remove_watcher() i=3 2024-09-12T00:27:59.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.727+0000 7f551cafe9c0 20 remove_watcher() i=4 2024-09-12T00:27:59.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.731+0000 7f551cafe9c0 20 remove_watcher() i=5 2024-09-12T00:27:59.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.735+0000 7f551cafe9c0 20 remove_watcher() i=6 2024-09-12T00:27:59.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:27:59.735+0000 7f551cafe9c0 20 remove_watcher() i=7 2024-09-12T00:27:59.754 INFO:tasks.ragweed:Configuring ragweed... 2024-09-12T00:27:59.755 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:27:59.755 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/archive/ragweed.client.0.conf 2024-09-12T00:27:59.801 INFO:tasks.ragweed:Configuring boto... 2024-09-12T00:27:59.802 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:27:59.802 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/boto.cfg 2024-09-12T00:27:59.850 DEBUG:teuthology.orchestra.run.smithi078:ragweed tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/ragweed.client.0 && RAGWEED_CONF=/home/ubuntu/cephtest/archive/ragweed.client.0.conf RAGWEED_STAGES=prepare,check BOTO_CONFIG=/home/ubuntu/cephtest/boto.cfg tox --sitepackages -- -v -m 'not fails_on_rgw' 2024-09-12T00:28:00.048 INFO:teuthology.orchestra.run.smithi078.stdout:GLOB sdist-make: /home/ubuntu/cephtest/ragweed.client.0/setup.py 2024-09-12T00:28:00.227 INFO:teuthology.orchestra.run.smithi078.stdout:py create: /home/ubuntu/cephtest/ragweed.client.0/.tox/py 2024-09-12T00:28:00.838 INFO:teuthology.orchestra.run.smithi078.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:28:03.556 INFO:teuthology.orchestra.run.smithi078.stdout:py inst: /home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip 2024-09-12T00:28:07.807 INFO:teuthology.orchestra.run.smithi078.stdout:py installed: appdirs==1.4.4,asyncssh==2.5.0,attrs==21.2.0,Babel==2.8.0,bcrypt==3.2.0,beautifulsoup4==4.10.0,beniget==0.4.1,blinker==1.4,boto==2.49.0,Brotli==1.0.9,cachetools==5.0.0,ceph==1.0.0,ceph-volume==1.0.0,cephfs==2.0.0,certifi==2020.6.20,chardet==4.0.0,cheroot==8.5.2+ds1,CherryPy==18.6.1,command-not-found==0.3,configobj==5.0.6,cryptography==3.4.8,cycler==0.11.0,dbus-python==1.2.18,decorator==4.4.2,distlib==0.3.4,distro==1.7.0,distro-info===1.1build1,docopt==0.6.2,execnet==1.9.0,filelock==3.6.0,fonttools==4.29.1,fs==2.4.12,gast==0.5.2,gevent==21.8.0,google-auth==1.5.1,greenlet==1.1.2,html5lib==1.1,httplib2==0.20.2,idna==3.3,importlib-metadata==4.6.4,iniconfig==1.1.1,isodate==0.6.1,jaraco.classes==3.2.1,jaraco.collections==3.4.0,jaraco.functools==3.4.0,jaraco.text==3.6.0,jeepney==0.7.1,Jinja2==3.0.3,joblib==0.17.0,keyring==23.5.0,kiwisolver==1.3.2,kubernetes==12.0.1,language-selector==0.1,launchpadlib==1.10.16,lazr.restfulclient==0.14.4,lazr.uri==1.0.6,logutils==0.3.3,lxml==4.8.0,lz4==3.1.3+dfsg,Mako==1.1.3,MarkupSafe==2.0.1,matplotlib==3.5.1,more-itertools==8.10.0,mpmath==0.0.0,munch==4.0.0,natsort==8.0.2,netifaces==0.11.0,nose==1.3.7,numpy==1.21.5,oauthlib==3.2.0,olefile==0.46,packaging==21.3,Paste==3.5.0,PasteDeploy==2.1.1,PasteScript==2.0.2,pecan==1.3.3,Pillow==9.0.1,platformdirs==2.5.1,pluggy==0.13.0,ply==3.11,portend==3.0.0,prettytable==2.5.0,psutil==5.9.0,py==1.10.0,pyasn1==0.4.8,pyasn1-modules==0.2.1,Pygments==2.11.2,PyGObject==3.42.1,pyinotify==0.9.6,PyJWT==2.3.0,pymacaroons==0.13.0,PyNaCl==1.5.0,pyOpenSSL==21.0.0,pyparsing==2.4.7,pytest==6.2.5,python-apt==2.3.0+ubuntu2.1,python-dateutil==2.8.1,python-magic==0.4.24,pythran==0.10.0,pytz==2022.1,PyYAML==5.4.1,rados==2.0.0,ragweed @ file:///home/ubuntu/cephtest/ragweed.client.0/.tox/.tmp/package/1/ragweed-0.0.1.zip#sha256=eb2fb18acbeba11e46f214ca2d27b1440aa1f01463511c9dd88abd192d668d91,rbd==2.0.0,registries-conf-ctl @ git+https://github.com/sebastian-philipp/registries-conf-ctl@0e9bf2dc202aa9be9b0bf8e8265aac3f2308f9db,remoto==1.2.1,repoze.lru==0.7,requests==2.25.1,requests-oauthlib==1.3.0,rgw==2.0.0,Routes==2.5.1,rsa==4.8,s3cmd==2.2.0,scikit-learn==0.23.2,scipy==1.8.0,SecretStorage==3.3.1,simplegeneric==0.8.1,simplejson==3.17.6,six==1.16.0,soupsieve==2.3.1,ssh-import-id==5.11,sympy==1.9,Tempita==0.5.2,tempora==4.1.2,threadpoolctl==3.1.0,toml==0.10.2,ubuntu-advantage-tools==27.12,ufoLib2==0.13.1,ufw==0.36.1,unattended-upgrades==0.1,unicodedata2==14.0.0,urllib3==1.26.5,virtualenv==20.13.0+ds,wadllib==1.3.6,waitress==1.4.4,wcwidth==0.2.5,webencodings==0.5.1,WebOb==1.8.6,websocket-client==1.2.3,WebTest==2.0.35,Werkzeug==2.0.2,zc.lockfile==2.0,zipp==1.0.0,zope.event==4.4,zope.interface==5.4.0 2024-09-12T00:28:07.807 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test-pre: PYTHONHASHSEED='433486189' 2024-09-12T00:28:07.807 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test: commands[0] | python -m pytest -v -m 'not fails_on_rgw' 2024-09-12T00:28:07.979 INFO:teuthology.orchestra.run.smithi078.stdout:============================= test session starts ============================== 2024-09-12T00:28:07.980 INFO:teuthology.orchestra.run.smithi078.stdout:platform linux -- Python 3.10.6, pytest-6.2.5, py-1.10.0, pluggy-0.13.0 -- /home/ubuntu/cephtest/ragweed.client.0/.tox/py/bin/python 2024-09-12T00:28:07.980 INFO:teuthology.orchestra.run.smithi078.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:28:07.980 INFO:teuthology.orchestra.run.smithi078.stdout:rootdir: /home/ubuntu/cephtest/ragweed.client.0, configfile: pytest.ini 2024-09-12T00:28:08.133 INFO:teuthology.orchestra.run.smithi078.stdout:collecting ... collected 9 items 2024-09-12T00:28:08.133 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:28:08.951 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_small_obj_data::test PASSED [ 11%] 2024-09-12T00:28:09.853 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_simple::test PASSED [ 22%] 2024-09-12T00:28:10.539 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_index_versioning::test PASSED [ 33%] 2024-09-12T00:28:11.433 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_defer_complete::test PASSED [ 44%] 2024-09-12T00:28:12.443 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_multipart_defer_update_complete::test PASSED [ 55%] 2024-09-12T00:28:18.760 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class::test PASSED [ 66%] 2024-09-12T00:28:20.866 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart::test PASSED [ 77%] 2024-09-12T00:28:22.904 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_copy::test PASSED [ 88%] 2024-09-12T00:28:26.487 INFO:teuthology.orchestra.run.smithi078.stdout:ragweed/tests/tests.py::r_test_obj_storage_class_multipart_copy::test PASSED [100%] 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout:=============================== warnings summary =============================== 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/ragweed.client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout: import imp 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout:-- Docs: https://docs.pytest.org/en/stable/warnings.html 2024-09-12T00:28:26.488 INFO:teuthology.orchestra.run.smithi078.stdout:======================== 9 passed, 1 warning in 18.51s ========================= 2024-09-12T00:28:26.534 INFO:teuthology.orchestra.run.smithi078.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:28:26.534 INFO:teuthology.orchestra.run.smithi078.stdout: py: commands succeeded 2024-09-12T00:28:26.534 INFO:teuthology.orchestra.run.smithi078.stdout: congratulations :) 2024-09-12T00:28:26.558 INFO:tasks.ragweed:Cleaning up boto... 2024-09-12T00:28:26.559 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/boto.cfg 2024-09-12T00:28:26.564 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid ragweed.client.0 --purge-data 2024-09-12T00:28:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:26.643 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:26.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.683+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 realm 2024-09-12T00:28:26.686 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:26.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:26.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.687+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.691+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:26.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.691+0000 7faab66fa9c0 20 searching for the correct realm 2024-09-12T00:28:26.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.695+0000 7faab4200640 0 -- 172.21.15.78:0/1599225714 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55ce3926d3e0 msgr2=0x55ce3926f8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:28:26.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.699+0000 7faab39ff640 0 -- 172.21.15.78:0/1599225714 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7faaa4072040 msgr2=0x7faaa4040980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:28:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:26.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:28:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 zone default found 2024-09-12T00:28:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 4 Realm: () 2024-09-12T00:28:26.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:28:26.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:28:26.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:26.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 zonegroup default 2024-09-12T00:28:26.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:26.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.919+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.923+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:26.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.923+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:26.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.923+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:26.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.923+0000 7faab66fa9c0 20 started sync module instance, tier type = 2024-09-12T00:28:26.922 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.923+0000 7faab66fa9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:28:26.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=0 2024-09-12T00:28:26.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=1 2024-09-12T00:28:26.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=2 2024-09-12T00:28:26.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=3 2024-09-12T00:28:26.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=4 2024-09-12T00:28:26.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=5 2024-09-12T00:28:26.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=6 2024-09-12T00:28:26.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 20 add_watcher() i=7 2024-09-12T00:28:26.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.947+0000 7faab66fa9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.955+0000 7fa96a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.955+0000 7faab66fa9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:26.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:26.955+0000 7faab66fa9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.047+0000 7fa9697e2640 20 reqs_thread_entry: start 2024-09-12T00:28:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.047+0000 7faab66fa9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:28:27.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.047+0000 7faab66fa9c0 20 Filter name: none 2024-09-12T00:28:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.047+0000 7fa8daffd640 20 reqs_thread_entry: start 2024-09-12T00:28:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.047+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+users.uid+ragweed.client.0 : miss 2024-09-12T00:28:27.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.047+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:28:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+users.uid+ragweed.client.0 info.flags=0x13 2024-09-12T00:28:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 adding default.rgw.meta+users.uid+ragweed.client.0 to cache LRU end 2024-09-12T00:28:27.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 : miss 2024-09-12T00:28:27.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=426 2024-09-12T00:28:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-conf:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 info.flags=0x17 2024-09-12T00:28:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-conf:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 to cache LRU end 2024-09-12T00:28:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.051+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-conf:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 2024-09-12T00:28:27.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.055+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:28:27.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.055+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_index_versioning 2024-09-12T00:28:27.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.055+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_copy 2024-09-12T00:28:27.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.055+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_update_complete 2024-09-12T00:28:27.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.059+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_defer_complete 2024-09-12T00:28:27.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.059+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class 2024-09-12T00:28:27.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.059+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_multipart_simple 2024-09-12T00:28:27.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.059+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_obj_storage_class_multipart 2024-09-12T00:28:27.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.063+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got tests/r_test_small_obj_data 2024-09-12T00:28:27.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.063+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55ce3931e498 s->prefetch_data=0 2024-09-12T00:28:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.063+0000 7faab66fa9c0 10 manifest: total_size = 15940 2024-09-12T00:28:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.063+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15576401084135503089 2024-09-12T00:28:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.063+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart_copy state=0x55ce3931e498 s->prefetch_data=0 2024-09-12T00:28:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.063+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce3931e498 2024-09-12T00:28:27.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.063+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.1 2024-09-12T00:28:27.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.071+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55ce392a8908 s->prefetch_data=0 2024-09-12T00:28:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.071+0000 7faab66fa9c0 10 manifest: total_size = 5123 2024-09-12T00:28:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.071+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7133081764599964321 2024-09-12T00:28:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.071+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_multipart_index_versioning state=0x55ce392a8908 s->prefetch_data=0 2024-09-12T00:28:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.071+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a8908 2024-09-12T00:28:27.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.071+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.2 2024-09-12T00:28:27.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.075+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart_copy 2024-09-12T00:28:27.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.083+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.083+0000 7faab66fa9c0 10 manifest: total_size = 7693 2024-09-12T00:28:27.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.083+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8271723510578098511 2024-09-12T00:28:27.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.083+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_obj_storage_class_copy state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.083+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5078 2024-09-12T00:28:27.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.083+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.2 2024-09-12T00:28:27.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.087+0000 7fa98affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_index_versioning 2024-09-12T00:28:27.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.087+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.091+0000 7faab66fa9c0 10 manifest: total_size = 4971 2024-09-12T00:28:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.091+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1795807896690443139 2024-09-12T00:28:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.091+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac031040 obj=test-client.0-conf:tests/r_test_multipart_defer_update_complete state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.091+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5078 2024-09-12T00:28:27.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.091+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.3 2024-09-12T00:28:27.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.091+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_copy 2024-09-12T00:28:27.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.095+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392631b0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.095+0000 7faab66fa9c0 10 manifest: total_size = 4966 2024-09-12T00:28:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.099+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1923919482225022508 2024-09-12T00:28:27.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.099+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392631b0 obj=test-client.0-conf:tests/r_test_multipart_defer_complete state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.099+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5078 2024-09-12T00:28:27.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.099+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.4 2024-09-12T00:28:27.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.099+0000 7fa98affd640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_update_complete 2024-09-12T00:28:27.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.103+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262d20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.103+0000 7faab66fa9c0 10 manifest: total_size = 7633 2024-09-12T00:28:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.103+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15581911394203200063 2024-09-12T00:28:27.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.103+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262d20 obj=test-client.0-conf:tests/r_test_obj_storage_class state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.103+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5078 2024-09-12T00:28:27.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.103+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.4 2024-09-12T00:28:27.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.107+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_defer_complete 2024-09-12T00:28:27.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.111+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392632e0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.111+0000 7faab66fa9c0 10 manifest: total_size = 7511 2024-09-12T00:28:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.111+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16750808095087768022 2024-09-12T00:28:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.111+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392632e0 obj=test-client.0-conf:tests/r_test_multipart_simple state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.111+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5078 2024-09-12T00:28:27.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.111+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.5 2024-09-12T00:28:27.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.115+0000 7fa98affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class 2024-09-12T00:28:27.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.115+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392632e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.119+0000 7faab66fa9c0 10 manifest: total_size = 14188 2024-09-12T00:28:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.119+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14740467035597432420 2024-09-12T00:28:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.119+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392632e0 obj=test-client.0-conf:tests/r_test_obj_storage_class_multipart state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.119+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5078 2024-09-12T00:28:27.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.119+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.7 2024-09-12T00:28:27.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.119+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_multipart_simple 2024-09-12T00:28:27.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.123+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392632e0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.123+0000 7faab66fa9c0 10 manifest: total_size = 38488 2024-09-12T00:28:27.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.123+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.991751954768799424 2024-09-12T00:28:27.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.123+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392632e0 obj=test-client.0-conf:tests/r_test_small_obj_data state=0x55ce392a5078 s->prefetch_data=0 2024-09-12T00:28:27.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.123+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5078 2024-09-12T00:28:27.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.123+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4.8 2024-09-12T00:28:27.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.127+0000 7fa98affd640 20 handle_completion(): completion ok for obj=tests/r_test_obj_storage_class_multipart 2024-09-12T00:28:27.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.131+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.131+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.131+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=tests/r_test_small_obj_data 2024-09-12T00:28:27.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.135+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.135+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.135+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.135+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.135+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-conf[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.139+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-conf : miss 2024-09-12T00:28:27.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.139+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.139+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=204 2024-09-12T00:28:27.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.139+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-conf info.flags=0x11 2024-09-12T00:28:27.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.139+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-conf to cache LRU end 2024-09-12T00:28:27.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.143+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-conf from cache 2024-09-12T00:28:27.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.143+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-conf, ofs0, ns] 2024-09-12T00:28:27.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.143+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398865 cookie 94344210475664 notifier 5964 bl.length()=162 2024-09-12T00:28:27.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.147+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-conf:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 from cache 2024-09-12T00:28:27.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.147+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-conf:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4, ofs0, ns] 2024-09-12T00:28:27.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.147+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398923 cookie 94344210497008 notifier 5964 bl.length()=219 2024-09-12T00:28:27.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.155+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-conf/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 : miss 2024-09-12T00:28:27.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.155+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.155+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.155+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-conf/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 info.flags=0x0 2024-09-12T00:28:27.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.155+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-conf/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4 to cache LRU end 2024-09-12T00:28:27.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.159+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 : miss 2024-09-12T00:28:27.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.159+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.163+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=457 2024-09-12T00:28:27.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.163+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 info.flags=0x17 2024-09-12T00:28:27.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.163+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 to cache LRU end 2024-09-12T00:28:27.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.163+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.163+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.163+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 2024-09-12T00:28:27.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.171+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:28:27.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.171+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3931edd0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.175+0000 7faab66fa9c0 10 manifest: total_size = 74198 2024-09-12T00:28:27.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.175+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6866448550724242207 2024-09-12T00:28:27.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.175+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3931edd0 obj=test-client.0-r-test-multipart-defer-complete.1:foo state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.175+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392bc658 2024-09-12T00:28:27.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.175+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11.10 2024-09-12T00:28:27.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=20613 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=20613 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=61839 stripe_ofs=61839 part_ofs=61839 rule->part_size=12359 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=12359 rules.size()=2 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4256143 part_ofs=61839 rule->part_size=12359 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=74198 stripe_ofs=74198 part_ofs=74198 rule->part_size=12359 2024-09-12T00:28:27.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6866448550724242207 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.1 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 346 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.2 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 592 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.3 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 838 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.4 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1084 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.179+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.28tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6866448550724242207 2024-09-12T00:28:27.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:28:27.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.183+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-complete.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.187+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 : miss 2024-09-12T00:28:27.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.187+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.191+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=235 2024-09-12T00:28:27.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.191+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 info.flags=0x11 2024-09-12T00:28:27.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.191+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 to cache LRU end 2024-09-12T00:28:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.191+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-complete.1 from cache 2024-09-12T00:28:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.191+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-complete.1, ofs0, ns] 2024-09-12T00:28:27.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.191+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398919 cookie 94344210477872 notifier 5964 bl.length()=191 2024-09-12T00:28:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.195+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 from cache 2024-09-12T00:28:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.195+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11, ofs0, ns] 2024-09-12T00:28:27.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.195+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398920 cookie 94344210493312 notifier 5964 bl.length()=249 2024-09-12T00:28:27.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.203+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 : miss 2024-09-12T00:28:27.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.203+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.203+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.203+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 info.flags=0x0 2024-09-12T00:28:27.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.203+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-complete.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11 to cache LRU end 2024-09-12T00:28:27.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 : miss 2024-09-12T00:28:27.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=464 2024-09-12T00:28:27.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 info.flags=0x17 2024-09-12T00:28:27.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 to cache LRU end 2024-09-12T00:28:27.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.207+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 2024-09-12T00:28:27.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.215+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:28:27.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.215+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a75b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55ce3929e4b8 s->prefetch_data=0 2024-09-12T00:28:27.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.219+0000 7faab66fa9c0 10 manifest: total_size = 18874368 2024-09-12T00:28:27.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.219+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13680846715615614488 2024-09-12T00:28:27.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.219+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a75b0 obj=test-client.0-r-test-multipart-defer-update-complete.1:foo state=0x55ce3929e4b8 s->prefetch_data=0 2024-09-12T00:28:27.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.219+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce3929e4b8 2024-09-12T00:28:27.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.219+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12.10 2024-09-12T00:28:27.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=14680064 stripe_ofs=14680064 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=18874368 part_ofs=10485760 rule->part_size=5242880 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=15728640 stripe_ofs=15728640 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=3145728 rules.size()=2 2024-09-12T00:28:27.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=19922944 part_ofs=15728640 rule->part_size=3145728 2024-09-12T00:28:27.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=18874368 stripe_ofs=18874368 part_ofs=18874368 rule->part_size=3145728 2024-09-12T00:28:27.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13680846715615614488 2024-09-12T00:28:27.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.1 2024-09-12T00:28:27.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:28:27.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__shadow_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.1_1 2024-09-12T00:28:27.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 591 2024-09-12T00:28:27.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.2 2024-09-12T00:28:27.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 837 2024-09-12T00:28:27.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__shadow_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.2_1 2024-09-12T00:28:27.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1081 2024-09-12T00:28:27.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.3 2024-09-12T00:28:27.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1327 2024-09-12T00:28:27.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__shadow_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.3_1 2024-09-12T00:28:27.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1571 2024-09-12T00:28:27.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.4 2024-09-12T00:28:27.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1817 2024-09-12T00:28:27.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.223+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13680846715615614488 2024-09-12T00:28:27.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:28:27.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.227+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-defer-update-complete.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.231+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 : miss 2024-09-12T00:28:27.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.231+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.235+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=242 2024-09-12T00:28:27.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.235+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 info.flags=0x11 2024-09-12T00:28:27.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.235+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 to cache LRU end 2024-09-12T00:28:27.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.235+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-defer-update-complete.1 from cache 2024-09-12T00:28:27.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.235+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-defer-update-complete.1, ofs0, ns] 2024-09-12T00:28:27.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.235+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398866 cookie 94344210487328 notifier 5964 bl.length()=198 2024-09-12T00:28:27.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.239+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 from cache 2024-09-12T00:28:27.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.239+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-defer-update-complete.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12, ofs0, ns] 2024-09-12T00:28:27.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.239+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398921 cookie 94344210477872 notifier 5964 bl.length()=256 2024-09-12T00:28:27.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.247+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 : miss 2024-09-12T00:28:27.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.247+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.247+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.247+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 info.flags=0x0 2024-09-12T00:28:27.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.247+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-defer-update-complete.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12 to cache LRU end 2024-09-12T00:28:27.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 : miss 2024-09-12T00:28:27.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=459 2024-09-12T00:28:27.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 info.flags=0x17 2024-09-12T00:28:27.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 to cache LRU end 2024-09-12T00:28:27.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.251+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 2024-09-12T00:28:27.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.259+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo[ijqPnESSbRzaP0.ToH85jE9no2FxaGZ] 2024-09-12T00:28:27.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.263+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10.10 2024-09-12T00:28:27.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.263+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a82d0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55ce392bfe18 s->prefetch_data=0 2024-09-12T00:28:27.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.263+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to yd6b0cy3wd7qq6b5gb001lhcz74qtvqf 2024-09-12T00:28:27.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.263+0000 7faab66fa9c0 20 get_obj_state_impl: setting s->olh_tag to ke6wr69v00vf7wjio3fe7z75qesepq3f 2024-09-12T00:28:27.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.263+0000 7faab66fa9c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=ke6wr69v00vf7wjio3fe7z75qesepq3f 2024-09-12T00:28:27.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.267+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10.10 2024-09-12T00:28:27.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.267+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10.10 2024-09-12T00:28:27.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 20 olh_log_entry: epoch=3 op=2 key=foo[] 2024-09-12T00:28:27.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 20 olh_log_entry: epoch=3 op=3 key=foo[ijqPnESSbRzaP0.ToH85jE9no2FxaGZ] 2024-09-12T00:28:27.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a82d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:ijqPnESSbRzaP0.ToH85jE9no2FxaGZ_foo state=0x55ce392a5a68 s->prefetch_data=0 2024-09-12T00:28:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 10 manifest: total_size = 886297 2024-09-12T00:28:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15848241144789875135 2024-09-12T00:28:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a82d0 obj=test-client.0-r-test-multipart-index-versioning.1:_:ijqPnESSbRzaP0.ToH85jE9no2FxaGZ_foo state=0x55ce392a5a68 s->prefetch_data=0 2024-09-12T00:28:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392a5a68 2024-09-12T00:28:27.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.271+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10.10 2024-09-12T00:28:27.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:28:27.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=246247 2024-09-12T00:28:27.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=246247 stripe_ofs=246247 part_ofs=246247 rule->part_size=246247 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4440551 part_ofs=246247 rule->part_size=246247 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=492494 stripe_ofs=492494 part_ofs=492494 rule->part_size=246247 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=246247 rules.size()=2 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4686798 part_ofs=492494 rule->part_size=246247 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=738741 stripe_ofs=738741 part_ofs=738741 rule->part_size=147556 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=147556 rules.size()=2 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4933045 part_ofs=738741 rule->part_size=147556 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=886297 stripe_ofs=886297 part_ofs=886297 rule->part_size=147556 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15848241144789875135 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.1 2024-09-12T00:28:27.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 347 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.2 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 593 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.3 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 839 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.4 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1085 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.275+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.27tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15848241144789875135 2024-09-12T00:28:27.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.279+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo[ijqPnESSbRzaP0.ToH85jE9no2FxaGZ] 2024-09-12T00:28:27.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.283+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a82d0 obj=test-client.0-r-test-multipart-index-versioning.1:foo state=0x55ce392bfe18 s->prefetch_data=0 2024-09-12T00:28:27.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.283+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10.10 2024-09-12T00:28:27.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.287+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10.10 2024-09-12T00:28:27.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.287+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.287+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.291+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.291+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.291+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.291+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.291+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-index-versioning.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.295+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 : miss 2024-09-12T00:28:27.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.295+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.295+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=237 2024-09-12T00:28:27.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.295+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 info.flags=0x11 2024-09-12T00:28:27.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.295+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 to cache LRU end 2024-09-12T00:28:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.299+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-index-versioning.1 from cache 2024-09-12T00:28:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.299+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-index-versioning.1, ofs0, ns] 2024-09-12T00:28:27.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.299+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398867 cookie 94344210487328 notifier 5964 bl.length()=193 2024-09-12T00:28:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.299+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 from cache 2024-09-12T00:28:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.299+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-index-versioning.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10, ofs0, ns] 2024-09-12T00:28:27.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.303+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398924 cookie 94344210500656 notifier 5964 bl.length()=251 2024-09-12T00:28:27.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.307+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 : miss 2024-09-12T00:28:27.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.307+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.311+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.311+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 info.flags=0x0 2024-09-12T00:28:27.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.311+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-index-versioning.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10 to cache LRU end 2024-09-12T00:28:27.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 : miss 2024-09-12T00:28:27.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:28:27.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 info.flags=0x17 2024-09-12T00:28:27.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 to cache LRU end 2024-09-12T00:28:27.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.315+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 2024-09-12T00:28:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.323+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo 2024-09-12T00:28:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.323+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392c0f20 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55ce392bfd78 s->prefetch_data=0 2024-09-12T00:28:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.323+0000 7faab66fa9c0 10 manifest: total_size = 1667 2024-09-12T00:28:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.323+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.602460215211618388 2024-09-12T00:28:27.324 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.323+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392c0f20 obj=test-client.0-r-test-multipart-simple.1:foo state=0x55ce392bfd78 s->prefetch_data=0 2024-09-12T00:28:27.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.323+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392bfd78 2024-09-12T00:28:27.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.323+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9.10 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=516 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=516 stripe_ofs=516 part_ofs=516 rule->part_size=516 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194820 part_ofs=516 rule->part_size=516 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=1032 stripe_ofs=1032 part_ofs=1032 rule->part_size=516 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=516 rules.size()=2 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4195336 part_ofs=1032 rule->part_size=516 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=1548 stripe_ofs=1548 part_ofs=1548 rule->part_size=119 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=119 rules.size()=2 2024-09-12T00:28:27.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4195852 part_ofs=1548 rule->part_size=119 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=1667 stripe_ofs=1667 part_ofs=1667 rule->part_size=119 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.602460215211618388 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.1 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 343 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.2 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 587 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.3 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 831 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.4 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1075 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.18tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.602460215211618388 2024-09-12T00:28:27.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo 2024-09-12T00:28:27.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.332 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.331+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.335+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.335+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.335+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.335+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.335+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-multipart-simple.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.339+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 : miss 2024-09-12T00:28:27.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.339+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.339+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=225 2024-09-12T00:28:27.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.339+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 info.flags=0x11 2024-09-12T00:28:27.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.339+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 to cache LRU end 2024-09-12T00:28:27.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.343+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-multipart-simple.1 from cache 2024-09-12T00:28:27.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.343+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-multipart-simple.1, ofs0, ns] 2024-09-12T00:28:27.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.343+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398922 cookie 94344210493312 notifier 5964 bl.length()=183 2024-09-12T00:28:27.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.347+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-multipart-simple.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 from cache 2024-09-12T00:28:27.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.347+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-multipart-simple.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9, ofs0, ns] 2024-09-12T00:28:27.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.347+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398923 cookie 94344210493312 notifier 5964 bl.length()=240 2024-09-12T00:28:27.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.351+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 : miss 2024-09-12T00:28:27.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.351+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.355+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.355+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 info.flags=0x0 2024-09-12T00:28:27.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.355+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-multipart-simple.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9 to cache LRU end 2024-09-12T00:28:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 : miss 2024-09-12T00:28:27.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:28:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 info.flags=0x17 2024-09-12T00:28:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 to cache LRU end 2024-09-12T00:28:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 2024-09-12T00:28:27.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.359+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:28:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.363+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:28:27.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.363+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:28:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.363+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:28:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.363+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:28:27.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.363+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:28:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:28:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:28:27.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:28:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:28:27.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:28:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:28:27.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _JeEhb5rxyrPIEalp7ZNTh1knhX2y0ud 2024-09-12T00:28:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.367+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.0 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _JeEhb5rxyrPIEalp7ZNTh1knhX2y0ud 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.wssclK2_yzTaF861dQutTj4eGqHuqgv_0 2024-09-12T00:28:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:28:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.wssclK2_yzTaF861dQutTj4eGqHuqgv_1 2024-09-12T00:28:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:28:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: _JeEhb5rxyrPIEalp7ZNTh1knhX2y0ud 2024-09-12T00:28:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:28:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _FxF__9uy9H9heaHZKJBKs8TabLVSUzQ 2024-09-12T00:28:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.375+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.2 2024-09-12T00:28:27.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _FxF__9uy9H9heaHZKJBKs8TabLVSUzQ 2024-09-12T00:28:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.-MQLskYtgLx1Kw1p-cacQF3eJa3DpE4_1 2024-09-12T00:28:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:28:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.383+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _FxF__9uy9H9heaHZKJBKs8TabLVSUzQ 2024-09-12T00:28:27.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.387+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.387+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:28:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.387+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.387+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6290783858316596427 2024-09-12T00:28:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.387+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.387+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.387+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.3 2024-09-12T00:28:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6290783858316596427 2024-09-12T00:28:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_0 2024-09-12T00:28:27.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:28:27.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_1 2024-09-12T00:28:27.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:28:27.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.391+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6290783858316596427 2024-09-12T00:28:27.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.395+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:28:27.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.395+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa4067390 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.399+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.399+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _MGtnEWXkfZotvOm_1BZ0QD9FvpzIhmq 2024-09-12T00:28:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.399+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa4067390 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.399+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.399+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.5 2024-09-12T00:28:27.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _MGtnEWXkfZotvOm_1BZ0QD9FvpzIhmq 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.eH9ZEeILgdoUajXHYbzBOpBzJaU8srp_0 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.eH9ZEeILgdoUajXHYbzBOpBzJaU8srp_1 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.403+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _MGtnEWXkfZotvOm_1BZ0QD9FvpzIhmq 2024-09-12T00:28:27.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.407+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:28:27.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.407+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.407+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.407+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _c4jIs3Tahl3g23gM_0N-2TfHiBcbTNs 2024-09-12T00:28:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.407+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.407+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.407+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.5 2024-09-12T00:28:27.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _c4jIs3Tahl3g23gM_0N-2TfHiBcbTNs 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.MotVFXc18HMeuUF6KD6pDIsaTdNA5JP_0 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.MotVFXc18HMeuUF6KD6pDIsaTdNA5JP_1 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.415+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.0tag is: _c4jIs3Tahl3g23gM_0N-2TfHiBcbTNs 2024-09-12T00:28:27.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.419+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:28:27.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.419+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b3d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.419+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.419+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16080735421554646484 2024-09-12T00:28:27.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.419+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b3d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.419+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.419+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.5 2024-09-12T00:28:27.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16080735421554646484 2024-09-12T00:28:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.Fs9VUaj8m3FHBUzD2KsTqZS6VZb-ZvL_1 2024-09-12T00:28:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:28:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.9tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16080735421554646484 2024-09-12T00:28:27.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.427+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:28:27.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.431+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.431+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.431+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _ZPewx4S-qLsnEihihOhldROdmNX7wde 2024-09-12T00:28:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.431+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.431+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.431+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.7 2024-09-12T00:28:27.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _ZPewx4S-qLsnEihihOhldROdmNX7wde 2024-09-12T00:28:27.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.1oDRHaLyAj_PjAhk9HeQ9L10tOtv4LH_1 2024-09-12T00:28:27.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:28:27.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.439+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.2tag is: _ZPewx4S-qLsnEihihOhldROdmNX7wde 2024-09-12T00:28:27.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.443+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b3d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.443+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:28:27.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.443+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.443+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4601412571682205722 2024-09-12T00:28:27.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.443+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b3d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.443+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.443+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.7 2024-09-12T00:28:27.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4601412571682205722 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_0 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_1 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.447+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.11tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4601412571682205722 2024-09-12T00:28:27.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.451+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:28:27.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.451+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b3d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.455+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.455+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17221409918446709520 2024-09-12T00:28:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.455+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b3d70 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-STANDARD state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.455+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.455+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.7 2024-09-12T00:28:27.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17221409918446709520 2024-09-12T00:28:27.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.Fs9VUaj8m3FHBUzD2KsTqZS6VZb-ZvL_1 2024-09-12T00:28:27.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 331 2024-09-12T00:28:27.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.459+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.4tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17221409918446709520 2024-09-12T00:28:27.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.463+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:28:27.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.463+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.467+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.467+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12247121667611165907 2024-09-12T00:28:27.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.467+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-LUKEWARM-LUKEWARM state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.467+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.467+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.8 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12247121667611165907 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_0 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 340 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_1 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 579 2024-09-12T00:28:27.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.471+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.31tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12247121667611165907 2024-09-12T00:28:27.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.475+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:28:27.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.475+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80012f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.475+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.475+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _cY84uCBbM42YsZHhn_Ub9ntScd0-dVn 2024-09-12T00:28:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.475+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80012f0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-STANDARD-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.475+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.475+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.8 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _cY84uCBbM42YsZHhn_Ub9ntScd0-dVn 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.bIv8P1kQTaIfgpcniMq03tb48pRNtmt_0 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.bIv8P1kQTaIfgpcniMq03tb48pRNtmt_1 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:28:27.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.483+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _cY84uCBbM42YsZHhn_Ub9ntScd0-dVn 2024-09-12T00:28:27.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.487+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:28:27.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.487+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.487+0000 7faab66fa9c0 10 manifest: total_size = 5242880 2024-09-12T00:28:27.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.487+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5129143859965715391 2024-09-12T00:28:27.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.487+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa8007ba0 obj=test-client.0-r-test-obj-storage-class-copy.1:foo-FROZEN-FROZEN state=0x55ce39261478 s->prefetch_data=0 2024-09-12T00:28:27.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.487+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce39261478 2024-09-12T00:28:27.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.487+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15.9 2024-09-12T00:28:27.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5129143859965715391 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_0 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 337 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_1 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 574 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.495+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.8tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5129143859965715391 2024-09-12T00:28:27.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.499+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:28:27.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.499+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.499+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.503+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.503+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.503+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.503+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.503+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-copy.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.507+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 : miss 2024-09-12T00:28:27.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.507+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.507+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=233 2024-09-12T00:28:27.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.507+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 info.flags=0x11 2024-09-12T00:28:27.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.507+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 to cache LRU end 2024-09-12T00:28:27.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.511+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-copy.1 from cache 2024-09-12T00:28:27.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.511+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-copy.1, ofs0, ns] 2024-09-12T00:28:27.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.511+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398868 cookie 94344210487328 notifier 5964 bl.length()=189 2024-09-12T00:28:27.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.515+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 from cache 2024-09-12T00:28:27.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.515+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15, ofs0, ns] 2024-09-12T00:28:27.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.519+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398925 cookie 94344210500656 notifier 5964 bl.length()=247 2024-09-12T00:28:27.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.523+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 : miss 2024-09-12T00:28:27.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.523+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.527+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.527+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 info.flags=0x0 2024-09-12T00:28:27.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.527+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-copy.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15 to cache LRU end 2024-09-12T00:28:27.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 : miss 2024-09-12T00:28:27.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=465 2024-09-12T00:28:27.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 info.flags=0x17 2024-09-12T00:28:27.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 to cache LRU end 2024-09-12T00:28:27.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.531+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 2024-09-12T00:28:27.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.535+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD-LUKEWARM 2024-09-12T00:28:27.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.535+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-STANDARD 2024-09-12T00:28:27.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.535+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:28:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.539+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN-LUKEWARM 2024-09-12T00:28:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.539+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-FROZEN 2024-09-12T00:28:27.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.539+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:28:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN-STANDARD 2024-09-12T00:28:27.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:28:27.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD-STANDARD 2024-09-12T00:28:27.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM-LUKEWARM 2024-09-12T00:28:27.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD-FROZEN 2024-09-12T00:28:27.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN-FROZEN 2024-09-12T00:28:27.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 10 manifest: total_size = 16379 2024-09-12T00:28:27.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _rYXwXN7jiooMrkkOh0q8scF-BkGUjHs 2024-09-12T00:28:27.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.543+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.0 2024-09-12T00:28:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _rYXwXN7jiooMrkkOh0q8scF-BkGUjHs 2024-09-12T00:28:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.iZjSnhTYYVZRH7IQW8meQcPCwezwXWy_0 2024-09-12T00:28:27.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:28:27.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.551+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.23tag is: _rYXwXN7jiooMrkkOh0q8scF-BkGUjHs 2024-09-12T00:28:27.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.555+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-LUKEWARM 2024-09-12T00:28:27.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.555+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a6680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.555+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.555+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _Qi8Yw8z-rcRXDs5vyAhIbp6dvntn3c- 2024-09-12T00:28:27.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.555+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a6680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.555+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.555+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.2 2024-09-12T00:28:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _Qi8Yw8z-rcRXDs5vyAhIbp6dvntn3c- 2024-09-12T00:28:27.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.KcRWH3OV9ubYQTCyl0ys1TweU9R2-5d_1 2024-09-12T00:28:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:28:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.KcRWH3OV9ubYQTCyl0ys1TweU9R2-5d_2 2024-09-12T00:28:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:28:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.563+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.29tag is: _Qi8Yw8z-rcRXDs5vyAhIbp6dvntn3c- 2024-09-12T00:28:27.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.567+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-STANDARD 2024-09-12T00:28:27.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.567+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a6680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.567+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.567+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11515984522338195923 2024-09-12T00:28:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.567+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392a6680 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.567+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.567+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.3 2024-09-12T00:28:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11515984522338195923 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 368 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1_1 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 633 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 900 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2_1 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1165 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.3 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1432 2024-09-12T00:28:27.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.575+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.13tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11515984522338195923 2024-09-12T00:28:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.579+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:28:27.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.579+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3929fc60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.579+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.579+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _W9ktUuAFekshmiUOqXgAhaxJZ2qZiS0 2024-09-12T00:28:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.579+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3929fc60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.579+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.579+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.5 2024-09-12T00:28:27.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _W9ktUuAFekshmiUOqXgAhaxJZ2qZiS0 2024-09-12T00:28:27.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.kAFrcWNYNZyyEMqJSSKSkQfGHglPS7H_0 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 310 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.kAFrcWNYNZyyEMqJSSKSkQfGHglPS7H_1 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 549 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.kAFrcWNYNZyyEMqJSSKSkQfGHglPS7H_2 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 788 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.587+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.14tag is: _W9ktUuAFekshmiUOqXgAhaxJZ2qZiS0 2024-09-12T00:28:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.591+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-LUKEWARM 2024-09-12T00:28:27.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.591+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3929fc60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.591+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.591+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _-Ud2n_014q1wHNXcbXkUb95xRQq3o4w 2024-09-12T00:28:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.591+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3929fc60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.591+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.591+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.5 2024-09-12T00:28:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _-Ud2n_014q1wHNXcbXkUb95xRQq3o4w 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.waHH1aCSLy7IN_iBWMXNr0-BSeyo160_0 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.waHH1aCSLy7IN_iBWMXNr0-BSeyo160_1 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 545 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.waHH1aCSLy7IN_iBWMXNr0-BSeyo160_2 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 782 2024-09-12T00:28:27.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.599+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.24tag is: _-Ud2n_014q1wHNXcbXkUb95xRQq3o4w 2024-09-12T00:28:27.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.603+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3929fc60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.603+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-FROZEN 2024-09-12T00:28:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.603+0000 7faab66fa9c0 10 manifest: total_size = 16379 2024-09-12T00:28:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.603+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2423826511234987677 2024-09-12T00:28:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.603+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce3929fc60 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.603+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.603+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.5 2024-09-12T00:28:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T00:28:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2024-09-12T00:28:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7673 2024-09-12T00:28:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T00:28:27.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7673 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=1035 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4209648 part_ofs=15344 rule->part_size=1035 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=16379 rule->part_size=1035 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2423826511234987677 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.1 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 364 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.2 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 628 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.3 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 892 2024-09-12T00:28:27.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2423826511234987677 2024-09-12T00:28:27.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.611+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:28:27.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.615+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.615+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.615+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _l5qtj9CAYSIXFjgcKI5VfpAobeberax 2024-09-12T00:28:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.615+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.615+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.615+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.7 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _l5qtj9CAYSIXFjgcKI5VfpAobeberax 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.vQwvOutFWrSutlS4bkxG37xoOwHITef_1 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 301 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.vQwvOutFWrSutlS4bkxG37xoOwHITef_2 2024-09-12T00:28:27.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 531 2024-09-12T00:28:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.623+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: _l5qtj9CAYSIXFjgcKI5VfpAobeberax 2024-09-12T00:28:27.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.627+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-FROZEN-STANDARD 2024-09-12T00:28:27.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.627+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.627+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.627+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2873798180363383908 2024-09-12T00:28:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.627+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.627+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.627+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.7 2024-09-12T00:28:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.635 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:28:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:28:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2873798180363383908 2024-09-12T00:28:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1 2024-09-12T00:28:27.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:28:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1_1 2024-09-12T00:28:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:28:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2 2024-09-12T00:28:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:28:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2_1 2024-09-12T00:28:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:28:27.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.3 2024-09-12T00:28:27.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:28:27.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.635+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.3tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2873798180363383908 2024-09-12T00:28:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.639+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:28:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.639+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392c6c20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.639+0000 7faab66fa9c0 10 manifest: total_size = 16379 2024-09-12T00:28:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.639+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.164568517454645964 2024-09-12T00:28:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.639+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392c6c20 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-STANDARD state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.639+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.639+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.7 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=7671 rules.size()=3 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=7671 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=7671 stripe_ofs=7671 part_ofs=7671 rule->part_size=7673 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=7673 rules.size()=3 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4201975 part_ofs=7671 rule->part_size=7673 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=15344 stripe_ofs=15344 part_ofs=15344 rule->part_size=1035 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1035 rules.size()=3 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4209648 part_ofs=15344 rule->part_size=1035 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=16379 rule->part_size=1035 2024-09-12T00:28:27.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.164568517454645964 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.1 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.2 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.3 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.647+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.25tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.164568517454645964 2024-09-12T00:28:27.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.651+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-STANDARD 2024-09-12T00:28:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.651+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.651+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.651+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1170014077582854684 2024-09-12T00:28:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.651+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392bf5d0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-LUKEWARM-LUKEWARM state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.651+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.651+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.8 2024-09-12T00:28:27.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1170014077582854684 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 373 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1_1 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 644 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 917 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2_1 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1188 2024-09-12T00:28:27.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.3 2024-09-12T00:28:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1461 2024-09-12T00:28:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1170014077582854684 2024-09-12T00:28:27.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.659+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-LUKEWARM-LUKEWARM 2024-09-12T00:28:27.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.663+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392ba4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.663+0000 7faab66fa9c0 10 manifest: total_size = 16379 2024-09-12T00:28:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.663+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to _36fk1NFU9xuZc7g4JWcFg0dnv55uDhU 2024-09-12T00:28:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.663+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392ba4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-STANDARD-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.663+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.663+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.8 2024-09-12T00:28:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=16379 stripe_ofs=16379 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: _36fk1NFU9xuZc7g4JWcFg0dnv55uDhU 2024-09-12T00:28:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.Tqkr-drTcWpq2NYy6n0ya0q2YYgs8iO_0 2024-09-12T00:28:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 308 2024-09-12T00:28:27.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.17tag is: _36fk1NFU9xuZc7g4JWcFg0dnv55uDhU 2024-09-12T00:28:27.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.671+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-STANDARD-FROZEN 2024-09-12T00:28:27.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.675+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392ba4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.675+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.675+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4314825876673728153 2024-09-12T00:28:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.675+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392ba4c0 obj=test-client.0-r-test-obj-storage-class-multipart-copy.1:foo-FROZEN-FROZEN state=0x55ce392b7b58 s->prefetch_data=0 2024-09-12T00:28:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.675+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392b7b58 2024-09-12T00:28:27.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.675+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16.9 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4314825876673728153 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1_1 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2_1 2024-09-12T00:28:27.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:28:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.3 2024-09-12T00:28:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:28:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.679+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4314825876673728153 2024-09-12T00:28:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.683+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-FROZEN-FROZEN 2024-09-12T00:28:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.683+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.683+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.687+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.687+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.687+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.687+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.687+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart-copy.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.691+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 : miss 2024-09-12T00:28:27.690 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.691+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.691+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=243 2024-09-12T00:28:27.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.691+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 info.flags=0x11 2024-09-12T00:28:27.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.691+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 to cache LRU end 2024-09-12T00:28:27.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.695+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart-copy.1 from cache 2024-09-12T00:28:27.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.695+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart-copy.1, ofs0, ns] 2024-09-12T00:28:27.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.695+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398860 cookie 94344210489536 notifier 5964 bl.length()=199 2024-09-12T00:28:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.699+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 from cache 2024-09-12T00:28:27.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.699+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart-copy.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16, ofs0, ns] 2024-09-12T00:28:27.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.699+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398869 cookie 94344210487328 notifier 5964 bl.length()=257 2024-09-12T00:28:27.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.707+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 : miss 2024-09-12T00:28:27.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.707+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.707+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.707+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 info.flags=0x0 2024-09-12T00:28:27.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.707+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart-copy.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16 to cache LRU end 2024-09-12T00:28:27.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 : miss 2024-09-12T00:28:27.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:28:27.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 info.flags=0x17 2024-09-12T00:28:27.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 to cache LRU end 2024-09-12T00:28:27.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.715+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 2024-09-12T00:28:27.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.719+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:28:27.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.723+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:28:27.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.723+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:28:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.727+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9df0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.727+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.727+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2287584523344853376 2024-09-12T00:28:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.727+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9df0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-FROZEN state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.727+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392bc658 2024-09-12T00:28:27.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.727+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14.3 2024-09-12T00:28:27.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2287584523344853376 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.1 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 367 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.1_1 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 632 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.2 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 899 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.2_1 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1164 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.3 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1431 2024-09-12T00:28:27.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.735+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.30tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2287584523344853376 2024-09-12T00:28:27.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.739+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:28:27.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.739+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.739+0000 7faab66fa9c0 10 manifest: total_size = 45360 2024-09-12T00:28:27.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.739+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.255924249743586597 2024-09-12T00:28:27.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.739+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaac011cc0 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-STANDARD state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.739+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392bc658 2024-09-12T00:28:27.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.739+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14.5 2024-09-12T00:28:27.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:28:27.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=20613 2024-09-12T00:28:27.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=20613 stripe_ofs=20613 part_ofs=20613 rule->part_size=20613 2024-09-12T00:28:27.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=20613 rules.size()=2 2024-09-12T00:28:27.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4214917 part_ofs=20613 rule->part_size=20613 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=41226 stripe_ofs=41226 part_ofs=41226 rule->part_size=4134 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=4134 rules.size()=2 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4235530 part_ofs=41226 rule->part_size=4134 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=45360 stripe_ofs=45360 part_ofs=45360 rule->part_size=4134 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.255924249743586597 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-STANDARD.2~JpErWK2LREdiIuRJw3EOnb-k4DjwqM_.1 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 363 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-STANDARD.2~JpErWK2LREdiIuRJw3EOnb-k4DjwqM_.2 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 627 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-STANDARD.2~JpErWK2LREdiIuRJw3EOnb-k4DjwqM_.3 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 891 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.15tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.255924249743586597 2024-09-12T00:28:27.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.747+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:28:27.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.751+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39261810 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.751+0000 7faab66fa9c0 10 manifest: total_size = 11534336 2024-09-12T00:28:27.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.751+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10760192229307867919 2024-09-12T00:28:27.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.751+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39261810 obj=test-client.0-r-test-obj-storage-class-multipart.1:foo-LUKEWARM state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.751+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392bc658 2024-09-12T00:28:27.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.751+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14.7 2024-09-12T00:28:27.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=8388608 part_ofs=0 rule->part_size=5242880 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=5242880 stripe_ofs=5242880 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=9437184 stripe_ofs=9437184 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=5242880 rules.size()=2 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=13631488 part_ofs=5242880 rule->part_size=5242880 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=1048576 rules.size()=2 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): stripe_ofs=14680064 part_ofs=10485760 rule->part_size=1048576 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=11534336 stripe_ofs=11534336 part_ofs=11534336 rule->part_size=1048576 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10760192229307867919 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.1 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 374 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.1_1 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 645 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.2 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 918 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.2_1 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1189 2024-09-12T00:28:27.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.3 2024-09-12T00:28:27.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 1462 2024-09-12T00:28:27.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.755+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.1tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10760192229307867919 2024-09-12T00:28:27.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.759+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:28:27.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.819+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.819+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.823+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.823+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.823+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.823+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.823+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class-multipart.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.827+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 : miss 2024-09-12T00:28:27.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.827+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.827+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=238 2024-09-12T00:28:27.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.827+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 info.flags=0x11 2024-09-12T00:28:27.828 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.827+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 to cache LRU end 2024-09-12T00:28:27.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.831+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class-multipart.1 from cache 2024-09-12T00:28:27.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.831+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class-multipart.1, ofs0, ns] 2024-09-12T00:28:27.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.831+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398926 cookie 94344210494368 notifier 5964 bl.length()=194 2024-09-12T00:28:27.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.835+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 from cache 2024-09-12T00:28:27.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.835+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class-multipart.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14, ofs0, ns] 2024-09-12T00:28:27.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.835+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398870 cookie 94344210487328 notifier 5964 bl.length()=252 2024-09-12T00:28:27.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.843+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 : miss 2024-09-12T00:28:27.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.843+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.843+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.843+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 info.flags=0x0 2024-09-12T00:28:27.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.843+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class-multipart.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14 to cache LRU end 2024-09-12T00:28:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 : miss 2024-09-12T00:28:27.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=450 2024-09-12T00:28:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 info.flags=0x17 2024-09-12T00:28:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 to cache LRU end 2024-09-12T00:28:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.851+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 2024-09-12T00:28:27.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.855+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-FROZEN 2024-09-12T00:28:27.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.855+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-STANDARD 2024-09-12T00:28:27.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.859+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got foo-LUKEWARM 2024-09-12T00:28:27.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.863+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392be350 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55ce392ba868 s->prefetch_data=0 2024-09-12T00:28:27.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.863+0000 7faab66fa9c0 10 manifest: total_size = 10485760 2024-09-12T00:28:27.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.863+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15195941230104383500 2024-09-12T00:28:27.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.863+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392be350 obj=test-client.0-r-test-obj-storage-class.1:foo-FROZEN state=0x55ce392ba868 s->prefetch_data=0 2024-09-12T00:28:27.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.863+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392ba868 2024-09-12T00:28:27.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.863+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13.3 2024-09-12T00:28:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15195941230104383500 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.7pQymxok79S7hpSnegKOgv2jf97pqNJ_0 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 338 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.7pQymxok79S7hpSnegKOgv2jf97pqNJ_1 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 575 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.7pQymxok79S7hpSnegKOgv2jf97pqNJ_2 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 812 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.871+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.10tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15195941230104383500 2024-09-12T00:28:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.875+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-FROZEN 2024-09-12T00:28:27.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.875+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392be350 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55ce392ba868 s->prefetch_data=0 2024-09-12T00:28:27.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.875+0000 7faab66fa9c0 10 manifest: total_size = 44258 2024-09-12T00:28:27.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.875+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12035475737565499596 2024-09-12T00:28:27.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.875+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392be350 obj=test-client.0-r-test-obj-storage-class.1:foo-STANDARD state=0x55ce392ba868 s->prefetch_data=0 2024-09-12T00:28:27.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.875+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392ba868 2024-09-12T00:28:27.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.875+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13.5 2024-09-12T00:28:27.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.883+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392be350 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55ce392ba868 s->prefetch_data=0 2024-09-12T00:28:27.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.883+0000 7faab66fa9c0 10 manifest: total_size = 10485760 2024-09-12T00:28:27.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.883+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4810448816227242926 2024-09-12T00:28:27.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.883+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392be350 obj=test-client.0-r-test-obj-storage-class.1:foo-LUKEWARM state=0x55ce392ba868 s->prefetch_data=0 2024-09-12T00:28:27.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.883+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392ba868 2024-09-12T00:28:27.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.883+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13.7 2024-09-12T00:28:27.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.887+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=foo-STANDARD 2024-09-12T00:28:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=4194304 stripe_ofs=4194304 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=8388608 stripe_ofs=8388608 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): rule->part_size=0 rules.size()=1 2024-09-12T00:28:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 RGWObjManifest::operator++(): result: ofs=10485760 stripe_ofs=10485760 part_ofs=0 rule->part_size=0 2024-09-12T00:28:27.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4810448816227242926 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - rgw_max_chunk_size is: 4194304 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.0KP9-VArl2W5VI2XLziD_3ot3N4C8TM_0 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 339 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.0KP9-VArl2W5VI2XLziD_3ot3N4C8TM_1 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 578 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - adding obj with name: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.0KP9-VArl2W5VI2XLziD_3ot3N4C8TM_2 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - total_encoded_size is: 817 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_split_chain - sending leftover objects 2024-09-12T00:28:27.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.891+0000 7faab66fa9c0 20 garbage collection: RGWGC::send_chain - on object name: gc.21tag is: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4810448816227242926 2024-09-12T00:28:27.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.895+0000 7fa98affd640 20 handle_completion(): completion ok for obj=foo-LUKEWARM 2024-09-12T00:28:27.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.895+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.895+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.899+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.899+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.899+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.899+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.899+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-obj-storage-class.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.903+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 : miss 2024-09-12T00:28:27.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.903+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.903+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=228 2024-09-12T00:28:27.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.903+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 info.flags=0x11 2024-09-12T00:28:27.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.903+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 to cache LRU end 2024-09-12T00:28:27.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.907+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-obj-storage-class.1 from cache 2024-09-12T00:28:27.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.907+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-obj-storage-class.1, ofs0, ns] 2024-09-12T00:28:27.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.907+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398871 cookie 94344210487328 notifier 5964 bl.length()=184 2024-09-12T00:28:27.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.911+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-obj-storage-class.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 from cache 2024-09-12T00:28:27.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.911+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-obj-storage-class.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13, ofs0, ns] 2024-09-12T00:28:27.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.911+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398924 cookie 94344210477872 notifier 5964 bl.length()=242 2024-09-12T00:28:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.919+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 : miss 2024-09-12T00:28:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.919+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.919+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.919+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 info.flags=0x0 2024-09-12T00:28:27.920 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.919+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-obj-storage-class.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13 to cache LRU end 2024-09-12T00:28:27.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 : miss 2024-09-12T00:28:27.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:28:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 info.flags=0x17 2024-09-12T00:28:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 to cache LRU end 2024-09-12T00:28:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:27.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.927+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 2024-09-12T00:28:27.930 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.931+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:28:27.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.931+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:28:27.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.935+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:28:27.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.935+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:28:27.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.939+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.939+0000 7faab66fa9c0 10 manifest: total_size = 0 2024-09-12T00:28:27.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.939+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10936888974616617053 2024-09-12T00:28:27.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.939+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:___ state=0x55ce392bc658 s->prefetch_data=0 2024-09-12T00:28:27.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.939+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392bc658 2024-09-12T00:28:27.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.939+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6.2 2024-09-12T00:28:27.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.947+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55ce392c5538 s->prefetch_data=0 2024-09-12T00:28:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.947+0000 7faab66fa9c0 10 manifest: total_size = 0 2024-09-12T00:28:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.947+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11812171585909891407 2024-09-12T00:28:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.947+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:__ _ state=0x55ce392c5538 s->prefetch_data=0 2024-09-12T00:28:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.947+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392c5538 2024-09-12T00:28:27.946 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.947+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6.3 2024-09-12T00:28:27.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.947+0000 7fa98affd640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:28:27.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.955+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55ce392c5538 s->prefetch_data=0 2024-09-12T00:28:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.955+0000 7faab66fa9c0 10 manifest: total_size = 0 2024-09-12T00:28:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.955+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17731107803605074610 2024-09-12T00:28:27.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.955+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:__ state=0x55ce392c5538 s->prefetch_data=0 2024-09-12T00:28:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.955+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392c5538 2024-09-12T00:28:27.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.955+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6.6 2024-09-12T00:28:27.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.955+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:28:27.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.963+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55ce392c5538 s->prefetch_data=0 2024-09-12T00:28:27.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.967+0000 7faab66fa9c0 10 manifest: total_size = 0 2024-09-12T00:28:27.966 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.967+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1548293819218943761 2024-09-12T00:28:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.967+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce39262da0 obj=test-client.0-r-test-small-obj-data.1:obj state=0x55ce392c5538 s->prefetch_data=0 2024-09-12T00:28:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.967+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392c5538 2024-09-12T00:28:27.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.967+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6.8 2024-09-12T00:28:27.968 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.967+0000 7fa98affd640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:28:27.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.971+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:27.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.971+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:27.976 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.979+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:28:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.979+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.979+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.979+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.979+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:27.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.979+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.1[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:27.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.983+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 : miss 2024-09-12T00:28:27.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.983+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:27.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.983+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:28:27.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.983+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 info.flags=0x11 2024-09-12T00:28:27.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.983+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 to cache LRU end 2024-09-12T00:28:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.987+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.1 from cache 2024-09-12T00:28:27.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.987+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.1, ofs0, ns] 2024-09-12T00:28:27.988 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.987+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398925 cookie 94344210477872 notifier 5964 bl.length()=181 2024-09-12T00:28:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.991+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 from cache 2024-09-12T00:28:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.991+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.1:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6, ofs0, ns] 2024-09-12T00:28:27.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:27.995+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398926 cookie 94344210477872 notifier 5964 bl.length()=238 2024-09-12T00:28:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.003+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 : miss 2024-09-12T00:28:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.003+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.003+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.003+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 info.flags=0x0 2024-09-12T00:28:28.002 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.003+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.1/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6 to cache LRU end 2024-09-12T00:28:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.007+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 : miss 2024-09-12T00:28:28.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.007+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.011+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:28:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.011+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 info.flags=0x17 2024-09-12T00:28:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.011+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 to cache LRU end 2024-09-12T00:28:28.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.011+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.011+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:28.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.011+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 2024-09-12T00:28:28.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.011+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:28:28.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.015+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:28:28.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.019+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:28:28.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.019+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:28:28.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.019+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.023+0000 7faab66fa9c0 10 manifest: total_size = 527 2024-09-12T00:28:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.023+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3942703282979298721 2024-09-12T00:28:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.023+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:___ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.023+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.021 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.023+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7.2 2024-09-12T00:28:28.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.027+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.031+0000 7faab66fa9c0 10 manifest: total_size = 527 2024-09-12T00:28:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.031+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2416112515659804416 2024-09-12T00:28:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.031+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:__ _ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.031+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.029 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.031+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7.3 2024-09-12T00:28:28.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.031+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:28:28.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.035+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.039+0000 7faab66fa9c0 10 manifest: total_size = 38 2024-09-12T00:28:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.039+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8404590581246116272 2024-09-12T00:28:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.039+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:__ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.039+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.039+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7.6 2024-09-12T00:28:28.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.039+0000 7fa98affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:28:28.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.043+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.047+0000 7faab66fa9c0 10 manifest: total_size = 527 2024-09-12T00:28:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.047+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17704811871011537434 2024-09-12T00:28:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.047+0000 7faab66fa9c0 20 get_obj_state: octx=0x7faaa80cef80 obj=test-client.0-r-test-small-obj-data.2:obj state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.047+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.047+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7.8 2024-09-12T00:28:28.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.047+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:28:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.051+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:28.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.051+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:28.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.055+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:28:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.055+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.055+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.055+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.055+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:28.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.055+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.2[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:28.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.059+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 : miss 2024-09-12T00:28:28.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.059+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.063+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:28:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.063+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 info.flags=0x11 2024-09-12T00:28:28.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.063+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 to cache LRU end 2024-09-12T00:28:28.063 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.063+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.2 from cache 2024-09-12T00:28:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.063+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.2, ofs0, ns] 2024-09-12T00:28:28.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.063+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398927 cookie 94344210477872 notifier 5964 bl.length()=181 2024-09-12T00:28:28.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.071+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.2:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 from cache 2024-09-12T00:28:28.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.071+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.2:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7, ofs0, ns] 2024-09-12T00:28:28.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.071+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398928 cookie 94344210477872 notifier 5964 bl.length()=238 2024-09-12T00:28:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.075+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 : miss 2024-09-12T00:28:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.075+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.079+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.079+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 info.flags=0x0 2024-09-12T00:28:28.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.079+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.2/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7 to cache LRU end 2024-09-12T00:28:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 : miss 2024-09-12T00:28:28.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=445 2024-09-12T00:28:28.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 info.flags=0x17 2024-09-12T00:28:28.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 10 adding default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 to cache LRU end 2024-09-12T00:28:28.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:28.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:28:28.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.083+0000 7faab66fa9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 2024-09-12T00:28:28.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.087+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got ___ 2024-09-12T00:28:28.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.087+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got __ _ 2024-09-12T00:28:28.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.091+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got __ 2024-09-12T00:28:28.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.091+0000 7faab66fa9c0 10 cls_bucket_list_unordered: got obj 2024-09-12T00:28:28.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.091+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.095+0000 7faab66fa9c0 10 manifest: total_size = 49187 2024-09-12T00:28:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.095+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14437407792333179187 2024-09-12T00:28:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.095+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:___ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.095+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.095+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8.2 2024-09-12T00:28:28.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.099+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.099+0000 7faab66fa9c0 10 manifest: total_size = 49187 2024-09-12T00:28:28.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.099+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17999988705272564981 2024-09-12T00:28:28.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.099+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:__ _ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.099+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.099+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8.3 2024-09-12T00:28:28.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.103+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=___ 2024-09-12T00:28:28.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.107+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.107+0000 7faab66fa9c0 10 manifest: total_size = 1035 2024-09-12T00:28:28.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.107+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17076274781137590588 2024-09-12T00:28:28.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.107+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:__ state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.107+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.107+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8.6 2024-09-12T00:28:28.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.111+0000 7fa98affd640 20 handle_completion(): completion ok for obj=__ _ 2024-09-12T00:28:28.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.115+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.115+0000 7faab66fa9c0 10 manifest: total_size = 1048576 2024-09-12T00:28:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.115+0000 7faab66fa9c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18006186971405431829 2024-09-12T00:28:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.115+0000 7faab66fa9c0 20 get_obj_state: octx=0x55ce392b9ca0 obj=test-client.0-r-test-small-obj-data.3:obj state=0x55ce392aa4c8 s->prefetch_data=0 2024-09-12T00:28:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.115+0000 7faab66fa9c0 20 prepare_atomic_modification: state is not atomic. state=0x55ce392aa4c8 2024-09-12T00:28:28.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.115+0000 7faab66fa9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8.8 2024-09-12T00:28:28.117 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.119+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=__ 2024-09-12T00:28:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.123+0000 7faab66fa9c0 20 list_objects_ordered: starting attempt 1 2024-09-12T00:28:28.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.123+0000 7faab66fa9c0 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-12T00:28:28.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.127+0000 7fa98b7fe640 20 handle_completion(): completion ok for obj=obj 2024-09-12T00:28:28.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.127+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-12T00:28:28.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.127+0000 7faab66fa9c0 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-12T00:28:28.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.127+0000 7faab66fa9c0 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-12T00:28:28.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.127+0000 7faab66fa9c0 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-12T00:28:28.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.127+0000 7faab66fa9c0 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":test-client.0-r-test-small-obj-data.3[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8])"; uploads.size()=0; is_truncated=0 2024-09-12T00:28:28.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.131+0000 7faab66fa9c0 10 cache get: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 : miss 2024-09-12T00:28:28.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.131+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.131+0000 7faab66fa9c0 20 rados_obj.operate() r=0 bl.length=223 2024-09-12T00:28:28.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.131+0000 7faab66fa9c0 10 cache put: name=default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 info.flags=0x11 2024-09-12T00:28:28.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.131+0000 7faab66fa9c0 10 adding default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 to cache LRU end 2024-09-12T00:28:28.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.135+0000 7faab66fa9c0 10 removing default.rgw.meta+root+test-client.0-r-test-small-obj-data.3 from cache 2024-09-12T00:28:28.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.135+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:test-client.0-r-test-small-obj-data.3, ofs0, ns] 2024-09-12T00:28:28.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.135+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398929 cookie 94344210477872 notifier 5964 bl.length()=181 2024-09-12T00:28:28.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.139+0000 7faab66fa9c0 10 removing default.rgw.meta+root+.bucket.meta.test-client.0-r-test-small-obj-data.3:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 from cache 2024-09-12T00:28:28.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.139+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.test-client.0-r-test-small-obj-data.3:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8, ofs0, ns] 2024-09-12T00:28:28.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.139+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398930 cookie 94344210477872 notifier 5964 bl.length()=238 2024-09-12T00:28:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.147+0000 7faab66fa9c0 10 cache get: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 : miss 2024-09-12T00:28:28.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.147+0000 7faab66fa9c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.147+0000 7faab66fa9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.147+0000 7faab66fa9c0 10 cache put: name=default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 info.flags=0x0 2024-09-12T00:28:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.147+0000 7faab66fa9c0 10 adding default.rgw.log++pubsub..bucket.test-client.0-r-test-small-obj-data.3/88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8 to cache LRU end 2024-09-12T00:28:28.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.155+0000 7faab66fa9c0 10 removing key index: ZSNJCAYTDCYWFRIRHZLL 2024-09-12T00:28:28.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.155+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:ZSNJCAYTDCYWFRIRHZLL, ofs0, ns] 2024-09-12T00:28:28.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.159+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398872 cookie 94344210487328 notifier 5964 bl.length()=170 2024-09-12T00:28:28.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.159+0000 7faab66fa9c0 10 removing email index: ragweed.client.0+test@test.test 2024-09-12T00:28:28.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.159+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.email:ragweed.client.0+test@test.test, ofs0, ns] 2024-09-12T00:28:28.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.163+0000 7fa98affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94344210487328 notifier 5964 bl.length()=182 2024-09-12T00:28:28.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.163+0000 7faab66fa9c0 10 removing user buckets index 2024-09-12T00:28:28.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.167+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0.buckets, ofs0, ns] 2024-09-12T00:28:28.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.167+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398927 cookie 94344210494368 notifier 5964 bl.length()=173 2024-09-12T00:28:28.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.167+0000 7faab66fa9c0 10 removing user index: ragweed.client.0 2024-09-12T00:28:28.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.171+0000 7faab66fa9c0 10 removing default.rgw.meta+users.uid+ragweed.client.0 from cache 2024-09-12T00:28:28.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.171+0000 7faab66fa9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:ragweed.client.0, ofs0, ns] 2024-09-12T00:28:28.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.171+0000 7fa98b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398931 cookie 94344210493312 notifier 5964 bl.length()=165 2024-09-12T00:28:28.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.175+0000 7fa96a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:28.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.179+0000 7faab66fa9c0 20 remove_watcher() i=0 2024-09-12T00:28:28.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.179+0000 7faab66fa9c0 2 removed watcher, disabling cache 2024-09-12T00:28:28.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.183+0000 7faab66fa9c0 20 remove_watcher() i=1 2024-09-12T00:28:28.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.183+0000 7faab66fa9c0 20 remove_watcher() i=2 2024-09-12T00:28:28.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.187+0000 7faab66fa9c0 20 remove_watcher() i=3 2024-09-12T00:28:28.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.187+0000 7faab66fa9c0 20 remove_watcher() i=4 2024-09-12T00:28:28.190 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.191+0000 7faab66fa9c0 20 remove_watcher() i=5 2024-09-12T00:28:28.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.195+0000 7faab66fa9c0 20 remove_watcher() i=6 2024-09-12T00:28:28.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.199+0000 7faab66fa9c0 20 remove_watcher() i=7 2024-09-12T00:28:28.215 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid sysuser.client.0 --purge-data 2024-09-12T00:28:28.292 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:28:28.293 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:28:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.335+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 realm 2024-09-12T00:28:28.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:28:28.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:28.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.339+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.343+0000 7f9d0c6339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:28:28.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.343+0000 7f9d0c6339c0 20 searching for the correct realm 2024-09-12T00:28:28.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.347+0000 7f9d0a93a640 0 -- 172.21.15.78:0/453289574 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f9cfc03f910 msgr2=0x7f9cfc0263d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:28.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.563+0000 7f9d0a139640 0 -- 172.21.15.78:0/453289574 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55b3ba6a76f0 msgr2=0x55b3ba6a9bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:28:28.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.571+0000 7f9d0c6339c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:28:28.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.571+0000 7f9d0c6339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:28:28.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.571+0000 7f9d0c6339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:28:28.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.571+0000 7f9d0c6339c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:28:28.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.571+0000 7f9d0c6339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:28:28.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.571+0000 7f9d0c6339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:28:28.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.571+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:28:28.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:28:28.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 zone default found 2024-09-12T00:28:28.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 4 Realm: () 2024-09-12T00:28:28.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:28:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:28:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:28:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 zonegroup default 2024-09-12T00:28:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:28:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.575+0000 7f9d0c6339c0 20 started sync module instance, tier type = 2024-09-12T00:28:28.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.579+0000 7f9d0c6339c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:28:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.599+0000 7f9d0c6339c0 20 add_watcher() i=0 2024-09-12T00:28:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.599+0000 7f9d0c6339c0 20 add_watcher() i=1 2024-09-12T00:28:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.599+0000 7f9d0c6339c0 20 add_watcher() i=2 2024-09-12T00:28:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.599+0000 7f9d0c6339c0 20 add_watcher() i=3 2024-09-12T00:28:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.599+0000 7f9d0c6339c0 20 add_watcher() i=4 2024-09-12T00:28:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.599+0000 7f9d0c6339c0 20 add_watcher() i=5 2024-09-12T00:28:28.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.599+0000 7f9d0c6339c0 20 add_watcher() i=6 2024-09-12T00:28:28.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.603+0000 7f9d0c6339c0 20 add_watcher() i=7 2024-09-12T00:28:28.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.603+0000 7f9d0c6339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:28:28.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.607+0000 7f9bc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:28.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.607+0000 7f9d0c6339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:28:28.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.607+0000 7f9d0c6339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:28:28.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.699+0000 7f9b3b7fe640 20 reqs_thread_entry: start 2024-09-12T00:28:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.699+0000 7f9d0c6339c0 20 init_complete bucket index max shards: 11 2024-09-12T00:28:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 20 Filter name: none 2024-09-12T00:28:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9b397fa640 20 reqs_thread_entry: start 2024-09-12T00:28:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 10 cache get: name=default.rgw.meta+users.uid+sysuser.client.0 : miss 2024-09-12T00:28:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 20 rados->read ofs=0 len=0 2024-09-12T00:28:28.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:28:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 10 cache put: name=default.rgw.meta+users.uid+sysuser.client.0 info.flags=0x13 2024-09-12T00:28:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 10 adding default.rgw.meta+users.uid+sysuser.client.0 to cache LRU end 2024-09-12T00:28:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:28:28.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.703+0000 7f9d0c6339c0 10 removing key index: ULGYDYSOMIHSEFAFQWNU 2024-09-12T00:28:28.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.707+0000 7f9d0c6339c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.keys:ULGYDYSOMIHSEFAFQWNU, ofs0, ns] 2024-09-12T00:28:28.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.707+0000 7f9bedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398928 cookie 94230415129664 notifier 5690 bl.length()=170 2024-09-12T00:28:28.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.707+0000 7f9d0c6339c0 10 removing email index: sysuser.client.0+test@test.test 2024-09-12T00:28:28.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.711+0000 7f9d0c6339c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.email:sysuser.client.0+test@test.test, ofs0, ns] 2024-09-12T00:28:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.711+0000 7f9bedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398932 cookie 94230415116768 notifier 5690 bl.length()=182 2024-09-12T00:28:28.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.711+0000 7f9d0c6339c0 10 removing user buckets index 2024-09-12T00:28:28.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.711+0000 7f9d0c6339c0 10 removing user index: sysuser.client.0 2024-09-12T00:28:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.715+0000 7f9d0c6339c0 10 removing default.rgw.meta+users.uid+sysuser.client.0 from cache 2024-09-12T00:28:28.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.715+0000 7f9d0c6339c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:sysuser.client.0, ofs0, ns] 2024-09-12T00:28:28.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.715+0000 7f9bed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94230415114272 notifier 5690 bl.length()=165 2024-09-12T00:28:28.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.719+0000 7f9bc0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:28:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.723+0000 7f9d0c6339c0 20 remove_watcher() i=0 2024-09-12T00:28:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.723+0000 7f9d0c6339c0 2 removed watcher, disabling cache 2024-09-12T00:28:28.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.723+0000 7f9d0c6339c0 20 remove_watcher() i=1 2024-09-12T00:28:28.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.727+0000 7f9d0c6339c0 20 remove_watcher() i=2 2024-09-12T00:28:28.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.727+0000 7f9d0c6339c0 20 remove_watcher() i=3 2024-09-12T00:28:28.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.731+0000 7f9d0c6339c0 20 remove_watcher() i=4 2024-09-12T00:28:28.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.731+0000 7f9d0c6339c0 20 remove_watcher() i=5 2024-09-12T00:28:28.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.735+0000 7f9d0c6339c0 20 remove_watcher() i=6 2024-09-12T00:28:28.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:28:28.739+0000 7f9d0c6339c0 20 remove_watcher() i=7 2024-09-12T00:28:28.754 INFO:tasks.ragweed:Removing ragweed... 2024-09-12T00:28:28.754 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/ragweed.client.0 2024-09-12T00:28:28.841 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:28:28.851 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:28:28.851 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:28:28.851 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:28:28.857 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:28:28.857 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:28:28.858 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:28:28.904 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:28:28.905 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:28:28.953 INFO:tasks.workunit:timeout=3h 2024-09-12T00:28:28.953 INFO:tasks.workunit:cleanup=True 2024-09-12T00:28:28.953 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:28:29.003 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:29:11.340 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:29:11.340 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:11.340 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:29:11.340 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:29:11.340 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:29:11.340 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:11.341 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:29:11.346 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:29:11.394 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:29:11.396 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:29:11.396 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:29:11.457 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:29:11.511 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:29:11.551 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:29:11.553 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:29:11.553 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:29:11.595 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:29:11.598 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:29:11.598 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:29:11.645 INFO:tasks.workunit:Running workunits matching rgw/run-reshard.sh on client.0... 2024-09-12T00:29:11.646 INFO:tasks.workunit:Running workunit rgw/run-reshard.sh... 2024-09-12T00:29:11.647 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/run-reshard.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:29:11.698 INFO:tasks.workunit.client.0.smithi078.stderr:+ ulimit -c 0 2024-09-12T00:29:11.698 INFO:tasks.workunit.client.0.smithi078.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-reshard.sh 2024-09-12T00:29:11.698 INFO:tasks.workunit.client.0.smithi078.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:29:11.699 INFO:tasks.workunit.client.0.smithi078.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:29:14.531 INFO:tasks.workunit.client.0.smithi078.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:29:14.531 INFO:tasks.workunit.client.0.smithi078.stderr:++ deactivate nondestructive 2024-09-12T00:29:14.531 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:29:14.531 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:29:14.531 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PATH 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -z '' ']' 2024-09-12T00:29:14.532 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:29:14.533 INFO:tasks.workunit.client.0.smithi078.stderr:++ PS1='(rgw) ' 2024-09-12T00:29:14.533 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PS1 2024-09-12T00:29:14.533 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:29:14.533 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:29:14.533 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:29:14.533 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-12T00:29:14.533 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install pip --upgrade 2024-09-12T00:29:14.923 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:29:15.138 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-12T00:29:15.144 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:29:15.178 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-12T00:29:15.178 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-12T00:29:15.178 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:29:15.472 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:29:15.478 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:29:16.487 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-12T00:29:16.554 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install boto3 2024-09-12T00:29:17.534 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-12T00:29:17.536 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:29:18.089 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:29:18.090 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:29:18.141 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:29:18.142 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:29:18.178 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:29:18.179 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:29:18.221 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:29:18.222 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:29:18.291 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:29:18.292 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:29:18.452 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:29:18.453 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:29:18.457 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:29:18.458 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:29:18.468 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:29:18.469 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:29:18.470 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:29:18.472 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:29:18.473 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:29:18.541 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:29:19.606 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:29:19.788 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_reshard.py 2024-09-12T00:29:19.924 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin user create --uid tester --display-name "Testing" --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn 2024-09-12T00:29:19.963 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:19.963 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:20.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.006+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 realm 2024-09-12T00:29:20.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:20.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:20.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.014+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.018+0000 7fb10d2139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:20.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.018+0000 7fb10d2139c0 20 searching for the correct realm 2024-09-12T00:29:20.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.022+0000 7fb10b51a640 0 -- 172.21.15.78:0/968456526 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fb104026400 msgr2=0x7fb104026880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:20.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.234+0000 7fb10ad19640 0 -- 172.21.15.78:0/968456526 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55e8e1538a00 msgr2=0x55e8e153ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:20.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.242+0000 7fb10d2139c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:20.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.242+0000 7fb10d2139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:20.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.242+0000 7fb10d2139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:20.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.242+0000 7fb10d2139c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:20.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.242+0000 7fb10d2139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:20.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.242+0000 7fb10d2139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:20.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.242+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:20.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:20.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 zone default found 2024-09-12T00:29:20.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 4 Realm: () 2024-09-12T00:29:20.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:20.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:20.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:20.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 zonegroup default 2024-09-12T00:29:20.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.246+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.250+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.250+0000 7fb10d2139c0 20 started sync module instance, tier type = 2024-09-12T00:29:20.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.250+0000 7fb10d2139c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:20.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=0 2024-09-12T00:29:20.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=1 2024-09-12T00:29:20.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=2 2024-09-12T00:29:20.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=3 2024-09-12T00:29:20.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=4 2024-09-12T00:29:20.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=5 2024-09-12T00:29:20.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=6 2024-09-12T00:29:20.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 20 add_watcher() i=7 2024-09-12T00:29:20.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.274+0000 7fb10d2139c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:20.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.278+0000 7fafc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:20.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:20.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:20.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 5 note: GC not initialized 2024-09-12T00:29:20.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7faf3bfff640 20 reqs_thread_entry: start 2024-09-12T00:29:20.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:20.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 20 Filter name: none 2024-09-12T00:29:20.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7faf39ffb640 20 reqs_thread_entry: start 2024-09-12T00:29:20.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 10 cache get: name=default.rgw.meta+users.uid+tester : miss 2024-09-12T00:29:20.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x0 2024-09-12T00:29:20.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 10 adding default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:29:20.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-12T00:29:20.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.282+0000 7fb10d2139c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-12T00:29:20.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:29:20.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:29:20.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-12T00:29:20.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 10 cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:29:20.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 10 moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:29:20.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.286+0000 7fb10d2139c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester, ofs0, ns] 2024-09-12T00:29:20.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.290+0000 7fafee7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398929 cookie 94458701194512 notifier 5708 bl.length()=569 2024-09-12T00:29:20.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.290+0000 7fafee7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester info.flags=0x17 2024-09-12T00:29:20.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.290+0000 7fafee7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester to cache LRU end 2024-09-12T00:29:20.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.294+0000 7fb10d2139c0 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:29:20.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.294+0000 7fb10d2139c0 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:29:20.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.294+0000 7fb10d2139c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-12T00:29:20.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.294+0000 7fafedffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398930 cookie 94458701193392 notifier 5708 bl.length()=180 2024-09-12T00:29:20.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.294+0000 7fafedffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-12T00:29:20.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.294+0000 7fafedffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-12T00:29:20.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.298+0000 7fafc17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:20.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.302+0000 7fb10d2139c0 20 remove_watcher() i=0 2024-09-12T00:29:20.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.302+0000 7fb10d2139c0 2 removed watcher, disabling cache 2024-09-12T00:29:20.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.306+0000 7fb10d2139c0 20 remove_watcher() i=1 2024-09-12T00:29:20.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.306+0000 7fb10d2139c0 20 remove_watcher() i=2 2024-09-12T00:29:20.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.310+0000 7fb10d2139c0 20 remove_watcher() i=3 2024-09-12T00:29:20.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.310+0000 7fb10d2139c0 20 remove_watcher() i=4 2024-09-12T00:29:20.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.314+0000 7fb10d2139c0 20 remove_watcher() i=5 2024-09-12T00:29:20.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.318+0000 7fb10d2139c0 20 remove_watcher() i=6 2024-09-12T00:29:20.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.322+0000 7fb10d2139c0 20 remove_watcher() i=7 2024-09-12T00:29:20.585 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard add 2024-09-12T00:29:20.585 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:20.586 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:20.616 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:20.616 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:20.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.866+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 realm 2024-09-12T00:29:20.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:20.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:20.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:20.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.870+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:20.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.874+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:20.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.874+0000 7f232f48b9c0 20 searching for the correct realm 2024-09-12T00:29:20.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.878+0000 7f232cf91640 0 -- 172.21.15.78:0/3975014446 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55d5822bd3e0 msgr2=0x55d5822bf880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:20.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:20.882+0000 7f2327fff640 0 -- 172.21.15.78:0/3975014446 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f23200fca30 msgr2=0x7f232011a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:21.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.098+0000 7f232f48b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:21.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.098+0000 7f232f48b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:21.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.098+0000 7f232f48b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:21.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.098+0000 7f232f48b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:21.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.098+0000 7f232f48b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:21.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.098+0000 7f232f48b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:21.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.098+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:21.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:21.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 zone default found 2024-09-12T00:29:21.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 4 Realm: () 2024-09-12T00:29:21.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:21.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:21.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:21.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 zonegroup default 2024-09-12T00:29:21.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.102+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.106+0000 7f232f48b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.106+0000 7f232f48b9c0 20 started sync module instance, tier type = 2024-09-12T00:29:21.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.106+0000 7f232f48b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=0 2024-09-12T00:29:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=1 2024-09-12T00:29:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=2 2024-09-12T00:29:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=3 2024-09-12T00:29:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=4 2024-09-12T00:29:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=5 2024-09-12T00:29:21.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=6 2024-09-12T00:29:21.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 20 add_watcher() i=7 2024-09-12T00:29:21.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.130+0000 7f232f48b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:21.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.134+0000 7f21e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:21.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.134+0000 7f232f48b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:21.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.134+0000 7f232f48b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:21.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.134+0000 7f232f48b9c0 5 note: GC not initialized 2024-09-12T00:29:21.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f21e1fe3640 20 reqs_thread_entry: start 2024-09-12T00:29:21.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:21.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 Filter name: none 2024-09-12T00:29:21.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f21537fe640 20 reqs_thread_entry: start 2024-09-12T00:29:21.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:21.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:21.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:21.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.138+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.142+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:21.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.142+0000 7f232f48b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.142+0000 7f232f48b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:21.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.142+0000 7f232f48b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:21.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.146+0000 7f21e2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:21.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.150+0000 7f232f48b9c0 20 remove_watcher() i=0 2024-09-12T00:29:21.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.150+0000 7f232f48b9c0 2 removed watcher, disabling cache 2024-09-12T00:29:21.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.150+0000 7f232f48b9c0 20 remove_watcher() i=1 2024-09-12T00:29:21.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.154+0000 7f232f48b9c0 20 remove_watcher() i=2 2024-09-12T00:29:21.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.158+0000 7f232f48b9c0 20 remove_watcher() i=3 2024-09-12T00:29:21.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.158+0000 7f232f48b9c0 20 remove_watcher() i=4 2024-09-12T00:29:21.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.162+0000 7f232f48b9c0 20 remove_watcher() i=5 2024-09-12T00:29:21.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.162+0000 7f232f48b9c0 20 remove_watcher() i=6 2024-09-12T00:29:21.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.166+0000 7f232f48b9c0 20 remove_watcher() i=7 2024-09-12T00:29:21.182 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:21.182 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:21.183 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:29:21.183 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:21.183 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 12 2024-09-12T00:29:21.211 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:21.211 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:21.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 realm 2024-09-12T00:29:21.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:21.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.254+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.258+0000 7f2a2d3569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:21.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.258+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.258+0000 7f2a2d3569c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:21.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.258+0000 7f2a2d3569c0 20 searching for the correct realm 2024-09-12T00:29:21.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.262+0000 7f2a2b65d640 0 -- 172.21.15.78:0/3597250130 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f2a180ab070 msgr2=0x7f2a180df430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:21.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.270+0000 7f2a2a65b640 0 -- 172.21.15.78:0/3597250130 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f2a180df430 msgr2=0x7f2a180df8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:21.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:21.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 zone default found 2024-09-12T00:29:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 4 Realm: () 2024-09-12T00:29:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:21.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 zonegroup default 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 started sync module instance, tier type = 2024-09-12T00:29:21.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.278+0000 7f2a2d3569c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=0 2024-09-12T00:29:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=1 2024-09-12T00:29:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=2 2024-09-12T00:29:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=3 2024-09-12T00:29:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=4 2024-09-12T00:29:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=5 2024-09-12T00:29:21.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=6 2024-09-12T00:29:21.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 20 add_watcher() i=7 2024-09-12T00:29:21.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.298+0000 7f2a2d3569c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:21.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f28e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 5 note: GC not initialized 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f285b7fe640 20 reqs_thread_entry: start 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 Filter name: none 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f28597fa640 20 reqs_thread_entry: start 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:21.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:21.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:21.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:29:21.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:21.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:21.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:21.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:21.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:21.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.302+0000 7f2a2d3569c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:21.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.306+0000 7f28e0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:21.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.310+0000 7f2a2d3569c0 20 remove_watcher() i=0 2024-09-12T00:29:21.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.310+0000 7f2a2d3569c0 2 removed watcher, disabling cache 2024-09-12T00:29:21.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.314+0000 7f2a2d3569c0 20 remove_watcher() i=1 2024-09-12T00:29:21.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.314+0000 7f2a2d3569c0 20 remove_watcher() i=2 2024-09-12T00:29:21.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.318+0000 7f2a2d3569c0 20 remove_watcher() i=3 2024-09-12T00:29:21.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.318+0000 7f2a2d3569c0 20 remove_watcher() i=4 2024-09-12T00:29:21.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.318+0000 7f2a2d3569c0 20 remove_watcher() i=5 2024-09-12T00:29:21.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.322+0000 7f2a2d3569c0 20 remove_watcher() i=6 2024-09-12T00:29:21.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.326+0000 7f2a2d3569c0 20 remove_watcher() i=7 2024-09-12T00:29:21.336 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard list 2024-09-12T00:29:21.358 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:21.358 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:21.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 realm 2024-09-12T00:29:21.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:21.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.398+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.402+0000 7f5b8a44f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:21.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.402+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.402+0000 7f5b8a44f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:21.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.402+0000 7f5b8a44f9c0 20 searching for the correct realm 2024-09-12T00:29:21.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.406+0000 7f5b88756640 0 -- 172.21.15.78:0/3578905148 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f5b780dd910 msgr2=0x7f5b780cf400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:21.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.618+0000 7f5b87f55640 0 -- 172.21.15.78:0/3578905148 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55acf892e1f0 msgr2=0x55acf89305e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:21.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.630+0000 7f5b8a44f9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:21.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.630+0000 7f5b8a44f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:21.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.630+0000 7f5b8a44f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:21.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.630+0000 7f5b8a44f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:21.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.630+0000 7f5b8a44f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:21.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.630+0000 7f5b8a44f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:21.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.630+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:21.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:21.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 zone default found 2024-09-12T00:29:21.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 4 Realm: () 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 zonegroup default 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.634+0000 7f5b8a44f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.638+0000 7f5b8a44f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.638+0000 7f5b8a44f9c0 20 started sync module instance, tier type = 2024-09-12T00:29:21.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.638+0000 7f5b8a44f9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=0 2024-09-12T00:29:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=1 2024-09-12T00:29:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=2 2024-09-12T00:29:21.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=3 2024-09-12T00:29:21.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=4 2024-09-12T00:29:21.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=5 2024-09-12T00:29:21.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=6 2024-09-12T00:29:21.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 20 add_watcher() i=7 2024-09-12T00:29:21.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.662+0000 7f5b8a44f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:21.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.666+0000 7f5a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:21.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.670+0000 7f5b8a44f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:21.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.670+0000 7f5b8a44f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:21.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.670+0000 7f5b8a44f9c0 5 note: GC not initialized 2024-09-12T00:29:21.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.670+0000 7f5a3cfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:21.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.670+0000 7f5b8a44f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:21.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.670+0000 7f5b8a44f9c0 20 Filter name: none 2024-09-12T00:29:21.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.670+0000 7f59b67fc640 20 reqs_thread_entry: start 2024-09-12T00:29:21.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.682+0000 7f5a3dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.686+0000 7f5b8a44f9c0 20 remove_watcher() i=0 2024-09-12T00:29:21.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.686+0000 7f5b8a44f9c0 2 removed watcher, disabling cache 2024-09-12T00:29:21.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.690+0000 7f5b8a44f9c0 20 remove_watcher() i=1 2024-09-12T00:29:21.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.690+0000 7f5b8a44f9c0 20 remove_watcher() i=2 2024-09-12T00:29:21.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.694+0000 7f5b8a44f9c0 20 remove_watcher() i=3 2024-09-12T00:29:21.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.694+0000 7f5b8a44f9c0 20 remove_watcher() i=4 2024-09-12T00:29:21.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.698+0000 7f5b8a44f9c0 20 remove_watcher() i=5 2024-09-12T00:29:21.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.702+0000 7f5b8a44f9c0 20 remove_watcher() i=6 2024-09-12T00:29:21.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.702+0000 7f5b8a44f9c0 20 remove_watcher() i=7 2024-09-12T00:29:21.724 INFO:tasks.workunit.client.0.smithi078.stderr:bucket name a-bucket 2024-09-12T00:29:21.724 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard process 2024-09-12T00:29:21.724 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:21.724 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard process 2024-09-12T00:29:21.754 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:21.754 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:21.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 realm 2024-09-12T00:29:21.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:21.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:21.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.802+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.806+0000 7f34ed62c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:21.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.806+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:21.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.806+0000 7f34ed62c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:21.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.806+0000 7f34ed62c9c0 20 searching for the correct realm 2024-09-12T00:29:21.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.810+0000 7f34eb132640 0 -- 172.21.15.78:0/1080021112 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55d53d442b70 msgr2=0x55d53d445030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:21.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:21.818+0000 7f34ea931640 0 -- 172.21.15.78:0/1080021112 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f34dc0082d0 msgr2=0x7f34dc0820d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:22.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:22.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 zone default found 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 4 Realm: () 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 zonegroup default 2024-09-12T00:29:22.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.038+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.042+0000 7f34ed62c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:22.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.042+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.042+0000 7f34ed62c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:22.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.042+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.042+0000 7f34ed62c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:22.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.042+0000 7f34ed62c9c0 20 started sync module instance, tier type = 2024-09-12T00:29:22.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.042+0000 7f34ed62c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:22.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=0 2024-09-12T00:29:22.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=1 2024-09-12T00:29:22.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=2 2024-09-12T00:29:22.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=3 2024-09-12T00:29:22.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=4 2024-09-12T00:29:22.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=5 2024-09-12T00:29:22.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=6 2024-09-12T00:29:22.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 20 add_watcher() i=7 2024-09-12T00:29:22.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.066+0000 7f34ed62c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:22.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f33a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:22.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f34ed62c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:22.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f34ed62c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:22.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f34ed62c9c0 5 note: GC not initialized 2024-09-12T00:29:22.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f33a0fe1640 20 reqs_thread_entry: start 2024-09-12T00:29:22.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f34ed62c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:22.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f34ed62c9c0 20 Filter name: none 2024-09-12T00:29:22.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f331a7fc640 20 reqs_thread_entry: start 2024-09-12T00:29:22.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.074+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000000 2024-09-12T00:29:22.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.078+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:29:22.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.078+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000001 2024-09-12T00:29:22.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.086+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:29:22.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.086+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000002 2024-09-12T00:29:22.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.090+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:29:22.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.090+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000003 2024-09-12T00:29:22.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.094+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:29:22.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.094+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000004 2024-09-12T00:29:22.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.102+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:29:22.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.102+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000005 2024-09-12T00:29:22.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.106+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:29:22.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.106+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000006 2024-09-12T00:29:22.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.110+0000 7f34ed62c9c0 20 process_entry resharding a-bucket 2024-09-12T00:29:22.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.110+0000 7f34ed62c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:22.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.110+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:22.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:29:22.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:22.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:29:22.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:22.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:22.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:22.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:22.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:22.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:22.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.114+0000 7f34ed62c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:22.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.126+0000 7f34ed62c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:22.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.126+0000 7f34ed62c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:22.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.126+0000 7f34ed62c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:22.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.126+0000 7f34ed62c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:29:22.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f33ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94374344291920 notifier 5771 bl.length()=827 2024-09-12T00:29:22.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f33ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:22.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f33ce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:22.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f33ce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:22.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:29:22.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:29:22.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:29:22.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.130+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.0 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.0 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.1 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.1 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.2 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.2 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.3 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.3 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.4 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.4 2024-09-12T00:29:22.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.5 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.5 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.6 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.6 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.7 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.7 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.8 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.8 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.9 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.9 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.10 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.10 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.11 2024-09-12T00:29:22.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.11 2024-09-12T00:29:22.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.0 2024-09-12T00:29:22.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.138+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1 2024-09-12T00:29:22.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.142+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2 2024-09-12T00:29:22.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.142+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3 2024-09-12T00:29:22.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.142+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.4 2024-09-12T00:29:22.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.146+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.5 2024-09-12T00:29:22.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.146+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.6 2024-09-12T00:29:22.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.146+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.7 2024-09-12T00:29:22.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.146+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.8 2024-09-12T00:29:22.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.146+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.9 2024-09-12T00:29:22.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.150+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.10 2024-09-12T00:29:22.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.150+0000 7f34ed62c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:22.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.150+0000 7f34ed62c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:22.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.150+0000 7f34ed62c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:22.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.150+0000 7f34ed62c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:22.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.150+0000 7f34ed62c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.150+0000 7f34ed62c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:29:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f33ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398936 cookie 94374344291920 notifier 5771 bl.length()=827 2024-09-12T00:29:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f33ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f33ce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f33ce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:22.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:29:22.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:29:22.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:29:22.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.154+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:29:22.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.158+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.0 2024-09-12T00:29:22.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.158+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1 2024-09-12T00:29:22.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.158+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2 2024-09-12T00:29:22.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.162+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3 2024-09-12T00:29:22.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.162+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.4 2024-09-12T00:29:22.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.162+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.5 2024-09-12T00:29:22.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.162+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.6 2024-09-12T00:29:22.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.162+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.7 2024-09-12T00:29:22.165 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.166+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.8 2024-09-12T00:29:22.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.166+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.9 2024-09-12T00:29:22.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.166+0000 7f34ed62c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.10 2024-09-12T00:29:22.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.166+0000 7f34ed62c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:22.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.166+0000 7f34ed62c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:22.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:22.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:22.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:22.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:29:22.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f33ce7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398937 cookie 94374344291920 notifier 5771 bl.length()=795 2024-09-12T00:29:22.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f33ce7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:22.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f33ce7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:22.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f33ce7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:22.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:29:22.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:29:22.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:29:22.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.170+0000 7f34ed62c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:29:22.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.174+0000 7f34ed62c9c0 1 execute INFO: reshard of bucket "a-bucket" from 11 shards to 12 shards completed successfully 2024-09-12T00:29:22.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.178+0000 7f34ed62c9c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:29:22.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.182+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:29:22.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.182+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000007 2024-09-12T00:29:22.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.186+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:29:22.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.186+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000008 2024-09-12T00:29:22.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.190+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:29:22.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.190+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000009 2024-09-12T00:29:22.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.194+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:29:22.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.194+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000010 2024-09-12T00:29:22.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.202+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:29:22.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.202+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000011 2024-09-12T00:29:22.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.206+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:29:22.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.206+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000012 2024-09-12T00:29:22.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.210+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:29:22.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.210+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000013 2024-09-12T00:29:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.218+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:29:22.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.218+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000014 2024-09-12T00:29:22.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.222+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:29:22.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.222+0000 7f34ed62c9c0 20 processing logshard = reshard.0000000015 2024-09-12T00:29:22.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.226+0000 7f34ed62c9c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:29:22.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.230+0000 7f33a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:22.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.238+0000 7f34ed62c9c0 20 remove_watcher() i=0 2024-09-12T00:29:22.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.238+0000 7f34ed62c9c0 2 removed watcher, disabling cache 2024-09-12T00:29:22.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.238+0000 7f34ed62c9c0 20 remove_watcher() i=1 2024-09-12T00:29:22.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.242+0000 7f34ed62c9c0 20 remove_watcher() i=2 2024-09-12T00:29:22.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.242+0000 7f34ed62c9c0 20 remove_watcher() i=3 2024-09-12T00:29:22.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.246+0000 7f34ed62c9c0 20 remove_watcher() i=4 2024-09-12T00:29:22.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.246+0000 7f34ed62c9c0 20 remove_watcher() i=5 2024-09-12T00:29:22.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.250+0000 7f34ed62c9c0 20 remove_watcher() i=6 2024-09-12T00:29:22.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:22.254+0000 7f34ed62c9c0 20 remove_watcher() i=7 2024-09-12T00:29:27.277 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:27.311 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:27.311 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:27.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.358+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.358+0000 7f74a6d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.358+0000 7f74a6d269c0 20 realm 2024-09-12T00:29:27.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.358+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.358+0000 7f74a6d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.358+0000 7f74a6d269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:27.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.358+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.362+0000 7f74a6d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.362+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.362+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:27.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.362+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.362+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:27.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.362+0000 7f74a6d269c0 20 searching for the correct realm 2024-09-12T00:29:27.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.370+0000 7f74a502d640 0 -- 172.21.15.78:0/1194584364 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x55f5dc8203e0 msgr2=0x55f5dc8227d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:27.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.374+0000 7f74a402b640 0 -- 172.21.15.78:0/1194584364 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f7494044910 msgr2=0x7f7494027400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:27.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:27.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:27.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:27.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:27.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:27.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:27.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:27.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:27.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 zone default found 2024-09-12T00:29:27.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 4 Realm: () 2024-09-12T00:29:27.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:27.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:27.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:27.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 zonegroup default 2024-09-12T00:29:27.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.382+0000 7f74a6d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.386+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.386+0000 7f74a6d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.386+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.386+0000 7f74a6d269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.386+0000 7f74a6d269c0 20 started sync module instance, tier type = 2024-09-12T00:29:27.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.386+0000 7f74a6d269c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:27.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.402+0000 7f74a6d269c0 20 add_watcher() i=0 2024-09-12T00:29:27.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.402+0000 7f74a6d269c0 20 add_watcher() i=1 2024-09-12T00:29:27.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.402+0000 7f74a6d269c0 20 add_watcher() i=2 2024-09-12T00:29:27.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.402+0000 7f74a6d269c0 20 add_watcher() i=3 2024-09-12T00:29:27.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.402+0000 7f74a6d269c0 20 add_watcher() i=4 2024-09-12T00:29:27.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.402+0000 7f74a6d269c0 20 add_watcher() i=5 2024-09-12T00:29:27.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.402+0000 7f74a6d269c0 20 add_watcher() i=6 2024-09-12T00:29:27.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.406+0000 7f74a6d269c0 20 add_watcher() i=7 2024-09-12T00:29:27.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.406+0000 7f74a6d269c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:27.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f735afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:27.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:27.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:27.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 5 note: GC not initialized 2024-09-12T00:29:27.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f7359fe3640 20 reqs_thread_entry: start 2024-09-12T00:29:27.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:27.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 Filter name: none 2024-09-12T00:29:27.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f72cb7fe640 20 reqs_thread_entry: start 2024-09-12T00:29:27.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:27.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.410+0000 7f74a6d269c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.414+0000 7f74a6d269c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:27.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.414+0000 7f74a6d269c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:27.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.414+0000 7f735afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:27.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.418+0000 7f74a6d269c0 20 remove_watcher() i=0 2024-09-12T00:29:27.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.418+0000 7f74a6d269c0 2 removed watcher, disabling cache 2024-09-12T00:29:27.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.422+0000 7f74a6d269c0 20 remove_watcher() i=1 2024-09-12T00:29:27.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.422+0000 7f74a6d269c0 20 remove_watcher() i=2 2024-09-12T00:29:27.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.426+0000 7f74a6d269c0 20 remove_watcher() i=3 2024-09-12T00:29:27.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.426+0000 7f74a6d269c0 20 remove_watcher() i=4 2024-09-12T00:29:27.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.430+0000 7f74a6d269c0 20 remove_watcher() i=5 2024-09-12T00:29:27.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.434+0000 7f74a6d269c0 20 remove_watcher() i=6 2024-09-12T00:29:27.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.434+0000 7f74a6d269c0 20 remove_watcher() i=7 2024-09-12T00:29:27.450 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:27.450 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:27.450 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:29:27.451 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:27.451 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard add non empty bucket 2024-09-12T00:29:27.451 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:27.560 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:27.593 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:27.593 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:27.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.846+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.850+0000 7f16c546b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.850+0000 7f16c546b9c0 20 realm 2024-09-12T00:29:27.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.850+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.850+0000 7f16c546b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.850+0000 7f16c546b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:27.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.850+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.850+0000 7f16c546b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:27.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.854+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.854+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:27.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.854+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:27.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.854+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:27.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.854+0000 7f16c546b9c0 20 searching for the correct realm 2024-09-12T00:29:27.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.858+0000 7f16c3772640 0 -- 172.21.15.78:0/2472058173 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x55ab865f8300 msgr2=0x55ab865fa6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:27.866+0000 7f16c2770640 0 -- 172.21.15.78:0/2472058173 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f16b40503e0 msgr2=0x7f16b4050840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:28.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.082+0000 7f16c546b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:28.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.082+0000 7f16c546b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:28.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.082+0000 7f16c546b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:28.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.082+0000 7f16c546b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:28.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.082+0000 7f16c546b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:28.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.082+0000 7f16c546b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:28.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.082+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.085 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:28.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:28.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 zone default found 2024-09-12T00:29:28.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 4 Realm: () 2024-09-12T00:29:28.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:28.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:28.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:28.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 zonegroup default 2024-09-12T00:29:28.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.086+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.090+0000 7f16c546b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.090+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.090+0000 7f16c546b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.090+0000 7f16c546b9c0 20 started sync module instance, tier type = 2024-09-12T00:29:28.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.090+0000 7f16c546b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:28.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=0 2024-09-12T00:29:28.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=1 2024-09-12T00:29:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=2 2024-09-12T00:29:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=3 2024-09-12T00:29:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=4 2024-09-12T00:29:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=5 2024-09-12T00:29:28.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=6 2024-09-12T00:29:28.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 20 add_watcher() i=7 2024-09-12T00:29:28.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.114+0000 7f16c546b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:28.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f15797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:28.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 5 note: GC not initialized 2024-09-12T00:29:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f14f3fff640 20 reqs_thread_entry: start 2024-09-12T00:29:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 Filter name: none 2024-09-12T00:29:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f14f1ffb640 20 reqs_thread_entry: start 2024-09-12T00:29:28.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:28.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:28.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:28.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.122+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.126+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:28.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.126+0000 7f16c546b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.126+0000 7f16c546b9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:28.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.126+0000 7f16c546b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:28.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.126+0000 7f15797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:28.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.134+0000 7f16c546b9c0 20 remove_watcher() i=0 2024-09-12T00:29:28.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.134+0000 7f16c546b9c0 2 removed watcher, disabling cache 2024-09-12T00:29:28.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.134+0000 7f16c546b9c0 20 remove_watcher() i=1 2024-09-12T00:29:28.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.138+0000 7f16c546b9c0 20 remove_watcher() i=2 2024-09-12T00:29:28.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.142+0000 7f16c546b9c0 20 remove_watcher() i=3 2024-09-12T00:29:28.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.142+0000 7f16c546b9c0 20 remove_watcher() i=4 2024-09-12T00:29:28.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.146+0000 7f16c546b9c0 20 remove_watcher() i=5 2024-09-12T00:29:28.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.146+0000 7f16c546b9c0 20 remove_watcher() i=6 2024-09-12T00:29:28.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.150+0000 7f16c546b9c0 20 remove_watcher() i=7 2024-09-12T00:29:28.166 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:28.166 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:28.166 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 8 size_kb: 1 num_shards: 12 2024-09-12T00:29:28.166 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:28.166 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard add --bucket a-bucket --num-shards 13 2024-09-12T00:29:28.199 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:28.200 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:28.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 realm 2024-09-12T00:29:28.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:28.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:28.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.246+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.250+0000 7f5698cec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:28.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.250+0000 7f5698cec9c0 20 searching for the correct realm 2024-09-12T00:29:28.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.254+0000 7f5696ff3640 0 -- 172.21.15.78:0/2154322874 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f56900c4b60 msgr2=0x7f56900d3930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:28.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.470+0000 7f56967f2640 0 -- 172.21.15.78:0/2154322874 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560f1d1867d0 msgr2=0x560f1d188c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:28.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:28.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:28.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:28.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:28.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:28.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:28.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:28.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:28.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 zone default found 2024-09-12T00:29:28.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 4 Realm: () 2024-09-12T00:29:28.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:28.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:28.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:28.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 zonegroup default 2024-09-12T00:29:28.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.482+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.486+0000 7f5698cec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.486+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.486+0000 7f5698cec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.486+0000 7f5698cec9c0 20 started sync module instance, tier type = 2024-09-12T00:29:28.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.486+0000 7f5698cec9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:28.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.506+0000 7f5698cec9c0 20 add_watcher() i=0 2024-09-12T00:29:28.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.506+0000 7f5698cec9c0 20 add_watcher() i=1 2024-09-12T00:29:28.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.506+0000 7f5698cec9c0 20 add_watcher() i=2 2024-09-12T00:29:28.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.506+0000 7f5698cec9c0 20 add_watcher() i=3 2024-09-12T00:29:28.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.506+0000 7f5698cec9c0 20 add_watcher() i=4 2024-09-12T00:29:28.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.506+0000 7f5698cec9c0 20 add_watcher() i=5 2024-09-12T00:29:28.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.506+0000 7f5698cec9c0 20 add_watcher() i=6 2024-09-12T00:29:28.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.510+0000 7f5698cec9c0 20 add_watcher() i=7 2024-09-12T00:29:28.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.510+0000 7f5698cec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:28.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.514+0000 7f554cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:28.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:28.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:28.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 5 note: GC not initialized 2024-09-12T00:29:28.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f54c77fe640 20 reqs_thread_entry: start 2024-09-12T00:29:28.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:28.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 Filter name: none 2024-09-12T00:29:28.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f54c57fa640 20 reqs_thread_entry: start 2024-09-12T00:29:28.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:28.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:28.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:29:28.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:28.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:29:28.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:28.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:28.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:28.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:28.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:28.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.518+0000 7f5698cec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:28.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.522+0000 7f554cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.526+0000 7f5698cec9c0 20 remove_watcher() i=0 2024-09-12T00:29:28.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.526+0000 7f5698cec9c0 2 removed watcher, disabling cache 2024-09-12T00:29:28.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.530+0000 7f5698cec9c0 20 remove_watcher() i=1 2024-09-12T00:29:28.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.530+0000 7f5698cec9c0 20 remove_watcher() i=2 2024-09-12T00:29:28.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.534+0000 7f5698cec9c0 20 remove_watcher() i=3 2024-09-12T00:29:28.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.534+0000 7f5698cec9c0 20 remove_watcher() i=4 2024-09-12T00:29:28.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.538+0000 7f5698cec9c0 20 remove_watcher() i=5 2024-09-12T00:29:28.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.538+0000 7f5698cec9c0 20 remove_watcher() i=6 2024-09-12T00:29:28.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.542+0000 7f5698cec9c0 20 remove_watcher() i=7 2024-09-12T00:29:28.559 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard list 2024-09-12T00:29:28.588 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:28.588 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:28.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.842+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.842+0000 7febb906c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.842+0000 7febb906c9c0 20 realm 2024-09-12T00:29:28.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.842+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.842+0000 7febb906c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.842+0000 7febb906c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:28.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.842+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.846+0000 7febb906c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:28.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.846+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.846+0000 7febb906c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:28.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.846+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:28.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.846+0000 7febb906c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:28.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.846+0000 7febb906c9c0 20 searching for the correct realm 2024-09-12T00:29:28.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:28.850+0000 7febb7373640 0 -- 172.21.15.78:0/3402233183 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7feba80cd410 msgr2=0x7feba80cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:29.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.066+0000 7febb6b72640 0 -- 172.21.15.78:0/3402233183 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55bf2e32dd30 msgr2=0x55bf2e330170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:29.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.074+0000 7febb906c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:29.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.074+0000 7febb906c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:29.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.074+0000 7febb906c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:29.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.074+0000 7febb906c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:29.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.074+0000 7febb906c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:29.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.074+0000 7febb906c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:29.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.074+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:29.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 zone default found 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 4 Realm: () 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 zonegroup default 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.078+0000 7febb906c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.082+0000 7febb906c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.082+0000 7febb906c9c0 20 started sync module instance, tier type = 2024-09-12T00:29:29.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.082+0000 7febb906c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:29.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.106+0000 7febb906c9c0 20 add_watcher() i=0 2024-09-12T00:29:29.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.106+0000 7febb906c9c0 20 add_watcher() i=1 2024-09-12T00:29:29.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.106+0000 7febb906c9c0 20 add_watcher() i=2 2024-09-12T00:29:29.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.106+0000 7febb906c9c0 20 add_watcher() i=3 2024-09-12T00:29:29.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.106+0000 7febb906c9c0 20 add_watcher() i=4 2024-09-12T00:29:29.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.106+0000 7febb906c9c0 20 add_watcher() i=5 2024-09-12T00:29:29.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.106+0000 7febb906c9c0 20 add_watcher() i=6 2024-09-12T00:29:29.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.110+0000 7febb906c9c0 20 add_watcher() i=7 2024-09-12T00:29:29.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.110+0000 7febb906c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:29.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7fea6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:29.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7febb906c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:29.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7febb906c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:29.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7febb906c9c0 5 note: GC not initialized 2024-09-12T00:29:29.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7fe9e7fff640 20 reqs_thread_entry: start 2024-09-12T00:29:29.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7febb906c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:29.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7febb906c9c0 20 Filter name: none 2024-09-12T00:29:29.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.114+0000 7fe9e5ffb640 20 reqs_thread_entry: start 2024-09-12T00:29:29.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.130+0000 7fea6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:29.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.134+0000 7febb906c9c0 20 remove_watcher() i=0 2024-09-12T00:29:29.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.134+0000 7febb906c9c0 2 removed watcher, disabling cache 2024-09-12T00:29:29.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.134+0000 7febb906c9c0 20 remove_watcher() i=1 2024-09-12T00:29:29.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.138+0000 7febb906c9c0 20 remove_watcher() i=2 2024-09-12T00:29:29.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.138+0000 7febb906c9c0 20 remove_watcher() i=3 2024-09-12T00:29:29.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.142+0000 7febb906c9c0 20 remove_watcher() i=4 2024-09-12T00:29:29.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.142+0000 7febb906c9c0 20 remove_watcher() i=5 2024-09-12T00:29:29.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.146+0000 7febb906c9c0 20 remove_watcher() i=6 2024-09-12T00:29:29.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.150+0000 7febb906c9c0 20 remove_watcher() i=7 2024-09-12T00:29:29.164 INFO:tasks.workunit.client.0.smithi078.stderr:bucket name a-bucket 2024-09-12T00:29:29.164 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard process non empty bucket 2024-09-12T00:29:29.164 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:29.164 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshard process 2024-09-12T00:29:29.190 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:29.191 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:29.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.234+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.234+0000 7fa9af9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.234+0000 7fa9af9769c0 20 realm 2024-09-12T00:29:29.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.234+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.234+0000 7fa9af9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.234+0000 7fa9af9769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:29.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.234+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.238+0000 7fa9af9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.238+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.238+0000 7fa9af9769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:29.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.238+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.238+0000 7fa9af9769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:29.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.238+0000 7fa9af9769c0 20 searching for the correct realm 2024-09-12T00:29:29.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.242+0000 7fa9adc7d640 0 -- 172.21.15.78:0/3922275655 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fa9a002f3f0 msgr2=0x7fa9a002f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:29.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.458+0000 7fa9ad47c640 0 -- 172.21.15.78:0/3922275655 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x555c60219740 msgr2=0x555c6021bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:29.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:29.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:29.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:29.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:29.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:29.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:29.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.470+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:29.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 zone default found 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 4 Realm: () 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 zonegroup default 2024-09-12T00:29:29.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.474+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.478+0000 7fa9af9769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.478+0000 7fa9af9769c0 20 started sync module instance, tier type = 2024-09-12T00:29:29.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.478+0000 7fa9af9769c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:29.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=0 2024-09-12T00:29:29.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=1 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=2 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=3 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=4 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=5 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=6 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 20 add_watcher() i=7 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.502+0000 7fa9af9769c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa863fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa9af9769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa9af9769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa9af9769c0 5 note: GC not initialized 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa862fe5640 20 reqs_thread_entry: start 2024-09-12T00:29:29.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa9af9769c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:29.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa9af9769c0 20 Filter name: none 2024-09-12T00:29:29.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa860fe1640 20 reqs_thread_entry: start 2024-09-12T00:29:29.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.510+0000 7fa9af9769c0 20 processing logshard = reshard.0000000000 2024-09-12T00:29:29.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.518+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000000 , ret = 0 2024-09-12T00:29:29.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.518+0000 7fa9af9769c0 20 processing logshard = reshard.0000000001 2024-09-12T00:29:29.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.522+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000001 , ret = 0 2024-09-12T00:29:29.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.522+0000 7fa9af9769c0 20 processing logshard = reshard.0000000002 2024-09-12T00:29:29.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.530+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000002 , ret = 0 2024-09-12T00:29:29.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.530+0000 7fa9af9769c0 20 processing logshard = reshard.0000000003 2024-09-12T00:29:29.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.534+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000003 , ret = 0 2024-09-12T00:29:29.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.534+0000 7fa9af9769c0 20 processing logshard = reshard.0000000004 2024-09-12T00:29:29.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.538+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000004 , ret = 0 2024-09-12T00:29:29.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.538+0000 7fa9af9769c0 20 processing logshard = reshard.0000000005 2024-09-12T00:29:29.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.546+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000005 , ret = 0 2024-09-12T00:29:29.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.546+0000 7fa9af9769c0 20 processing logshard = reshard.0000000006 2024-09-12T00:29:29.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.546+0000 7fa9af9769c0 20 process_entry resharding a-bucket 2024-09-12T00:29:29.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:29:29.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x1 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:29.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.550+0000 7fa9af9769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:29.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:29.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:29.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:29.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:29:29.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa890ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398938 cookie 93855238229792 notifier 5855 bl.length()=827 2024-09-12T00:29:29.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa890ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:29.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa890ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:29.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa890ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:29.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:29:29.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:29:29.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:29:29.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.562+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:29:29.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:29:29.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:29:29.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:29:29.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:29:29.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:29:29.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.0 2024-09-12T00:29:29.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.0 2024-09-12T00:29:29.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.1 2024-09-12T00:29:29.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.1 2024-09-12T00:29:29.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.2 2024-09-12T00:29:29.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.2 2024-09-12T00:29:29.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.3 2024-09-12T00:29:29.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.3 2024-09-12T00:29:29.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.4 2024-09-12T00:29:29.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.574+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.4 2024-09-12T00:29:29.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.5 2024-09-12T00:29:29.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.5 2024-09-12T00:29:29.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.6 2024-09-12T00:29:29.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.6 2024-09-12T00:29:29.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.7 2024-09-12T00:29:29.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.7 2024-09-12T00:29:29.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.8 2024-09-12T00:29:29.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.8 2024-09-12T00:29:29.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.9 2024-09-12T00:29:29.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.578+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.9 2024-09-12T00:29:29.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.582+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.10 2024-09-12T00:29:29.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.582+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.10 2024-09-12T00:29:29.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.582+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.11 2024-09-12T00:29:29.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.582+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.11 2024-09-12T00:29:29.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.586+0000 7fa9af9769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:29.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.586+0000 7fa9af9769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:29.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:29.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:29.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:29.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:29:29.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa890ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398939 cookie 93855238229792 notifier 5855 bl.length()=827 2024-09-12T00:29:29.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa890ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:29.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa890ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:29.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa890ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:29.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:29:29.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:29:29.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:29:29.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.590+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:29:29.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.0 2024-09-12T00:29:29.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.0 2024-09-12T00:29:29.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.1 2024-09-12T00:29:29.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.1 2024-09-12T00:29:29.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.2 2024-09-12T00:29:29.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.2 2024-09-12T00:29:29.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.3 2024-09-12T00:29:29.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.3 2024-09-12T00:29:29.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.4 2024-09-12T00:29:29.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.4 2024-09-12T00:29:29.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.5 2024-09-12T00:29:29.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.598+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.5 2024-09-12T00:29:29.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.6 2024-09-12T00:29:29.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.6 2024-09-12T00:29:29.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.7 2024-09-12T00:29:29.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.7 2024-09-12T00:29:29.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.8 2024-09-12T00:29:29.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.8 2024-09-12T00:29:29.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.9 2024-09-12T00:29:29.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.9 2024-09-12T00:29:29.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.10 2024-09-12T00:29:29.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.10 2024-09-12T00:29:29.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.11 2024-09-12T00:29:29.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.602+0000 7fa9af9769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.1.11 2024-09-12T00:29:29.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:29.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:29:29.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:29.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:29.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:29.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:29:29.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa890ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398940 cookie 93855238229792 notifier 5855 bl.length()=795 2024-09-12T00:29:29.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa890ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:29:29.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa890ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:29:29.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa890ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:29:29.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:29:29.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:29:29.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:29:29.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.606+0000 7fa9af9769c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:29:29.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.614+0000 7fa9af9769c0 1 execute INFO: reshard of bucket "a-bucket" from 12 shards to 13 shards completed successfully 2024-09-12T00:29:29.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.618+0000 7fa9af9769c0 20 process_entry removing reshard queue entry for bucket a-bucket 2024-09-12T00:29:29.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.622+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000006 , ret = 0 2024-09-12T00:29:29.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.622+0000 7fa9af9769c0 20 processing logshard = reshard.0000000007 2024-09-12T00:29:29.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.626+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000007 , ret = 0 2024-09-12T00:29:29.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.626+0000 7fa9af9769c0 20 processing logshard = reshard.0000000008 2024-09-12T00:29:29.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.630+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000008 , ret = 0 2024-09-12T00:29:29.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.630+0000 7fa9af9769c0 20 processing logshard = reshard.0000000009 2024-09-12T00:29:29.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.638+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000009 , ret = 0 2024-09-12T00:29:29.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.638+0000 7fa9af9769c0 20 processing logshard = reshard.0000000010 2024-09-12T00:29:29.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.646+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000010 , ret = 0 2024-09-12T00:29:29.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.646+0000 7fa9af9769c0 20 processing logshard = reshard.0000000011 2024-09-12T00:29:29.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.654+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000011 , ret = 0 2024-09-12T00:29:29.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.654+0000 7fa9af9769c0 20 processing logshard = reshard.0000000012 2024-09-12T00:29:29.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.658+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000012 , ret = 0 2024-09-12T00:29:29.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.658+0000 7fa9af9769c0 20 processing logshard = reshard.0000000013 2024-09-12T00:29:29.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.662+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000013 , ret = 0 2024-09-12T00:29:29.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.662+0000 7fa9af9769c0 20 processing logshard = reshard.0000000014 2024-09-12T00:29:29.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.670+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000014 , ret = 0 2024-09-12T00:29:29.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.670+0000 7fa9af9769c0 20 processing logshard = reshard.0000000015 2024-09-12T00:29:29.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.674+0000 7fa9af9769c0 20 finish processing logshard = reshard.0000000015 , ret = 0 2024-09-12T00:29:29.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.678+0000 7fa863fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:29.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.682+0000 7fa9af9769c0 20 remove_watcher() i=0 2024-09-12T00:29:29.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.682+0000 7fa9af9769c0 2 removed watcher, disabling cache 2024-09-12T00:29:29.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.682+0000 7fa9af9769c0 20 remove_watcher() i=1 2024-09-12T00:29:29.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.686+0000 7fa9af9769c0 20 remove_watcher() i=2 2024-09-12T00:29:29.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.690+0000 7fa9af9769c0 20 remove_watcher() i=3 2024-09-12T00:29:29.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.690+0000 7fa9af9769c0 20 remove_watcher() i=4 2024-09-12T00:29:29.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.694+0000 7fa9af9769c0 20 remove_watcher() i=5 2024-09-12T00:29:29.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.698+0000 7fa9af9769c0 20 remove_watcher() i=6 2024-09-12T00:29:29.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.698+0000 7fa9af9769c0 20 remove_watcher() i=7 2024-09-12T00:29:29.722 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:29:29.755 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:29.755 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:29.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.798+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 20 realm 2024-09-12T00:29:29.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:29.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:29.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.802+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.806+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:29.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.806+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:29.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.806+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:29.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.806+0000 7f3b66cb49c0 20 searching for the correct realm 2024-09-12T00:29:29.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:29.806+0000 7f3b63fb9640 0 -- 172.21.15.78:0/3513550944 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f3b5c066c20 msgr2=0x7f3b5c0880d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:30.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.018+0000 7f3b647ba640 0 -- 172.21.15.78:0/3513550944 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f3b580d4040 msgr2=0x7f3b580c4970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:30.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:30.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:30.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.238+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 zone default found 2024-09-12T00:29:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 4 Realm: () 2024-09-12T00:29:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:30.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:30.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 zonegroup default 2024-09-12T00:29:30.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:30.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:30.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:30.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 started sync module instance, tier type = 2024-09-12T00:29:30.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.242+0000 7f3b66cb49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:30.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.266+0000 7f3b66cb49c0 20 add_watcher() i=0 2024-09-12T00:29:30.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.266+0000 7f3b66cb49c0 20 add_watcher() i=1 2024-09-12T00:29:30.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.266+0000 7f3b66cb49c0 20 add_watcher() i=2 2024-09-12T00:29:30.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.266+0000 7f3b66cb49c0 20 add_watcher() i=3 2024-09-12T00:29:30.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.266+0000 7f3b66cb49c0 20 add_watcher() i=4 2024-09-12T00:29:30.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.266+0000 7f3b66cb49c0 20 add_watcher() i=5 2024-09-12T00:29:30.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.266+0000 7f3b66cb49c0 20 add_watcher() i=6 2024-09-12T00:29:30.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.270+0000 7f3b66cb49c0 20 add_watcher() i=7 2024-09-12T00:29:30.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.270+0000 7f3b66cb49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:30.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.274+0000 7f3a1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:30.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.274+0000 7f3b66cb49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:30.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.274+0000 7f3b66cb49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:30.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.274+0000 7f3b66cb49c0 5 note: GC not initialized 2024-09-12T00:29:30.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.274+0000 7f3a19fdb640 20 reqs_thread_entry: start 2024-09-12T00:29:30.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:30.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 Filter name: none 2024-09-12T00:29:30.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f398b7fe640 20 reqs_thread_entry: start 2024-09-12T00:29:30.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:30.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:30.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:30.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:29:30.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.278+0000 7f3b66cb49c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.282+0000 7f3b66cb49c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:29:30.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.282+0000 7f3b66cb49c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:30.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.282+0000 7f3a1afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:30.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.290+0000 7f3b66cb49c0 20 remove_watcher() i=0 2024-09-12T00:29:30.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.290+0000 7f3b66cb49c0 2 removed watcher, disabling cache 2024-09-12T00:29:30.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.290+0000 7f3b66cb49c0 20 remove_watcher() i=1 2024-09-12T00:29:30.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.294+0000 7f3b66cb49c0 20 remove_watcher() i=2 2024-09-12T00:29:30.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.298+0000 7f3b66cb49c0 20 remove_watcher() i=3 2024-09-12T00:29:30.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.298+0000 7f3b66cb49c0 20 remove_watcher() i=4 2024-09-12T00:29:30.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.302+0000 7f3b66cb49c0 20 remove_watcher() i=5 2024-09-12T00:29:30.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.302+0000 7f3b66cb49c0 20 remove_watcher() i=6 2024-09-12T00:29:30.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.306+0000 7f3b66cb49c0 20 remove_watcher() i=7 2024-09-12T00:29:30.324 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:30.324 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:30.324 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:29:30.324 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:30.324 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at init_index 2024-09-12T00:29:30.325 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:30.736 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:29:30.769 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:30.769 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:30.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.814+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:30.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 realm 2024-09-12T00:29:30.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:30.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:30.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:30.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:30.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.818+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:30.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.822+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:30.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.822+0000 7fc2f27379c0 20 searching for the correct realm 2024-09-12T00:29:30.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.822+0000 7fc2efa3c640 0 -- 172.21.15.78:0/1983168727 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x55d8e9a37550 msgr2=0x55d8e9a39940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:30.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:30.830+0000 7fc2efa3c640 0 -- 172.21.15.78:0/1983168727 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fc2e0099c00 msgr2=0x7fc2e0060070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:31.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:31.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:31.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:31.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:31.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:31.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:31.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:31.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 zone default found 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 4 Realm: () 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 zonegroup default 2024-09-12T00:29:31.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.050+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.054+0000 7fc2f27379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.054+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.054+0000 7fc2f27379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.054+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.054+0000 7fc2f27379c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.054+0000 7fc2f27379c0 20 started sync module instance, tier type = 2024-09-12T00:29:31.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.054+0000 7fc2f27379c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:31.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.078+0000 7fc2f27379c0 20 add_watcher() i=0 2024-09-12T00:29:31.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.078+0000 7fc2f27379c0 20 add_watcher() i=1 2024-09-12T00:29:31.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.078+0000 7fc2f27379c0 20 add_watcher() i=2 2024-09-12T00:29:31.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.078+0000 7fc2f27379c0 20 add_watcher() i=3 2024-09-12T00:29:31.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.078+0000 7fc2f27379c0 20 add_watcher() i=4 2024-09-12T00:29:31.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.078+0000 7fc2f27379c0 20 add_watcher() i=5 2024-09-12T00:29:31.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.078+0000 7fc2f27379c0 20 add_watcher() i=6 2024-09-12T00:29:31.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.082+0000 7fc2f27379c0 20 add_watcher() i=7 2024-09-12T00:29:31.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.082+0000 7fc2f27379c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:31.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.086+0000 7fc1a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:31.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.086+0000 7fc2f27379c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:31.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.086+0000 7fc2f27379c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:31.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.086+0000 7fc2f27379c0 5 note: GC not initialized 2024-09-12T00:29:31.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.086+0000 7fc1a5fdb640 20 reqs_thread_entry: start 2024-09-12T00:29:31.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.086+0000 7fc2f27379c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:31.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.086+0000 7fc2f27379c0 20 Filter name: none 2024-09-12T00:29:31.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc1177fe640 20 reqs_thread_entry: start 2024-09-12T00:29:31.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:31.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:31.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:31.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:31.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.090+0000 7fc2f27379c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.094+0000 7fc2f27379c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:31.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.094+0000 7fc2f27379c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:31.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.094+0000 7fc1a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:31.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.098+0000 7fc2f27379c0 20 remove_watcher() i=0 2024-09-12T00:29:31.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.098+0000 7fc2f27379c0 2 removed watcher, disabling cache 2024-09-12T00:29:31.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.102+0000 7fc2f27379c0 20 remove_watcher() i=1 2024-09-12T00:29:31.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.102+0000 7fc2f27379c0 20 remove_watcher() i=2 2024-09-12T00:29:31.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.106+0000 7fc2f27379c0 20 remove_watcher() i=3 2024-09-12T00:29:31.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.106+0000 7fc2f27379c0 20 remove_watcher() i=4 2024-09-12T00:29:31.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.110+0000 7fc2f27379c0 20 remove_watcher() i=5 2024-09-12T00:29:31.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.114+0000 7fc2f27379c0 20 remove_watcher() i=6 2024-09-12T00:29:31.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.114+0000 7fc2f27379c0 20 remove_watcher() i=7 2024-09-12T00:29:31.133 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:31.133 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:31.133 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:29:31.133 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:31.134 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index 2024-09-12T00:29:31.170 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:31.171 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:31.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.214+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 realm 2024-09-12T00:29:31.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:31.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:31.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:31.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.218+0000 7f58284899c0 20 searching for the correct realm 2024-09-12T00:29:31.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.226+0000 7f5826790640 0 -- 172.21.15.78:0/2142575036 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f58180fb220 msgr2=0x7f5818110840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:31.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.842+0000 7f581d78e640 0 -- 172.21.15.78:0/2142575036 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f5818103dc0 msgr2=0x7f58180f9390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:31.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:31.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:31.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:31.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:31.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:31.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:31.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:31.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:31.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 zone default found 2024-09-12T00:29:31.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 4 Realm: () 2024-09-12T00:29:31.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:31.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:31.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:31.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 zonegroup default 2024-09-12T00:29:31.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.858+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.862+0000 7f58284899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.862+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.862+0000 7f58284899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.862+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.862+0000 7f58284899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:31.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.862+0000 7f58284899c0 20 started sync module instance, tier type = 2024-09-12T00:29:31.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.862+0000 7f58284899c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:31.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=0 2024-09-12T00:29:31.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=1 2024-09-12T00:29:31.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=2 2024-09-12T00:29:31.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=3 2024-09-12T00:29:31.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=4 2024-09-12T00:29:31.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=5 2024-09-12T00:29:31.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=6 2024-09-12T00:29:31.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 20 add_watcher() i=7 2024-09-12T00:29:31.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.886+0000 7f58284899c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:31.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f56d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:31.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:31.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:31.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 5 note: GC not initialized 2024-09-12T00:29:31.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f56d67fc640 20 reqs_thread_entry: start 2024-09-12T00:29:31.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:31.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 Filter name: none 2024-09-12T00:29:31.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f5647fff640 20 reqs_thread_entry: start 2024-09-12T00:29:31.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:29:31.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:31.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:29:31.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:29:31.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 : miss 2024-09-12T00:29:31.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:31.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:31.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:31.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:31.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:31.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:31.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.894+0000 7f58284899c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 2024-09-12T00:29:31.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.898+0000 7f58284899c0 -1 Injecting error=-5 at location=init_index 2024-09-12T00:29:31.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.898+0000 7f58284899c0 0 ERROR: init_target_index failed to initialize target index shard objects: (5) Input/output error 2024-09-12T00:29:31.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.902+0000 7f56d77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:31.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.906+0000 7f58284899c0 20 remove_watcher() i=0 2024-09-12T00:29:31.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.906+0000 7f58284899c0 2 removed watcher, disabling cache 2024-09-12T00:29:31.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.910+0000 7f58284899c0 20 remove_watcher() i=1 2024-09-12T00:29:31.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.910+0000 7f58284899c0 20 remove_watcher() i=2 2024-09-12T00:29:31.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.914+0000 7f58284899c0 20 remove_watcher() i=3 2024-09-12T00:29:31.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.914+0000 7f58284899c0 20 remove_watcher() i=4 2024-09-12T00:29:31.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.918+0000 7f58284899c0 20 remove_watcher() i=5 2024-09-12T00:29:31.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.918+0000 7f58284899c0 20 remove_watcher() i=6 2024-09-12T00:29:31.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:31.922+0000 7f58284899c0 20 remove_watcher() i=7 2024-09-12T00:29:31.938 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:29:31.967 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:31.967 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:32.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.218+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 20 realm 2024-09-12T00:29:32.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.222+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.226+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:32.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.226+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.226+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.226+0000 7fe5b29e09c0 20 searching for the correct realm 2024-09-12T00:29:32.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.226+0000 7fe5afce5640 0 -- 172.21.15.78:0/1630920814 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fe5a00b3040 msgr2=0x7fe5a00f6fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:32.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.442+0000 7fe5b04e6640 0 -- 172.21.15.78:0/1630920814 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fe5a4035060 msgr2=0x7fe5a408e9e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:32.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:32.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:32.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.662+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:32.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:32.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 zone default found 2024-09-12T00:29:32.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 4 Realm: () 2024-09-12T00:29:32.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:32.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:32.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:32.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 zonegroup default 2024-09-12T00:29:32.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.666+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.670+0000 7fe5b29e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.670+0000 7fe5b29e09c0 20 started sync module instance, tier type = 2024-09-12T00:29:32.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.670+0000 7fe5b29e09c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:32.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.690+0000 7fe5b29e09c0 20 add_watcher() i=0 2024-09-12T00:29:32.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.690+0000 7fe5b29e09c0 20 add_watcher() i=1 2024-09-12T00:29:32.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.690+0000 7fe5b29e09c0 20 add_watcher() i=2 2024-09-12T00:29:32.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.690+0000 7fe5b29e09c0 20 add_watcher() i=3 2024-09-12T00:29:32.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.690+0000 7fe5b29e09c0 20 add_watcher() i=4 2024-09-12T00:29:32.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.690+0000 7fe5b29e09c0 20 add_watcher() i=5 2024-09-12T00:29:32.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.690+0000 7fe5b29e09c0 20 add_watcher() i=6 2024-09-12T00:29:32.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.694+0000 7fe5b29e09c0 20 add_watcher() i=7 2024-09-12T00:29:32.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.694+0000 7fe5b29e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:32.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.698+0000 7fe466fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:32.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.698+0000 7fe5b29e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:32.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.698+0000 7fe5b29e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:32.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.698+0000 7fe5b29e09c0 5 note: GC not initialized 2024-09-12T00:29:32.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.698+0000 7fe465fdb640 20 reqs_thread_entry: start 2024-09-12T00:29:32.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.698+0000 7fe5b29e09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:32.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.698+0000 7fe5b29e09c0 20 Filter name: none 2024-09-12T00:29:32.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe3d77fe640 20 reqs_thread_entry: start 2024-09-12T00:29:32.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:32.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:32.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:32.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:32.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:32.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.702+0000 7fe5b29e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:32.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.706+0000 7fe466fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:32.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.710+0000 7fe5b29e09c0 20 remove_watcher() i=0 2024-09-12T00:29:32.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.710+0000 7fe5b29e09c0 2 removed watcher, disabling cache 2024-09-12T00:29:32.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.714+0000 7fe5b29e09c0 20 remove_watcher() i=1 2024-09-12T00:29:32.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.714+0000 7fe5b29e09c0 20 remove_watcher() i=2 2024-09-12T00:29:32.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.718+0000 7fe5b29e09c0 20 remove_watcher() i=3 2024-09-12T00:29:32.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.718+0000 7fe5b29e09c0 20 remove_watcher() i=4 2024-09-12T00:29:32.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.722+0000 7fe5b29e09c0 20 remove_watcher() i=5 2024-09-12T00:29:32.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.726+0000 7fe5b29e09c0 20 remove_watcher() i=6 2024-09-12T00:29:32.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.726+0000 7fe5b29e09c0 20 remove_watcher() i=7 2024-09-12T00:29:32.743 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:32.743 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:32.743 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:29:32.743 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:32.802 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:29:32.839 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:32.839 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:32.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.882+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 realm 2024-09-12T00:29:32.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:32.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:32.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:32.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.886+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:32.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.890+0000 7f0dfcf339c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:32.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.890+0000 7f0dfcf339c0 20 searching for the correct realm 2024-09-12T00:29:32.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:32.894+0000 7f0dfb23a640 0 -- 172.21.15.78:0/4268107986 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0dec11c440 msgr2=0x7f0dec0fe6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:33.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.106+0000 7f0dfb23a640 0 -- 172.21.15.78:0/4268107986 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5583f8ab5d30 msgr2=0x5583f8ab81b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:33.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 zone default found 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 4 Realm: () 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 zonegroup default 2024-09-12T00:29:33.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.122+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.126+0000 7f0dfcf339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.126+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.126+0000 7f0dfcf339c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.126+0000 7f0dfcf339c0 20 started sync module instance, tier type = 2024-09-12T00:29:33.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.126+0000 7f0dfcf339c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:33.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=0 2024-09-12T00:29:33.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=1 2024-09-12T00:29:33.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=2 2024-09-12T00:29:33.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=3 2024-09-12T00:29:33.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=4 2024-09-12T00:29:33.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=5 2024-09-12T00:29:33.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=6 2024-09-12T00:29:33.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 20 add_watcher() i=7 2024-09-12T00:29:33.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.150+0000 7f0dfcf339c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:33.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0cb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:33.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:33.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:33.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 5 note: GC not initialized 2024-09-12T00:29:33.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0c2bfff640 20 reqs_thread_entry: start 2024-09-12T00:29:33.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:33.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 20 Filter name: none 2024-09-12T00:29:33.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0c29ffb640 20 reqs_thread_entry: start 2024-09-12T00:29:33.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:29:33.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:33.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:29:33.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:29:33.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 : miss 2024-09-12T00:29:33.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.158+0000 7f0dfcf339c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.162+0000 7f0dfcf339c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:33.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.162+0000 7f0dfcf339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:33.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.162+0000 7f0dfcf339c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:33.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.162+0000 7f0dfcf339c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:33.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.162+0000 7f0dfcf339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:33.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.162+0000 7f0dfcf339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 2024-09-12T00:29:33.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0dfcf339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:33.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0dfcf339c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:33.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0dfcf339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:33.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0dfcf339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19, ofs0, ns] 2024-09-12T00:29:33.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0cde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398935 cookie 94025301135264 notifier 5933 bl.length()=911 2024-09-12T00:29:33.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0cde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:33.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0cde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:33.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.170+0000 7f0cde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:33.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.174+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): orig_sources= new_sources= 2024-09-12T00:29:33.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.174+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): potential sources added=[] removed=[] 2024-09-12T00:29:33.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.174+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): orig_dests= new_dests= 2024-09-12T00:29:33.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.174+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): potential dests added=[] removed=[] 2024-09-12T00:29:33.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.0 2024-09-12T00:29:33.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.0 2024-09-12T00:29:33.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.1 2024-09-12T00:29:33.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.1 2024-09-12T00:29:33.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.2 2024-09-12T00:29:33.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.2 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.3 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.3 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.4 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.4 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.5 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.5 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.6 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.6 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.7 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.7 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.8 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.8 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.9 2024-09-12T00:29:33.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.9 2024-09-12T00:29:33.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.10 2024-09-12T00:29:33.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.10 2024-09-12T00:29:33.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.11 2024-09-12T00:29:33.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1.11 2024-09-12T00:29:33.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.0 2024-09-12T00:29:33.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.182+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1 2024-09-12T00:29:33.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.186+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.2 2024-09-12T00:29:33.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.186+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.3 2024-09-12T00:29:33.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.186+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.4 2024-09-12T00:29:33.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.186+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.5 2024-09-12T00:29:33.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.190+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.6 2024-09-12T00:29:33.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.190+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.7 2024-09-12T00:29:33.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.190+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.8 2024-09-12T00:29:33.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.190+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.9 2024-09-12T00:29:33.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.194+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.10 2024-09-12T00:29:33.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.198+0000 7f0dfcf339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:33.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.198+0000 7f0dfcf339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 2024-09-12T00:29:33.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:33.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:33.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:33.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19, ofs0, ns] 2024-09-12T00:29:33.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0cddffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398936 cookie 94025301135264 notifier 5933 bl.length()=911 2024-09-12T00:29:33.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0cddffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:33.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0cddffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:33.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0cddffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:33.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): orig_sources= new_sources= 2024-09-12T00:29:33.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): potential sources added=[] removed=[] 2024-09-12T00:29:33.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): orig_dests= new_dests= 2024-09-12T00:29:33.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.202+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): potential dests added=[] removed=[] 2024-09-12T00:29:33.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.210+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.0 2024-09-12T00:29:33.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.210+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.1 2024-09-12T00:29:33.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.210+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.2 2024-09-12T00:29:33.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.210+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.3 2024-09-12T00:29:33.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.210+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.4 2024-09-12T00:29:33.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.214+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.5 2024-09-12T00:29:33.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.214+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.6 2024-09-12T00:29:33.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.214+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.7 2024-09-12T00:29:33.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.214+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.8 2024-09-12T00:29:33.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.214+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.9 2024-09-12T00:29:33.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0dfcf339c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19.10 2024-09-12T00:29:33.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0dfcf339c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:33.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0dfcf339c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 2024-09-12T00:29:33.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0dfcf339c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:33.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0dfcf339c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:33.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0dfcf339c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:33.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0dfcf339c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19, ofs0, ns] 2024-09-12T00:29:33.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0cde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398937 cookie 94025301135264 notifier 5933 bl.length()=879 2024-09-12T00:29:33.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0cde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 info.flags=0x17 2024-09-12T00:29:33.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0cde7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 to cache LRU end 2024-09-12T00:29:33.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.218+0000 7f0cde7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:33.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.222+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): orig_sources= new_sources= 2024-09-12T00:29:33.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.222+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): potential sources added=[] removed=[] 2024-09-12T00:29:33.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.222+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): orig_dests= new_dests= 2024-09-12T00:29:33.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.222+0000 7f0dfcf339c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19]): potential dests added=[] removed=[] 2024-09-12T00:29:33.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.226+0000 7f0dfcf339c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:29:33.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.230+0000 7f0cb17e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:33.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.234+0000 7f0dfcf339c0 20 remove_watcher() i=0 2024-09-12T00:29:33.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.234+0000 7f0dfcf339c0 2 removed watcher, disabling cache 2024-09-12T00:29:33.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.238+0000 7f0dfcf339c0 20 remove_watcher() i=1 2024-09-12T00:29:33.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.238+0000 7f0dfcf339c0 20 remove_watcher() i=2 2024-09-12T00:29:33.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.242+0000 7f0dfcf339c0 20 remove_watcher() i=3 2024-09-12T00:29:33.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.242+0000 7f0dfcf339c0 20 remove_watcher() i=4 2024-09-12T00:29:33.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.246+0000 7f0dfcf339c0 20 remove_watcher() i=5 2024-09-12T00:29:33.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.250+0000 7f0dfcf339c0 20 remove_watcher() i=6 2024-09-12T00:29:33.251 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.250+0000 7f0dfcf339c0 20 remove_watcher() i=7 2024-09-12T00:29:33.267 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:29:33.298 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:33.298 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:33.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.342+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 realm 2024-09-12T00:29:33.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:33.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:33.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:33.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.346+0000 7fadb7cd09c0 20 searching for the correct realm 2024-09-12T00:29:33.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.354+0000 7fadb5fd7640 0 -- 172.21.15.78:0/1550857734 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fada812f7f0 msgr2=0x7fada810e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:33.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.566+0000 7fadb5fd7640 0 -- 172.21.15.78:0/1550857734 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55d05ffc6580 msgr2=0x55d05ffc8970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:33.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:33.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:33.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:33.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:33.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:33.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:33.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:33.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:33.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 zone default found 2024-09-12T00:29:33.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 4 Realm: () 2024-09-12T00:29:33.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:33.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:33.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:33.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 zonegroup default 2024-09-12T00:29:33.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.582+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.586+0000 7fadb7cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.586+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.586+0000 7fadb7cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.586+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.586+0000 7fadb7cd09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:33.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.586+0000 7fadb7cd09c0 20 started sync module instance, tier type = 2024-09-12T00:29:33.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.586+0000 7fadb7cd09c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.610+0000 7fadb7cd09c0 20 add_watcher() i=0 2024-09-12T00:29:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.610+0000 7fadb7cd09c0 20 add_watcher() i=1 2024-09-12T00:29:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.610+0000 7fadb7cd09c0 20 add_watcher() i=2 2024-09-12T00:29:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.610+0000 7fadb7cd09c0 20 add_watcher() i=3 2024-09-12T00:29:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.610+0000 7fadb7cd09c0 20 add_watcher() i=4 2024-09-12T00:29:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.610+0000 7fadb7cd09c0 20 add_watcher() i=5 2024-09-12T00:29:33.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.610+0000 7fadb7cd09c0 20 add_watcher() i=6 2024-09-12T00:29:33.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.614+0000 7fadb7cd09c0 20 add_watcher() i=7 2024-09-12T00:29:33.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.614+0000 7fadb7cd09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:33.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fac6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fadb7cd09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fadb7cd09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:33.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fadb7cd09c0 5 note: GC not initialized 2024-09-12T00:29:33.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fac6a7e4640 20 reqs_thread_entry: start 2024-09-12T00:29:33.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fadb7cd09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:33.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fadb7cd09c0 20 Filter name: none 2024-09-12T00:29:33.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fabdbfff640 20 reqs_thread_entry: start 2024-09-12T00:29:33.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.618+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:33.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:33.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:33.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:33.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.622+0000 7fadb7cd09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:33.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.626+0000 7fac6b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:33.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.630+0000 7fadb7cd09c0 20 remove_watcher() i=0 2024-09-12T00:29:33.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.630+0000 7fadb7cd09c0 2 removed watcher, disabling cache 2024-09-12T00:29:33.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.634+0000 7fadb7cd09c0 20 remove_watcher() i=1 2024-09-12T00:29:33.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.638+0000 7fadb7cd09c0 20 remove_watcher() i=2 2024-09-12T00:29:33.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.638+0000 7fadb7cd09c0 20 remove_watcher() i=3 2024-09-12T00:29:33.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.642+0000 7fadb7cd09c0 20 remove_watcher() i=4 2024-09-12T00:29:33.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.642+0000 7fadb7cd09c0 20 remove_watcher() i=5 2024-09-12T00:29:33.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.646+0000 7fadb7cd09c0 20 remove_watcher() i=6 2024-09-12T00:29:33.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:33.650+0000 7fadb7cd09c0 20 remove_watcher() i=7 2024-09-12T00:29:33.665 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:33.665 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:33.665 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.19 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:29:33.665 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:33.780 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EOPNOTSUPP injected at init_index 2024-09-12T00:29:33.780 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:34.170 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:29:34.202 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:34.202 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:34.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.250+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.250+0000 7f34310739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.250+0000 7f34310739c0 20 realm 2024-09-12T00:29:34.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.250+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:34.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:34.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:34.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.254+0000 7f34310739c0 20 searching for the correct realm 2024-09-12T00:29:34.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.262+0000 7f342f37a640 0 -- 172.21.15.78:0/318026103 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f34200f7b50 msgr2=0x7f342011c990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:34.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.266+0000 7f342eb79640 0 -- 172.21.15.78:0/318026103 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55b388f46240 msgr2=0x55b388f48690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:34.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.274+0000 7f34310739c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:34.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.274+0000 7f34310739c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:34.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.274+0000 7f34310739c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:34.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.274+0000 7f34310739c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:34.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.274+0000 7f34310739c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:34.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.274+0000 7f34310739c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:34.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.274+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:34.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:34.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 zone default found 2024-09-12T00:29:34.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 4 Realm: () 2024-09-12T00:29:34.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:34.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:34.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:34.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 zonegroup default 2024-09-12T00:29:34.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 started sync module instance, tier type = 2024-09-12T00:29:34.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.278+0000 7f34310739c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:34.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.298+0000 7f34310739c0 20 add_watcher() i=0 2024-09-12T00:29:34.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.298+0000 7f34310739c0 20 add_watcher() i=1 2024-09-12T00:29:34.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.298+0000 7f34310739c0 20 add_watcher() i=2 2024-09-12T00:29:34.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.298+0000 7f34310739c0 20 add_watcher() i=3 2024-09-12T00:29:34.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.298+0000 7f34310739c0 20 add_watcher() i=4 2024-09-12T00:29:34.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.298+0000 7f34310739c0 20 add_watcher() i=5 2024-09-12T00:29:34.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.298+0000 7f34310739c0 20 add_watcher() i=6 2024-09-12T00:29:34.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.302+0000 7f34310739c0 20 add_watcher() i=7 2024-09-12T00:29:34.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.302+0000 7f34310739c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:34.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f32e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:34.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:34.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:34.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 5 note: GC not initialized 2024-09-12T00:29:34.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f325ffff640 20 reqs_thread_entry: start 2024-09-12T00:29:34.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:34.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 20 Filter name: none 2024-09-12T00:29:34.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f325dffb640 20 reqs_thread_entry: start 2024-09-12T00:29:34.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:34.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.306+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.310+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:34.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.310+0000 7f34310739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:34.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.310+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.310+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:34.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.310+0000 7f34310739c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.310+0000 7f34310739c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:34.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.310+0000 7f34310739c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:34.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.314+0000 7f32e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:34.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.318+0000 7f34310739c0 20 remove_watcher() i=0 2024-09-12T00:29:34.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.318+0000 7f34310739c0 2 removed watcher, disabling cache 2024-09-12T00:29:34.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.318+0000 7f34310739c0 20 remove_watcher() i=1 2024-09-12T00:29:34.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.322+0000 7f34310739c0 20 remove_watcher() i=2 2024-09-12T00:29:34.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.322+0000 7f34310739c0 20 remove_watcher() i=3 2024-09-12T00:29:34.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.326+0000 7f34310739c0 20 remove_watcher() i=4 2024-09-12T00:29:34.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.326+0000 7f34310739c0 20 remove_watcher() i=5 2024-09-12T00:29:34.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.330+0000 7f34310739c0 20 remove_watcher() i=6 2024-09-12T00:29:34.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.334+0000 7f34310739c0 20 remove_watcher() i=7 2024-09-12T00:29:34.347 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:34.347 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:34.347 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:29:34.347 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:34.348 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-init-index --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at init_index --inject-error-code 95 2024-09-12T00:29:34.383 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:34.383 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:34.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.426+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 20 realm 2024-09-12T00:29:34.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:34.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.430+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.434+0000 7fec361ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:34.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.434+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.434+0000 7fec361ba9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:34.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.434+0000 7fec361ba9c0 20 searching for the correct realm 2024-09-12T00:29:34.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.438+0000 7fec344c1640 0 -- 172.21.15.78:0/2448149508 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fec2406bc10 msgr2=0x7fec2405b3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:34.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.650+0000 7fec344c1640 0 -- 172.21.15.78:0/2448149508 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563800fe2860 msgr2=0x563800fe4ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:34.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:34.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:34.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:34.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:34.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:34.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:34.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.662+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:34.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:34.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 zone default found 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 4 Realm: () 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 zonegroup default 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.666+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.670+0000 7fec361ba9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.670+0000 7fec361ba9c0 20 started sync module instance, tier type = 2024-09-12T00:29:34.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.670+0000 7fec361ba9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:34.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.698+0000 7fec361ba9c0 20 add_watcher() i=0 2024-09-12T00:29:34.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.698+0000 7fec361ba9c0 20 add_watcher() i=1 2024-09-12T00:29:34.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.698+0000 7fec361ba9c0 20 add_watcher() i=2 2024-09-12T00:29:34.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.698+0000 7fec361ba9c0 20 add_watcher() i=3 2024-09-12T00:29:34.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.698+0000 7fec361ba9c0 20 add_watcher() i=4 2024-09-12T00:29:34.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.698+0000 7fec361ba9c0 20 add_watcher() i=5 2024-09-12T00:29:34.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.702+0000 7fec361ba9c0 20 add_watcher() i=6 2024-09-12T00:29:34.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.702+0000 7fec361ba9c0 20 add_watcher() i=7 2024-09-12T00:29:34.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.702+0000 7fec361ba9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:34.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.706+0000 7feae9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:34.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.706+0000 7fec361ba9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:34.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.706+0000 7fec361ba9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:34.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.706+0000 7fec361ba9c0 5 note: GC not initialized 2024-09-12T00:29:34.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.706+0000 7feae8fe1640 20 reqs_thread_entry: start 2024-09-12T00:29:34.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.706+0000 7fec361ba9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:34.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.706+0000 7fec361ba9c0 20 Filter name: none 2024-09-12T00:29:34.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fea627fc640 20 reqs_thread_entry: start 2024-09-12T00:29:34.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 cache get: name=default.rgw.meta+root+error-at-init-index : miss 2024-09-12T00:29:34.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:34.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 cache put: name=default.rgw.meta+root+error-at-init-index info.flags=0x11 2024-09-12T00:29:34.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 adding default.rgw.meta+root+error-at-init-index to cache LRU end 2024-09-12T00:29:34.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 : miss 2024-09-12T00:29:34.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:34.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 info.flags=0x17 2024-09-12T00:29:34.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 to cache LRU end 2024-09-12T00:29:34.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:34.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:34.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.710+0000 7fec361ba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 2024-09-12T00:29:34.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.714+0000 7fec361ba9c0 -1 Injecting error=-95 at location=init_index 2024-09-12T00:29:34.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.714+0000 7fec361ba9c0 0 WARNING: init_index() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:29:34.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 info.flags=0x17 2024-09-12T00:29:34.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 to cache LRU end 2024-09-12T00:29:34.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:34.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20, ofs0, ns] 2024-09-12T00:29:34.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7feb12ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398942 cookie 94798534896160 notifier 5981 bl.length()=911 2024-09-12T00:29:34.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7feb12ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 info.flags=0x17 2024-09-12T00:29:34.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7feb12ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 to cache LRU end 2024-09-12T00:29:34.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7feb12ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:34.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): orig_sources= new_sources= 2024-09-12T00:29:34.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): potential sources added=[] removed=[] 2024-09-12T00:29:34.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): orig_dests= new_dests= 2024-09-12T00:29:34.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.722+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): potential dests added=[] removed=[] 2024-09-12T00:29:34.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.0 2024-09-12T00:29:34.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.0 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.1 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.1 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.2 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.2 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.3 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.3 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.4 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.4 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.5 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.5 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.6 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.6 2024-09-12T00:29:34.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.7 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.7 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.8 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.8 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.9 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.9 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.10 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.10 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.11 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1.11 2024-09-12T00:29:34.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.0 2024-09-12T00:29:34.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.1 2024-09-12T00:29:34.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.2 2024-09-12T00:29:34.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.730+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.3 2024-09-12T00:29:34.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.734+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.4 2024-09-12T00:29:34.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.734+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.5 2024-09-12T00:29:34.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.734+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.6 2024-09-12T00:29:34.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.734+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.7 2024-09-12T00:29:34.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.738+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.8 2024-09-12T00:29:34.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.738+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.9 2024-09-12T00:29:34.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.738+0000 7fec361ba9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20.10 2024-09-12T00:29:34.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.746+0000 7fec361ba9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 : hit (requested=0x17, cached=0x17) 2024-09-12T00:29:34.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.746+0000 7fec361ba9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 2024-09-12T00:29:34.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.746+0000 7fec361ba9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 info.flags=0x17 2024-09-12T00:29:34.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.746+0000 7fec361ba9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 to cache LRU end 2024-09-12T00:29:34.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.746+0000 7fec361ba9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:34.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.746+0000 7fec361ba9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20, ofs0, ns] 2024-09-12T00:29:34.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7feb127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398943 cookie 94798534896160 notifier 5981 bl.length()=879 2024-09-12T00:29:34.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7feb127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 info.flags=0x17 2024-09-12T00:29:34.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7feb127fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-init-index:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 to cache LRU end 2024-09-12T00:29:34.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7feb127fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:34.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): orig_sources= new_sources= 2024-09-12T00:29:34.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): potential sources added=[] removed=[] 2024-09-12T00:29:34.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): orig_dests= new_dests= 2024-09-12T00:29:34.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.750+0000 7fec361ba9c0 20 handle_bi_update(): bucket=:error-at-init-index[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20]): potential dests added=[] removed=[] 2024-09-12T00:29:34.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.754+0000 7fec361ba9c0 1 execute INFO: reshard of bucket "error-at-init-index" from 11 shards to 12 shards completed successfully 2024-09-12T00:29:34.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.758+0000 7feae9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:34.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.762+0000 7fec361ba9c0 20 remove_watcher() i=0 2024-09-12T00:29:34.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.762+0000 7fec361ba9c0 2 removed watcher, disabling cache 2024-09-12T00:29:34.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.766+0000 7fec361ba9c0 20 remove_watcher() i=1 2024-09-12T00:29:34.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.766+0000 7fec361ba9c0 20 remove_watcher() i=2 2024-09-12T00:29:34.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.770+0000 7fec361ba9c0 20 remove_watcher() i=3 2024-09-12T00:29:34.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.770+0000 7fec361ba9c0 20 remove_watcher() i=4 2024-09-12T00:29:34.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.774+0000 7fec361ba9c0 20 remove_watcher() i=5 2024-09-12T00:29:34.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.778+0000 7fec361ba9c0 20 remove_watcher() i=6 2024-09-12T00:29:34.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.782+0000 7fec361ba9c0 20 remove_watcher() i=7 2024-09-12T00:29:34.797 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-init-index 2024-09-12T00:29:34.827 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:34.827 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:34.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.870+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.870+0000 7f2d27a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.870+0000 7f2d27a659c0 20 realm 2024-09-12T00:29:34.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.870+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:34.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:34.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:34.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:34.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.874+0000 7f2d27a659c0 20 searching for the correct realm 2024-09-12T00:29:34.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.882+0000 7f2d25d6c640 0 -- 172.21.15.78:0/1345930812 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f2d18037910 msgr2=0x7f2d180283f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:34.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:34.886+0000 7f2d24d6a640 0 -- 172.21.15.78:0/1345930812 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f2d18043440 msgr2=0x7f2d180438c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:35.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:35.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:35.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:35.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:35.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:35.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:35.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:35.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:35.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.106+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:35.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 zone default found 2024-09-12T00:29:35.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 4 Realm: () 2024-09-12T00:29:35.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:35.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:35.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:35.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 zonegroup default 2024-09-12T00:29:35.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:35.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:35.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:35.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 started sync module instance, tier type = 2024-09-12T00:29:35.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.110+0000 7f2d27a659c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:35.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.138+0000 7f2d27a659c0 20 add_watcher() i=0 2024-09-12T00:29:35.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.138+0000 7f2d27a659c0 20 add_watcher() i=1 2024-09-12T00:29:35.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.138+0000 7f2d27a659c0 20 add_watcher() i=2 2024-09-12T00:29:35.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.138+0000 7f2d27a659c0 20 add_watcher() i=3 2024-09-12T00:29:35.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.138+0000 7f2d27a659c0 20 add_watcher() i=4 2024-09-12T00:29:35.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.138+0000 7f2d27a659c0 20 add_watcher() i=5 2024-09-12T00:29:35.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.138+0000 7f2d27a659c0 20 add_watcher() i=6 2024-09-12T00:29:35.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.142+0000 7f2d27a659c0 20 add_watcher() i=7 2024-09-12T00:29:35.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.142+0000 7f2d27a659c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:35.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2bdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:35.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:35.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:35.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 5 note: GC not initialized 2024-09-12T00:29:35.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2bda7e4640 20 reqs_thread_entry: start 2024-09-12T00:29:35.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:35.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 20 Filter name: none 2024-09-12T00:29:35.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2b4bfff640 20 reqs_thread_entry: start 2024-09-12T00:29:35.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:35.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.146+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.150+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:35.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.150+0000 7f2d27a659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:35.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.150+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.150+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:29:35.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.150+0000 7f2d27a659c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.150+0000 7f2d27a659c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:29:35.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.150+0000 7f2d27a659c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:35.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.154+0000 7f2bdb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:35.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.158+0000 7f2d27a659c0 20 remove_watcher() i=0 2024-09-12T00:29:35.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.158+0000 7f2d27a659c0 2 removed watcher, disabling cache 2024-09-12T00:29:35.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.162+0000 7f2d27a659c0 20 remove_watcher() i=1 2024-09-12T00:29:35.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.162+0000 7f2d27a659c0 20 remove_watcher() i=2 2024-09-12T00:29:35.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.166+0000 7f2d27a659c0 20 remove_watcher() i=3 2024-09-12T00:29:35.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.170+0000 7f2d27a659c0 20 remove_watcher() i=4 2024-09-12T00:29:35.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.170+0000 7f2d27a659c0 20 remove_watcher() i=5 2024-09-12T00:29:35.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.174+0000 7f2d27a659c0 20 remove_watcher() i=6 2024-09-12T00:29:35.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.178+0000 7f2d27a659c0 20 remove_watcher() i=7 2024-09-12T00:29:35.194 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:35.194 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:35.194 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-init-index id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.20 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:29:35.194 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:35.299 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at init_index 2024-09-12T00:29:35.299 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:35.720 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:29:35.752 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:35.752 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:35.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.798+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.798+0000 7f58f93249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:35.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.798+0000 7f58f93249c0 20 realm 2024-09-12T00:29:35.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.798+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.798+0000 7f58f93249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:35.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.798+0000 7f58f93249c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:35.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.798+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.802+0000 7f58f93249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:35.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.802+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.802+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:35.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.802+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:35.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.802+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:35.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.802+0000 7f58f93249c0 20 searching for the correct realm 2024-09-12T00:29:35.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:35.806+0000 7f58f762b640 0 -- 172.21.15.78:0/3136120406 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f58e811eb60 msgr2=0x7f58e8009a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:36.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.018+0000 7f58f6e2a640 0 -- 172.21.15.78:0/3136120406 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5620c7907400 msgr2=0x5620c7909830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:36.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.030+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 zone default found 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 4 Realm: () 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 zonegroup default 2024-09-12T00:29:36.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 started sync module instance, tier type = 2024-09-12T00:29:36.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.034+0000 7f58f93249c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:36.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=0 2024-09-12T00:29:36.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=1 2024-09-12T00:29:36.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=2 2024-09-12T00:29:36.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=3 2024-09-12T00:29:36.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=4 2024-09-12T00:29:36.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=5 2024-09-12T00:29:36.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=6 2024-09-12T00:29:36.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 20 add_watcher() i=7 2024-09-12T00:29:36.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.062+0000 7f58f93249c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:36.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.066+0000 7f57ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:36.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:36.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:36.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 5 note: GC not initialized 2024-09-12T00:29:36.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f5727fff640 20 reqs_thread_entry: start 2024-09-12T00:29:36.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:36.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 Filter name: none 2024-09-12T00:29:36.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f5725ffb640 20 reqs_thread_entry: start 2024-09-12T00:29:36.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:36.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:36.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:36.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.070+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.074+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:36.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.074+0000 7f58f93249c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.074+0000 7f58f93249c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:36.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.074+0000 7f58f93249c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:36.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.078+0000 7f57ad7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:36.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.082+0000 7f58f93249c0 20 remove_watcher() i=0 2024-09-12T00:29:36.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.082+0000 7f58f93249c0 2 removed watcher, disabling cache 2024-09-12T00:29:36.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.082+0000 7f58f93249c0 20 remove_watcher() i=1 2024-09-12T00:29:36.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.086+0000 7f58f93249c0 20 remove_watcher() i=2 2024-09-12T00:29:36.087 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.086+0000 7f58f93249c0 20 remove_watcher() i=3 2024-09-12T00:29:36.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.090+0000 7f58f93249c0 20 remove_watcher() i=4 2024-09-12T00:29:36.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.090+0000 7f58f93249c0 20 remove_watcher() i=5 2024-09-12T00:29:36.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.094+0000 7f58f93249c0 20 remove_watcher() i=6 2024-09-12T00:29:36.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.098+0000 7f58f93249c0 20 remove_watcher() i=7 2024-09-12T00:29:36.121 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-init-indext id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:29:36.122 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.122 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at init_index 2024-09-12T00:29:36.155 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:36.156 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:36.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 realm 2024-09-12T00:29:36.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:36.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:36.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 searching for the correct realm 2024-09-12T00:29:36.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.210+0000 7ff38eaec640 0 -- 172.21.15.78:0/2193495943 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7ff38003d3c0 msgr2=0x7ff38003be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:36.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.422+0000 7ff38eaec640 0 -- 172.21.15.78:0/2193495943 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55820c204de0 msgr2=0x55820c207280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:36.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:36.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:36.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:36.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:36.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:36.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:36.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:36.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 zone default found 2024-09-12T00:29:36.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 Realm: () 2024-09-12T00:29:36.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:36.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:36.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:36.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 zonegroup default 2024-09-12T00:29:36.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 started sync module instance, tier type = 2024-09-12T00:29:36.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:36.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=0 2024-09-12T00:29:36.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=1 2024-09-12T00:29:36.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=2 2024-09-12T00:29:36.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=3 2024-09-12T00:29:36.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=4 2024-09-12T00:29:36.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=5 2024-09-12T00:29:36.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=6 2024-09-12T00:29:36.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.466+0000 7ff3907e59c0 20 add_watcher() i=7 2024-09-12T00:29:36.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.466+0000 7ff3907e59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:36.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:36.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:36.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:36.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 note: GC not initialized 2024-09-12T00:29:36.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff1bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:29:36.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:36.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 Filter name: none 2024-09-12T00:29:36.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff1bd7fa640 20 reqs_thread_entry: start 2024-09-12T00:29:36.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff3907e59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:29:36.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:36.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:29:36.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:29:36.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 : miss 2024-09-12T00:29:36.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:36.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:29:36.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:29:36.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:36.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:36.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 2024-09-12T00:29:36.475 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3907e59c0 time 2024-09-12T00:29:36.480790+0000 2024-09-12T00:29:36.475 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:36.479 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3940bf2eb] 2024-09-12T00:29:36.479 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.479 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.479 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.479 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.479 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ff3907e59c0 thread_name:radosgw-admin 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.478+0000 7ff3907e59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3907e59c0 time 2024-09-12T00:29:36.480790+0000 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3940bf2eb] 2024-09-12T00:29:36.480 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:29:36.481 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.520 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.520 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff392f3e520] 2024-09-12T00:29:36.520 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3940bf345] 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.521 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.482+0000 7ff3907e59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ff3907e59c0 thread_name:radosgw-admin 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff392f3e520] 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:29:36.522 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3940bf345] 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:36.523 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820bfa7050 auth_method 0 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): get_auth_request con 0x55820bfd0460 auth_method 0 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_done global_id 6369 payload 274 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.525 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:29:36.178+0000 7ff38eaec640 1 monclient: found mon.noname-a 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: dump: 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.526 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6369 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: dump: 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.527 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 4 set_mon_vals no callback set 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: shutdown 2024-09-12T00:29:36.528 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) unregister_commands rotate-key 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.529 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.530 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.530 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding auth protocol: cephx 2024-09-12T00:29:36.530 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding auth protocol: cephx 2024-09-12T00:29:36.530 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding auth protocol: cephx 2024-09-12T00:29:36.530 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.530 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.530 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.531 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: starting msgr at 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: starting objecter 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command objecter_requests hook 0x55820bf3c280 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: setting wanted keys 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: calling monclient init 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding auth protocol: cephx 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding auth protocol: cephx 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding auth protocol: cephx 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.532 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.533 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key hook 0x55820c118408 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820bfa7050 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820bfd0460 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c11b5a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.534 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.519273s 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820bfa7050 auth_method 0 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): get_auth_request con 0x55820c11b5a0 auth_method 0 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.535 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 1 monclient: found mon.noname-a 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820bfd0460 auth_method 0 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:29:36.178+0000 7ff27ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:36.536 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: dump: 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.537 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: dump: 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.538 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:29:36.182+0000 7ff27c608640 4 set_mon_vals no callback set 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6372 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 1 librados: init done 2024-09-12T00:29:36.539 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:29:36.182+0000 7ff27ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:29:36.182+0000 7ff27ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:29:36.182+0000 7ff27ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:29:36.182+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff274070b10 auth_method 0 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:29:36.182+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c140850 auth_method 0 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:29:36.186+0000 7ff38e2eb640 10 monclient: get_auth_request con 0x55820c1631f0 auth_method 0 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:29:36.186+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820c167550 auth_method 0 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:29:36.186+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c166a50 auth_method 0 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.540 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding auth protocol: cephx 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding auth protocol: cephx 2024-09-12T00:29:36.541 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding auth protocol: cephx 2024-09-12T00:29:36.542 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.542 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.542 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.542 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.544 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.544 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55820c172f80 EEXIST 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding auth protocol: cephx 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding auth protocol: cephx 2024-09-12T00:29:36.545 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding auth protocol: cephx 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.546 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key cmddesc rotate-key hook 0x55820c16e5d0 EEXIST 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c197130 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820c196a60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820c195440 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.547 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.530554s 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): get_auth_request con 0x55820c197130 auth_method 0 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820c195440 auth_method 0 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.548 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:29:36.190+0000 7ff38daea640 1 monclient: found mon.noname-c 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:29:36.190+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c196a60 auth_method 0 2024-09-12T00:29:36.549 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: dump: 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.550 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: dump: 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.551 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6029 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:29:36.190+0000 7ff38f2ed640 4 set_mon_vals no callback set 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.552 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:29:36.194+0000 7ff273fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:29:36.194+0000 7ff273fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:29:36.194+0000 7ff273fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff268070a20 auth_method 0 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: get_monmap_and_config 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.553 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding auth protocol: cephx 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding auth protocol: cephx 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding auth protocol: cephx 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.554 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.555 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding auth protocol: cephx 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding auth protocol: cephx 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding auth protocol: cephx 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.556 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff04f4a6a8 EEXIST 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820c1e50b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c1e5490 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820c1e6950 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.557 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.534908s 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): get_auth_request con 0x55820c1e5490 auth_method 0 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820c1e6950 auth_method 0 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.558 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_done global_id 6032 payload 274 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:29:36.194+0000 7ff38eaec640 1 monclient: found mon.noname-c 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.559 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: dump: 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.560 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: dump: 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.561 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6032 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 4 set_mon_vals no callback set 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: shutdown 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.562 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding auth protocol: cephx 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding auth protocol: cephx 2024-09-12T00:29:36.563 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding auth protocol: cephx 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.564 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: starting msgr at 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: starting objecter 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55820c1950b0 EEXIST 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: setting wanted keys 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: calling monclient init 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding auth protocol: cephx 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding auth protocol: cephx 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding auth protocol: cephx 2024-09-12T00:29:36.565 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.566 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key cmddesc rotate-key hook 0x55820c199098 EEXIST 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820c1e50b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820c1e6950 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c1d9b70 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.567 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.537674s 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): get_auth_request con 0x55820c1e6950 auth_method 0 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820c1d9b70 auth_method 0 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.568 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_done global_id 6035 payload 824 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 1 monclient: found mon.noname-c 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:29:36.198+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820c1e50b0 auth_method 0 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: dump: 2024-09-12T00:29:36.569 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.570 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: dump: 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.571 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6035 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:29:36.198+0000 7ff271ffb640 4 set_mon_vals no callback set 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: init done 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cr dump hook 0x55820c1d96f8 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.572 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:29:36.202+0000 7ff25ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:29:36.202+0000 7ff25ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:29:36.202+0000 7ff25ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:29:36.202+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff258070ae0 auth_method 0 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:29:36.202+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c204de0 auth_method 0 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 realm 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.573 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:29:36.202+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820c209170 auth_method 0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:29:36.206+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c20c800 auth_method 0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 searching for the correct realm 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:29:36.206+0000 7ff38e2eb640 10 monclient: get_auth_request con 0x55820c211500 auth_method 0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:29:36.206+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff380089350 auth_method 0 2024-09-12T00:29:36.574 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:29:36.210+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff38003d3c0 auth_method 0 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:29:36.210+0000 7ff38eaec640 0 -- 172.21.15.78:0/2193495943 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7ff38003d3c0 msgr2=0x7ff38003be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:29:36.414+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff38003d3c0 auth_method 0 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:29:36.418+0000 7ff38e2eb640 10 monclient: get_auth_request con 0x7ff378032060 auth_method 0 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:29:36.422+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff380045eb0 auth_method 0 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:29:36.422+0000 7ff38eaec640 0 -- 172.21.15.78:0/2193495943 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55820c204de0 msgr2=0x55820c207280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:29:36.422+0000 7ff25ffff640 1 client.6035.objecter ms_handle_reset 0x55820c204de0 session 0x55820c204760 osd.6 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:29:36.422+0000 7ff25ffff640 10 monclient: _renew_subs 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:29:36.422+0000 7ff25ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:29:36.422+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff258080d10 auth_method 0 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:36.575 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.576 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 zone default found 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 Realm: () 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 zonegroup default 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.577 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 started sync module instance, tier type = 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=0 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=1 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=2 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=3 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=4 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=5 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=6 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:29:36.466+0000 7ff3907e59c0 20 add_watcher() i=7 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:29:36.466+0000 7ff3907e59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:36.578 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding auth protocol: cephx 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding auth protocol: cephx 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding auth protocol: cephx 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:29:36.470+0000 7ff244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.579 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache list hook 0x55820c1dc040 2024-09-12T00:29:36.580 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache inspect hook 0x55820c1dc040 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache erase hook 0x55820c1dc040 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache zap hook 0x55820c1dc040 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 note: GC not initialized 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:29:36.470+0000 7ff1bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace show hook 0x7ff380004710 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace history hook 0x7ff380004710 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace active hook 0x7ff380004710 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace active_short hook 0x7ff380004710 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 Filter name: none 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:29:36.470+0000 7ff1bd7fa640 20 reqs_thread_entry: start 2024-09-12T00:29:36.581 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 : miss 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:36.582 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:29:36.478+0000 7ff3907e59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3907e59c0 time 2024-09-12T00:29:36.480790+0000 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3940bf2eb] 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.583 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:29:36.482+0000 7ff3907e59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ff3907e59c0 thread_name:radosgw-admin 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff392f3e520] 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:29:36.584 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3940bf345] 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:29:36.585 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:29:36.586 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:29:36.587 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:29:36.588 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:29:36.589 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:29:36.590 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:29:36.591 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:29:36.592 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:29:36.593 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff1bd7fa640 / http_manager 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff1bf7fe640 / http_manager 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff244fe1640 / rgw_dt_lg_renew 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff25ffff640 / ms_dispatch 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff271ffb640 / io_context_pool 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff273fff640 / ms_dispatch 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff27ae05640 / ms_dispatch 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff27c608640 / io_context_pool 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38daea640 / msgr-worker-2 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38e2eb640 / msgr-worker-1 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38eaec640 / msgr-worker-0 2024-09-12T00:29:36.594 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38f2ed640 / io_context_pool 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff3907e59c0 / radosgw-admin 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.81614.log 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820bfa7050 auth_method 0 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.595 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): get_auth_request con 0x55820bfd0460 auth_method 0 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.596 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_done global_id 6369 payload 274 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:29:36.178+0000 7ff38eaec640 1 monclient: found mon.noname-a 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: dump: 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.597 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6369 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:29:36.178+0000 7ff27c608640 10 monclient: dump: 2024-09-12T00:29:36.598 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 4 set_mon_vals no callback set 2024-09-12T00:29:36.599 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: shutdown 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) unregister_commands rotate-key 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.600 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding auth protocol: cephx 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding auth protocol: cephx 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding auth protocol: cephx 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.601 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: crc 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c11a0b0) adding con mode: secure 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: starting msgr at 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: starting objecter 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command objecter_requests hook 0x55820bf3c280 2024-09-12T00:29:36.602 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: setting wanted keys 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 1 librados: calling monclient init 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding auth protocol: cephx 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding auth protocol: cephx 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding auth protocol: cephx 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.603 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: crc 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1182c0) adding con mode: secure 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key hook 0x55820c118408 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.604 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820bfa7050 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820bfd0460 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c11b5a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:29:36.178+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.519273s 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820bfa7050 auth_method 0 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.605 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): get_auth_request con 0x55820c11b5a0 auth_method 0 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.606 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:29:36.178+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_done global_id 6372 payload 824 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 1 monclient: found mon.noname-a 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:29:36.178+0000 7ff38e2eb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:29:36.178+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820bfd0460 auth_method 0 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:29:36.178+0000 7ff27ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: dump: 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.607 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:29:36.608 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:29:36.182+0000 7ff27ae05640 10 monclient: dump: 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:29:36.182+0000 7ff27c608640 4 set_mon_vals no callback set 2024-09-12T00:29:36.609 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6372 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:29:36.182+0000 7ff3907e59c0 1 librados: init done 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:29:36.182+0000 7ff27ae05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:29:36.182+0000 7ff27ae05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:29:36.182+0000 7ff27ae05640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:29:36.182+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff274070b10 auth_method 0 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:29:36.182+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c140850 auth_method 0 2024-09-12T00:29:36.610 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:29:36.186+0000 7ff38e2eb640 10 monclient: get_auth_request con 0x55820c1631f0 auth_method 0 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:29:36.186+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820c167550 auth_method 0 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:29:36.186+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c166a50 auth_method 0 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.611 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding auth protocol: cephx 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding auth protocol: cephx 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding auth protocol: cephx 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.612 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: crc 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16f590) adding con mode: secure 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55820c172f80 EEXIST 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.613 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding auth protocol: cephx 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding auth protocol: cephx 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding auth protocol: cephx 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.614 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: crc 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 AuthRegistry(0x55820c16e488) adding con mode: secure 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key cmddesc rotate-key hook 0x55820c16e5d0 EEXIST 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c197130 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820c196a60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820c195440 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.615 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.530554s 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): get_auth_request con 0x55820c197130 auth_method 0 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820c195440 auth_method 0 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.616 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:29:36.190+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient(hunting): handle_auth_done global_id 6029 payload 824 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:29:36.190+0000 7ff38daea640 1 monclient: found mon.noname-c 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:29:36.190+0000 7ff38daea640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.617 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:29:36.190+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c196a60 auth_method 0 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: dump: 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.618 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:29:36.190+0000 7ff273fff640 10 monclient: dump: 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.619 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6029 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:29:36.190+0000 7ff38f2ed640 4 set_mon_vals no callback set 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.620 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:29:36.190+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:29:36.194+0000 7ff273fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:29:36.194+0000 7ff273fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:29:36.194+0000 7ff273fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff268070a20 auth_method 0 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: get_monmap_and_config 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.621 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding auth protocol: cephx 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding auth protocol: cephx 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding auth protocol: cephx 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.622 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: crc 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1b6ae0) adding con mode: secure 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.623 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding auth protocol: cephx 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding auth protocol: cephx 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding auth protocol: cephx 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.624 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: crc 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4a560) adding con mode: secure 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff04f4a6a8 EEXIST 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820c1e50b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.625 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c1e5490 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820c1e6950 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.534908s 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): get_auth_request con 0x55820c1e5490 auth_method 0 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820c1e6950 auth_method 0 2024-09-12T00:29:36.626 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:29:36.194+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient(hunting): handle_auth_done global_id 6032 payload 274 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.627 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:29:36.194+0000 7ff38eaec640 1 monclient: found mon.noname-c 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:29:36.194+0000 7ff38eaec640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: dump: 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.628 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:29:36.194+0000 7ff271ffb640 10 monclient: dump: 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.629 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.630 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6032 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:29:36.194+0000 7ff3907e59c0 4 set_mon_vals no callback set 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: shutdown 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: build_initial_monmap 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 build_initial for_mkfs: 0 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: monmap: 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:29:36.631 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding auth protocol: cephx 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding auth protocol: cephx 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding auth protocol: cephx 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.632 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: crc 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c1ea790) adding con mode: secure 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: starting msgr at 2024-09-12T00:29:36.633 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: starting objecter 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x55820c1950b0 EEXIST 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: setting wanted keys 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: calling monclient init 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: init 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding auth protocol: cephx 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding auth protocol: cephx 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding auth protocol: cephx 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.634 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: crc 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 AuthRegistry(0x55820c198f50) adding con mode: secure 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command rotate-key cmddesc rotate-key hook 0x55820c199098 EEXIST 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:29:36.635 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-b con 0x55820c1e50b0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-a con 0x55820c1e6950 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): picked mon.noname-c con 0x55820c1d9b70 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient(hunting): authenticate will time out at 2100.537674s 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): get_auth_request con 0x55820c1e6950 auth_method 0 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.636 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request con 0x55820c1d9b70 auth_method 0 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:29:36.198+0000 7ff38eaec640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:29:36.637 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient(hunting): handle_auth_done global_id 6035 payload 824 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient: _finish_hunting 0 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 1 monclient: found mon.noname-c 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:29:36.198+0000 7ff38e2eb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:29:36.198+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820c1e50b0 auth_method 0 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: dump: 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.638 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: _finish_auth 0 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: _check_auth_tickets 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:29:36.639 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:29:36.198+0000 7ff25ffff640 10 monclient: dump: 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.640 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 monclient: authenticate success, global_id 6035 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:29:36.198+0000 7ff271ffb640 4 set_mon_vals no callback set 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _renew_subs 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 1 librados: init done 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:29:36.198+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cr dump hook 0x55820c1d96f8 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:29:36.202+0000 7ff25ffff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:29:36.202+0000 7ff25ffff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.641 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:29:36.202+0000 7ff25ffff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:29:36.202+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff258070ae0 auth_method 0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:29:36.202+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c204de0 auth_method 0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 realm 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:29:36.202+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:29:36.202+0000 7ff38daea640 10 monclient: get_auth_request con 0x55820c209170 auth_method 0 2024-09-12T00:29:36.642 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:29:36.206+0000 7ff38eaec640 10 monclient: get_auth_request con 0x55820c20c800 auth_method 0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:29:36.206+0000 7ff3907e59c0 20 searching for the correct realm 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:29:36.206+0000 7ff38e2eb640 10 monclient: get_auth_request con 0x55820c211500 auth_method 0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:29:36.206+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff380089350 auth_method 0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:29:36.210+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff38003d3c0 auth_method 0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:29:36.210+0000 7ff38eaec640 0 -- 172.21.15.78:0/2193495943 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7ff38003d3c0 msgr2=0x7ff38003be90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:29:36.414+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff38003d3c0 auth_method 0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:29:36.418+0000 7ff38e2eb640 10 monclient: get_auth_request con 0x7ff378032060 auth_method 0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:29:36.422+0000 7ff38daea640 10 monclient: get_auth_request con 0x7ff380045eb0 auth_method 0 2024-09-12T00:29:36.643 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:29:36.422+0000 7ff38eaec640 0 -- 172.21.15.78:0/2193495943 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55820c204de0 msgr2=0x55820c207280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:29:36.422+0000 7ff25ffff640 1 client.6035.objecter ms_handle_reset 0x55820c204de0 session 0x55820c204760 osd.6 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:29:36.422+0000 7ff25ffff640 10 monclient: _renew_subs 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:29:36.422+0000 7ff25ffff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:29:36.422+0000 7ff38eaec640 10 monclient: get_auth_request con 0x7ff258080d10 auth_method 0 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:36.644 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:29:36.434+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 zone default found 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 Realm: () 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:36.645 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 zonegroup default 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:29:36.438+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 started sync module instance, tier type = 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:29:36.442+0000 7ff3907e59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=0 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=1 2024-09-12T00:29:36.646 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=2 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=3 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=4 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=5 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:29:36.462+0000 7ff3907e59c0 20 add_watcher() i=6 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:29:36.466+0000 7ff3907e59c0 20 add_watcher() i=7 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:29:36.466+0000 7ff3907e59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding auth protocol: cephx 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding auth protocol: cephx 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding auth protocol: cephx 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.647 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:29:36.470+0000 7ff244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: crc 2024-09-12T00:29:36.648 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 AuthRegistry(0x7fff04f4aa40) adding con mode: secure 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache list hook 0x55820c1dc040 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache inspect hook 0x55820c1dc040 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache erase hook 0x55820c1dc040 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command cache zap hook 0x55820c1dc040 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 note: GC not initialized 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:29:36.470+0000 7ff1bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace show hook 0x7ff380004710 2024-09-12T00:29:36.649 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace history hook 0x7ff380004710 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace active hook 0x7ff380004710 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 5 asok(0x55820bf0d2b0) register_command sync trace active_short hook 0x7ff380004710 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 Filter name: none 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:29:36.470+0000 7ff1bd7fa640 20 reqs_thread_entry: start 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:29:36.470+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 : miss 2024-09-12T00:29:36.650 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:29:36.474+0000 7ff3907e59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:29:36.478+0000 7ff3907e59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ff3907e59c0 time 2024-09-12T00:29:36.480790+0000 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.651 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ff3940bf2eb] 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:29:36.482+0000 7ff3907e59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ff3907e59c0 thread_name:radosgw-admin 2024-09-12T00:29:36.652 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ff392f3e520] 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ff3940bf345] 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ff3940bf49f] 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5582093e3cc1] 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1421f32) [0x558209e40f32] 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5582093f8ced] 2024-09-12T00:29:36.653 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ff392f25d90] 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:29:36.654 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:29:36.655 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:29:36.656 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:29:36.657 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:29:36.658 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:29:36.659 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:29:36.660 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:29:36.661 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff1bd7fa640 / http_manager 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff1bf7fe640 / http_manager 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff244fe1640 / rgw_dt_lg_renew 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff25ffff640 / ms_dispatch 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff271ffb640 / io_context_pool 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff273fff640 / ms_dispatch 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff27ae05640 / ms_dispatch 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff27c608640 / io_context_pool 2024-09-12T00:29:36.662 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38daea640 / msgr-worker-2 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38e2eb640 / msgr-worker-1 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38eaec640 / msgr-worker-0 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff38f2ed640 / io_context_pool 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff3907e59c0 / radosgw-admin 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:29:36.487676Z_7bcf4166-7ef2-41ea-9ec7-e5bad9e970d1/log 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:29:36.663 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:29:36.665 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:36.665 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:36.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.570+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 20 realm 2024-09-12T00:29:36.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.574+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.578+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.578+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.578+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.578+0000 7fc7422af9c0 20 searching for the correct realm 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.582+0000 7fc73fdb5640 0 -- 172.21.15.78:0/4189732678 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x5626bd5c69d0 msgr2=0x5626bd5c8e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:36.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.590+0000 7fc73f5b4640 0 -- 172.21.15.78:0/4189732678 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fc730003990 msgr2=0x7fc7300d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:36.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:36.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:36.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 zone default found 2024-09-12T00:29:36.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 4 Realm: () 2024-09-12T00:29:36.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:36.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:36.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:36.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 zonegroup default 2024-09-12T00:29:36.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.810+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.814+0000 7fc7422af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.814+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.814+0000 7fc7422af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.814 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.814+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.814+0000 7fc7422af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:36.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.814+0000 7fc7422af9c0 20 started sync module instance, tier type = 2024-09-12T00:29:36.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.814+0000 7fc7422af9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:36.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=0 2024-09-12T00:29:36.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=1 2024-09-12T00:29:36.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=2 2024-09-12T00:29:36.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=3 2024-09-12T00:29:36.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=4 2024-09-12T00:29:36.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=5 2024-09-12T00:29:36.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=6 2024-09-12T00:29:36.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 20 add_watcher() i=7 2024-09-12T00:29:36.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.838+0000 7fc7422af9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:36.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.842+0000 7fc5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:36.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:36.845 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:36.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 5 note: GC not initialized 2024-09-12T00:29:36.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc5f4fe1640 20 reqs_thread_entry: start 2024-09-12T00:29:36.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:36.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 20 Filter name: none 2024-09-12T00:29:36.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc56e7fc640 20 reqs_thread_entry: start 2024-09-12T00:29:36.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:36.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.846+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.850+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:36.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.850+0000 7fc7422af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:36.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.850+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.850+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:36.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.850+0000 7fc7422af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:36.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.850+0000 7fc7422af9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:36.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.850+0000 7fc7422af9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:29:36.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.854+0000 7fc5f5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:36.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.858+0000 7fc7422af9c0 20 remove_watcher() i=0 2024-09-12T00:29:36.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.858+0000 7fc7422af9c0 2 removed watcher, disabling cache 2024-09-12T00:29:36.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.862+0000 7fc7422af9c0 20 remove_watcher() i=1 2024-09-12T00:29:36.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.862+0000 7fc7422af9c0 20 remove_watcher() i=2 2024-09-12T00:29:36.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.866+0000 7fc7422af9c0 20 remove_watcher() i=3 2024-09-12T00:29:36.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.866+0000 7fc7422af9c0 20 remove_watcher() i=4 2024-09-12T00:29:36.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.870+0000 7fc7422af9c0 20 remove_watcher() i=5 2024-09-12T00:29:36.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.874+0000 7fc7422af9c0 20 remove_watcher() i=6 2024-09-12T00:29:36.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:36.874+0000 7fc7422af9c0 20 remove_watcher() i=7 2024-09-12T00:29:36.891 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.891 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:29:36.891 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-init-indext id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:29:36.891 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:29:36.946 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:29:36.982 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:29:36.982 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:29:37.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.026+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:37.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 realm 2024-09-12T00:29:37.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:37.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:29:37.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:37.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:37.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:29:37.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.030+0000 7fb12b76d9c0 20 searching for the correct realm 2024-09-12T00:29:37.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.038+0000 7fb129a74640 0 -- 172.21.15.78:0/3694359377 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fb11c064e30 msgr2=0x7fb11c0718b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:29:37.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.250+0000 7fb129273640 0 -- 172.21.15.78:0/3694359377 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x56289bdb50a0 msgr2=0x56289bdb7490 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:29:37.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.262+0000 7fb12b76d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.262+0000 7fb12b76d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.262+0000 7fb12b76d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.262+0000 7fb12b76d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.262+0000 7fb12b76d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.262+0000 7fb12b76d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.262+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:37.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:29:37.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 zone default found 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 4 Realm: () 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 zonegroup default 2024-09-12T00:29:37.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:37.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.266+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.270+0000 7fb12b76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:37.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.270+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.270+0000 7fb12b76d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:29:37.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.270+0000 7fb12b76d9c0 20 started sync module instance, tier type = 2024-09-12T00:29:37.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.270+0000 7fb12b76d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:29:37.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.290+0000 7fb12b76d9c0 20 add_watcher() i=0 2024-09-12T00:29:37.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.290+0000 7fb12b76d9c0 20 add_watcher() i=1 2024-09-12T00:29:37.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.290+0000 7fb12b76d9c0 20 add_watcher() i=2 2024-09-12T00:29:37.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.290+0000 7fb12b76d9c0 20 add_watcher() i=3 2024-09-12T00:29:37.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.290+0000 7fb12b76d9c0 20 add_watcher() i=4 2024-09-12T00:29:37.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.290+0000 7fb12b76d9c0 20 add_watcher() i=5 2024-09-12T00:29:37.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.290+0000 7fb12b76d9c0 20 add_watcher() i=6 2024-09-12T00:29:37.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.294+0000 7fb12b76d9c0 20 add_watcher() i=7 2024-09-12T00:29:37.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.294+0000 7fb12b76d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:29:37.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.298+0000 7fafdffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:37.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.298+0000 7fb12b76d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:29:37.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.298+0000 7fb12b76d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:29:37.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.298+0000 7fb12b76d9c0 5 note: GC not initialized 2024-09-12T00:29:37.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.298+0000 7fafdefe5640 20 reqs_thread_entry: start 2024-09-12T00:29:37.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.298+0000 7fb12b76d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:29:37.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 20 Filter name: none 2024-09-12T00:29:37.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fafdcfe1640 20 reqs_thread_entry: start 2024-09-12T00:29:37.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:29:37.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:29:37.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:29:37.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:29:37.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 : miss 2024-09-12T00:29:37.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:29:37.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:29:37.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:29:37.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:29:37.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:29:37.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:29:37.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.302+0000 7fb12b76d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 2024-09-12T00:29:37.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.306+0000 7fb12b76d9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to be held by another RGW process; skipping for now 2024-09-12T00:29:37.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.306+0000 7fafdffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:29:37.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.310+0000 7fb12b76d9c0 20 remove_watcher() i=0 2024-09-12T00:29:37.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.310+0000 7fb12b76d9c0 2 removed watcher, disabling cache 2024-09-12T00:29:37.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.314+0000 7fb12b76d9c0 20 remove_watcher() i=1 2024-09-12T00:29:37.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.314+0000 7fb12b76d9c0 20 remove_watcher() i=2 2024-09-12T00:29:37.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.318+0000 7fb12b76d9c0 20 remove_watcher() i=3 2024-09-12T00:29:37.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.318+0000 7fb12b76d9c0 20 remove_watcher() i=4 2024-09-12T00:29:37.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.322+0000 7fb12b76d9c0 20 remove_watcher() i=5 2024-09-12T00:29:37.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.322+0000 7fb12b76d9c0 20 remove_watcher() i=6 2024-09-12T00:29:37.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:29:37.326+0000 7fb12b76d9c0 20 remove_watcher() i=7 2024-09-12T00:29:37.343 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:30:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-init-indext --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:30:07.396 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:07.396 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:07.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 realm 2024-09-12T00:30:07.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:07.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.445+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.449+0000 7f28abc1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:07.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.449+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.449+0000 7f28abc1d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:07.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.449+0000 7f28abc1d9c0 20 searching for the correct realm 2024-09-12T00:30:07.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.453+0000 7f28a9f24640 0 -- 172.21.15.78:0/3770118386 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f289c066010 msgr2=0x7f289c090920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:07.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.665+0000 7f28a9723640 0 -- 172.21.15.78:0/3770118386 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55fac2278610 msgr2=0x55fac227aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:07.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.677+0000 7f28abc1d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:07.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.677+0000 7f28abc1d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:07.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.677+0000 7f28abc1d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:07.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.677+0000 7f28abc1d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:07.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.677+0000 7f28abc1d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:07.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.677+0000 7f28abc1d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:07.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.677+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:07.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:07.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 zone default found 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 4 Realm: () 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 zonegroup default 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.681+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.685+0000 7f28abc1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.685+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.685+0000 7f28abc1d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.685+0000 7f28abc1d9c0 20 started sync module instance, tier type = 2024-09-12T00:30:07.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.685+0000 7f28abc1d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:07.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=0 2024-09-12T00:30:07.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=1 2024-09-12T00:30:07.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=2 2024-09-12T00:30:07.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=3 2024-09-12T00:30:07.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=4 2024-09-12T00:30:07.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=5 2024-09-12T00:30:07.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=6 2024-09-12T00:30:07.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 20 add_watcher() i=7 2024-09-12T00:30:07.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.709+0000 7f28abc1d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:07.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.713+0000 7f275f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:07.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:07.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:07.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 5 note: GC not initialized 2024-09-12T00:30:07.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f275e7e4640 20 reqs_thread_entry: start 2024-09-12T00:30:07.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:07.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 Filter name: none 2024-09-12T00:30:07.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f26cffff640 20 reqs_thread_entry: start 2024-09-12T00:30:07.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 cache get: name=default.rgw.meta+root+abort-at-init-indext : miss 2024-09-12T00:30:07.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:30:07.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 cache put: name=default.rgw.meta+root+abort-at-init-indext info.flags=0x11 2024-09-12T00:30:07.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 adding default.rgw.meta+root+abort-at-init-indext to cache LRU end 2024-09-12T00:30:07.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 : miss 2024-09-12T00:30:07.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:30:07.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:30:07.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:30:07.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:07.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:07.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.717+0000 7f28abc1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 2024-09-12T00:30:07.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f28abc1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:30:07.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f28abc1d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:30:07.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f28abc1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:07.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f28abc1d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21, ofs0, ns] 2024-09-12T00:30:07.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f278cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398947 cookie 94535487633664 notifier 6438 bl.length()=913 2024-09-12T00:30:07.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f278cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:30:07.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f278cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:30:07.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.729+0000 7f278cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:07.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.733+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): orig_sources= new_sources= 2024-09-12T00:30:07.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.733+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): potential sources added=[] removed=[] 2024-09-12T00:30:07.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.733+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): orig_dests= new_dests= 2024-09-12T00:30:07.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.733+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): potential dests added=[] removed=[] 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.0 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.0 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.1 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.1 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.2 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.2 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.3 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.3 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.4 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.4 2024-09-12T00:30:07.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.5 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.5 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.6 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.6 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.7 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.7 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.8 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.8 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.9 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.9 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.10 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.10 2024-09-12T00:30:07.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.11 2024-09-12T00:30:07.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1.11 2024-09-12T00:30:07.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.0 2024-09-12T00:30:07.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1 2024-09-12T00:30:07.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.741+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.2 2024-09-12T00:30:07.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.745+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.3 2024-09-12T00:30:07.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.745+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.4 2024-09-12T00:30:07.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.745+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.5 2024-09-12T00:30:07.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.745+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.6 2024-09-12T00:30:07.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.749+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.7 2024-09-12T00:30:07.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.749+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.8 2024-09-12T00:30:07.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.749+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.9 2024-09-12T00:30:07.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.749+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.10 2024-09-12T00:30:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.757+0000 7f28abc1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:07.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.757+0000 7f28abc1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 2024-09-12T00:30:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.757+0000 7f28abc1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:30:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.757+0000 7f28abc1d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:30:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.757+0000 7f28abc1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:07.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.757+0000 7f28abc1d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21, ofs0, ns] 2024-09-12T00:30:07.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f277bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398948 cookie 94535487633664 notifier 6438 bl.length()=913 2024-09-12T00:30:07.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f277bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:30:07.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f277bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:30:07.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f277bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:07.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): orig_sources= new_sources= 2024-09-12T00:30:07.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): potential sources added=[] removed=[] 2024-09-12T00:30:07.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): orig_dests= new_dests= 2024-09-12T00:30:07.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.761+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): potential dests added=[] removed=[] 2024-09-12T00:30:07.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.765+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.0 2024-09-12T00:30:07.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.765+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.1 2024-09-12T00:30:07.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.765+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.2 2024-09-12T00:30:07.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.765+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.3 2024-09-12T00:30:07.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.769+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.4 2024-09-12T00:30:07.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.769+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.5 2024-09-12T00:30:07.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.769+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.6 2024-09-12T00:30:07.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.769+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.7 2024-09-12T00:30:07.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.769+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.8 2024-09-12T00:30:07.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.9 2024-09-12T00:30:07.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21.10 2024-09-12T00:30:07.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:07.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 2024-09-12T00:30:07.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:30:07.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:30:07.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:07.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.773+0000 7f28abc1d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21, ofs0, ns] 2024-09-12T00:30:07.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f277bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398949 cookie 94535487633664 notifier 6438 bl.length()=881 2024-09-12T00:30:07.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f277bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 info.flags=0x17 2024-09-12T00:30:07.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f277bfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-init-indext:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 to cache LRU end 2024-09-12T00:30:07.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f277bfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:07.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): orig_sources= new_sources= 2024-09-12T00:30:07.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): potential sources added=[] removed=[] 2024-09-12T00:30:07.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): orig_dests= new_dests= 2024-09-12T00:30:07.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.777+0000 7f28abc1d9c0 20 handle_bi_update(): bucket=:abort-at-init-indext[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21]): potential dests added=[] removed=[] 2024-09-12T00:30:07.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.781+0000 7f28abc1d9c0 1 execute INFO: reshard of bucket "abort-at-init-indext" from 11 shards to 12 shards completed successfully 2024-09-12T00:30:07.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.785+0000 7f275f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:07.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.789+0000 7f28abc1d9c0 20 remove_watcher() i=0 2024-09-12T00:30:07.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.789+0000 7f28abc1d9c0 2 removed watcher, disabling cache 2024-09-12T00:30:07.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.789+0000 7f28abc1d9c0 20 remove_watcher() i=1 2024-09-12T00:30:07.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.793+0000 7f28abc1d9c0 20 remove_watcher() i=2 2024-09-12T00:30:07.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.797+0000 7f28abc1d9c0 20 remove_watcher() i=3 2024-09-12T00:30:07.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.797+0000 7f28abc1d9c0 20 remove_watcher() i=4 2024-09-12T00:30:07.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.801+0000 7f28abc1d9c0 20 remove_watcher() i=5 2024-09-12T00:30:07.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.801+0000 7f28abc1d9c0 20 remove_watcher() i=6 2024-09-12T00:30:07.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.805+0000 7f28abc1d9c0 20 remove_watcher() i=7 2024-09-12T00:30:07.827 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-init-indext 2024-09-12T00:30:07.855 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:07.855 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:07.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.901+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 20 realm 2024-09-12T00:30:07.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:07.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:07.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.905+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.909+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:07.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.909+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:07.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.909+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:07.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.909+0000 7f1c8de729c0 20 searching for the correct realm 2024-09-12T00:30:07.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:07.913+0000 7f1c8c179640 0 -- 172.21.15.78:0/1557167391 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1c7c017b30 msgr2=0x7f1c7c07a040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:08.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.129+0000 7f1c8c179640 0 -- 172.21.15.78:0/1557167391 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55dde6b2fa80 msgr2=0x55dde6b31ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:08.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.137+0000 7f1c8de729c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:08.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.137+0000 7f1c8de729c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.137+0000 7f1c8de729c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.137+0000 7f1c8de729c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.137+0000 7f1c8de729c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.137+0000 7f1c8de729c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.137+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:08.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:08.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 zone default found 2024-09-12T00:30:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 4 Realm: () 2024-09-12T00:30:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:08.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 zonegroup default 2024-09-12T00:30:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:08.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.141+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.145+0000 7f1c8de729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:08.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.145+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.145+0000 7f1c8de729c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:08.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.145+0000 7f1c8de729c0 20 started sync module instance, tier type = 2024-09-12T00:30:08.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.145+0000 7f1c8de729c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:08.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.165+0000 7f1c8de729c0 20 add_watcher() i=0 2024-09-12T00:30:08.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.165+0000 7f1c8de729c0 20 add_watcher() i=1 2024-09-12T00:30:08.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.165+0000 7f1c8de729c0 20 add_watcher() i=2 2024-09-12T00:30:08.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.165+0000 7f1c8de729c0 20 add_watcher() i=3 2024-09-12T00:30:08.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.165+0000 7f1c8de729c0 20 add_watcher() i=4 2024-09-12T00:30:08.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.165+0000 7f1c8de729c0 20 add_watcher() i=5 2024-09-12T00:30:08.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.165+0000 7f1c8de729c0 20 add_watcher() i=6 2024-09-12T00:30:08.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.169+0000 7f1c8de729c0 20 add_watcher() i=7 2024-09-12T00:30:08.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.169+0000 7f1c8de729c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:08.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:08.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1c8de729c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:08.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1c8de729c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:08.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1c8de729c0 5 note: GC not initialized 2024-09-12T00:30:08.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1b40fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:08.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1c8de729c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:08.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1c8de729c0 20 Filter name: none 2024-09-12T00:30:08.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1aba7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:08.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.173+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:30:08.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:30:08.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:08.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=188 2024-09-12T00:30:08.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 rados_obj.operate() r=0 bl.length=410 2024-09-12T00:30:08.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.177+0000 7f1c8de729c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:08.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.181+0000 7f1b41fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:08.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.185+0000 7f1c8de729c0 20 remove_watcher() i=0 2024-09-12T00:30:08.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.185+0000 7f1c8de729c0 2 removed watcher, disabling cache 2024-09-12T00:30:08.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.189+0000 7f1c8de729c0 20 remove_watcher() i=1 2024-09-12T00:30:08.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.189+0000 7f1c8de729c0 20 remove_watcher() i=2 2024-09-12T00:30:08.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.193+0000 7f1c8de729c0 20 remove_watcher() i=3 2024-09-12T00:30:08.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.193+0000 7f1c8de729c0 20 remove_watcher() i=4 2024-09-12T00:30:08.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.197+0000 7f1c8de729c0 20 remove_watcher() i=5 2024-09-12T00:30:08.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.201+0000 7f1c8de729c0 20 remove_watcher() i=6 2024-09-12T00:30:08.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.201+0000 7f1c8de729c0 20 remove_watcher() i=7 2024-09-12T00:30:08.217 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:08.217 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:08.218 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-init-indext id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.21 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:30:08.218 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:08.331 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at set_target_layout 2024-09-12T00:30:08.331 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:08.750 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:30:08.783 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:08.784 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:08.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.829+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:08.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 realm 2024-09-12T00:30:08.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:08.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:08.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:08.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:08.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.833+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:08.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.837+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:08.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.837+0000 7f025c89e9c0 20 searching for the correct realm 2024-09-12T00:30:08.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:08.841+0000 7f025aba5640 0 -- 172.21.15.78:0/4016784471 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f024c076150 msgr2=0x7f024c078860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:09.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.053+0000 7f025a3a4640 0 -- 172.21.15.78:0/4016784471 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x561dc0aa69d0 msgr2=0x561dc0aa8e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.065+0000 7f025c89e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.065+0000 7f025c89e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.065+0000 7f025c89e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.065+0000 7f025c89e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:09.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.065+0000 7f025c89e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.065+0000 7f025c89e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.065+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:09.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 zone default found 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 4 Realm: () 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 zonegroup default 2024-09-12T00:30:09.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.069+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.073+0000 7f025c89e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.073+0000 7f025c89e9c0 20 started sync module instance, tier type = 2024-09-12T00:30:09.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.073+0000 7f025c89e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.093+0000 7f025c89e9c0 20 add_watcher() i=0 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.093+0000 7f025c89e9c0 20 add_watcher() i=1 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.093+0000 7f025c89e9c0 20 add_watcher() i=2 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.093+0000 7f025c89e9c0 20 add_watcher() i=3 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.093+0000 7f025c89e9c0 20 add_watcher() i=4 2024-09-12T00:30:09.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.093+0000 7f025c89e9c0 20 add_watcher() i=5 2024-09-12T00:30:09.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.093+0000 7f025c89e9c0 20 add_watcher() i=6 2024-09-12T00:30:09.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.097+0000 7f025c89e9c0 20 add_watcher() i=7 2024-09-12T00:30:09.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.097+0000 7f025c89e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:09.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.101+0000 7f0110fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.101+0000 7f025c89e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.101+0000 7f025c89e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:09.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.101+0000 7f025c89e9c0 5 note: GC not initialized 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.101+0000 7f008b7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.101+0000 7f025c89e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 Filter name: none 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f00897fa640 20 reqs_thread_entry: start 2024-09-12T00:30:09.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:09.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:09.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.105+0000 7f025c89e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.109+0000 7f025c89e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:09.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.109+0000 7f025c89e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:09.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.109+0000 7f0110fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.113+0000 7f025c89e9c0 20 remove_watcher() i=0 2024-09-12T00:30:09.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.113+0000 7f025c89e9c0 2 removed watcher, disabling cache 2024-09-12T00:30:09.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.117+0000 7f025c89e9c0 20 remove_watcher() i=1 2024-09-12T00:30:09.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.117+0000 7f025c89e9c0 20 remove_watcher() i=2 2024-09-12T00:30:09.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.121+0000 7f025c89e9c0 20 remove_watcher() i=3 2024-09-12T00:30:09.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.121+0000 7f025c89e9c0 20 remove_watcher() i=4 2024-09-12T00:30:09.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.125+0000 7f025c89e9c0 20 remove_watcher() i=5 2024-09-12T00:30:09.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.129+0000 7f025c89e9c0 20 remove_watcher() i=6 2024-09-12T00:30:09.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.129+0000 7f025c89e9c0 20 remove_watcher() i=7 2024-09-12T00:30:09.142 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:09.143 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:09.177 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:09.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.225+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.225+0000 7f02034f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.225+0000 7f02034f89c0 20 realm 2024-09-12T00:30:09.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.225+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:09.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:09.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:09.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.229+0000 7f02034f89c0 20 searching for the correct realm 2024-09-12T00:30:09.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.441+0000 7f02017ff640 0 -- 172.21.15.78:0/791957300 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f01f80c9450 msgr2=0x7f01f80c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:09.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.857+0000 7f0200ffe640 0 -- 172.21.15.78:0/791957300 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560a8cdaad00 msgr2=0x560a8cdad170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:09.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.869+0000 7f02034f89c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:09.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.869+0000 7f02034f89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:09.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.869+0000 7f02034f89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:09.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.869+0000 7f02034f89c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:09.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.869+0000 7f02034f89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:09.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.869+0000 7f02034f89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:09.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.869+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:09.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 zone default found 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 4 Realm: () 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 zonegroup default 2024-09-12T00:30:09.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.873+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.877+0000 7f02034f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.877+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.877+0000 7f02034f89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:09.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.877+0000 7f02034f89c0 20 started sync module instance, tier type = 2024-09-12T00:30:09.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.877+0000 7f02034f89c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:09.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=0 2024-09-12T00:30:09.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=1 2024-09-12T00:30:09.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=2 2024-09-12T00:30:09.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=3 2024-09-12T00:30:09.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=4 2024-09-12T00:30:09.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=5 2024-09-12T00:30:09.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=6 2024-09-12T00:30:09.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 20 add_watcher() i=7 2024-09-12T00:30:09.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.901+0000 7f02034f89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:09.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f00b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:09.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:09.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:09.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 5 note: GC not initialized 2024-09-12T00:30:09.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f00b67e4640 20 reqs_thread_entry: start 2024-09-12T00:30:09.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:09.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 20 Filter name: none 2024-09-12T00:30:09.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f00af7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:09.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:30:09.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:09.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:30:09.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:30:09.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 : miss 2024-09-12T00:30:09.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.909+0000 7f02034f89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:09.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.913+0000 7f02034f89c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:09.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.913+0000 7f02034f89c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:09.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.913+0000 7f02034f89c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:09.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.913+0000 7f02034f89c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:09.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.913+0000 7f02034f89c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:09.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.913+0000 7f02034f89c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 2024-09-12T00:30:09.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.921+0000 7f02034f89c0 -1 Injecting error=-5 at location=set_target_layout 2024-09-12T00:30:09.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.921+0000 7f02034f89c0 0 ERROR: init_target_layout failed to write target index layout to bucket info: (5) Input/output error 2024-09-12T00:30:09.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.929+0000 7f00b77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:09.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.933+0000 7f02034f89c0 20 remove_watcher() i=0 2024-09-12T00:30:09.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.933+0000 7f02034f89c0 2 removed watcher, disabling cache 2024-09-12T00:30:09.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.937+0000 7f02034f89c0 20 remove_watcher() i=1 2024-09-12T00:30:09.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.937+0000 7f02034f89c0 20 remove_watcher() i=2 2024-09-12T00:30:09.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.941+0000 7f02034f89c0 20 remove_watcher() i=3 2024-09-12T00:30:09.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.945+0000 7f02034f89c0 20 remove_watcher() i=4 2024-09-12T00:30:09.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.945+0000 7f02034f89c0 20 remove_watcher() i=5 2024-09-12T00:30:09.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.949+0000 7f02034f89c0 20 remove_watcher() i=6 2024-09-12T00:30:09.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:09.953+0000 7f02034f89c0 20 remove_watcher() i=7 2024-09-12T00:30:09.965 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:30:09.994 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:09.994 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:10.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.037+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 realm 2024-09-12T00:30:10.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:10.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:10.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.041+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.045+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:10.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.045+0000 7f138f4169c0 20 searching for the correct realm 2024-09-12T00:30:10.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.049+0000 7f138d71d640 0 -- 172.21.15.78:0/3923855236 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1380016400 msgr2=0x7f1380016880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:10.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.265+0000 7f138cf1c640 0 -- 172.21.15.78:0/3923855236 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5577e851f0f0 msgr2=0x5577e8521510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:10.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:10.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:10.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:10.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:10.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:10.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:10.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:10.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:10.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 zone default found 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 4 Realm: () 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 zonegroup default 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.277+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.281+0000 7f138f4169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.281+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.281+0000 7f138f4169c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.281+0000 7f138f4169c0 20 started sync module instance, tier type = 2024-09-12T00:30:10.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.281+0000 7f138f4169c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:10.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.301+0000 7f138f4169c0 20 add_watcher() i=0 2024-09-12T00:30:10.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.301+0000 7f138f4169c0 20 add_watcher() i=1 2024-09-12T00:30:10.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.301+0000 7f138f4169c0 20 add_watcher() i=2 2024-09-12T00:30:10.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.301+0000 7f138f4169c0 20 add_watcher() i=3 2024-09-12T00:30:10.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.301+0000 7f138f4169c0 20 add_watcher() i=4 2024-09-12T00:30:10.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.301+0000 7f138f4169c0 20 add_watcher() i=5 2024-09-12T00:30:10.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.305+0000 7f138f4169c0 20 add_watcher() i=6 2024-09-12T00:30:10.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.305+0000 7f138f4169c0 20 add_watcher() i=7 2024-09-12T00:30:10.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.305+0000 7f138f4169c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:10.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.309+0000 7f1242fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:10.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.309+0000 7f138f4169c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:10.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.309+0000 7f138f4169c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:10.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.309+0000 7f138f4169c0 5 note: GC not initialized 2024-09-12T00:30:10.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f1241fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:10.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:10.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 Filter name: none 2024-09-12T00:30:10.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f11b37fe640 20 reqs_thread_entry: start 2024-09-12T00:30:10.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:10.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:10.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:10.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.313+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.317+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:10.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.317+0000 7f138f4169c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.317+0000 7f138f4169c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:10.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.317+0000 7f138f4169c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:10.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.321+0000 7f1242fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:10.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.325+0000 7f138f4169c0 20 remove_watcher() i=0 2024-09-12T00:30:10.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.325+0000 7f138f4169c0 2 removed watcher, disabling cache 2024-09-12T00:30:10.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.325+0000 7f138f4169c0 20 remove_watcher() i=1 2024-09-12T00:30:10.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.329+0000 7f138f4169c0 20 remove_watcher() i=2 2024-09-12T00:30:10.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.329+0000 7f138f4169c0 20 remove_watcher() i=3 2024-09-12T00:30:10.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.333+0000 7f138f4169c0 20 remove_watcher() i=4 2024-09-12T00:30:10.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.337+0000 7f138f4169c0 20 remove_watcher() i=5 2024-09-12T00:30:10.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.337+0000 7f138f4169c0 20 remove_watcher() i=6 2024-09-12T00:30:10.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.341+0000 7f138f4169c0 20 remove_watcher() i=7 2024-09-12T00:30:10.354 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:10.354 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:10.354 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:10.354 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:10.410 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:30:10.446 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:10.447 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:10.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.497+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.497+0000 7f3c5dc919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.497+0000 7f3c5dc919c0 20 realm 2024-09-12T00:30:10.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.497+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.497+0000 7f3c5dc919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.497+0000 7f3c5dc919c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:10.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.497+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.501+0000 7f3c5dc919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.497 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.501+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.501+0000 7f3c5dc919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:10.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.501+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.501+0000 7f3c5dc919c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:10.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.501+0000 7f3c5dc919c0 20 searching for the correct realm 2024-09-12T00:30:10.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.505+0000 7f3c5af96640 0 -- 172.21.15.78:0/2030735405 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f3c4c0cb040 msgr2=0x7f3c4c0a4a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:10.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.721+0000 7f3c5b797640 0 -- 172.21.15.78:0/2030735405 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f3c44019070 msgr2=0x7f3c44001b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:10.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:10.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:10.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:10.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:10.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:10.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:10.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:10.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.941+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 zone default found 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 4 Realm: () 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 zonegroup default 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:10.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 started sync module instance, tier type = 2024-09-12T00:30:10.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.945+0000 7f3c5dc919c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:10.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.969+0000 7f3c5dc919c0 20 add_watcher() i=0 2024-09-12T00:30:10.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.969+0000 7f3c5dc919c0 20 add_watcher() i=1 2024-09-12T00:30:10.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.969+0000 7f3c5dc919c0 20 add_watcher() i=2 2024-09-12T00:30:10.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.969+0000 7f3c5dc919c0 20 add_watcher() i=3 2024-09-12T00:30:10.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.969+0000 7f3c5dc919c0 20 add_watcher() i=4 2024-09-12T00:30:10.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.969+0000 7f3c5dc919c0 20 add_watcher() i=5 2024-09-12T00:30:10.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.969+0000 7f3c5dc919c0 20 add_watcher() i=6 2024-09-12T00:30:10.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.973+0000 7f3c5dc919c0 20 add_watcher() i=7 2024-09-12T00:30:10.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.973+0000 7f3c5dc919c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:10.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.977+0000 7f3b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:10.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.977+0000 7f3c5dc919c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:10.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.977+0000 7f3c5dc919c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:10.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.977+0000 7f3c5dc919c0 5 note: GC not initialized 2024-09-12T00:30:10.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3b10fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:10.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:10.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 20 Filter name: none 2024-09-12T00:30:10.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3a8a7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:10.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:30:10.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:10.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:30:10.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:30:10.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 : miss 2024-09-12T00:30:10.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:10.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:10.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:10.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:10.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:10.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:10.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.981+0000 7f3c5dc919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 2024-09-12T00:30:10.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3c5dc919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:10.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3c5dc919c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3c5dc919c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3c5dc919c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22, ofs0, ns] 2024-09-12T00:30:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3b3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398944 cookie 94294186675744 notifier 6173 bl.length()=925 2024-09-12T00:30:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3b3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3b3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:10.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.993+0000 7f3b3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:10.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.997+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): orig_sources= new_sources= 2024-09-12T00:30:10.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.997+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): potential sources added=[] removed=[] 2024-09-12T00:30:10.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.997+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): orig_dests= new_dests= 2024-09-12T00:30:10.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:10.997+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): potential dests added=[] removed=[] 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.0 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.0 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.1 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.1 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.2 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.2 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.3 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.3 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.4 2024-09-12T00:30:11.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.4 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.5 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.5 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.6 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.6 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.7 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.7 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.8 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.8 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.9 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.9 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.10 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.10 2024-09-12T00:30:11.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.11 2024-09-12T00:30:11.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1.11 2024-09-12T00:30:11.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.0 2024-09-12T00:30:11.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.005+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1 2024-09-12T00:30:11.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.009+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.2 2024-09-12T00:30:11.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.009+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.3 2024-09-12T00:30:11.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.009+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.4 2024-09-12T00:30:11.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.013+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.5 2024-09-12T00:30:11.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.013+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.6 2024-09-12T00:30:11.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.013+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.7 2024-09-12T00:30:11.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.013+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.8 2024-09-12T00:30:11.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.013+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.9 2024-09-12T00:30:11.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.017+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.10 2024-09-12T00:30:11.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.021+0000 7f3c5dc919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:11.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.021+0000 7f3c5dc919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 2024-09-12T00:30:11.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:11.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:11.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:11.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22, ofs0, ns] 2024-09-12T00:30:11.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3b3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398945 cookie 94294186675744 notifier 6173 bl.length()=925 2024-09-12T00:30:11.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3b3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:11.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3b3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:11.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3b3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:11.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): orig_sources= new_sources= 2024-09-12T00:30:11.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): potential sources added=[] removed=[] 2024-09-12T00:30:11.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): orig_dests= new_dests= 2024-09-12T00:30:11.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.025+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): potential dests added=[] removed=[] 2024-09-12T00:30:11.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.033+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.0 2024-09-12T00:30:11.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.033+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.1 2024-09-12T00:30:11.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.033+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.2 2024-09-12T00:30:11.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.037+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.3 2024-09-12T00:30:11.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.037+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.4 2024-09-12T00:30:11.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.037+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.5 2024-09-12T00:30:11.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.037+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.6 2024-09-12T00:30:11.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.037+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.7 2024-09-12T00:30:11.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.041+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.8 2024-09-12T00:30:11.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.041+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.9 2024-09-12T00:30:11.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.041+0000 7f3c5dc919c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22.10 2024-09-12T00:30:11.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.041+0000 7f3c5dc919c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:11.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.041+0000 7f3c5dc919c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 2024-09-12T00:30:11.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:11.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:11.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:11.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22, ofs0, ns] 2024-09-12T00:30:11.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3b3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398946 cookie 94294186675744 notifier 6173 bl.length()=893 2024-09-12T00:30:11.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3b3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 info.flags=0x17 2024-09-12T00:30:11.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3b3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 to cache LRU end 2024-09-12T00:30:11.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3b3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:11.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): orig_sources= new_sources= 2024-09-12T00:30:11.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): potential sources added=[] removed=[] 2024-09-12T00:30:11.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): orig_dests= new_dests= 2024-09-12T00:30:11.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.045+0000 7f3c5dc919c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22]): potential dests added=[] removed=[] 2024-09-12T00:30:11.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.053+0000 7f3c5dc919c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:30:11.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.057+0000 7f3b11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:11.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.061+0000 7f3c5dc919c0 20 remove_watcher() i=0 2024-09-12T00:30:11.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.061+0000 7f3c5dc919c0 2 removed watcher, disabling cache 2024-09-12T00:30:11.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.061+0000 7f3c5dc919c0 20 remove_watcher() i=1 2024-09-12T00:30:11.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.065+0000 7f3c5dc919c0 20 remove_watcher() i=2 2024-09-12T00:30:11.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.065+0000 7f3c5dc919c0 20 remove_watcher() i=3 2024-09-12T00:30:11.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.069+0000 7f3c5dc919c0 20 remove_watcher() i=4 2024-09-12T00:30:11.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.069+0000 7f3c5dc919c0 20 remove_watcher() i=5 2024-09-12T00:30:11.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.073+0000 7f3c5dc919c0 20 remove_watcher() i=6 2024-09-12T00:30:11.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.077+0000 7f3c5dc919c0 20 remove_watcher() i=7 2024-09-12T00:30:11.093 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:30:11.124 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:11.124 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:11.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:11.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 realm 2024-09-12T00:30:11.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:11.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:11.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:11.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.173+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.177+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:11.173 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.177+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.177+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:11.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.177+0000 7fd1b426d9c0 20 searching for the correct realm 2024-09-12T00:30:11.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.181+0000 7fd1b2574640 0 -- 172.21.15.78:0/2261029581 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fd1a401f060 msgr2=0x7fd1a4076060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:11.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.397+0000 7fd1b2574640 0 -- 172.21.15.78:0/2261029581 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55725f99aaa0 msgr2=0x55725f99cf00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:11.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:11.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:11.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:11.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 zone default found 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 4 Realm: () 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 zonegroup default 2024-09-12T00:30:11.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:11.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.409+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.413+0000 7fd1b426d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:11.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.413+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.413+0000 7fd1b426d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:11.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.413+0000 7fd1b426d9c0 20 started sync module instance, tier type = 2024-09-12T00:30:11.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.413+0000 7fd1b426d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:11.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=0 2024-09-12T00:30:11.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=1 2024-09-12T00:30:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=2 2024-09-12T00:30:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=3 2024-09-12T00:30:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=4 2024-09-12T00:30:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=5 2024-09-12T00:30:11.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=6 2024-09-12T00:30:11.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 20 add_watcher() i=7 2024-09-12T00:30:11.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.437+0000 7fd1b426d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:11.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd0637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:11.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:11.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:11.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 5 note: GC not initialized 2024-09-12T00:30:11.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd0627fc640 20 reqs_thread_entry: start 2024-09-12T00:30:11.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:11.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 20 Filter name: none 2024-09-12T00:30:11.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fcfd3fff640 20 reqs_thread_entry: start 2024-09-12T00:30:11.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:11.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.445+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.449+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:11.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.449+0000 7fd1b426d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:11.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.449+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.449+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:11.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.449+0000 7fd1b426d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:11.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.449+0000 7fd1b426d9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:11.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.449+0000 7fd1b426d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:11.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.453+0000 7fd0637fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:11.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.457+0000 7fd1b426d9c0 20 remove_watcher() i=0 2024-09-12T00:30:11.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.457+0000 7fd1b426d9c0 2 removed watcher, disabling cache 2024-09-12T00:30:11.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.457+0000 7fd1b426d9c0 20 remove_watcher() i=1 2024-09-12T00:30:11.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.461+0000 7fd1b426d9c0 20 remove_watcher() i=2 2024-09-12T00:30:11.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.461+0000 7fd1b426d9c0 20 remove_watcher() i=3 2024-09-12T00:30:11.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.465+0000 7fd1b426d9c0 20 remove_watcher() i=4 2024-09-12T00:30:11.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.465+0000 7fd1b426d9c0 20 remove_watcher() i=5 2024-09-12T00:30:11.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.469+0000 7fd1b426d9c0 20 remove_watcher() i=6 2024-09-12T00:30:11.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:11.473+0000 7fd1b426d9c0 20 remove_watcher() i=7 2024-09-12T00:30:11.484 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:11.484 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:11.485 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.22 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:30:11.485 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:11.591 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with ECANCELED injected at set_target_layout 2024-09-12T00:30:11.591 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:11.993 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:30:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:12.027 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:12.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.073+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 realm 2024-09-12T00:30:12.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:12.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.077+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.081+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:12.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.081+0000 7f4c9b9b79c0 20 searching for the correct realm 2024-09-12T00:30:12.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.085+0000 7f4c99cbe640 0 -- 172.21.15.78:0/3484993268 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x557f84170390 msgr2=0x557f84172780 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:12.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.093+0000 7f4c98cbc640 0 -- 172.21.15.78:0/3484993268 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f4c8c105380 msgr2=0x7f4c8c0ff2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.097+0000 7f4c9b9b79c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.097+0000 7f4c9b9b79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.097+0000 7f4c9b9b79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.097+0000 7f4c9b9b79c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.097+0000 7f4c9b9b79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.097+0000 7f4c9b9b79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:12.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.097+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:12.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 zone default found 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 4 Realm: () 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 zonegroup default 2024-09-12T00:30:12.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 started sync module instance, tier type = 2024-09-12T00:30:12.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.101+0000 7f4c9b9b79c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:12.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.121+0000 7f4c9b9b79c0 20 add_watcher() i=0 2024-09-12T00:30:12.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.121+0000 7f4c9b9b79c0 20 add_watcher() i=1 2024-09-12T00:30:12.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.121+0000 7f4c9b9b79c0 20 add_watcher() i=2 2024-09-12T00:30:12.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.121+0000 7f4c9b9b79c0 20 add_watcher() i=3 2024-09-12T00:30:12.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.121+0000 7f4c9b9b79c0 20 add_watcher() i=4 2024-09-12T00:30:12.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.121+0000 7f4c9b9b79c0 20 add_watcher() i=5 2024-09-12T00:30:12.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.121+0000 7f4c9b9b79c0 20 add_watcher() i=6 2024-09-12T00:30:12.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.125+0000 7f4c9b9b79c0 20 add_watcher() i=7 2024-09-12T00:30:12.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.125+0000 7f4c9b9b79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:12.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4b4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 5 note: GC not initialized 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4b4efe5640 20 reqs_thread_entry: start 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 Filter name: none 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4b4cfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:12.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:12.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:12.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:12.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.129+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.133+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:12.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.133+0000 7f4c9b9b79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.133+0000 7f4c9b9b79c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:12.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.133+0000 7f4c9b9b79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:12.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.137+0000 7f4b4ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:12.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.141+0000 7f4c9b9b79c0 20 remove_watcher() i=0 2024-09-12T00:30:12.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.141+0000 7f4c9b9b79c0 2 removed watcher, disabling cache 2024-09-12T00:30:12.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.141+0000 7f4c9b9b79c0 20 remove_watcher() i=1 2024-09-12T00:30:12.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.145+0000 7f4c9b9b79c0 20 remove_watcher() i=2 2024-09-12T00:30:12.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.149+0000 7f4c9b9b79c0 20 remove_watcher() i=3 2024-09-12T00:30:12.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.149+0000 7f4c9b9b79c0 20 remove_watcher() i=4 2024-09-12T00:30:12.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.153+0000 7f4c9b9b79c0 20 remove_watcher() i=5 2024-09-12T00:30:12.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.153+0000 7f4c9b9b79c0 20 remove_watcher() i=6 2024-09-12T00:30:12.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.157+0000 7f4c9b9b79c0 20 remove_watcher() i=7 2024-09-12T00:30:12.170 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:12.170 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:12.170 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:12.170 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:12.170 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at set_target_layout --inject-error-code 125 2024-09-12T00:30:12.205 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:12.205 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:12.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.257+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.257+0000 7f77ebc7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.257+0000 7f77ebc7e9c0 20 realm 2024-09-12T00:30:12.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.257+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:12.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:12.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:12.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.261+0000 7f77ebc7e9c0 20 searching for the correct realm 2024-09-12T00:30:12.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.269+0000 7f77e9f85640 0 -- 172.21.15.78:0/4104454544 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f77dc040900 msgr2=0x7f77dc00c3b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:12.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.273+0000 7f77e3fff640 0 -- 172.21.15.78:0/4104454544 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f77dc00c3b0 msgr2=0x7f77dc00c830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:12.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:12.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:12.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:12.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:12.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:12.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:12.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:12.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:12.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 zone default found 2024-09-12T00:30:12.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 4 Realm: () 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 zonegroup default 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.285+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.289+0000 7f77ebc7e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.289+0000 7f77ebc7e9c0 20 started sync module instance, tier type = 2024-09-12T00:30:12.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.289+0000 7f77ebc7e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.305+0000 7f77ebc7e9c0 20 add_watcher() i=0 2024-09-12T00:30:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.305+0000 7f77ebc7e9c0 20 add_watcher() i=1 2024-09-12T00:30:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.305+0000 7f77ebc7e9c0 20 add_watcher() i=2 2024-09-12T00:30:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.305+0000 7f77ebc7e9c0 20 add_watcher() i=3 2024-09-12T00:30:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.305+0000 7f77ebc7e9c0 20 add_watcher() i=4 2024-09-12T00:30:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.305+0000 7f77ebc7e9c0 20 add_watcher() i=5 2024-09-12T00:30:12.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.305+0000 7f77ebc7e9c0 20 add_watcher() i=6 2024-09-12T00:30:12.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.309+0000 7f77ebc7e9c0 20 add_watcher() i=7 2024-09-12T00:30:12.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.309+0000 7f77ebc7e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.313+0000 7f769ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 5 note: GC not initialized 2024-09-12T00:30:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f769efe5640 20 reqs_thread_entry: start 2024-09-12T00:30:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 Filter name: none 2024-09-12T00:30:12.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f769cfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:12.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 cache get: name=default.rgw.meta+root+error-at-set-target-layout : miss 2024-09-12T00:30:12.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 cache put: name=default.rgw.meta+root+error-at-set-target-layout info.flags=0x11 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 adding default.rgw.meta+root+error-at-set-target-layout to cache LRU end 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 : miss 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 info.flags=0x17 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 to cache LRU end 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:12.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.317+0000 7f77ebc7e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 2024-09-12T00:30:12.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.329+0000 7f77ebc7e9c0 -1 Injecting error=-125 at location=set_target_layout 2024-09-12T00:30:12.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 info.flags=0x17 2024-09-12T00:30:12.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 to cache LRU end 2024-09-12T00:30:12.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:12.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23, ofs0, ns] 2024-09-12T00:30:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f76bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398949 cookie 94074125378144 notifier 6224 bl.length()=925 2024-09-12T00:30:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f76bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 info.flags=0x17 2024-09-12T00:30:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f76bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 to cache LRU end 2024-09-12T00:30:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f76bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): orig_sources= new_sources= 2024-09-12T00:30:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): potential sources added=[] removed=[] 2024-09-12T00:30:12.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): orig_dests= new_dests= 2024-09-12T00:30:12.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.333+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): potential dests added=[] removed=[] 2024-09-12T00:30:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.0 2024-09-12T00:30:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.0 2024-09-12T00:30:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.1 2024-09-12T00:30:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.1 2024-09-12T00:30:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.2 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.2 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.3 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.3 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.4 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.4 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.5 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.5 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.6 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.6 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.7 2024-09-12T00:30:12.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.7 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.8 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.8 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.9 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.9 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.10 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.10 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.11 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1.11 2024-09-12T00:30:12.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.0 2024-09-12T00:30:12.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1 2024-09-12T00:30:12.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.2 2024-09-12T00:30:12.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.3 2024-09-12T00:30:12.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.4 2024-09-12T00:30:12.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.345+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.5 2024-09-12T00:30:12.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.349+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.6 2024-09-12T00:30:12.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.349+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.7 2024-09-12T00:30:12.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.349+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.8 2024-09-12T00:30:12.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.349+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.9 2024-09-12T00:30:12.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.353+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.10 2024-09-12T00:30:12.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.361+0000 7f77ebc7e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:12.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.361+0000 7f77ebc7e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 2024-09-12T00:30:12.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 info.flags=0x17 2024-09-12T00:30:12.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 to cache LRU end 2024-09-12T00:30:12.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:12.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23, ofs0, ns] 2024-09-12T00:30:12.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f76ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398950 cookie 94074125378144 notifier 6224 bl.length()=925 2024-09-12T00:30:12.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f76ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 info.flags=0x17 2024-09-12T00:30:12.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f76ccff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 to cache LRU end 2024-09-12T00:30:12.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f76ccff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:12.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): orig_sources= new_sources= 2024-09-12T00:30:12.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): potential sources added=[] removed=[] 2024-09-12T00:30:12.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): orig_dests= new_dests= 2024-09-12T00:30:12.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.365+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): potential dests added=[] removed=[] 2024-09-12T00:30:12.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.369+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.0 2024-09-12T00:30:12.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.373+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.1 2024-09-12T00:30:12.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.373+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.2 2024-09-12T00:30:12.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.373+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.3 2024-09-12T00:30:12.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.373+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.4 2024-09-12T00:30:12.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.373+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.5 2024-09-12T00:30:12.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.373+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.6 2024-09-12T00:30:12.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.373+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.7 2024-09-12T00:30:12.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.377+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.8 2024-09-12T00:30:12.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.377+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.9 2024-09-12T00:30:12.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.377+0000 7f77ebc7e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23.10 2024-09-12T00:30:12.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.377+0000 7f77ebc7e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:12.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.377+0000 7f77ebc7e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 2024-09-12T00:30:12.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 info.flags=0x17 2024-09-12T00:30:12.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 to cache LRU end 2024-09-12T00:30:12.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:12.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23, ofs0, ns] 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f76bbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398951 cookie 94074125378144 notifier 6224 bl.length()=893 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f76bbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 info.flags=0x17 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f76bbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 to cache LRU end 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f76bbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): orig_sources= new_sources= 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): potential sources added=[] removed=[] 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): orig_dests= new_dests= 2024-09-12T00:30:12.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.381+0000 7f77ebc7e9c0 20 handle_bi_update(): bucket=:error-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23]): potential dests added=[] removed=[] 2024-09-12T00:30:12.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.389+0000 7f77ebc7e9c0 1 execute INFO: reshard of bucket "error-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:30:12.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.389+0000 7f769ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.397+0000 7f77ebc7e9c0 20 remove_watcher() i=0 2024-09-12T00:30:12.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.397+0000 7f77ebc7e9c0 2 removed watcher, disabling cache 2024-09-12T00:30:12.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.397+0000 7f77ebc7e9c0 20 remove_watcher() i=1 2024-09-12T00:30:12.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.401+0000 7f77ebc7e9c0 20 remove_watcher() i=2 2024-09-12T00:30:12.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.401+0000 7f77ebc7e9c0 20 remove_watcher() i=3 2024-09-12T00:30:12.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.405+0000 7f77ebc7e9c0 20 remove_watcher() i=4 2024-09-12T00:30:12.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.405+0000 7f77ebc7e9c0 20 remove_watcher() i=5 2024-09-12T00:30:12.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.409+0000 7f77ebc7e9c0 20 remove_watcher() i=6 2024-09-12T00:30:12.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.413+0000 7f77ebc7e9c0 20 remove_watcher() i=7 2024-09-12T00:30:12.426 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-set-target-layout 2024-09-12T00:30:12.457 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:12.457 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:12.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.501+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 realm 2024-09-12T00:30:12.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:12.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:12.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:12.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.509+0000 7f8f5e6109c0 20 searching for the correct realm 2024-09-12T00:30:12.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.517+0000 7f8f5c917640 0 -- 172.21.15.78:0/3240353063 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f8f4c00e070 msgr2=0x7f8f4c04e380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:12.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.733+0000 7f8f5c917640 0 -- 172.21.15.78:0/3240353063 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ac60335c00 msgr2=0x55ac60338060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:12.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.741+0000 7f8f5e6109c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.741+0000 7f8f5e6109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.741+0000 7f8f5e6109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.741+0000 7f8f5e6109c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.741+0000 7f8f5e6109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.741+0000 7f8f5e6109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:12.741 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.741+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:12.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 zone default found 2024-09-12T00:30:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 4 Realm: () 2024-09-12T00:30:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 zonegroup default 2024-09-12T00:30:12.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.745+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.749+0000 7f8f5e6109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:12.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.749+0000 7f8f5e6109c0 20 started sync module instance, tier type = 2024-09-12T00:30:12.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.749+0000 7f8f5e6109c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.769+0000 7f8f5e6109c0 20 add_watcher() i=0 2024-09-12T00:30:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.769+0000 7f8f5e6109c0 20 add_watcher() i=1 2024-09-12T00:30:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.769+0000 7f8f5e6109c0 20 add_watcher() i=2 2024-09-12T00:30:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.769+0000 7f8f5e6109c0 20 add_watcher() i=3 2024-09-12T00:30:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.769+0000 7f8f5e6109c0 20 add_watcher() i=4 2024-09-12T00:30:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.769+0000 7f8f5e6109c0 20 add_watcher() i=5 2024-09-12T00:30:12.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.769+0000 7f8f5e6109c0 20 add_watcher() i=6 2024-09-12T00:30:12.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.773+0000 7f8f5e6109c0 20 add_watcher() i=7 2024-09-12T00:30:12.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.773+0000 7f8f5e6109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:12.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8e12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:12.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8f5e6109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:12.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8f5e6109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:12.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8f5e6109c0 5 note: GC not initialized 2024-09-12T00:30:12.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8e11fdb640 20 reqs_thread_entry: start 2024-09-12T00:30:12.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8f5e6109c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:12.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8f5e6109c0 20 Filter name: none 2024-09-12T00:30:12.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.777+0000 7f8d837fe640 20 reqs_thread_entry: start 2024-09-12T00:30:12.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:12.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:12.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:12.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:12.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.781+0000 7f8f5e6109c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:12.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.785+0000 7f8f5e6109c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:12.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.785+0000 7f8f5e6109c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:12.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.789+0000 7f8e12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:12.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.793+0000 7f8f5e6109c0 20 remove_watcher() i=0 2024-09-12T00:30:12.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.793+0000 7f8f5e6109c0 2 removed watcher, disabling cache 2024-09-12T00:30:12.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.793+0000 7f8f5e6109c0 20 remove_watcher() i=1 2024-09-12T00:30:12.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.797+0000 7f8f5e6109c0 20 remove_watcher() i=2 2024-09-12T00:30:12.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.797+0000 7f8f5e6109c0 20 remove_watcher() i=3 2024-09-12T00:30:12.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.801+0000 7f8f5e6109c0 20 remove_watcher() i=4 2024-09-12T00:30:12.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.801+0000 7f8f5e6109c0 20 remove_watcher() i=5 2024-09-12T00:30:12.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.805+0000 7f8f5e6109c0 20 remove_watcher() i=6 2024-09-12T00:30:12.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:12.805+0000 7f8f5e6109c0 20 remove_watcher() i=7 2024-09-12T00:30:12.821 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:12.821 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:12.821 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.23 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:30:12.821 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:12.940 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at set_target_layout 2024-09-12T00:30:12.941 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:13.355 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:30:13.387 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:13.387 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:13.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.433+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:13.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 realm 2024-09-12T00:30:13.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:13.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:13.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:13.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:13.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.437+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.441+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:13.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.441+0000 7f939054b9c0 20 searching for the correct realm 2024-09-12T00:30:13.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.445+0000 7f938e852640 0 -- 172.21.15.78:0/451124088 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f93800403f0 msgr2=0x7f9380040830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:13.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.865+0000 7f938d850640 0 -- 172.21.15.78:0/451124088 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f938004f3f0 msgr2=0x7f938004f870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:13.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:13.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.877+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:13.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 zone default found 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 4 Realm: () 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 zonegroup default 2024-09-12T00:30:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:13.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:13.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:13.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 started sync module instance, tier type = 2024-09-12T00:30:13.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.881+0000 7f939054b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:13.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.905+0000 7f939054b9c0 20 add_watcher() i=0 2024-09-12T00:30:13.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.905+0000 7f939054b9c0 20 add_watcher() i=1 2024-09-12T00:30:13.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.905+0000 7f939054b9c0 20 add_watcher() i=2 2024-09-12T00:30:13.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.905+0000 7f939054b9c0 20 add_watcher() i=3 2024-09-12T00:30:13.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.905+0000 7f939054b9c0 20 add_watcher() i=4 2024-09-12T00:30:13.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.905+0000 7f939054b9c0 20 add_watcher() i=5 2024-09-12T00:30:13.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.905+0000 7f939054b9c0 20 add_watcher() i=6 2024-09-12T00:30:13.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.909+0000 7f939054b9c0 20 add_watcher() i=7 2024-09-12T00:30:13.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.909+0000 7f939054b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:13.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.913+0000 7f9244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:13.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.913+0000 7f939054b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:13.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.913+0000 7f939054b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:13.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.913+0000 7f939054b9c0 5 note: GC not initialized 2024-09-12T00:30:13.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.913+0000 7f91bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:13.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:13.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 Filter name: none 2024-09-12T00:30:13.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f91bd7fa640 20 reqs_thread_entry: start 2024-09-12T00:30:13.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:13.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:13.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:13.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:13.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.917+0000 7f939054b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:13.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.921+0000 7f939054b9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:13.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.921+0000 7f939054b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:13.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.921+0000 7f9244fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:13.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.929+0000 7f939054b9c0 20 remove_watcher() i=0 2024-09-12T00:30:13.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.929+0000 7f939054b9c0 2 removed watcher, disabling cache 2024-09-12T00:30:13.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.929+0000 7f939054b9c0 20 remove_watcher() i=1 2024-09-12T00:30:13.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.933+0000 7f939054b9c0 20 remove_watcher() i=2 2024-09-12T00:30:13.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.937+0000 7f939054b9c0 20 remove_watcher() i=3 2024-09-12T00:30:13.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.937+0000 7f939054b9c0 20 remove_watcher() i=4 2024-09-12T00:30:13.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.941+0000 7f939054b9c0 20 remove_watcher() i=5 2024-09-12T00:30:13.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.945+0000 7f939054b9c0 20 remove_watcher() i=6 2024-09-12T00:30:13.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:13.949+0000 7f939054b9c0 20 remove_watcher() i=7 2024-09-12T00:30:13.961 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:13.961 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:13.961 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:13.961 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:13.962 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at set_target_layout 2024-09-12T00:30:13.996 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:13.996 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:14.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 realm 2024-09-12T00:30:14.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.045+0000 7f7cd711e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:14.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:14.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 searching for the correct realm 2024-09-12T00:30:14.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.053+0000 7f7cd5425640 0 -- 172.21.15.78:0/3393258212 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7cc401d940 msgr2=0x7f7cc401c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.269+0000 7f7cd4c24640 0 -- 172.21.15.78:0/3393258212 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560487559c30 msgr2=0x56048755c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:14.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 zone default found 2024-09-12T00:30:14.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 Realm: () 2024-09-12T00:30:14.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:14.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:14.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:14.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 zonegroup default 2024-09-12T00:30:14.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 started sync module instance, tier type = 2024-09-12T00:30:14.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:14.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=0 2024-09-12T00:30:14.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=1 2024-09-12T00:30:14.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=2 2024-09-12T00:30:14.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=3 2024-09-12T00:30:14.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=4 2024-09-12T00:30:14.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=5 2024-09-12T00:30:14.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=6 2024-09-12T00:30:14.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=7 2024-09-12T00:30:14.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.309+0000 7f7cd711e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:14.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.313+0000 7f7b8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:14.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:14.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:14.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 note: GC not initialized 2024-09-12T00:30:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7b89fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 Filter name: none 2024-09-12T00:30:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7afb7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:30:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:30:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:30:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 : miss 2024-09-12T00:30:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:14.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:14.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:14.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:14.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 2024-09-12T00:30:14.326 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7cd711e9c0 time 2024-09-12T00:30:14.331513+0000 2024-09-12T00:30:14.326 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7cda9f82eb] 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:14.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.329+0000 7f7cd711e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7cd711e9c0 time 2024-09-12T00:30:14.331513+0000 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7cda9f82eb] 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:14.329 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.330 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:30:14.330 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f7cd711e9c0 thread_name:radosgw-admin 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7cd9877520] 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7cda9f8345] 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.349 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.333+0000 7f7cd711e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f7cd711e9c0 thread_name:radosgw-admin 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7cd9877520] 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:14.350 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7cda9f8345] 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.351 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x560487327bf0 auth_method 0 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6257 payload 274 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:30:14.021+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: dump: 2024-09-12T00:30:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6257 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.353 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 4 set_mon_vals no callback set 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: dump: 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.354 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: shutdown 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 asok(0x5604872632b0) unregister_commands rotate-key 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.355 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding auth protocol: cephx 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding auth protocol: cephx 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding auth protocol: cephx 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.356 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: starting msgr at 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: starting objecter 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command objecter_requests hook 0x5604871ddde0 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: setting wanted keys 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: calling monclient init 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding auth protocol: cephx 2024-09-12T00:30:14.357 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding auth protocol: cephx 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding auth protocol: cephx 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.358 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key hook 0x56048746e5e8 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x56048731e300 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x560487327bf0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x560487329850 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.359792s 2024-09-12T00:30:14.359 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x560487329850 auth_method 0 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x560487327bf0 auth_method 0 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.360 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x56048731e300 auth_method 0 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6260 payload 824 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:30:14.025+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: dump: 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.361 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.362 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: dump: 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6260 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:30:14.025+0000 7f7bc2e0d640 4 set_mon_vals no callback set 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.363 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 1 librados: init done 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:30:14.025+0000 7f7bc160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:30:14.025+0000 7f7bc160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:30:14.025+0000 7f7bc160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x7f7bbc070ae0 auth_method 0 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient: get_auth_request con 0x5604874ad630 auth_method 0 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:30:14.029+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x5604874b8ac0 auth_method 0 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:30:14.029+0000 7f7cd4423640 10 monclient: get_auth_request con 0x5604874bccb0 auth_method 0 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:30:14.029+0000 7f7cd5425640 10 monclient: get_auth_request con 0x5604874bc350 auth_method 0 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.364 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding auth protocol: cephx 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding auth protocol: cephx 2024-09-12T00:30:14.365 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding auth protocol: cephx 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.366 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command objecter_requests cmddesc objecter_requests hook 0x5604874c87a0 EEXIST 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding auth protocol: cephx 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding auth protocol: cephx 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding auth protocol: cephx 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.367 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key cmddesc rotate-key hook 0x5604874c3df0 EEXIST 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x5604874ec950 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x5604874ec280 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x5604874eac60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.368 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.370031s 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x5604874ec950 auth_method 0 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x5604874ec280 auth_method 0 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.369 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x5604874eac60 auth_method 0 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.370 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_done global_id 6263 payload 824 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:30:14.033+0000 7f7cd4423640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: dump: 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.372 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: dump: 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.373 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:30:14.033+0000 7f7cd5c26640 4 set_mon_vals no callback set 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6263 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.374 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:30:14.037+0000 7f7bba7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:30:14.037+0000 7f7bba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:30:14.037+0000 7f7bba7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient: get_auth_request con 0x7f7bac070a20 auth_method 0 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.375 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding auth protocol: cephx 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding auth protocol: cephx 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding auth protocol: cephx 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.376 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding auth protocol: cephx 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding auth protocol: cephx 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding auth protocol: cephx 2024-09-12T00:30:14.377 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.378 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd43700738 EEXIST 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x56048753a800 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x56048753abe0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x56048753c0a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.375087s 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x56048753abe0 auth_method 0 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.379 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x56048753c0a0 auth_method 0 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x56048753a800 auth_method 0 2024-09-12T00:30:14.380 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6266 payload 274 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:30:14.037+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: dump: 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.381 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6266 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 4 set_mon_vals no callback set 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.382 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: dump: 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: shutdown 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.383 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding auth protocol: cephx 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding auth protocol: cephx 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding auth protocol: cephx 2024-09-12T00:30:14.384 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.385 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: starting msgr at 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: starting objecter 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command objecter_requests cmddesc objecter_requests hook 0x560487540ab0 EEXIST 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: setting wanted keys 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: calling monclient init 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding auth protocol: cephx 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding auth protocol: cephx 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding auth protocol: cephx 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.386 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key cmddesc rotate-key hook 0x5604874ee8b8 EEXIST 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:30:14.387 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x56048753a800 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x56048753c0a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x560487534110 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.377991s 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x56048753c0a0 auth_method 0 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x560487534110 auth_method 0 2024-09-12T00:30:14.388 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x56048753a800 auth_method 0 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6269 payload 824 2024-09-12T00:30:14.389 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:30:14.041+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: dump: 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.390 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: dump: 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.391 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6269 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:30:14.041+0000 7f7babfff640 4 set_mon_vals no callback set 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: init done 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cr dump hook 0x560487534a28 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:30:14.045+0000 7f7baa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:14.392 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:30:14.045+0000 7f7baa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:30:14.045+0000 7f7baa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:30:14.045+0000 7f7cd4423640 10 monclient: get_auth_request con 0x7f7ba0070ae0 auth_method 0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:30:14.045+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x560487559c30 auth_method 0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 realm 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:30:14.049+0000 7f7cd4423640 10 monclient: get_auth_request con 0x56048755df20 auth_method 0 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.393 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:30:14.049+0000 7f7cd5425640 10 monclient: get_auth_request con 0x560487561680 auth_method 0 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 searching for the correct realm 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:30:14.049+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x560487566440 auth_method 0 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:30:14.053+0000 7f7cd4423640 10 monclient: get_auth_request con 0x7f7cc402e440 auth_method 0 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:30:14.053+0000 7f7cd5425640 0 -- 172.21.15.78:0/3393258212 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7cc401d940 msgr2=0x7f7cc401c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:30:14.257+0000 7f7cd5425640 10 monclient: get_auth_request con 0x7f7cc401d940 auth_method 0 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:30:14.265+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x7f7cc8033060 auth_method 0 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:30:14.265+0000 7f7cd4423640 10 monclient: get_auth_request con 0x7f7cc4041960 auth_method 0 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:30:14.269+0000 7f7cd4c24640 0 -- 172.21.15.78:0/3393258212 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560487559c30 msgr2=0x56048755c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:30:14.269+0000 7f7baa7fc640 1 client.6269.objecter ms_handle_reset 0x560487559c30 session 0x560487559560 osd.6 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:30:14.269+0000 7f7baa7fc640 10 monclient: _renew_subs 2024-09-12T00:30:14.394 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:30:14.269+0000 7f7baa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:30:14.269+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x7f7ba0080df0 auth_method 0 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.395 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 zone default found 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 Realm: () 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 zonegroup default 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 started sync module instance, tier type = 2024-09-12T00:30:14.396 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=0 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=1 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=2 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=3 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=4 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=5 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=6 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=7 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding auth protocol: cephx 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding auth protocol: cephx 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding auth protocol: cephx 2024-09-12T00:30:14.397 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:30:14.313+0000 7f7b8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.398 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache list hook 0x560487534510 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache inspect hook 0x560487534510 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache erase hook 0x560487534510 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache zap hook 0x560487534510 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 note: GC not initialized 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:30:14.317+0000 7f7b89fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace show hook 0x7f7cc40014b0 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace history hook 0x7f7cc40014b0 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace active hook 0x7f7cc40014b0 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace active_short hook 0x7f7cc40014b0 2024-09-12T00:30:14.399 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 Filter name: none 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:30:14.317+0000 7f7afb7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 : miss 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:14.400 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:30:14.329+0000 7f7cd711e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7cd711e9c0 time 2024-09-12T00:30:14.331513+0000 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7cda9f82eb] 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:14.401 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:30:14.333+0000 7f7cd711e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f7cd711e9c0 thread_name:radosgw-admin 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7cd9877520] 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7cda9f8345] 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.402 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:30:14.403 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:30:14.404 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:30:14.405 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:14.406 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:30:14.407 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:30:14.408 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:30:14.409 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7afb7fe640 / http_manager 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7b89fe3640 / http_manager 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7b8afe5640 / rgw_dt_lg_renew 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7baa7fc640 / ms_dispatch 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7babfff640 / io_context_pool 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7bba7fc640 / ms_dispatch 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7bc160a640 / ms_dispatch 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7bc2e0d640 / io_context_pool 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd4423640 / msgr-worker-2 2024-09-12T00:30:14.410 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd4c24640 / msgr-worker-1 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd5425640 / msgr-worker-0 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd5c26640 / io_context_pool 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd711e9c0 / radosgw-admin 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.89875.log 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x560487327bf0 auth_method 0 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6257 payload 274 2024-09-12T00:30:14.411 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:30:14.021+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: dump: 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.412 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6257 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 4 set_mon_vals no callback set 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:30:14.021+0000 7f7bc2e0d640 10 monclient: dump: 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.413 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: shutdown 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 asok(0x5604872632b0) unregister_commands rotate-key 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.414 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding auth protocol: cephx 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding auth protocol: cephx 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding auth protocol: cephx 2024-09-12T00:30:14.415 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: crc 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874737f0) adding con mode: secure 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.416 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: starting msgr at 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: starting objecter 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command objecter_requests hook 0x5604871ddde0 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: setting wanted keys 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 1 librados: calling monclient init 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding auth protocol: cephx 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding auth protocol: cephx 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding auth protocol: cephx 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.417 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: crc 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 AuthRegistry(0x56048746e4a0) adding con mode: secure 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key hook 0x56048746e5e8 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x56048731e300 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x560487327bf0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.418 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x560487329850 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:30:14.021+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.359792s 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x560487329850 auth_method 0 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:30:14.021+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x560487327bf0 auth_method 0 2024-09-12T00:30:14.419 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:30:14.021+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x56048731e300 auth_method 0 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.420 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6260 payload 824 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:30:14.025+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:30:14.025+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: dump: 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.421 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:30:14.025+0000 7f7bc160a640 10 monclient: dump: 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.422 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6260 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:30:14.025+0000 7f7bc2e0d640 4 set_mon_vals no callback set 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:30:14.025+0000 7f7cd711e9c0 1 librados: init done 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:30:14.025+0000 7f7bc160a640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:14.423 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:30:14.025+0000 7f7bc160a640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:30:14.025+0000 7f7bc160a640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:30:14.025+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x7f7bbc070ae0 auth_method 0 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:30:14.025+0000 7f7cd4423640 10 monclient: get_auth_request con 0x5604874ad630 auth_method 0 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:30:14.029+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x5604874b8ac0 auth_method 0 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:30:14.029+0000 7f7cd4423640 10 monclient: get_auth_request con 0x5604874bccb0 auth_method 0 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:30:14.029+0000 7f7cd5425640 10 monclient: get_auth_request con 0x5604874bc350 auth_method 0 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.424 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding auth protocol: cephx 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding auth protocol: cephx 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding auth protocol: cephx 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.425 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: crc 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c4db0) adding con mode: secure 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command objecter_requests cmddesc objecter_requests hook 0x5604874c87a0 EEXIST 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding auth protocol: cephx 2024-09-12T00:30:14.426 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding auth protocol: cephx 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding auth protocol: cephx 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: crc 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874c3ca8) adding con mode: secure 2024-09-12T00:30:14.427 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key cmddesc rotate-key hook 0x5604874c3df0 EEXIST 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x5604874ec950 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x5604874ec280 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x5604874eac60 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.370031s 2024-09-12T00:30:14.428 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x5604874ec950 auth_method 0 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x5604874ec280 auth_method 0 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:30:14.033+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.429 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x5604874eac60 auth_method 0 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:30:14.033+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient(hunting): handle_auth_done global_id 6263 payload 824 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:30:14.033+0000 7f7cd4423640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:30:14.033+0000 7f7cd4423640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: dump: 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.430 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:30:14.033+0000 7f7bba7fc640 10 monclient: dump: 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.431 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:30:14.033+0000 7f7cd5c26640 4 set_mon_vals no callback set 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6263 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.432 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:30:14.033+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:30:14.037+0000 7f7bba7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:30:14.037+0000 7f7bba7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:30:14.037+0000 7f7bba7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient: get_auth_request con 0x7f7bac070a20 auth_method 0 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.433 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding auth protocol: cephx 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding auth protocol: cephx 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding auth protocol: cephx 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.434 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: crc 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c270) adding con mode: secure 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding auth protocol: cephx 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding auth protocol: cephx 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding auth protocol: cephx 2024-09-12T00:30:14.435 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: crc 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd437005f0) adding con mode: secure 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.436 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd43700738 EEXIST 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x56048753a800 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x56048753abe0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x56048753c0a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.375087s 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x56048753abe0 auth_method 0 2024-09-12T00:30:14.437 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x56048753c0a0 auth_method 0 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:30:14.037+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x56048753a800 auth_method 0 2024-09-12T00:30:14.438 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:30:14.037+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6266 payload 274 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:30:14.037+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:30:14.037+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: dump: 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.439 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6266 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:30:14.037+0000 7f7cd711e9c0 4 set_mon_vals no callback set 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.440 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:30:14.037+0000 7f7babfff640 10 monclient: dump: 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: shutdown 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: build_initial_monmap 2024-09-12T00:30:14.441 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: monmap: 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding auth protocol: cephx 2024-09-12T00:30:14.442 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding auth protocol: cephx 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding auth protocol: cephx 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: crc 2024-09-12T00:30:14.443 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x56048750c220) adding con mode: secure 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: starting msgr at 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: starting objecter 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command objecter_requests cmddesc objecter_requests hook 0x560487540ab0 EEXIST 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: setting wanted keys 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: calling monclient init 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: init 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding auth protocol: cephx 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding auth protocol: cephx 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding auth protocol: cephx 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.444 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: crc 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 AuthRegistry(0x5604874ee770) adding con mode: secure 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command rotate-key cmddesc rotate-key hook 0x5604874ee8b8 EEXIST 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:14.445 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-b con 0x56048753a800 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-c con 0x56048753c0a0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): picked mon.noname-a con 0x560487534110 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient(hunting): authenticate will time out at 2138.377991s 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): get_auth_request con 0x56048753c0a0 auth_method 0 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request con 0x560487534110 auth_method 0 2024-09-12T00:30:14.446 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:30:14.041+0000 7f7cd4c24640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): get_auth_request con 0x56048753a800 auth_method 0 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:30:14.041+0000 7f7cd4423640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient(hunting): handle_auth_done global_id 6269 payload 824 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient: _finish_hunting 0 2024-09-12T00:30:14.447 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:30:14.041+0000 7f7cd5425640 1 monclient: found mon.noname-c 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:30:14.041+0000 7f7cd5425640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: dump: 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.448 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:30:14.041+0000 7f7baa7fc640 10 monclient: dump: 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:14.449 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 monclient: authenticate success, global_id 6269 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:30:14.041+0000 7f7babfff640 4 set_mon_vals no callback set 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _renew_subs 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 1 librados: init done 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:30:14.041+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cr dump hook 0x560487534a28 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:30:14.045+0000 7f7baa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:14.450 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:30:14.045+0000 7f7baa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:30:14.045+0000 7f7baa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:30:14.045+0000 7f7cd4423640 10 monclient: get_auth_request con 0x7f7ba0070ae0 auth_method 0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:30:14.045+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x560487559c30 auth_method 0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 realm 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:30:14.045+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:30:14.049+0000 7f7cd4423640 10 monclient: get_auth_request con 0x56048755df20 auth_method 0 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.451 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:30:14.049+0000 7f7cd5425640 10 monclient: get_auth_request con 0x560487561680 auth_method 0 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:30:14.049+0000 7f7cd711e9c0 20 searching for the correct realm 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:30:14.049+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x560487566440 auth_method 0 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:30:14.053+0000 7f7cd4423640 10 monclient: get_auth_request con 0x7f7cc402e440 auth_method 0 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:30:14.053+0000 7f7cd5425640 0 -- 172.21.15.78:0/3393258212 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7cc401d940 msgr2=0x7f7cc401c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:30:14.257+0000 7f7cd5425640 10 monclient: get_auth_request con 0x7f7cc401d940 auth_method 0 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:30:14.265+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x7f7cc8033060 auth_method 0 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:30:14.265+0000 7f7cd4423640 10 monclient: get_auth_request con 0x7f7cc4041960 auth_method 0 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:30:14.269+0000 7f7cd4c24640 0 -- 172.21.15.78:0/3393258212 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560487559c30 msgr2=0x56048755c020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:30:14.269+0000 7f7baa7fc640 1 client.6269.objecter ms_handle_reset 0x560487559c30 session 0x560487559560 osd.6 2024-09-12T00:30:14.452 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:30:14.269+0000 7f7baa7fc640 10 monclient: _renew_subs 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:30:14.269+0000 7f7baa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:30:14.269+0000 7f7cd4c24640 10 monclient: get_auth_request con 0x7f7ba0080df0 auth_method 0 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.453 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 zone default found 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 Realm: () 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 zonegroup default 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:30:14.281+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.454 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 started sync module instance, tier type = 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:30:14.285+0000 7f7cd711e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=0 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=1 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=2 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=3 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=4 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=5 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=6 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 20 add_watcher() i=7 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:30:14.309+0000 7f7cd711e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding auth protocol: cephx 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding auth protocol: cephx 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding auth protocol: cephx 2024-09-12T00:30:14.455 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: crc 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:30:14.313+0000 7f7cd711e9c0 5 AuthRegistry(0x7ffd43700ad0) adding con mode: secure 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:30:14.313+0000 7f7b8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:14.456 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache list hook 0x560487534510 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache inspect hook 0x560487534510 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache erase hook 0x560487534510 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command cache zap hook 0x560487534510 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 note: GC not initialized 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:30:14.317+0000 7f7b89fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace show hook 0x7f7cc40014b0 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace history hook 0x7f7cc40014b0 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace active hook 0x7f7cc40014b0 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 5 asok(0x5604872632b0) register_command sync trace active_short hook 0x7f7cc40014b0 2024-09-12T00:30:14.457 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 Filter name: none 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:30:14.317+0000 7f7afb7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 : miss 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:14.458 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:30:14.317+0000 7f7cd711e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:30:14.329+0000 7f7cd711e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f7cd711e9c0 time 2024-09-12T00:30:14.331513+0000 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f7cda9f82eb] 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:14.459 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:30:14.333+0000 7f7cd711e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f7cd711e9c0 thread_name:radosgw-admin 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f7cd9877520] 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f7cda9f8345] 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f7cda9f849f] 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5604860ddcc1] 2024-09-12T00:30:14.460 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422078) [0x560486b3b078] 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5604860f2ced] 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f7cd985ed90] 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:30:14.461 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:14.462 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:30:14.463 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:14.464 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:30:14.465 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:14.466 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:30:14.467 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7afb7fe640 / http_manager 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7b89fe3640 / http_manager 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7b8afe5640 / rgw_dt_lg_renew 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7baa7fc640 / ms_dispatch 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7babfff640 / io_context_pool 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7bba7fc640 / ms_dispatch 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7bc160a640 / ms_dispatch 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7bc2e0d640 / io_context_pool 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd4423640 / msgr-worker-2 2024-09-12T00:30:14.468 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd4c24640 / msgr-worker-1 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd5425640 / msgr-worker-0 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd5c26640 / io_context_pool 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr: 7f7cd711e9c0 / radosgw-admin 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:30:14.334923Z_77131c83-630f-431c-9f6e-46ba60ac267a/log 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:30:14.469 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:30:14.470 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.417+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.417+0000 7f00097da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.417+0000 7f00097da9c0 20 realm 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.417+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.417+0000 7f00097da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.417+0000 7f00097da9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.417+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.421+0000 7f00097da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.421+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.421+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.421+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.421+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:14.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.421+0000 7f00097da9c0 20 searching for the correct realm 2024-09-12T00:30:14.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.425+0000 7f0007ae1640 0 -- 172.21.15.78:0/3671854693 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0000036930 msgr2=0x7f00000253d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.641+0000 7f00072e0640 0 -- 172.21.15.78:0/3671854693 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5618f4805bd0 msgr2=0x5618f4808070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:14.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:14.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:14.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:14.651 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:14.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:14.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:14.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:14.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 zone default found 2024-09-12T00:30:14.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 4 Realm: () 2024-09-12T00:30:14.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:14.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:14.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:14.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 zonegroup default 2024-09-12T00:30:14.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.653+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.657+0000 7f00097da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.657+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.657+0000 7f00097da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.657+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.657+0000 7f00097da9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.657+0000 7f00097da9c0 20 started sync module instance, tier type = 2024-09-12T00:30:14.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.657+0000 7f00097da9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:14.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=0 2024-09-12T00:30:14.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=1 2024-09-12T00:30:14.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=2 2024-09-12T00:30:14.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=3 2024-09-12T00:30:14.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=4 2024-09-12T00:30:14.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=5 2024-09-12T00:30:14.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=6 2024-09-12T00:30:14.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 20 add_watcher() i=7 2024-09-12T00:30:14.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.681+0000 7f00097da9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:14.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.685+0000 7efebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:14.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:14.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:14.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 5 note: GC not initialized 2024-09-12T00:30:14.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7efebcfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:14.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:14.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 20 Filter name: none 2024-09-12T00:30:14.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7efe367fc640 20 reqs_thread_entry: start 2024-09-12T00:30:14.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:14.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.689+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.693+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:14.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.693+0000 7f00097da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:14.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.693+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.693+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:14.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.693+0000 7f00097da9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.693+0000 7f00097da9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:14.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.693+0000 7f00097da9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:14.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.697+0000 7efebdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:14.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.701+0000 7f00097da9c0 20 remove_watcher() i=0 2024-09-12T00:30:14.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.701+0000 7f00097da9c0 2 removed watcher, disabling cache 2024-09-12T00:30:14.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.701+0000 7f00097da9c0 20 remove_watcher() i=1 2024-09-12T00:30:14.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.705+0000 7f00097da9c0 20 remove_watcher() i=2 2024-09-12T00:30:14.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.709+0000 7f00097da9c0 20 remove_watcher() i=3 2024-09-12T00:30:14.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.709+0000 7f00097da9c0 20 remove_watcher() i=4 2024-09-12T00:30:14.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.713+0000 7f00097da9c0 20 remove_watcher() i=5 2024-09-12T00:30:14.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.717+0000 7f00097da9c0 20 remove_watcher() i=6 2024-09-12T00:30:14.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.717+0000 7f00097da9c0 20 remove_watcher() i=7 2024-09-12T00:30:14.730 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.730 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:14.730 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:14.730 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:14.786 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:30:14.822 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:14.822 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:14.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.869+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.869+0000 7f713563e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.869+0000 7f713563e9c0 20 realm 2024-09-12T00:30:14.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.869+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:14.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:14.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:14.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:14.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.873+0000 7f713563e9c0 20 searching for the correct realm 2024-09-12T00:30:14.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:14.877+0000 7f7133945640 0 -- 172.21.15.78:0/1721327326 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7124099ba0 msgr2=0x7f71240988d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:15.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.093+0000 7f7133945640 0 -- 172.21.15.78:0/1721327326 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ea0ded3270 msgr2=0x55ea0ded56c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:15.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:15.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 zone default found 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 4 Realm: () 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 zonegroup default 2024-09-12T00:30:15.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.105+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.109+0000 7f713563e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.109+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.109+0000 7f713563e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.109+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.109+0000 7f713563e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:15.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.109+0000 7f713563e9c0 20 started sync module instance, tier type = 2024-09-12T00:30:15.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.109+0000 7f713563e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:15.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=0 2024-09-12T00:30:15.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=1 2024-09-12T00:30:15.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=2 2024-09-12T00:30:15.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=3 2024-09-12T00:30:15.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=4 2024-09-12T00:30:15.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=5 2024-09-12T00:30:15.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=6 2024-09-12T00:30:15.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 20 add_watcher() i=7 2024-09-12T00:30:15.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.133+0000 7f713563e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:15.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f6fe9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:15.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:15.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:15.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 5 note: GC not initialized 2024-09-12T00:30:15.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f6fe8fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:15.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:15.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 20 Filter name: none 2024-09-12T00:30:15.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f6f627fc640 20 reqs_thread_entry: start 2024-09-12T00:30:15.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:30:15.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:15.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:30:15.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:30:15.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 : miss 2024-09-12T00:30:15.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.141+0000 7f713563e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:15.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.145+0000 7f713563e9c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:15.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.145+0000 7f713563e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:15.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.145+0000 7f713563e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:15.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.145+0000 7f713563e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:15.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.145+0000 7f713563e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:15.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.145+0000 7f713563e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 2024-09-12T00:30:15.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.145+0000 7f713563e9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to be held by another RGW process; skipping for now 2024-09-12T00:30:15.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.149+0000 7f6fe9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:15.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.153+0000 7f713563e9c0 20 remove_watcher() i=0 2024-09-12T00:30:15.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.153+0000 7f713563e9c0 2 removed watcher, disabling cache 2024-09-12T00:30:15.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.157+0000 7f713563e9c0 20 remove_watcher() i=1 2024-09-12T00:30:15.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.157+0000 7f713563e9c0 20 remove_watcher() i=2 2024-09-12T00:30:15.158 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.161+0000 7f713563e9c0 20 remove_watcher() i=3 2024-09-12T00:30:15.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.161+0000 7f713563e9c0 20 remove_watcher() i=4 2024-09-12T00:30:15.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.165+0000 7f713563e9c0 20 remove_watcher() i=5 2024-09-12T00:30:15.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.169+0000 7f713563e9c0 20 remove_watcher() i=6 2024-09-12T00:30:15.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:15.173+0000 7f713563e9c0 20 remove_watcher() i=7 2024-09-12T00:30:15.187 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:30:45.218 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-set-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:30:45.254 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:45.254 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:45.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.300+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 realm 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:45.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.304+0000 7f79605769c0 20 searching for the correct realm 2024-09-12T00:30:45.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.312+0000 7f795e87d640 0 -- 172.21.15.78:0/2348752413 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f795003c920 msgr2=0x7f795001a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:45.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.528+0000 7f795e07c640 0 -- 172.21.15.78:0/2348752413 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ee2a9ba200 msgr2=0x55ee2a9bc670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:45.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:45.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:45.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 zone default found 2024-09-12T00:30:45.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 4 Realm: () 2024-09-12T00:30:45.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:45.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:45.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:45.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 zonegroup default 2024-09-12T00:30:45.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.540+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.544+0000 7f79605769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.544+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.544+0000 7f79605769c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.544+0000 7f79605769c0 20 started sync module instance, tier type = 2024-09-12T00:30:45.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.544+0000 7f79605769c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:45.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.564+0000 7f79605769c0 20 add_watcher() i=0 2024-09-12T00:30:45.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.564+0000 7f79605769c0 20 add_watcher() i=1 2024-09-12T00:30:45.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.564+0000 7f79605769c0 20 add_watcher() i=2 2024-09-12T00:30:45.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.564+0000 7f79605769c0 20 add_watcher() i=3 2024-09-12T00:30:45.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.564+0000 7f79605769c0 20 add_watcher() i=4 2024-09-12T00:30:45.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.564+0000 7f79605769c0 20 add_watcher() i=5 2024-09-12T00:30:45.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.564+0000 7f79605769c0 20 add_watcher() i=6 2024-09-12T00:30:45.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.568+0000 7f79605769c0 20 add_watcher() i=7 2024-09-12T00:30:45.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.568+0000 7f79605769c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:45.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.572+0000 7f7814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.572+0000 7f79605769c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.572+0000 7f79605769c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:45.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.572+0000 7f79605769c0 5 note: GC not initialized 2024-09-12T00:30:45.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f778f7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:45.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:45.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 20 Filter name: none 2024-09-12T00:30:45.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f778d7fa640 20 reqs_thread_entry: start 2024-09-12T00:30:45.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 cache get: name=default.rgw.meta+root+abort-at-set-target-layout : miss 2024-09-12T00:30:45.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:45.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 cache put: name=default.rgw.meta+root+abort-at-set-target-layout info.flags=0x11 2024-09-12T00:30:45.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 adding default.rgw.meta+root+abort-at-set-target-layout to cache LRU end 2024-09-12T00:30:45.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 : miss 2024-09-12T00:30:45.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:45.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:45.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:45.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:45.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:45.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.576+0000 7f79605769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 2024-09-12T00:30:45.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.588+0000 7f79605769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:45.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.588+0000 7f79605769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:45.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.588+0000 7f79605769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:45.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.588+0000 7f79605769c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24, ofs0, ns] 2024-09-12T00:30:45.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f7841ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398954 cookie 94481405484320 notifier 6705 bl.length()=925 2024-09-12T00:30:45.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f7841ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:45.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f7841ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:45.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f7841ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:45.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): orig_sources= new_sources= 2024-09-12T00:30:45.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): potential sources added=[] removed=[] 2024-09-12T00:30:45.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): orig_dests= new_dests= 2024-09-12T00:30:45.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.592+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): potential dests added=[] removed=[] 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.0 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.0 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.1 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.1 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.2 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.2 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.3 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.3 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.4 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.4 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.5 2024-09-12T00:30:45.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.5 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.6 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.6 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.7 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.7 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.8 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.8 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.9 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.9 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.10 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.10 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.11 2024-09-12T00:30:45.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1.11 2024-09-12T00:30:45.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.0 2024-09-12T00:30:45.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.604+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1 2024-09-12T00:30:45.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.608+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.2 2024-09-12T00:30:45.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.608+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.3 2024-09-12T00:30:45.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.608+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.4 2024-09-12T00:30:45.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.612+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.5 2024-09-12T00:30:45.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.612+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.6 2024-09-12T00:30:45.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.612+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.7 2024-09-12T00:30:45.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.616+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.8 2024-09-12T00:30:45.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.616+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.9 2024-09-12T00:30:45.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.616+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.10 2024-09-12T00:30:45.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.624+0000 7f79605769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:45.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.624+0000 7f79605769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24, ofs0, ns] 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f7841ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398955 cookie 94481405484320 notifier 6705 bl.length()=925 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f7841ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f7841ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:45.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f7841ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:45.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): orig_sources= new_sources= 2024-09-12T00:30:45.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): potential sources added=[] removed=[] 2024-09-12T00:30:45.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): orig_dests= new_dests= 2024-09-12T00:30:45.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.628+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): potential dests added=[] removed=[] 2024-09-12T00:30:45.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.636+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.0 2024-09-12T00:30:45.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.636+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.1 2024-09-12T00:30:45.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.636+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.2 2024-09-12T00:30:45.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.636+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.3 2024-09-12T00:30:45.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.636+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.4 2024-09-12T00:30:45.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.640+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.5 2024-09-12T00:30:45.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.640+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.6 2024-09-12T00:30:45.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.640+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.7 2024-09-12T00:30:45.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.640+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.8 2024-09-12T00:30:45.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.644+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.9 2024-09-12T00:30:45.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.644+0000 7f79605769c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24.10 2024-09-12T00:30:45.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.644+0000 7f79605769c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:45.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.644+0000 7f79605769c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 2024-09-12T00:30:45.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.644+0000 7f79605769c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:45.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f79605769c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:45.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f79605769c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f79605769c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24, ofs0, ns] 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f7841ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398956 cookie 94481405484320 notifier 6705 bl.length()=893 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f7841ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 info.flags=0x17 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f7841ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-set-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 to cache LRU end 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f7841ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): orig_sources= new_sources= 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): potential sources added=[] removed=[] 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): orig_dests= new_dests= 2024-09-12T00:30:45.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.648+0000 7f79605769c0 20 handle_bi_update(): bucket=:abort-at-set-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24]): potential dests added=[] removed=[] 2024-09-12T00:30:45.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.652+0000 7f79605769c0 1 execute INFO: reshard of bucket "abort-at-set-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:30:45.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.656+0000 7f7814fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:45.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.664+0000 7f79605769c0 20 remove_watcher() i=0 2024-09-12T00:30:45.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.664+0000 7f79605769c0 2 removed watcher, disabling cache 2024-09-12T00:30:45.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.664+0000 7f79605769c0 20 remove_watcher() i=1 2024-09-12T00:30:45.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.668+0000 7f79605769c0 20 remove_watcher() i=2 2024-09-12T00:30:45.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.668+0000 7f79605769c0 20 remove_watcher() i=3 2024-09-12T00:30:45.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.672+0000 7f79605769c0 20 remove_watcher() i=4 2024-09-12T00:30:45.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.672+0000 7f79605769c0 20 remove_watcher() i=5 2024-09-12T00:30:45.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.676+0000 7f79605769c0 20 remove_watcher() i=6 2024-09-12T00:30:45.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.676+0000 7f79605769c0 20 remove_watcher() i=7 2024-09-12T00:30:45.696 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-set-target-layout 2024-09-12T00:30:45.725 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:45.726 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:45.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.772+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.772+0000 7f8bf37c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.772+0000 7f8bf37c19c0 20 realm 2024-09-12T00:30:45.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.772+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:45.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:45.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:45.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:45.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:45.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.776+0000 7f8bf37c19c0 20 searching for the correct realm 2024-09-12T00:30:45.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.780+0000 7f8bf1ac8640 0 -- 172.21.15.78:0/2681496931 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f8be4065b10 msgr2=0x7f8be4031a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:45.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:45.992+0000 7f8bf1ac8640 0 -- 172.21.15.78:0/2681496931 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559c842bb2d0 msgr2=0x559c842bd760 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:46.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:46.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:46.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:46.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:46.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:46.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:46.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:46.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.004+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 zone default found 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 4 Realm: () 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 zonegroup default 2024-09-12T00:30:46.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 started sync module instance, tier type = 2024-09-12T00:30:46.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.008+0000 7f8bf37c19c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:46.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.032+0000 7f8bf37c19c0 20 add_watcher() i=0 2024-09-12T00:30:46.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.032+0000 7f8bf37c19c0 20 add_watcher() i=1 2024-09-12T00:30:46.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.032+0000 7f8bf37c19c0 20 add_watcher() i=2 2024-09-12T00:30:46.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.032+0000 7f8bf37c19c0 20 add_watcher() i=3 2024-09-12T00:30:46.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.032+0000 7f8bf37c19c0 20 add_watcher() i=4 2024-09-12T00:30:46.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.032+0000 7f8bf37c19c0 20 add_watcher() i=5 2024-09-12T00:30:46.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.032+0000 7f8bf37c19c0 20 add_watcher() i=6 2024-09-12T00:30:46.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.036+0000 7f8bf37c19c0 20 add_watcher() i=7 2024-09-12T00:30:46.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.036+0000 7f8bf37c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:46.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8aa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:46.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:46.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:46.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 5 note: GC not initialized 2024-09-12T00:30:46.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8aa67e4640 20 reqs_thread_entry: start 2024-09-12T00:30:46.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:46.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 20 Filter name: none 2024-09-12T00:30:46.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8a17fff640 20 reqs_thread_entry: start 2024-09-12T00:30:46.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:46.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.040+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.044+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:46.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.044+0000 7f8bf37c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:46.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.044+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.044+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=194 2024-09-12T00:30:46.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.044+0000 7f8bf37c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.044+0000 7f8bf37c19c0 20 rados_obj.operate() r=0 bl.length=416 2024-09-12T00:30:46.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.044+0000 7f8bf37c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:46.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.048+0000 7f8aa77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:46.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.052+0000 7f8bf37c19c0 20 remove_watcher() i=0 2024-09-12T00:30:46.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.052+0000 7f8bf37c19c0 2 removed watcher, disabling cache 2024-09-12T00:30:46.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.056+0000 7f8bf37c19c0 20 remove_watcher() i=1 2024-09-12T00:30:46.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.056+0000 7f8bf37c19c0 20 remove_watcher() i=2 2024-09-12T00:30:46.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.060+0000 7f8bf37c19c0 20 remove_watcher() i=3 2024-09-12T00:30:46.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.060+0000 7f8bf37c19c0 20 remove_watcher() i=4 2024-09-12T00:30:46.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.064+0000 7f8bf37c19c0 20 remove_watcher() i=5 2024-09-12T00:30:46.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.064+0000 7f8bf37c19c0 20 remove_watcher() i=6 2024-09-12T00:30:46.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.068+0000 7f8bf37c19c0 20 remove_watcher() i=7 2024-09-12T00:30:46.081 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:46.081 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:46.081 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-set-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.24 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:30:46.081 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:46.193 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at trim_reshard_log_entries 2024-09-12T00:30:46.194 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:46.601 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:30:46.634 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:46.635 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:46.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.680+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 realm 2024-09-12T00:30:46.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:46.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:46.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.684+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.688+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:46.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.688+0000 7fb58c66f9c0 20 searching for the correct realm 2024-09-12T00:30:46.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.692+0000 7fb58a976640 0 -- 172.21.15.78:0/2269499474 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fb57c0e1b60 msgr2=0x7fb57c12ba60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:46.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.700+0000 7fb58a175640 0 -- 172.21.15.78:0/2269499474 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55a6660e64e0 msgr2=0x55a6660e88d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:46.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:46.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:46.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:46.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:46.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:46.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:46.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:46.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:46.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 zone default found 2024-09-12T00:30:46.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 4 Realm: () 2024-09-12T00:30:46.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:46.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:46.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:46.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 zonegroup default 2024-09-12T00:30:46.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 started sync module instance, tier type = 2024-09-12T00:30:46.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.708+0000 7fb58c66f9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.728+0000 7fb58c66f9c0 20 add_watcher() i=0 2024-09-12T00:30:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.728+0000 7fb58c66f9c0 20 add_watcher() i=1 2024-09-12T00:30:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.728+0000 7fb58c66f9c0 20 add_watcher() i=2 2024-09-12T00:30:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.728+0000 7fb58c66f9c0 20 add_watcher() i=3 2024-09-12T00:30:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.728+0000 7fb58c66f9c0 20 add_watcher() i=4 2024-09-12T00:30:46.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.728+0000 7fb58c66f9c0 20 add_watcher() i=5 2024-09-12T00:30:46.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.728+0000 7fb58c66f9c0 20 add_watcher() i=6 2024-09-12T00:30:46.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.732+0000 7fb58c66f9c0 20 add_watcher() i=7 2024-09-12T00:30:46.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.732+0000 7fb58c66f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb440fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 5 note: GC not initialized 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb3bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 Filter name: none 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb3b97fa640 20 reqs_thread_entry: start 2024-09-12T00:30:46.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:46.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:46.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:46.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:46.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.736+0000 7fb58c66f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.740+0000 7fb58c66f9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:46.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.740+0000 7fb58c66f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:46.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.740+0000 7fb440fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:46.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.744+0000 7fb58c66f9c0 20 remove_watcher() i=0 2024-09-12T00:30:46.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.744+0000 7fb58c66f9c0 2 removed watcher, disabling cache 2024-09-12T00:30:46.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.748+0000 7fb58c66f9c0 20 remove_watcher() i=1 2024-09-12T00:30:46.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.748+0000 7fb58c66f9c0 20 remove_watcher() i=2 2024-09-12T00:30:46.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.752+0000 7fb58c66f9c0 20 remove_watcher() i=3 2024-09-12T00:30:46.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.756+0000 7fb58c66f9c0 20 remove_watcher() i=4 2024-09-12T00:30:46.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.756+0000 7fb58c66f9c0 20 remove_watcher() i=5 2024-09-12T00:30:46.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.760+0000 7fb58c66f9c0 20 remove_watcher() i=6 2024-09-12T00:30:46.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.764+0000 7fb58c66f9c0 20 remove_watcher() i=7 2024-09-12T00:30:46.776 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:46.776 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:46.776 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:46.776 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:46.776 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries 2024-09-12T00:30:46.808 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:46.808 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:46.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.852+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 realm 2024-09-12T00:30:46.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:46.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:46.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:46.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:46.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:46.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.856+0000 7fb6489f99c0 20 searching for the correct realm 2024-09-12T00:30:46.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:46.864+0000 7fb646d00640 0 -- 172.21.15.78:0/2808426029 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fb638008070 msgr2=0x7fb638089820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:47.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.076+0000 7fb6464ff640 0 -- 172.21.15.78:0/2808426029 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55fe00993650 msgr2=0x55fe00995af0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:47.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.088+0000 7fb6489f99c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.088+0000 7fb6489f99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.088+0000 7fb6489f99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.088+0000 7fb6489f99c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.088+0000 7fb6489f99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.088+0000 7fb6489f99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.088+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:47.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 zone default found 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 4 Realm: () 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 zonegroup default 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.092+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.096+0000 7fb6489f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.096+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.096+0000 7fb6489f99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.096+0000 7fb6489f99c0 20 started sync module instance, tier type = 2024-09-12T00:30:47.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.096+0000 7fb6489f99c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:47.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=0 2024-09-12T00:30:47.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=1 2024-09-12T00:30:47.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=2 2024-09-12T00:30:47.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=3 2024-09-12T00:30:47.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=4 2024-09-12T00:30:47.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=5 2024-09-12T00:30:47.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=6 2024-09-12T00:30:47.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 20 add_watcher() i=7 2024-09-12T00:30:47.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.120+0000 7fb6489f99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:47.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.124+0000 7fb4fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:47.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.124+0000 7fb6489f99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:47.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.124+0000 7fb6489f99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:47.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.124+0000 7fb6489f99c0 5 note: GC not initialized 2024-09-12T00:30:47.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb4f77fe640 20 reqs_thread_entry: start 2024-09-12T00:30:47.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:47.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 20 Filter name: none 2024-09-12T00:30:47.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb4f57fa640 20 reqs_thread_entry: start 2024-09-12T00:30:47.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:30:47.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:47.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:30:47.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:30:47.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 : miss 2024-09-12T00:30:47.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:47.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:47.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:47.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:47.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:47.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.128+0000 7fb6489f99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 2024-09-12T00:30:47.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:47.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:47.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:47.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25, ofs0, ns] 2024-09-12T00:30:47.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb5297fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94549420164000 notifier 6374 bl.length()=939 2024-09-12T00:30:47.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb5297fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:47.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb5297fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:47.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb5297fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:47.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_sources= new_sources= 2024-09-12T00:30:47.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential sources added=[] removed=[] 2024-09-12T00:30:47.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_dests= new_dests= 2024-09-12T00:30:47.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential dests added=[] removed=[] 2024-09-12T00:30:47.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 -1 Injecting error=-5 at location=trim_reshard_log_entries 2024-09-12T00:30:47.141 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.140+0000 7fb6489f99c0 0 ERROR: init_reshard failed to trim reshard log entries: (5) Input/output error 2024-09-12T00:30:47.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.144+0000 7fb4fd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:47.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.148+0000 7fb6489f99c0 20 remove_watcher() i=0 2024-09-12T00:30:47.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.148+0000 7fb6489f99c0 2 removed watcher, disabling cache 2024-09-12T00:30:47.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.152+0000 7fb6489f99c0 20 remove_watcher() i=1 2024-09-12T00:30:47.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.152+0000 7fb6489f99c0 20 remove_watcher() i=2 2024-09-12T00:30:47.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.156+0000 7fb6489f99c0 20 remove_watcher() i=3 2024-09-12T00:30:47.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.156+0000 7fb6489f99c0 20 remove_watcher() i=4 2024-09-12T00:30:47.159 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.160+0000 7fb6489f99c0 20 remove_watcher() i=5 2024-09-12T00:30:47.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.164+0000 7fb6489f99c0 20 remove_watcher() i=6 2024-09-12T00:30:47.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.164+0000 7fb6489f99c0 20 remove_watcher() i=7 2024-09-12T00:30:47.179 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:30:47.210 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:47.210 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:47.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 realm 2024-09-12T00:30:47.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:47.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.256+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.260+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:47.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.260+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.260+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:47.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.260+0000 7f5401a8d9c0 20 searching for the correct realm 2024-09-12T00:30:47.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.264+0000 7f53ffd94640 0 -- 172.21.15.78:0/3670939365 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f53f000a980 msgr2=0x7f53f0038420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:47.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.476+0000 7f53ff593640 0 -- 172.21.15.78:0/3670939365 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5632033483d0 msgr2=0x56320334a7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:47.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:47.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:47.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:47.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:47.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:47.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:47.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.488+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:47.489 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 zone default found 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 4 Realm: () 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 zonegroup default 2024-09-12T00:30:47.491 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.492 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.492+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.496+0000 7f5401a8d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.496+0000 7f5401a8d9c0 20 started sync module instance, tier type = 2024-09-12T00:30:47.493 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.496+0000 7f5401a8d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:47.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.516+0000 7f5401a8d9c0 20 add_watcher() i=0 2024-09-12T00:30:47.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.516+0000 7f5401a8d9c0 20 add_watcher() i=1 2024-09-12T00:30:47.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.516+0000 7f5401a8d9c0 20 add_watcher() i=2 2024-09-12T00:30:47.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.516+0000 7f5401a8d9c0 20 add_watcher() i=3 2024-09-12T00:30:47.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.516+0000 7f5401a8d9c0 20 add_watcher() i=4 2024-09-12T00:30:47.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.516+0000 7f5401a8d9c0 20 add_watcher() i=5 2024-09-12T00:30:47.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.516+0000 7f5401a8d9c0 20 add_watcher() i=6 2024-09-12T00:30:47.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.520+0000 7f5401a8d9c0 20 add_watcher() i=7 2024-09-12T00:30:47.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.520+0000 7f5401a8d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:47.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f52b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:47.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f5401a8d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:47.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f5401a8d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:47.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f5401a8d9c0 5 note: GC not initialized 2024-09-12T00:30:47.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f52b4fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:47.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f5401a8d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:47.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f5401a8d9c0 20 Filter name: none 2024-09-12T00:30:47.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f522e7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:47.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.524+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:47.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:30:47.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:47.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:47.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:30:47.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.528+0000 7f5401a8d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:47.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.532+0000 7f52b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:47.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.536+0000 7f5401a8d9c0 20 remove_watcher() i=0 2024-09-12T00:30:47.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.536+0000 7f5401a8d9c0 2 removed watcher, disabling cache 2024-09-12T00:30:47.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.540+0000 7f5401a8d9c0 20 remove_watcher() i=1 2024-09-12T00:30:47.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.540+0000 7f5401a8d9c0 20 remove_watcher() i=2 2024-09-12T00:30:47.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.544+0000 7f5401a8d9c0 20 remove_watcher() i=3 2024-09-12T00:30:47.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.544+0000 7f5401a8d9c0 20 remove_watcher() i=4 2024-09-12T00:30:47.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.548+0000 7f5401a8d9c0 20 remove_watcher() i=5 2024-09-12T00:30:47.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.548+0000 7f5401a8d9c0 20 remove_watcher() i=6 2024-09-12T00:30:47.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.552+0000 7f5401a8d9c0 20 remove_watcher() i=7 2024-09-12T00:30:47.566 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:47.566 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:47.566 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:47.567 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:47.622 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:30:47.656 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:47.657 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:47.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 realm 2024-09-12T00:30:47.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:47.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.704+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.708+0000 7fafab4ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:47.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.708+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.708+0000 7fafab4ca9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:47.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.708+0000 7fafab4ca9c0 20 searching for the correct realm 2024-09-12T00:30:47.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.712+0000 7fafa97d1640 0 -- 172.21.15.78:0/342679267 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7faf980c9040 msgr2=0x7faf981037d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:47.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.924+0000 7fafa97d1640 0 -- 172.21.15.78:0/342679267 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5594fc1234d0 msgr2=0x5594fc125990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:47.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.936+0000 7fafab4ca9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:47.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.936+0000 7fafab4ca9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.936+0000 7fafab4ca9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.936+0000 7fafab4ca9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.936+0000 7fafab4ca9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.936+0000 7fafab4ca9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.936+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:47.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 zone default found 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 4 Realm: () 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 zonegroup default 2024-09-12T00:30:47.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.940+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.944+0000 7fafab4ca9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:47.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.944+0000 7fafab4ca9c0 20 started sync module instance, tier type = 2024-09-12T00:30:47.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.944+0000 7fafab4ca9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:47.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.964+0000 7fafab4ca9c0 20 add_watcher() i=0 2024-09-12T00:30:47.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.964+0000 7fafab4ca9c0 20 add_watcher() i=1 2024-09-12T00:30:47.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.964+0000 7fafab4ca9c0 20 add_watcher() i=2 2024-09-12T00:30:47.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.964+0000 7fafab4ca9c0 20 add_watcher() i=3 2024-09-12T00:30:47.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.964+0000 7fafab4ca9c0 20 add_watcher() i=4 2024-09-12T00:30:47.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.964+0000 7fafab4ca9c0 20 add_watcher() i=5 2024-09-12T00:30:47.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.964+0000 7fafab4ca9c0 20 add_watcher() i=6 2024-09-12T00:30:47.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.968+0000 7fafab4ca9c0 20 add_watcher() i=7 2024-09-12T00:30:47.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.968+0000 7fafab4ca9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:47.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fae5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:47.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fafab4ca9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:47.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fafab4ca9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:47.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fafab4ca9c0 5 note: GC not initialized 2024-09-12T00:30:47.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fae5dfe3640 20 reqs_thread_entry: start 2024-09-12T00:30:47.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fafab4ca9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:47.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fafab4ca9c0 20 Filter name: none 2024-09-12T00:30:47.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fadcf7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:47.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fafab4ca9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:30:47.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.972+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:47.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:30:47.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:30:47.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 : miss 2024-09-12T00:30:47.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:47.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:30:47.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:47.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:47.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:47.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:47.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 2024-09-12T00:30:47.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.976+0000 7fafab4ca9c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:30:47.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fafab4ca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:47.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fafab4ca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:47.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fafab4ca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:47.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fafab4ca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25, ofs0, ns] 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fae7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94098372641264 notifier 6407 bl.length()=939 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fae7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fae7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.992+0000 7fae7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.996+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_sources= new_sources= 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.996+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential sources added=[] removed=[] 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.996+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_dests= new_dests= 2024-09-12T00:30:47.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:47.996+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential dests added=[] removed=[] 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.0 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.0 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.1 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.1 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.2 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.2 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.3 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.3 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.4 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.4 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.5 2024-09-12T00:30:48.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.5 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.6 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.6 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.7 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.7 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.8 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.8 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.9 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.9 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.10 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.10 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.11 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2.11 2024-09-12T00:30:48.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.0 2024-09-12T00:30:48.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.1 2024-09-12T00:30:48.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.004+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2 2024-09-12T00:30:48.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.008+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.3 2024-09-12T00:30:48.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.008+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.4 2024-09-12T00:30:48.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.008+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.5 2024-09-12T00:30:48.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.008+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.6 2024-09-12T00:30:48.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.012+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.7 2024-09-12T00:30:48.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.012+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.8 2024-09-12T00:30:48.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.012+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.9 2024-09-12T00:30:48.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.012+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.10 2024-09-12T00:30:48.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.020+0000 7fafab4ca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:48.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.020+0000 7fafab4ca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 2024-09-12T00:30:48.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:48.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:48.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:48.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25, ofs0, ns] 2024-09-12T00:30:48.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fae7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94098372641264 notifier 6407 bl.length()=939 2024-09-12T00:30:48.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fae7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:48.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fae7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:48.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fae7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:48.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_sources= new_sources= 2024-09-12T00:30:48.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential sources added=[] removed=[] 2024-09-12T00:30:48.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_dests= new_dests= 2024-09-12T00:30:48.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.024+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential dests added=[] removed=[] 2024-09-12T00:30:48.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.028+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.0 2024-09-12T00:30:48.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.032+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.1 2024-09-12T00:30:48.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.032+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.2 2024-09-12T00:30:48.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.032+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.3 2024-09-12T00:30:48.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.032+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.4 2024-09-12T00:30:48.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.032+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.5 2024-09-12T00:30:48.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.032+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.6 2024-09-12T00:30:48.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.032+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.7 2024-09-12T00:30:48.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.036+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.8 2024-09-12T00:30:48.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.036+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.9 2024-09-12T00:30:48.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.036+0000 7fafab4ca9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25.10 2024-09-12T00:30:48.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.036+0000 7fafab4ca9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:48.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.036+0000 7fafab4ca9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 2024-09-12T00:30:48.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:48.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:48.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:48.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25, ofs0, ns] 2024-09-12T00:30:48.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fae7ffff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94098372641264 notifier 6407 bl.length()=907 2024-09-12T00:30:48.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fae7ffff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 info.flags=0x17 2024-09-12T00:30:48.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fae7ffff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 to cache LRU end 2024-09-12T00:30:48.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fae7ffff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:48.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_sources= new_sources= 2024-09-12T00:30:48.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential sources added=[] removed=[] 2024-09-12T00:30:48.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): orig_dests= new_dests= 2024-09-12T00:30:48.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.040+0000 7fafab4ca9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25]): potential dests added=[] removed=[] 2024-09-12T00:30:48.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.048+0000 7fafab4ca9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:30:48.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.052+0000 7fae5efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:48.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.056+0000 7fafab4ca9c0 20 remove_watcher() i=0 2024-09-12T00:30:48.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.056+0000 7fafab4ca9c0 2 removed watcher, disabling cache 2024-09-12T00:30:48.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.060+0000 7fafab4ca9c0 20 remove_watcher() i=1 2024-09-12T00:30:48.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.060+0000 7fafab4ca9c0 20 remove_watcher() i=2 2024-09-12T00:30:48.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.064+0000 7fafab4ca9c0 20 remove_watcher() i=3 2024-09-12T00:30:48.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.064+0000 7fafab4ca9c0 20 remove_watcher() i=4 2024-09-12T00:30:48.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.068+0000 7fafab4ca9c0 20 remove_watcher() i=5 2024-09-12T00:30:48.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.072+0000 7fafab4ca9c0 20 remove_watcher() i=6 2024-09-12T00:30:48.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.072+0000 7fafab4ca9c0 20 remove_watcher() i=7 2024-09-12T00:30:48.090 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:30:48.120 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:48.120 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:48.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.164+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 realm 2024-09-12T00:30:48.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:48.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:48.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.168+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.172+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:48.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.172+0000 7f7cc82529c0 20 searching for the correct realm 2024-09-12T00:30:48.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.176+0000 7f7cc6559640 0 -- 172.21.15.78:0/4215467218 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7cb806b7b0 msgr2=0x7f7cb8062020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:48.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.184+0000 7f7cc5d58640 0 -- 172.21.15.78:0/4215467218 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x556792366f60 msgr2=0x556792369350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:48.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:48.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:48.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:48.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:48.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:48.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:48.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:48.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.188+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:48.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 zone default found 2024-09-12T00:30:48.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 4 Realm: () 2024-09-12T00:30:48.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 zonegroup default 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 started sync module instance, tier type = 2024-09-12T00:30:48.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.192+0000 7f7cc82529c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:48.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=0 2024-09-12T00:30:48.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=1 2024-09-12T00:30:48.209 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=2 2024-09-12T00:30:48.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=3 2024-09-12T00:30:48.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=4 2024-09-12T00:30:48.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=5 2024-09-12T00:30:48.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=6 2024-09-12T00:30:48.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 20 add_watcher() i=7 2024-09-12T00:30:48.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.212+0000 7f7cc82529c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:48.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:48.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7cc82529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:48.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7cc82529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:48.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7cc82529c0 5 note: GC not initialized 2024-09-12T00:30:48.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7b767fc640 20 reqs_thread_entry: start 2024-09-12T00:30:48.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7cc82529c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:48.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7cc82529c0 20 Filter name: none 2024-09-12T00:30:48.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7ae7fff640 20 reqs_thread_entry: start 2024-09-12T00:30:48.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.216+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:48.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:48.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:48.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:48.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:48.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.220+0000 7f7cc82529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:48.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.224+0000 7f7b777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:48.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.228+0000 7f7cc82529c0 20 remove_watcher() i=0 2024-09-12T00:30:48.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.228+0000 7f7cc82529c0 2 removed watcher, disabling cache 2024-09-12T00:30:48.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.228+0000 7f7cc82529c0 20 remove_watcher() i=1 2024-09-12T00:30:48.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.232+0000 7f7cc82529c0 20 remove_watcher() i=2 2024-09-12T00:30:48.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.232+0000 7f7cc82529c0 20 remove_watcher() i=3 2024-09-12T00:30:48.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.236+0000 7f7cc82529c0 20 remove_watcher() i=4 2024-09-12T00:30:48.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.236+0000 7f7cc82529c0 20 remove_watcher() i=5 2024-09-12T00:30:48.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.240+0000 7f7cc82529c0 20 remove_watcher() i=6 2024-09-12T00:30:48.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.244+0000 7f7cc82529c0 20 remove_watcher() i=7 2024-09-12T00:30:48.256 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:48.256 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:48.257 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.25 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:30:48.257 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:48.372 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EOPNOTSUPP injected at trim_reshard_log_entries 2024-09-12T00:30:48.373 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:48.806 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:30:48.838 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:48.838 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:48.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.884+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 realm 2024-09-12T00:30:48.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:48.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:48.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.888+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.892+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:48.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.892+0000 7f4566f9a9c0 20 searching for the correct realm 2024-09-12T00:30:48.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.896+0000 7f45652a1640 0 -- 172.21.15.78:0/786897058 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f45540de3f0 msgr2=0x7f45540de850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:48.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.904+0000 7f4564aa0640 0 -- 172.21.15.78:0/786897058 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55d9380f4820 msgr2=0x55d9380f6c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:48.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:48.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:48.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:48.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:48.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:48.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 zone default found 2024-09-12T00:30:48.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 4 Realm: () 2024-09-12T00:30:48.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:48.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:48.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:48.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 zonegroup default 2024-09-12T00:30:48.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:48.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 started sync module instance, tier type = 2024-09-12T00:30:48.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.912+0000 7f4566f9a9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:48.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.932+0000 7f4566f9a9c0 20 add_watcher() i=0 2024-09-12T00:30:48.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.932+0000 7f4566f9a9c0 20 add_watcher() i=1 2024-09-12T00:30:48.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.932+0000 7f4566f9a9c0 20 add_watcher() i=2 2024-09-12T00:30:48.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.932+0000 7f4566f9a9c0 20 add_watcher() i=3 2024-09-12T00:30:48.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.932+0000 7f4566f9a9c0 20 add_watcher() i=4 2024-09-12T00:30:48.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.932+0000 7f4566f9a9c0 20 add_watcher() i=5 2024-09-12T00:30:48.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.932+0000 7f4566f9a9c0 20 add_watcher() i=6 2024-09-12T00:30:48.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.936+0000 7f4566f9a9c0 20 add_watcher() i=7 2024-09-12T00:30:48.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.936+0000 7f4566f9a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:48.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f441afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:48.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:48.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:48.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 5 note: GC not initialized 2024-09-12T00:30:48.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4419fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:48.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:48.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 Filter name: none 2024-09-12T00:30:48.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f438b7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:48.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:48.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:48.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:48.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.940+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.944+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:48.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.944+0000 7f4566f9a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:48.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.944+0000 7f4566f9a9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:48.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.944+0000 7f4566f9a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:48.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.944+0000 7f441afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:48.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.948+0000 7f4566f9a9c0 20 remove_watcher() i=0 2024-09-12T00:30:48.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.952+0000 7f4566f9a9c0 2 removed watcher, disabling cache 2024-09-12T00:30:48.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.952+0000 7f4566f9a9c0 20 remove_watcher() i=1 2024-09-12T00:30:48.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.952+0000 7f4566f9a9c0 20 remove_watcher() i=2 2024-09-12T00:30:48.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.956+0000 7f4566f9a9c0 20 remove_watcher() i=3 2024-09-12T00:30:48.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.956+0000 7f4566f9a9c0 20 remove_watcher() i=4 2024-09-12T00:30:48.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.960+0000 7f4566f9a9c0 20 remove_watcher() i=5 2024-09-12T00:30:48.962 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.964+0000 7f4566f9a9c0 20 remove_watcher() i=6 2024-09-12T00:30:48.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:48.968+0000 7f4566f9a9c0 20 remove_watcher() i=7 2024-09-12T00:30:48.980 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:48.980 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:48.980 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:48.981 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:48.981 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at trim_reshard_log_entries --inject-error-code 95 2024-09-12T00:30:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:49.016 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:49.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.272+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 realm 2024-09-12T00:30:49.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:49.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:49.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:49.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.276+0000 7f390c1cb9c0 20 searching for the correct realm 2024-09-12T00:30:49.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.280+0000 7f3909cd1640 0 -- 172.21.15.78:0/1076982229 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55f36756f420 msgr2=0x55f3675718e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:49.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.288+0000 7f39094d0640 0 -- 172.21.15.78:0/1076982229 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f38fc09c1a0 msgr2=0x7f38fc0721a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:49.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:49.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:49.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:49.505 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:49.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:49.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:49.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.506 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:49.507 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 zone default found 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 4 Realm: () 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 zonegroup default 2024-09-12T00:30:49.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.508+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.512+0000 7f390c1cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.512+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.512+0000 7f390c1cb9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.512+0000 7f390c1cb9c0 20 started sync module instance, tier type = 2024-09-12T00:30:49.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.512+0000 7f390c1cb9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=0 2024-09-12T00:30:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=1 2024-09-12T00:30:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=2 2024-09-12T00:30:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=3 2024-09-12T00:30:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=4 2024-09-12T00:30:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=5 2024-09-12T00:30:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=6 2024-09-12T00:30:49.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 20 add_watcher() i=7 2024-09-12T00:30:49.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.536+0000 7f390c1cb9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:49.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.540+0000 7f37bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:49.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:49.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:49.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 5 note: GC not initialized 2024-09-12T00:30:49.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f37befe5640 20 reqs_thread_entry: start 2024-09-12T00:30:49.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:49.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 Filter name: none 2024-09-12T00:30:49.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f37bcfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:49.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 cache get: name=default.rgw.meta+root+error-at-trim-reshard-log-entries : miss 2024-09-12T00:30:49.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:49.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 cache put: name=default.rgw.meta+root+error-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:30:49.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 adding default.rgw.meta+root+error-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:30:49.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 : miss 2024-09-12T00:30:49.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:49.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 info.flags=0x17 2024-09-12T00:30:49.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 to cache LRU end 2024-09-12T00:30:49.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:49.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:49.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.544+0000 7f390c1cb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 2024-09-12T00:30:49.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 info.flags=0x17 2024-09-12T00:30:49.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 to cache LRU end 2024-09-12T00:30:49.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:49.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26, ofs0, ns] 2024-09-12T00:30:49.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f37ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398884 cookie 94503899179376 notifier 6455 bl.length()=939 2024-09-12T00:30:49.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f37ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 info.flags=0x17 2024-09-12T00:30:49.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f37ed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 to cache LRU end 2024-09-12T00:30:49.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f37ed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:49.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): orig_sources= new_sources= 2024-09-12T00:30:49.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): potential sources added=[] removed=[] 2024-09-12T00:30:49.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): orig_dests= new_dests= 2024-09-12T00:30:49.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): potential dests added=[] removed=[] 2024-09-12T00:30:49.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 -1 Injecting error=-95 at location=trim_reshard_log_entries 2024-09-12T00:30:49.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.560+0000 7f390c1cb9c0 0 WARNING: trim_reshard_log_entries() does not supported logrecord, falling back to block reshard mode. 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.0 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.0 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.1 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.1 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.2 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.2 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.3 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.3 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.4 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.4 2024-09-12T00:30:49.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.5 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.5 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.6 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.6 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.7 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.7 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.8 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.8 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.9 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.9 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.10 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.10 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.11 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1.11 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.0 2024-09-12T00:30:49.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.1 2024-09-12T00:30:49.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.2 2024-09-12T00:30:49.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.568+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.3 2024-09-12T00:30:49.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.572+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.4 2024-09-12T00:30:49.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.572+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.5 2024-09-12T00:30:49.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.572+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.6 2024-09-12T00:30:49.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.572+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.7 2024-09-12T00:30:49.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.572+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.8 2024-09-12T00:30:49.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.576+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.9 2024-09-12T00:30:49.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.576+0000 7f390c1cb9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26.10 2024-09-12T00:30:49.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.584+0000 7f390c1cb9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 : hit (requested=0x17, cached=0x17) 2024-09-12T00:30:49.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.584+0000 7f390c1cb9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 2024-09-12T00:30:49.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 info.flags=0x17 2024-09-12T00:30:49.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 to cache LRU end 2024-09-12T00:30:49.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:49.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26, ofs0, ns] 2024-09-12T00:30:49.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f37ed7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398885 cookie 94503899179376 notifier 6455 bl.length()=907 2024-09-12T00:30:49.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f37ed7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 info.flags=0x17 2024-09-12T00:30:49.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f37ed7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 to cache LRU end 2024-09-12T00:30:49.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f37ed7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:49.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): orig_sources= new_sources= 2024-09-12T00:30:49.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): potential sources added=[] removed=[] 2024-09-12T00:30:49.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): orig_dests= new_dests= 2024-09-12T00:30:49.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.588+0000 7f390c1cb9c0 20 handle_bi_update(): bucket=:error-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26]): potential dests added=[] removed=[] 2024-09-12T00:30:49.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.592+0000 7f390c1cb9c0 1 execute INFO: reshard of bucket "error-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:30:49.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.596+0000 7f37bffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:49.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.600+0000 7f390c1cb9c0 20 remove_watcher() i=0 2024-09-12T00:30:49.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.600+0000 7f390c1cb9c0 2 removed watcher, disabling cache 2024-09-12T00:30:49.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.600+0000 7f390c1cb9c0 20 remove_watcher() i=1 2024-09-12T00:30:49.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.604+0000 7f390c1cb9c0 20 remove_watcher() i=2 2024-09-12T00:30:49.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.604+0000 7f390c1cb9c0 20 remove_watcher() i=3 2024-09-12T00:30:49.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.608+0000 7f390c1cb9c0 20 remove_watcher() i=4 2024-09-12T00:30:49.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.612+0000 7f390c1cb9c0 20 remove_watcher() i=5 2024-09-12T00:30:49.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.612+0000 7f390c1cb9c0 20 remove_watcher() i=6 2024-09-12T00:30:49.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.616+0000 7f390c1cb9c0 20 remove_watcher() i=7 2024-09-12T00:30:49.634 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-trim-reshard-log-entries 2024-09-12T00:30:49.661 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:49.662 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:49.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.704+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 realm 2024-09-12T00:30:49.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:49.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:49.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.708+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.712+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:49.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.712+0000 7fd22792d9c0 20 searching for the correct realm 2024-09-12T00:30:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.716+0000 7fd225c34640 0 -- 172.21.15.78:0/1324118987 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fd2181120b0 msgr2=0x7fd2181007d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:49.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.932+0000 7fd224c32640 0 -- 172.21.15.78:0/1324118987 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fd2180f9600 msgr2=0x7fd2180fe670 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:30:49.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:49.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:49.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:49.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:49.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:49.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:49.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:49.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.944+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 zone default found 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 4 Realm: () 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 zonegroup default 2024-09-12T00:30:49.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:49.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 started sync module instance, tier type = 2024-09-12T00:30:49.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.948+0000 7fd22792d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:49.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.976+0000 7fd22792d9c0 20 add_watcher() i=0 2024-09-12T00:30:49.976 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.976+0000 7fd22792d9c0 20 add_watcher() i=1 2024-09-12T00:30:49.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.976+0000 7fd22792d9c0 20 add_watcher() i=2 2024-09-12T00:30:49.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.976+0000 7fd22792d9c0 20 add_watcher() i=3 2024-09-12T00:30:49.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.976+0000 7fd22792d9c0 20 add_watcher() i=4 2024-09-12T00:30:49.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.976+0000 7fd22792d9c0 20 add_watcher() i=5 2024-09-12T00:30:49.977 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.976+0000 7fd22792d9c0 20 add_watcher() i=6 2024-09-12T00:30:49.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.980+0000 7fd22792d9c0 20 add_watcher() i=7 2024-09-12T00:30:49.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.980+0000 7fd22792d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:49.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd0db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:49.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:49.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:49.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 5 note: GC not initialized 2024-09-12T00:30:49.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd0da7e4640 20 reqs_thread_entry: start 2024-09-12T00:30:49.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:49.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 20 Filter name: none 2024-09-12T00:30:49.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd04bfff640 20 reqs_thread_entry: start 2024-09-12T00:30:49.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:49.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.984+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.988+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:49.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.988+0000 7fd22792d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:49.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.988+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.988+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:49.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.988+0000 7fd22792d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:49.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.988+0000 7fd22792d9c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:49.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.988+0000 7fd22792d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:49.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.992+0000 7fd0db7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:49.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.996+0000 7fd22792d9c0 20 remove_watcher() i=0 2024-09-12T00:30:49.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:49.996+0000 7fd22792d9c0 2 removed watcher, disabling cache 2024-09-12T00:30:49.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.000+0000 7fd22792d9c0 20 remove_watcher() i=1 2024-09-12T00:30:50.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.004+0000 7fd22792d9c0 20 remove_watcher() i=2 2024-09-12T00:30:50.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.004+0000 7fd22792d9c0 20 remove_watcher() i=3 2024-09-12T00:30:50.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.008+0000 7fd22792d9c0 20 remove_watcher() i=4 2024-09-12T00:30:50.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.012+0000 7fd22792d9c0 20 remove_watcher() i=5 2024-09-12T00:30:50.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.012+0000 7fd22792d9c0 20 remove_watcher() i=6 2024-09-12T00:30:50.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.016+0000 7fd22792d9c0 20 remove_watcher() i=7 2024-09-12T00:30:50.030 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:50.030 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:50.030 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.26 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:30:50.030 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:50.134 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at trim_reshard_log_entries 2024-09-12T00:30:50.134 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:30:50.581 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:50.581 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:50.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.628+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 20 realm 2024-09-12T00:30:50.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:50.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.632+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.636+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.636+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.636+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:50.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.636+0000 7fefa20c79c0 20 searching for the correct realm 2024-09-12T00:30:50.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.640+0000 7fefa03ce640 0 -- 172.21.15.78:0/112439840 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fef9011d0c0 msgr2=0x7fef900093d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:50.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.856+0000 7fef9fbcd640 0 -- 172.21.15.78:0/112439840 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x557118f600b0 msgr2=0x557118f62500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:50.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:50.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:50.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:50.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:50.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:50.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:50.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:50.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 zone default found 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 4 Realm: () 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 zonegroup default 2024-09-12T00:30:50.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.868+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.872+0000 7fefa20c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.872+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.872+0000 7fefa20c79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:50.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.872+0000 7fefa20c79c0 20 started sync module instance, tier type = 2024-09-12T00:30:50.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.872+0000 7fefa20c79c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:50.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.896+0000 7fefa20c79c0 20 add_watcher() i=0 2024-09-12T00:30:50.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.896+0000 7fefa20c79c0 20 add_watcher() i=1 2024-09-12T00:30:50.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.896+0000 7fefa20c79c0 20 add_watcher() i=2 2024-09-12T00:30:50.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.896+0000 7fefa20c79c0 20 add_watcher() i=3 2024-09-12T00:30:50.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.896+0000 7fefa20c79c0 20 add_watcher() i=4 2024-09-12T00:30:50.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.896+0000 7fefa20c79c0 20 add_watcher() i=5 2024-09-12T00:30:50.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.896+0000 7fefa20c79c0 20 add_watcher() i=6 2024-09-12T00:30:50.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.900+0000 7fefa20c79c0 20 add_watcher() i=7 2024-09-12T00:30:50.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.900+0000 7fefa20c79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:50.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fee55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:50.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:50.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:50.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 5 note: GC not initialized 2024-09-12T00:30:50.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fee54fe1640 20 reqs_thread_entry: start 2024-09-12T00:30:50.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:50.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 20 Filter name: none 2024-09-12T00:30:50.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fedce7fc640 20 reqs_thread_entry: start 2024-09-12T00:30:50.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:50.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.904+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.908+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:50.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.908+0000 7fefa20c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:50.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.908+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.908+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:50.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.908+0000 7fefa20c79c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:50.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.908+0000 7fefa20c79c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:50.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.908+0000 7fefa20c79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:50.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.912+0000 7fee55fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:50.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.920+0000 7fefa20c79c0 20 remove_watcher() i=0 2024-09-12T00:30:50.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.920+0000 7fefa20c79c0 2 removed watcher, disabling cache 2024-09-12T00:30:50.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.920+0000 7fefa20c79c0 20 remove_watcher() i=1 2024-09-12T00:30:50.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.924+0000 7fefa20c79c0 20 remove_watcher() i=2 2024-09-12T00:30:50.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.924+0000 7fefa20c79c0 20 remove_watcher() i=3 2024-09-12T00:30:50.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.928+0000 7fefa20c79c0 20 remove_watcher() i=4 2024-09-12T00:30:50.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.928+0000 7fefa20c79c0 20 remove_watcher() i=5 2024-09-12T00:30:50.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.932+0000 7fefa20c79c0 20 remove_watcher() i=6 2024-09-12T00:30:50.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:50.936+0000 7fefa20c79c0 20 remove_watcher() i=7 2024-09-12T00:30:50.950 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:50.950 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:50.950 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:50.950 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:50.951 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at trim_reshard_log_entries 2024-09-12T00:30:50.988 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:50.989 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:51.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.032+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 realm 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.040+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.040+0000 7f1e271849c0 20 searching for the correct realm 2024-09-12T00:30:51.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.044+0000 7f1e2548b640 0 -- 172.21.15.78:0/3261804567 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1e18045400 msgr2=0x7f1e18045880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.256+0000 7f1e24c8a640 0 -- 172.21.15.78:0/3261804567 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5616114940d0 msgr2=0x561611496530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:51.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:51.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:51.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:51.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:51.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:51.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.268+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:51.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 zone default found 2024-09-12T00:30:51.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 4 Realm: () 2024-09-12T00:30:51.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:51.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:51.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:51.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 zonegroup default 2024-09-12T00:30:51.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.276+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.276+0000 7f1e271849c0 20 started sync module instance, tier type = 2024-09-12T00:30:51.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.276+0000 7f1e271849c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=0 2024-09-12T00:30:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=1 2024-09-12T00:30:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=2 2024-09-12T00:30:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=3 2024-09-12T00:30:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=4 2024-09-12T00:30:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=5 2024-09-12T00:30:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=6 2024-09-12T00:30:51.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.300+0000 7f1e271849c0 20 add_watcher() i=7 2024-09-12T00:30:51.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.300+0000 7f1e271849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:51.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.304+0000 7f1cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.304+0000 7f1e271849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:51.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.304+0000 7f1e271849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:51.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 5 note: GC not initialized 2024-09-12T00:30:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1cd9fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 20 Filter name: none 2024-09-12T00:30:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1c4b7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:30:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:30:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:30:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 : miss 2024-09-12T00:30:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:51.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:51.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.308+0000 7f1e271849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 2024-09-12T00:30:51.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27, ofs0, ns] 2024-09-12T00:30:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398959 cookie 94652779347792 notifier 6503 bl.length()=939 2024-09-12T00:30:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_sources= new_sources= 2024-09-12T00:30:51.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential sources added=[] removed=[] 2024-09-12T00:30:51.321 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271849c0 time 2024-09-12T00:30:51.325286+0000 2024-09-12T00:30:51.321 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:51.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_dests= new_dests= 2024-09-12T00:30:51.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential dests added=[] removed=[] 2024-09-12T00:30:51.323 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.323 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1e2aa5e2eb] 2024-09-12T00:30:51.323 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f1e271849c0 thread_name:radosgw-admin 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.324+0000 7f1e271849c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271849c0 time 2024-09-12T00:30:51.325286+0000 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1e2aa5e2eb] 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.325 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:51.326 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.326 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:51.326 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:51.326 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.327 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.327 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1e298dd520] 2024-09-12T00:30:51.327 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:51.327 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:51.327 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1e2aa5e345] 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:51.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.328+0000 7f1e271849c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f1e271849c0 thread_name:radosgw-admin 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1e298dd520] 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1e2aa5e345] 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.330 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:30:51.367 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_done global_id 6900 payload 274 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: dump: 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.368 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: dump: 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.369 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.370 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.370 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.370 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.370 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.370 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.370 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.370 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6900 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:30:51.012+0000 7f1e271849c0 4 set_mon_vals no callback set 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: shutdown 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 asok(0x56161119d2b0) unregister_commands rotate-key 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.371 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.372 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.372 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.372 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.372 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.372 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.372 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding auth protocol: cephx 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding auth protocol: cephx 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding auth protocol: cephx 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.373 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:30:51.012+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: starting msgr at 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: starting objecter 2024-09-12T00:30:51.374 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command objecter_requests hook 0x561611190b70 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: setting wanted keys 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: calling monclient init 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding auth protocol: cephx 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding auth protocol: cephx 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding auth protocol: cephx 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.375 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:30:51.012+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:30:51.012+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key hook 0x5616113a7d78 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x561611258300 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x561611261bf0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.376 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x561611263850 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.351916s 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request con 0x561611258300 auth_method 0 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x561611263850 auth_method 0 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.377 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x561611261bf0 auth_method 0 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_done global_id 6903 payload 824 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:30:51.016+0000 7f1e2548b640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.378 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: dump: 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.379 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:30:51.016+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6903 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.380 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: dump: 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.381 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:30:51.016+0000 7f1d12e05640 4 set_mon_vals no callback set 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:30:51.016+0000 7f1e271849c0 1 librados: init done 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:30:51.016+0000 7f1d11602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:30:51.016+0000 7f1d11602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:30:51.016+0000 7f1d11602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x7f1d0c070b10 auth_method 0 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x5616113d2d90 auth_method 0 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:30:51.020+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x5616113f2630 auth_method 0 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:30:51.020+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x5616113f6cd0 auth_method 0 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:30:51.020+0000 7f1e2548b640 10 monclient: get_auth_request con 0x5616113faba0 auth_method 0 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.382 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:30:51.024+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding auth protocol: cephx 2024-09-12T00:30:51.383 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding auth protocol: cephx 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding auth protocol: cephx 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.384 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:30:51.024+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561611402700 EEXIST 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding auth protocol: cephx 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding auth protocol: cephx 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding auth protocol: cephx 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.385 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:30:51.024+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:30:51.024+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key cmddesc rotate-key hook 0x5616113fdd10 EEXIST 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x5616114268b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x5616114261e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x561611424bc0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.386 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.387 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.387 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.387 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.361995s 2024-09-12T00:30:51.387 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x5616114268b0 auth_method 0 2024-09-12T00:30:51.387 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.387 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.388 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.388 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request con 0x561611424bc0 auth_method 0 2024-09-12T00:30:51.388 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.388 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.388 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.388 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.388 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x5616114261e0 auth_method 0 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_done global_id 6906 payload 824 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.389 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.390 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.391 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6906 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:30:51.024+0000 7f1e25c8c640 4 set_mon_vals no callback set 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:30:51.028+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:30:51.028+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:30:51.028+0000 7f1d0a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient: get_auth_request con 0x7f1cfc070a20 auth_method 0 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: get_monmap_and_config 2024-09-12T00:30:51.392 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:30:51.028+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.393 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding auth protocol: cephx 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding auth protocol: cephx 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding auth protocol: cephx 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.394 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:30:51.028+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding auth protocol: cephx 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding auth protocol: cephx 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding auth protocol: cephx 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.395 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.396 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:30:51.028+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:30:51.028+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd105edb68 EEXIST 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x56161147a6f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x56161144a110 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x561611475ec0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.397 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.366445s 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x56161147a6f0 auth_method 0 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.398 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x56161144a110 auth_method 0 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.399 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_done global_id 6500 payload 274 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:30:51.028+0000 7f1e2548b640 1 monclient: found mon.noname-c 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.400 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.401 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.402 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6500 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:30:51.028+0000 7f1e271849c0 4 set_mon_vals no callback set 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: shutdown 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.403 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding auth protocol: cephx 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding auth protocol: cephx 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding auth protocol: cephx 2024-09-12T00:30:51.404 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:30:51.032+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.405 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: starting msgr at 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: starting objecter 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561611449e80 EEXIST 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: setting wanted keys 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: calling monclient init 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding auth protocol: cephx 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding auth protocol: cephx 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding auth protocol: cephx 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.406 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:30:51.032+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:30:51.032+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key cmddesc rotate-key hook 0x561611428818 EEXIST 2024-09-12T00:30:51.407 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x56161144a110 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x561611475ec0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x56161147a6f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.369180s 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x561611475ec0 auth_method 0 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.408 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x56161144a110 auth_method 0 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.409 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:30:51.032+0000 7f1e2548b640 1 monclient: found mon.noname-c 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.410 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.411 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.412 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:51.412 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T00:30:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.412 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.413 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:30:51.032+0000 7f1cfbfff640 4 set_mon_vals no callback set 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6503 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.414 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.415 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: init done 2024-09-12T00:30:51.415 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cr dump hook 0x56161146bbd8 2024-09-12T00:30:51.415 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:30:51.032+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.415 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.415 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.415 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.415 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:30:51.036+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x7f1cf0070b10 auth_method 0 2024-09-12T00:30:51.416 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:30:51.036+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x5616114940d0 auth_method 0 2024-09-12T00:30:51.416 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.416 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 realm 2024-09-12T00:30:51.416 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.416 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.416 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:30:51.036+0000 7f1e271849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:30:51.036+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x561611498250 auth_method 0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:30:51.040+0000 7f1e2548b640 10 monclient: get_auth_request con 0x56161149bb40 auth_method 0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:30:51.040+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:30:51.040+0000 7f1e271849c0 20 searching for the correct realm 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:30:51.040+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x5616114a08c0 auth_method 0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:30:51.040+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x7f1e18028040 auth_method 0 2024-09-12T00:30:51.417 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:30:51.044+0000 7f1e2548b640 0 -- 172.21.15.78:0/3261804567 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1e18045400 msgr2=0x7f1e18045880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:30:51.248+0000 7f1e2548b640 10 monclient: get_auth_request con 0x7f1e18045400 auth_method 0 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:30:51.252+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x7f1e10063e90 auth_method 0 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:30:51.256+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x7f1e1800d3e0 auth_method 0 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:30:51.256+0000 7f1e24c8a640 0 -- 172.21.15.78:0/3261804567 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5616114940d0 msgr2=0x561611496530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:30:51.256+0000 7f1cfa7fc640 1 client.6503.objecter ms_handle_reset 0x5616114940d0 session 0x561611493a50 osd.6 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:30:51.256+0000 7f1cfa7fc640 10 monclient: _renew_subs 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:30:51.256+0000 7f1cfa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.418 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:30:51.260+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x7f1cf0080dc0 auth_method 0 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.419 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 zone default found 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:30:51.272+0000 7f1e271849c0 4 Realm: () 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:30:51.272+0000 7f1e271849c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:30:51.272+0000 7f1e271849c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:30:51.272+0000 7f1e271849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 zonegroup default 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.420 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:30:51.276+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:30:51.276+0000 7f1e271849c0 20 started sync module instance, tier type = 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:30:51.276+0000 7f1e271849c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=0 2024-09-12T00:30:51.421 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=1 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=2 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=3 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=4 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=5 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=6 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:30:51.300+0000 7f1e271849c0 20 add_watcher() i=7 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:30:51.300+0000 7f1e271849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding auth protocol: cephx 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding auth protocol: cephx 2024-09-12T00:30:51.422 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding auth protocol: cephx 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.423 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:30:51.304+0000 7f1cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:30:51.304+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:30:51.304+0000 7f1e271849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:30:51.304+0000 7f1e271849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache list hook 0x5616114706f0 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache inspect hook 0x5616114706f0 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache erase hook 0x5616114706f0 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache zap hook 0x5616114706f0 2024-09-12T00:30:51.424 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 note: GC not initialized 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:30:51.308+0000 7f1cd9fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace show hook 0x7f1e20004910 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace history hook 0x7f1e20004910 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace active hook 0x7f1e20004910 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace active_short hook 0x7f1e20004910 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 Filter name: none 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:30:51.308+0000 7f1c4b7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:51.425 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 : miss 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27, ofs0, ns] 2024-09-12T00:30:51.426 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398959 cookie 94652779347792 notifier 6503 bl.length()=939 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_sources= new_sources= 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential sources added=[] removed=[] 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_dests= new_dests= 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential dests added=[] removed=[] 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:30:51.324+0000 7f1e271849c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271849c0 time 2024-09-12T00:30:51.325286+0000 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.427 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1e2aa5e2eb] 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:30:51.328+0000 7f1e271849c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:51.428 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f1e271849c0 thread_name:radosgw-admin 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1e298dd520] 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1e2aa5e345] 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.429 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:30:51.430 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:30:51.431 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:30:51.432 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:51.433 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:30:51.434 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:30:51.435 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:51.436 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:51.437 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1c4b7fe640 / http_manager 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cd9fe3640 / http_manager 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cdafe5640 / rgw_dt_lg_renew 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cfa7fc640 / ms_dispatch 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cfbfff640 / io_context_pool 2024-09-12T00:30:51.438 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1d0a7fc640 / ms_dispatch 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1d11602640 / ms_dispatch 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1d12e05640 / io_context_pool 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e1ffff640 / msgr-worker-2 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e24c8a640 / msgr-worker-1 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e2548b640 / msgr-worker-0 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e25c8c640 / io_context_pool 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e271849c0 / radosgw-admin 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:30:51.439 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.98135.log 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_done global_id 6900 payload 274 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:30:51.012+0000 7f1e24c8a640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: dump: 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.440 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:30:51.012+0000 7f1d12e05640 10 monclient: dump: 2024-09-12T00:30:51.441 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.442 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6900 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:30:51.012+0000 7f1e271849c0 4 set_mon_vals no callback set 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: shutdown 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 asok(0x56161119d2b0) unregister_commands rotate-key 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.443 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.444 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding auth protocol: cephx 2024-09-12T00:30:51.445 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding auth protocol: cephx 2024-09-12T00:30:51.445 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding auth protocol: cephx 2024-09-12T00:30:51.445 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.445 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.445 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.446 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.446 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.446 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.446 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.446 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: crc 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113d4a50) adding con mode: secure 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:30:51.012+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: starting msgr at 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: starting objecter 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command objecter_requests hook 0x561611190b70 2024-09-12T00:30:51.447 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: setting wanted keys 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:30:51.012+0000 7f1e271849c0 1 librados: calling monclient init 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding auth protocol: cephx 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding auth protocol: cephx 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding auth protocol: cephx 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.448 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: crc 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 AuthRegistry(0x5616113a7c30) adding con mode: secure 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:30:51.012+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:30:51.012+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:30:51.012+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key hook 0x5616113a7d78 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.449 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:30:51.450 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x561611258300 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.450 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x561611261bf0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.450 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x561611263850 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.450 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.450 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.450 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:30:51.012+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.351916s 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request con 0x561611258300 auth_method 0 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x561611263850 auth_method 0 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.451 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x561611261bf0 auth_method 0 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.452 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient(hunting): handle_auth_done global_id 6903 payload 824 2024-09-12T00:30:51.453 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.453 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:30:51.016+0000 7f1e2548b640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.453 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:30:51.016+0000 7f1e2548b640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.453 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.453 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.453 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: dump: 2024-09-12T00:30:51.453 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.454 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:30:51.016+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6903 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:30:51.016+0000 7f1d11602640 10 monclient: dump: 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.455 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:30:51.016+0000 7f1d12e05640 4 set_mon_vals no callback set 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.456 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:30:51.016+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.457 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:30:51.016+0000 7f1e271849c0 1 librados: init done 2024-09-12T00:30:51.457 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:30:51.016+0000 7f1d11602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.457 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:30:51.016+0000 7f1d11602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.460 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:30:51.016+0000 7f1d11602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.460 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:30:51.016+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x7f1d0c070b10 auth_method 0 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:30:51.016+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x5616113d2d90 auth_method 0 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:30:51.020+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x5616113f2630 auth_method 0 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:30:51.020+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x5616113f6cd0 auth_method 0 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:30:51.020+0000 7f1e2548b640 10 monclient: get_auth_request con 0x5616113faba0 auth_method 0 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:30:51.024+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.461 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding auth protocol: cephx 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding auth protocol: cephx 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding auth protocol: cephx 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.462 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: crc 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fecd0) adding con mode: secure 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:30:51.024+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561611402700 EEXIST 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding auth protocol: cephx 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding auth protocol: cephx 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding auth protocol: cephx 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.463 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: crc 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 AuthRegistry(0x5616113fdbc8) adding con mode: secure 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:30:51.024+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:30:51.024+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key cmddesc rotate-key hook 0x5616113fdd10 EEXIST 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.464 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x5616114268b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x5616114261e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x561611424bc0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.361995s 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x5616114268b0 auth_method 0 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request con 0x561611424bc0 auth_method 0 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.465 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:30:51.024+0000 7f1e24c8a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x5616114261e0 auth_method 0 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:30:51.024+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_done global_id 6906 payload 824 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.466 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 1 monclient: found mon.noname-a 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:30:51.024+0000 7f1e1ffff640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.467 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:30:51.024+0000 7f1d0a7fc640 10 monclient: dump: 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.468 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:30:51.024+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6906 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:30:51.024+0000 7f1e25c8c640 4 set_mon_vals no callback set 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:30:51.024+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:30:51.028+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:30:51.028+0000 7f1d0a7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:30:51.028+0000 7f1d0a7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient: get_auth_request con 0x7f1cfc070a20 auth_method 0 2024-09-12T00:30:51.469 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: get_monmap_and_config 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:30:51.028+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.470 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding auth protocol: cephx 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding auth protocol: cephx 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding auth protocol: cephx 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: crc 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x5616114461f0) adding con mode: secure 2024-09-12T00:30:51.471 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:30:51.028+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding auth protocol: cephx 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding auth protocol: cephx 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding auth protocol: cephx 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.472 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: crc 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105eda20) adding con mode: secure 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:30:51.028+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:30:51.028+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd105edb68 EEXIST 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x56161147a6f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.473 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x56161144a110 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x561611475ec0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.366445s 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x56161147a6f0 auth_method 0 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.474 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x56161144a110 auth_method 0 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.475 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.476 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.476 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:30:51.028+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.476 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient(hunting): handle_auth_done global_id 6500 payload 274 2024-09-12T00:30:51.476 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.476 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:30:51.028+0000 7f1e2548b640 1 monclient: found mon.noname-c 2024-09-12T00:30:51.476 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:30:51.028+0000 7f1e2548b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.476 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.477 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:30:51.028+0000 7f1cfbfff640 10 monclient: dump: 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:30:51.028+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6500 2024-09-12T00:30:51.478 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: get_monmap_and_config success 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:30:51.028+0000 7f1e271849c0 4 set_mon_vals no callback set 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:30:51.028+0000 7f1e271849c0 10 monclient: shutdown 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: build_initial_monmap 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 build_initial for_mkfs: 0 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: monmap: 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:30:51.479 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding auth protocol: cephx 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding auth protocol: cephx 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding auth protocol: cephx 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.480 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: crc 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x561611474850) adding con mode: secure 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:30:51.032+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: starting msgr at 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: starting objecter 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command objecter_requests cmddesc objecter_requests hook 0x561611449e80 EEXIST 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: setting wanted keys 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: calling monclient init 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: init 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding auth protocol: cephx 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding auth protocol: cephx 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding auth protocol: cephx 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.481 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: crc 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 AuthRegistry(0x5616114286d0) adding con mode: secure 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:30:51.032+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:30:51.032+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command rotate-key cmddesc rotate-key hook 0x561611428818 EEXIST 2024-09-12T00:30:51.482 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _reopen_session rank -1 2024-09-12T00:30:51.483 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:30:51.483 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-a con 0x56161144a110 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:30:51.483 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-c con 0x561611475ec0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:30:51.483 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): picked mon.noname-b con 0x56161147a6f0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:30:51.483 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.483 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.484 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:30:51.484 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): _renew_subs 2024-09-12T00:30:51.484 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient(hunting): authenticate will time out at 2175.369180s 2024-09-12T00:30:51.484 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): get_auth_request con 0x561611475ec0 auth_method 0 2024-09-12T00:30:51.484 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.484 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.484 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.485 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request con 0x56161144a110 auth_method 0 2024-09-12T00:30:51.485 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:30:51.485 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:30:51.485 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:30:51.485 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.485 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:30:51.032+0000 7f1e1ffff640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient(hunting): handle_auth_done global_id 6503 payload 824 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient: _finish_hunting 0 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:30:51.032+0000 7f1e2548b640 1 monclient: found mon.noname-c 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:30:51.032+0000 7f1e2548b640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T00:30:51.486 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: _finish_auth 0 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:30:51.487 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 10 monclient: dump: 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:30:51.032+0000 7f1cfbfff640 4 set_mon_vals no callback set 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 monclient: authenticate success, global_id 6503 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.488 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _renew_subs 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:30:51.032+0000 7f1e271849c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:30:51.032+0000 7f1e271849c0 1 librados: init done 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:30:51.032+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cr dump hook 0x56161146bbd8 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:30:51.032+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:30:51.032+0000 7f1cfa7fc640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:30:51.036+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x7f1cf0070b10 auth_method 0 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:30:51.036+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x5616114940d0 auth_method 0 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 realm 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.489 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:30:51.036+0000 7f1e271849c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:30:51.036+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x561611498250 auth_method 0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:30:51.036+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:30:51.040+0000 7f1e2548b640 10 monclient: get_auth_request con 0x56161149bb40 auth_method 0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:30:51.040+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:30:51.040+0000 7f1e271849c0 20 searching for the correct realm 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:30:51.040+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x5616114a08c0 auth_method 0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:30:51.040+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x7f1e18028040 auth_method 0 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:30:51.044+0000 7f1e2548b640 0 -- 172.21.15.78:0/3261804567 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1e18045400 msgr2=0x7f1e18045880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.490 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:30:51.248+0000 7f1e2548b640 10 monclient: get_auth_request con 0x7f1e18045400 auth_method 0 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:30:51.252+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x7f1e10063e90 auth_method 0 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:30:51.256+0000 7f1e1ffff640 10 monclient: get_auth_request con 0x7f1e1800d3e0 auth_method 0 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:30:51.256+0000 7f1e24c8a640 0 -- 172.21.15.78:0/3261804567 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5616114940d0 msgr2=0x561611496530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:30:51.256+0000 7f1cfa7fc640 1 client.6503.objecter ms_handle_reset 0x5616114940d0 session 0x561611493a50 osd.6 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:30:51.256+0000 7f1cfa7fc640 10 monclient: _renew_subs 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:30:51.256+0000 7f1cfa7fc640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:30:51.260+0000 7f1e24c8a640 10 monclient: get_auth_request con 0x7f1cf0080dc0 auth_method 0 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:51.491 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:30:51.268+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:51.492 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 zone default found 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:30:51.272+0000 7f1e271849c0 4 Realm: () 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:30:51.272+0000 7f1e271849c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:30:51.272+0000 7f1e271849c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:30:51.272+0000 7f1e271849c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 zonegroup default 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.493 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:30:51.272+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:30:51.276+0000 7f1e271849c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:30:51.276+0000 7f1e271849c0 20 started sync module instance, tier type = 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:30:51.276+0000 7f1e271849c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=0 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=1 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=2 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=3 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=4 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=5 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:30:51.296+0000 7f1e271849c0 20 add_watcher() i=6 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:30:51.300+0000 7f1e271849c0 20 add_watcher() i=7 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:30:51.300+0000 7f1e271849c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:51.494 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding auth protocol: cephx 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding auth protocol: cephx 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding auth protocol: cephx 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: crc 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 AuthRegistry(0x7ffd105edf00) adding con mode: secure 2024-09-12T00:30:51.495 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:30:51.304+0000 7f1cdafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:30:51.304+0000 7f1e271849c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:30:51.304+0000 7f1e271849c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:30:51.304+0000 7f1e271849c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache list hook 0x5616114706f0 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache inspect hook 0x5616114706f0 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache erase hook 0x5616114706f0 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:30:51.304+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command cache zap hook 0x5616114706f0 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 note: GC not initialized 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:30:51.308+0000 7f1cd9fe3640 20 reqs_thread_entry: start 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace show hook 0x7f1e20004910 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace history hook 0x7f1e20004910 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace active hook 0x7f1e20004910 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:30:51.308+0000 7f1e271849c0 5 asok(0x56161119d2b0) register_command sync trace active_short hook 0x7f1e20004910 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:51.496 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 Filter name: none 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:30:51.308+0000 7f1c4b7fe640 20 reqs_thread_entry: start 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 : miss 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:30:51.308+0000 7f1e271849c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:30:51.308+0000 7f1e271849c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.497 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:30:51.320+0000 7f1e271849c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27, ofs0, ns] 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398959 cookie 94652779347792 notifier 6503 bl.length()=939 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:30:51.320+0000 7f1cfbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_sources= new_sources= 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential sources added=[] removed=[] 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_dests= new_dests= 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:30:51.320+0000 7f1e271849c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential dests added=[] removed=[] 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:30:51.324+0000 7f1e271849c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f1e271849c0 time 2024-09-12T00:30:51.325286+0000 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.498 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f1e2aa5e2eb] 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:30:51.328+0000 7f1e271849c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:30:51.499 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f1e271849c0 thread_name:radosgw-admin 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f1e298dd520] 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f1e2aa5e345] 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f1e2aa5e49f] 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x56160f48acc1] 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422a3e) [0x56160fee8a3e] 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x56160f49fced] 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f1e298c4d90] 2024-09-12T00:30:51.500 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:30:51.501 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:30:51.502 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:30:51.503 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:30:51.504 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:30:51.505 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:30:51.506 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:30:51.507 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1c4b7fe640 / http_manager 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cd9fe3640 / http_manager 2024-09-12T00:30:51.508 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cdafe5640 / rgw_dt_lg_renew 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cfa7fc640 / ms_dispatch 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1cfbfff640 / io_context_pool 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1d0a7fc640 / ms_dispatch 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1d11602640 / ms_dispatch 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1d12e05640 / io_context_pool 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e1ffff640 / msgr-worker-2 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e24c8a640 / msgr-worker-1 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e2548b640 / msgr-worker-0 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e25c8c640 / io_context_pool 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1e271849c0 / radosgw-admin 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:30:51.332162Z_7fe45927-2a5c-4f12-8ed2-d4c49118f963/log 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:30:51.509 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:30:51.510 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.416+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 realm 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.420+0000 7f827a3e89c0 20 searching for the correct realm 2024-09-12T00:30:51.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.428+0000 7f82786ef640 0 -- 172.21.15.78:0/701007738 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f8268086290 msgr2=0x7f826802e040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.640+0000 7f82786ef640 0 -- 172.21.15.78:0/701007738 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5578ab0b1dd0 msgr2=0x5578ab0b4200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:51.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:51.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:51.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:51.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:51.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:51.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:51.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.652+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 zone default found 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 4 Realm: () 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 zonegroup default 2024-09-12T00:30:51.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 started sync module instance, tier type = 2024-09-12T00:30:51.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.656+0000 7f827a3e89c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.680+0000 7f827a3e89c0 20 add_watcher() i=0 2024-09-12T00:30:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.680+0000 7f827a3e89c0 20 add_watcher() i=1 2024-09-12T00:30:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.680+0000 7f827a3e89c0 20 add_watcher() i=2 2024-09-12T00:30:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.680+0000 7f827a3e89c0 20 add_watcher() i=3 2024-09-12T00:30:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.680+0000 7f827a3e89c0 20 add_watcher() i=4 2024-09-12T00:30:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.680+0000 7f827a3e89c0 20 add_watcher() i=5 2024-09-12T00:30:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.680+0000 7f827a3e89c0 20 add_watcher() i=6 2024-09-12T00:30:51.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.684+0000 7f827a3e89c0 20 add_watcher() i=7 2024-09-12T00:30:51.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.684+0000 7f827a3e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:51.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.688+0000 7f812dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.688+0000 7f827a3e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:51.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.688+0000 7f827a3e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:51.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.688+0000 7f827a3e89c0 5 note: GC not initialized 2024-09-12T00:30:51.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.688+0000 7f812cfe1640 20 reqs_thread_entry: start 2024-09-12T00:30:51.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:51.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 Filter name: none 2024-09-12T00:30:51.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f80a67fc640 20 reqs_thread_entry: start 2024-09-12T00:30:51.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:51.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:30:51.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:51.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:51.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:30:51.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.692+0000 7f827a3e89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:30:51.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.696+0000 7f812dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:51.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.700+0000 7f827a3e89c0 20 remove_watcher() i=0 2024-09-12T00:30:51.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.700+0000 7f827a3e89c0 2 removed watcher, disabling cache 2024-09-12T00:30:51.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.704+0000 7f827a3e89c0 20 remove_watcher() i=1 2024-09-12T00:30:51.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.708+0000 7f827a3e89c0 20 remove_watcher() i=2 2024-09-12T00:30:51.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.708+0000 7f827a3e89c0 20 remove_watcher() i=3 2024-09-12T00:30:51.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.712+0000 7f827a3e89c0 20 remove_watcher() i=4 2024-09-12T00:30:51.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.712+0000 7f827a3e89c0 20 remove_watcher() i=5 2024-09-12T00:30:51.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.716+0000 7f827a3e89c0 20 remove_watcher() i=6 2024-09-12T00:30:51.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.720+0000 7f827a3e89c0 20 remove_watcher() i=7 2024-09-12T00:30:51.733 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.734 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:30:51.734 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:30:51.734 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:30:51.791 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:30:51.827 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:30:51.827 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:30:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.872+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 realm 2024-09-12T00:30:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:30:51.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:51.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:51.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:51.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:30:51.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.876+0000 7f063e80c9c0 20 searching for the correct realm 2024-09-12T00:30:51.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:51.884+0000 7f063cb13640 0 -- 172.21.15.78:0/2225475782 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f062c0103e0 msgr2=0x7f062c010860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:52.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.100+0000 7f063c312640 0 -- 172.21.15.78:0/2225475782 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55eacdb02990 msgr2=0x55eacdb04dd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:52.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:30:52.111 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 zone default found 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 4 Realm: () 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 zonegroup default 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.112+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.116+0000 7f063e80c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:52.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.116+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.116+0000 7f063e80c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:52.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.116+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.116+0000 7f063e80c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:30:52.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.116+0000 7f063e80c9c0 20 started sync module instance, tier type = 2024-09-12T00:30:52.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.116+0000 7f063e80c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:30:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.136+0000 7f063e80c9c0 20 add_watcher() i=0 2024-09-12T00:30:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.136+0000 7f063e80c9c0 20 add_watcher() i=1 2024-09-12T00:30:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.136+0000 7f063e80c9c0 20 add_watcher() i=2 2024-09-12T00:30:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.136+0000 7f063e80c9c0 20 add_watcher() i=3 2024-09-12T00:30:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.136+0000 7f063e80c9c0 20 add_watcher() i=4 2024-09-12T00:30:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.136+0000 7f063e80c9c0 20 add_watcher() i=5 2024-09-12T00:30:52.137 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.136+0000 7f063e80c9c0 20 add_watcher() i=6 2024-09-12T00:30:52.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.140+0000 7f063e80c9c0 20 add_watcher() i=7 2024-09-12T00:30:52.139 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.140+0000 7f063e80c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:30:52.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.144+0000 7f04f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.144+0000 7f063e80c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:30:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.144+0000 7f063e80c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:30:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.144+0000 7f063e80c9c0 5 note: GC not initialized 2024-09-12T00:30:52.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f04f1fdb640 20 reqs_thread_entry: start 2024-09-12T00:30:52.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:30:52.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 20 Filter name: none 2024-09-12T00:30:52.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f04637fe640 20 reqs_thread_entry: start 2024-09-12T00:30:52.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:30:52.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:30:52.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:30:52.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:30:52.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 : miss 2024-09-12T00:30:52.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:30:52.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:30:52.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:30:52.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:30:52.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:30:52.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:30:52.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.148+0000 7f063e80c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 2024-09-12T00:30:52.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.152+0000 7f063e80c9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to be held by another RGW process; skipping for now 2024-09-12T00:30:52.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.152+0000 7f04f2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:30:52.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.156+0000 7f063e80c9c0 20 remove_watcher() i=0 2024-09-12T00:30:52.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.156+0000 7f063e80c9c0 2 removed watcher, disabling cache 2024-09-12T00:30:52.157 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.156+0000 7f063e80c9c0 20 remove_watcher() i=1 2024-09-12T00:30:52.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.164+0000 7f063e80c9c0 20 remove_watcher() i=2 2024-09-12T00:30:52.164 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.164+0000 7f063e80c9c0 20 remove_watcher() i=3 2024-09-12T00:30:52.166 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.168+0000 7f063e80c9c0 20 remove_watcher() i=4 2024-09-12T00:30:52.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.168+0000 7f063e80c9c0 20 remove_watcher() i=5 2024-09-12T00:30:52.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.176+0000 7f063e80c9c0 20 remove_watcher() i=6 2024-09-12T00:30:52.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:30:52.180+0000 7f063e80c9c0 20 remove_watcher() i=7 2024-09-12T00:30:52.199 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:31:22.222 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-trim-reshard-log-entries --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:31:22.258 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:22.258 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:22.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.304+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 realm 2024-09-12T00:31:22.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:22.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:22.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.308+0000 7f00dfec39c0 20 searching for the correct realm 2024-09-12T00:31:22.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.316+0000 7f00de1ca640 0 -- 172.21.15.78:0/658354581 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f00d00c0070 msgr2=0x7f00d00ad030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:22.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.528+0000 7f00dd9c9640 0 -- 172.21.15.78:0/658354581 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559da3238a80 msgr2=0x559da323af10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.540+0000 7f00dfec39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.540+0000 7f00dfec39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.540+0000 7f00dfec39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.540+0000 7f00dfec39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.540+0000 7f00dfec39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:22.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.540+0000 7f00dfec39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:22.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.540+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 zone default found 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 4 Realm: () 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 zonegroup default 2024-09-12T00:31:22.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 started sync module instance, tier type = 2024-09-12T00:31:22.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.544+0000 7f00dfec39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:22.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.576+0000 7f00dfec39c0 20 add_watcher() i=0 2024-09-12T00:31:22.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.576+0000 7f00dfec39c0 20 add_watcher() i=1 2024-09-12T00:31:22.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.576+0000 7f00dfec39c0 20 add_watcher() i=2 2024-09-12T00:31:22.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.576+0000 7f00dfec39c0 20 add_watcher() i=3 2024-09-12T00:31:22.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.576+0000 7f00dfec39c0 20 add_watcher() i=4 2024-09-12T00:31:22.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.576+0000 7f00dfec39c0 20 add_watcher() i=5 2024-09-12T00:31:22.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.576+0000 7f00dfec39c0 20 add_watcher() i=6 2024-09-12T00:31:22.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.580+0000 7f00dfec39c0 20 add_watcher() i=7 2024-09-12T00:31:22.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.580+0000 7f00dfec39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:22.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7eff8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:22.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:22.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:22.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 5 note: GC not initialized 2024-09-12T00:31:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7eff8e7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 20 Filter name: none 2024-09-12T00:31:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7efefffff640 20 reqs_thread_entry: start 2024-09-12T00:31:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 10 cache get: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries : miss 2024-09-12T00:31:22.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:31:22.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 10 cache put: name=default.rgw.meta+root+abort-at-trim-reshard-log-entries info.flags=0x11 2024-09-12T00:31:22.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 10 adding default.rgw.meta+root+abort-at-trim-reshard-log-entries to cache LRU end 2024-09-12T00:31:22.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 : miss 2024-09-12T00:31:22.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.584+0000 7f00dfec39c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.588+0000 7f00dfec39c0 20 rados_obj.operate() r=0 bl.length=455 2024-09-12T00:31:22.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.588+0000 7f00dfec39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:31:22.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.588+0000 7f00dfec39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:31:22.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.588+0000 7f00dfec39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:22.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.588+0000 7f00dfec39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:22.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.588+0000 7f00dfec39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 2024-09-12T00:31:22.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.588+0000 7f00dfec39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:31:22.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:31:22.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:31:22.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:22.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27, ofs0, ns] 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7effc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398960 cookie 94135535307216 notifier 6551 bl.length()=939 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7effc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7effc17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7effc17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_sources= new_sources= 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential sources added=[] removed=[] 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_dests= new_dests= 2024-09-12T00:31:22.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.604+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential dests added=[] removed=[] 2024-09-12T00:31:22.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.0 2024-09-12T00:31:22.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.0 2024-09-12T00:31:22.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.1 2024-09-12T00:31:22.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.1 2024-09-12T00:31:22.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.2 2024-09-12T00:31:22.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.2 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.3 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.3 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.4 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.4 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.5 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.5 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.6 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.6 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.7 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.7 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.8 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.8 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.9 2024-09-12T00:31:22.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.9 2024-09-12T00:31:22.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.10 2024-09-12T00:31:22.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.10 2024-09-12T00:31:22.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.11 2024-09-12T00:31:22.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2.11 2024-09-12T00:31:22.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.0 2024-09-12T00:31:22.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.1 2024-09-12T00:31:22.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2 2024-09-12T00:31:22.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.3 2024-09-12T00:31:22.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.616+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.4 2024-09-12T00:31:22.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.620+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.5 2024-09-12T00:31:22.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.620+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.6 2024-09-12T00:31:22.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.620+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.7 2024-09-12T00:31:22.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.624+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.8 2024-09-12T00:31:22.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.624+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.9 2024-09-12T00:31:22.624 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.624+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.10 2024-09-12T00:31:22.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.632+0000 7f00dfec39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:22.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.632+0000 7f00dfec39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 2024-09-12T00:31:22.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:31:22.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:31:22.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:22.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27, ofs0, ns] 2024-09-12T00:31:22.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7effc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398961 cookie 94135535307216 notifier 6551 bl.length()=939 2024-09-12T00:31:22.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7effc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7effc17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7effc17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_sources= new_sources= 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential sources added=[] removed=[] 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_dests= new_dests= 2024-09-12T00:31:22.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.636+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential dests added=[] removed=[] 2024-09-12T00:31:22.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.640+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.0 2024-09-12T00:31:22.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.640+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.1 2024-09-12T00:31:22.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.644+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.2 2024-09-12T00:31:22.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.644+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.3 2024-09-12T00:31:22.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.644+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.4 2024-09-12T00:31:22.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.644+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.5 2024-09-12T00:31:22.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.644+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.6 2024-09-12T00:31:22.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.648+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.7 2024-09-12T00:31:22.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.648+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.8 2024-09-12T00:31:22.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.648+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.9 2024-09-12T00:31:22.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.648+0000 7f00dfec39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27.10 2024-09-12T00:31:22.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.652+0000 7f00dfec39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:22.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.652+0000 7f00dfec39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.652+0000 7f00dfec39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.652+0000 7f00dfec39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.652+0000 7f00dfec39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.652+0000 7f00dfec39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27, ofs0, ns] 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7effc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398962 cookie 94135535307216 notifier 6551 bl.length()=907 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7effc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 info.flags=0x17 2024-09-12T00:31:22.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7effc17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-trim-reshard-log-entries:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 to cache LRU end 2024-09-12T00:31:22.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7effc17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:22.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_sources= new_sources= 2024-09-12T00:31:22.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential sources added=[] removed=[] 2024-09-12T00:31:22.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): orig_dests= new_dests= 2024-09-12T00:31:22.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.656+0000 7f00dfec39c0 20 handle_bi_update(): bucket=:abort-at-trim-reshard-log-entries[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27]): potential dests added=[] removed=[] 2024-09-12T00:31:22.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.660+0000 7f00dfec39c0 1 execute INFO: reshard of bucket "abort-at-trim-reshard-log-entries" from 11 shards to 12 shards completed successfully 2024-09-12T00:31:22.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.664+0000 7eff8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:22.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.668+0000 7f00dfec39c0 20 remove_watcher() i=0 2024-09-12T00:31:22.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.668+0000 7f00dfec39c0 2 removed watcher, disabling cache 2024-09-12T00:31:22.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.672+0000 7f00dfec39c0 20 remove_watcher() i=1 2024-09-12T00:31:22.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.672+0000 7f00dfec39c0 20 remove_watcher() i=2 2024-09-12T00:31:22.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.676+0000 7f00dfec39c0 20 remove_watcher() i=3 2024-09-12T00:31:22.676 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.676+0000 7f00dfec39c0 20 remove_watcher() i=4 2024-09-12T00:31:22.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.680+0000 7f00dfec39c0 20 remove_watcher() i=5 2024-09-12T00:31:22.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.684+0000 7f00dfec39c0 20 remove_watcher() i=6 2024-09-12T00:31:22.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.684+0000 7f00dfec39c0 20 remove_watcher() i=7 2024-09-12T00:31:22.702 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-trim-reshard-log-entries 2024-09-12T00:31:22.731 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:22.731 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:22.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.776+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 realm 2024-09-12T00:31:22.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:22.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:22.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:22.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:22.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:22.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.780+0000 7ffa3c9299c0 20 searching for the correct realm 2024-09-12T00:31:22.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.784+0000 7ffa3ac30640 0 -- 172.21.15.78:0/4131383033 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x55e8f7cc3810 msgr2=0x7ffa2c107630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:22.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:22.996+0000 7ffa3a42f640 0 -- 172.21.15.78:0/4131383033 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55e8f7f1de30 msgr2=0x55e8f7f20260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.008+0000 7ffa3c9299c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:23.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.008+0000 7ffa3c9299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:23.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.008+0000 7ffa3c9299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:23.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.008+0000 7ffa3c9299c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:23.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.008+0000 7ffa3c9299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:23.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.008+0000 7ffa3c9299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:23.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 zone default found 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 4 Realm: () 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 zonegroup default 2024-09-12T00:31:23.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.012+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.016+0000 7ffa3c9299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.016+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.016+0000 7ffa3c9299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.016+0000 7ffa3c9299c0 20 started sync module instance, tier type = 2024-09-12T00:31:23.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.016+0000 7ffa3c9299c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:23.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.040+0000 7ffa3c9299c0 20 add_watcher() i=0 2024-09-12T00:31:23.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.040+0000 7ffa3c9299c0 20 add_watcher() i=1 2024-09-12T00:31:23.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.040+0000 7ffa3c9299c0 20 add_watcher() i=2 2024-09-12T00:31:23.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.040+0000 7ffa3c9299c0 20 add_watcher() i=3 2024-09-12T00:31:23.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.040+0000 7ffa3c9299c0 20 add_watcher() i=4 2024-09-12T00:31:23.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.040+0000 7ffa3c9299c0 20 add_watcher() i=5 2024-09-12T00:31:23.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.040+0000 7ffa3c9299c0 20 add_watcher() i=6 2024-09-12T00:31:23.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.044+0000 7ffa3c9299c0 20 add_watcher() i=7 2024-09-12T00:31:23.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.044+0000 7ffa3c9299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:23.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ff8f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:23.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:23.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 5 note: GC not initialized 2024-09-12T00:31:23.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ff86b7fe640 20 reqs_thread_entry: start 2024-09-12T00:31:23.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:23.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 20 Filter name: none 2024-09-12T00:31:23.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ff8697fa640 20 reqs_thread_entry: start 2024-09-12T00:31:23.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:31:23.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.048+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.052+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:31:23.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.052+0000 7ffa3c9299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.052+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.052+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=201 2024-09-12T00:31:23.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.052+0000 7ffa3c9299c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.052+0000 7ffa3c9299c0 20 rados_obj.operate() r=0 bl.length=423 2024-09-12T00:31:23.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.052+0000 7ffa3c9299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.056+0000 7ff8f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.060+0000 7ffa3c9299c0 20 remove_watcher() i=0 2024-09-12T00:31:23.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.060+0000 7ffa3c9299c0 2 removed watcher, disabling cache 2024-09-12T00:31:23.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.064+0000 7ffa3c9299c0 20 remove_watcher() i=1 2024-09-12T00:31:23.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.064+0000 7ffa3c9299c0 20 remove_watcher() i=2 2024-09-12T00:31:23.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.068+0000 7ffa3c9299c0 20 remove_watcher() i=3 2024-09-12T00:31:23.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.068+0000 7ffa3c9299c0 20 remove_watcher() i=4 2024-09-12T00:31:23.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.072+0000 7ffa3c9299c0 20 remove_watcher() i=5 2024-09-12T00:31:23.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.072+0000 7ffa3c9299c0 20 remove_watcher() i=6 2024-09-12T00:31:23.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.076+0000 7ffa3c9299c0 20 remove_watcher() i=7 2024-09-12T00:31:23.090 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:23.090 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:23.090 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-trim-reshard-log-entries id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.27 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:31:23.090 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:23.196 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at block_writes 2024-09-12T00:31:23.196 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:23.611 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:31:23.643 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:23.644 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:23.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.692+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 realm 2024-09-12T00:31:23.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:23.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.696+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.700+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:23.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.700+0000 7f3e0ba239c0 20 searching for the correct realm 2024-09-12T00:31:23.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.704+0000 7f3e09529640 0 -- 172.21.15.78:0/2586288579 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x556b3b115430 msgr2=0x556b3b1178f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.708+0000 7f3e08d28640 0 -- 172.21.15.78:0/2586288579 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f3dfc025410 msgr2=0x7f3dfc025870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:23.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:23.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:23.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:23.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:23.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:23.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:23.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:23.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:23.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 zone default found 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 4 Realm: () 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 zonegroup default 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.928+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.932+0000 7f3e0ba239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.932+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.932+0000 7f3e0ba239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.932+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.932+0000 7f3e0ba239c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:23.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.932+0000 7f3e0ba239c0 20 started sync module instance, tier type = 2024-09-12T00:31:23.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.932+0000 7f3e0ba239c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:23.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.956+0000 7f3e0ba239c0 20 add_watcher() i=0 2024-09-12T00:31:23.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.956+0000 7f3e0ba239c0 20 add_watcher() i=1 2024-09-12T00:31:23.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.956+0000 7f3e0ba239c0 20 add_watcher() i=2 2024-09-12T00:31:23.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.956+0000 7f3e0ba239c0 20 add_watcher() i=3 2024-09-12T00:31:23.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.956+0000 7f3e0ba239c0 20 add_watcher() i=4 2024-09-12T00:31:23.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.956+0000 7f3e0ba239c0 20 add_watcher() i=5 2024-09-12T00:31:23.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.956+0000 7f3e0ba239c0 20 add_watcher() i=6 2024-09-12T00:31:23.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.960+0000 7f3e0ba239c0 20 add_watcher() i=7 2024-09-12T00:31:23.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.960+0000 7f3e0ba239c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:23.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.964+0000 7f3cbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.964+0000 7f3e0ba239c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:23.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.964+0000 7f3e0ba239c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:23.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.964+0000 7f3e0ba239c0 5 note: GC not initialized 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3cbe7e4640 20 reqs_thread_entry: start 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3e0ba239c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:23.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3e0ba239c0 20 Filter name: none 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3c2ffff640 20 reqs_thread_entry: start 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:23.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.968+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:23.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.972+0000 7f3e0ba239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.972+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.972+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:23.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.972+0000 7f3e0ba239c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:23.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.972+0000 7f3e0ba239c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:23.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.972+0000 7f3e0ba239c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:23.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.976+0000 7f3cbf7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:23.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.980+0000 7f3e0ba239c0 20 remove_watcher() i=0 2024-09-12T00:31:23.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.980+0000 7f3e0ba239c0 2 removed watcher, disabling cache 2024-09-12T00:31:23.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.984+0000 7f3e0ba239c0 20 remove_watcher() i=1 2024-09-12T00:31:23.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.984+0000 7f3e0ba239c0 20 remove_watcher() i=2 2024-09-12T00:31:23.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.988+0000 7f3e0ba239c0 20 remove_watcher() i=3 2024-09-12T00:31:23.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.988+0000 7f3e0ba239c0 20 remove_watcher() i=4 2024-09-12T00:31:23.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.992+0000 7f3e0ba239c0 20 remove_watcher() i=5 2024-09-12T00:31:23.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:23.996+0000 7f3e0ba239c0 20 remove_watcher() i=6 2024-09-12T00:31:23.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.000+0000 7f3e0ba239c0 20 remove_watcher() i=7 2024-09-12T00:31:24.014 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:24.014 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:24.014 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-block-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:31:24.014 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:24.014 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at block_writes 2024-09-12T00:31:24.050 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.051 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 realm 2024-09-12T00:31:24.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:24.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.096+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.100+0000 7f5a4a1179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.100+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.100+0000 7f5a4a1179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:24.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.100+0000 7f5a4a1179c0 20 searching for the correct realm 2024-09-12T00:31:24.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.104+0000 7f5a4841e640 0 -- 172.21.15.78:0/1417183408 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f5a3800e040 msgr2=0x7f5a38043910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.316+0000 7f5a47c1d640 0 -- 172.21.15.78:0/1417183408 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55dde8228050 msgr2=0x55dde822a4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.328+0000 7f5a4a1179c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:24.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.328+0000 7f5a4a1179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:24.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.328+0000 7f5a4a1179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:24.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.328+0000 7f5a4a1179c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:24.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.328+0000 7f5a4a1179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:24.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.328+0000 7f5a4a1179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:24.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 zone default found 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 4 Realm: () 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 zonegroup default 2024-09-12T00:31:24.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.332+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.336+0000 7f5a4a1179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.336+0000 7f5a4a1179c0 20 started sync module instance, tier type = 2024-09-12T00:31:24.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.336+0000 7f5a4a1179c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:24.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.356+0000 7f5a4a1179c0 20 add_watcher() i=0 2024-09-12T00:31:24.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.356+0000 7f5a4a1179c0 20 add_watcher() i=1 2024-09-12T00:31:24.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.356+0000 7f5a4a1179c0 20 add_watcher() i=2 2024-09-12T00:31:24.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.356+0000 7f5a4a1179c0 20 add_watcher() i=3 2024-09-12T00:31:24.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.356+0000 7f5a4a1179c0 20 add_watcher() i=4 2024-09-12T00:31:24.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.356+0000 7f5a4a1179c0 20 add_watcher() i=5 2024-09-12T00:31:24.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.356+0000 7f5a4a1179c0 20 add_watcher() i=6 2024-09-12T00:31:24.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.360+0000 7f5a4a1179c0 20 add_watcher() i=7 2024-09-12T00:31:24.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.360+0000 7f5a4a1179c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:24.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.364+0000 7f58fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.364+0000 7f5a4a1179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:24.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.364+0000 7f5a4a1179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:24.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.364+0000 7f5a4a1179c0 5 note: GC not initialized 2024-09-12T00:31:24.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.364+0000 7f58fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:24.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.364+0000 7f5a4a1179c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:24.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 20 Filter name: none 2024-09-12T00:31:24.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f58767fc640 20 reqs_thread_entry: start 2024-09-12T00:31:24.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:31:24.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:24.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:31:24.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:31:24.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 : miss 2024-09-12T00:31:24.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:24.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:24.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:24.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:24.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:24.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.368+0000 7f5a4a1179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 2024-09-12T00:31:24.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:24.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28, ofs0, ns] 2024-09-12T00:31:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f59267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398888 cookie 94411570777152 notifier 6599 bl.length()=915 2024-09-12T00:31:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f59267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f59267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:24.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f59267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:24.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_sources= new_sources= 2024-09-12T00:31:24.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential sources added=[] removed=[] 2024-09-12T00:31:24.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_dests= new_dests= 2024-09-12T00:31:24.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.380+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential dests added=[] removed=[] 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.0 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.0 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.1 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.1 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.2 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.2 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.3 2024-09-12T00:31:24.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.3 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.4 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.4 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.5 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.5 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.6 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.6 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.7 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.7 2024-09-12T00:31:24.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.8 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.8 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.9 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.9 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.10 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.10 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.11 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.11 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.0 2024-09-12T00:31:24.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.392+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1 2024-09-12T00:31:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.396+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.2 2024-09-12T00:31:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.396+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.3 2024-09-12T00:31:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.396+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.4 2024-09-12T00:31:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.396+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.5 2024-09-12T00:31:24.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.396+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.6 2024-09-12T00:31:24.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.396+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.7 2024-09-12T00:31:24.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.400+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.8 2024-09-12T00:31:24.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.400+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.9 2024-09-12T00:31:24.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.400+0000 7f5a4a1179c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.10 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.408+0000 7f5a4a1179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:24.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.408+0000 7f5a4a1179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 2024-09-12T00:31:24.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:24.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:24.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:24.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28, ofs0, ns] 2024-09-12T00:31:24.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5926ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398889 cookie 94411570777152 notifier 6599 bl.length()=915 2024-09-12T00:31:24.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5926ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:24.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5926ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:24.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5926ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:24.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_sources= new_sources= 2024-09-12T00:31:24.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential sources added=[] removed=[] 2024-09-12T00:31:24.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_dests= new_dests= 2024-09-12T00:31:24.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential dests added=[] removed=[] 2024-09-12T00:31:24.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 -1 Injecting error=-5 at location=block_writes 2024-09-12T00:31:24.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.412+0000 7f5a4a1179c0 0 ERROR: change_reshard_state failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:31:24.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.424+0000 7f5a4a1179c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:24.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.424+0000 7f5a4a1179c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 2024-09-12T00:31:24.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:24.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:24.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:24.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28, ofs0, ns] 2024-09-12T00:31:24.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f59267fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398890 cookie 94411570777152 notifier 6599 bl.length()=883 2024-09-12T00:31:24.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f59267fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:24.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f59267fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:24.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f59267fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:24.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_sources= new_sources= 2024-09-12T00:31:24.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential sources added=[] removed=[] 2024-09-12T00:31:24.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_dests= new_dests= 2024-09-12T00:31:24.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.428+0000 7f5a4a1179c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential dests added=[] removed=[] 2024-09-12T00:31:24.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.432+0000 7f5a4a1179c0 1 execute INFO: reshard of bucket "error-at-block-writes" canceled due to errors 2024-09-12T00:31:24.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.436+0000 7f58fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:24.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.444+0000 7f5a4a1179c0 20 remove_watcher() i=0 2024-09-12T00:31:24.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.444+0000 7f5a4a1179c0 2 removed watcher, disabling cache 2024-09-12T00:31:24.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.444+0000 7f5a4a1179c0 20 remove_watcher() i=1 2024-09-12T00:31:24.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.448+0000 7f5a4a1179c0 20 remove_watcher() i=2 2024-09-12T00:31:24.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.452+0000 7f5a4a1179c0 20 remove_watcher() i=3 2024-09-12T00:31:24.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.452+0000 7f5a4a1179c0 20 remove_watcher() i=4 2024-09-12T00:31:24.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.456+0000 7f5a4a1179c0 20 remove_watcher() i=5 2024-09-12T00:31:24.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.456+0000 7f5a4a1179c0 20 remove_watcher() i=6 2024-09-12T00:31:24.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.460+0000 7f5a4a1179c0 20 remove_watcher() i=7 2024-09-12T00:31:24.477 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:31:24.509 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:24.510 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:24.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.556+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.556+0000 7fbdfca8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.556+0000 7fbdfca8e9c0 20 realm 2024-09-12T00:31:24.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.556+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:24.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:24.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.560+0000 7fbdfca8e9c0 20 searching for the correct realm 2024-09-12T00:31:24.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.772+0000 7fbdfad95640 0 -- 172.21.15.78:0/3086177482 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fbdec0ff040 msgr2=0x7fbdec12b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:24.988+0000 7fbdfa594640 0 -- 172.21.15.78:0/3086177482 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563984df68f0 msgr2=0x563984df8d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:24.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:24.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:24.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:24.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:24.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:24.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:24.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:24.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:24.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:24.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:25.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 zone default found 2024-09-12T00:31:25.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 4 Realm: () 2024-09-12T00:31:25.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:25.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:25.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:25.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 zonegroup default 2024-09-12T00:31:25.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.000+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.004+0000 7fbdfca8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.004+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.004+0000 7fbdfca8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.004+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.004+0000 7fbdfca8e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.004+0000 7fbdfca8e9c0 20 started sync module instance, tier type = 2024-09-12T00:31:25.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.004+0000 7fbdfca8e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:25.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=0 2024-09-12T00:31:25.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=1 2024-09-12T00:31:25.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=2 2024-09-12T00:31:25.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=3 2024-09-12T00:31:25.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=4 2024-09-12T00:31:25.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=5 2024-09-12T00:31:25.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=6 2024-09-12T00:31:25.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 20 add_watcher() i=7 2024-09-12T00:31:25.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.028+0000 7fbdfca8e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:25.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.032+0000 7fbcb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:25.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:25.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:25.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 5 note: GC not initialized 2024-09-12T00:31:25.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbc2b7fe640 20 reqs_thread_entry: start 2024-09-12T00:31:25.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:25.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 Filter name: none 2024-09-12T00:31:25.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbc297fa640 20 reqs_thread_entry: start 2024-09-12T00:31:25.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:25.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:25.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:25.037 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.036+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.040+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:25.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.040+0000 7fbdfca8e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.040+0000 7fbdfca8e9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:25.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.040+0000 7fbdfca8e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:25.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.044+0000 7fbcb0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:25.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.048+0000 7fbdfca8e9c0 20 remove_watcher() i=0 2024-09-12T00:31:25.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.048+0000 7fbdfca8e9c0 2 removed watcher, disabling cache 2024-09-12T00:31:25.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.048+0000 7fbdfca8e9c0 20 remove_watcher() i=1 2024-09-12T00:31:25.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.052+0000 7fbdfca8e9c0 20 remove_watcher() i=2 2024-09-12T00:31:25.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.056+0000 7fbdfca8e9c0 20 remove_watcher() i=3 2024-09-12T00:31:25.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.056+0000 7fbdfca8e9c0 20 remove_watcher() i=4 2024-09-12T00:31:25.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.060+0000 7fbdfca8e9c0 20 remove_watcher() i=5 2024-09-12T00:31:25.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.060+0000 7fbdfca8e9c0 20 remove_watcher() i=6 2024-09-12T00:31:25.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.064+0000 7fbdfca8e9c0 20 remove_watcher() i=7 2024-09-12T00:31:25.077 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:25.077 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-block-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:31:25.077 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:25.134 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:31:25.167 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:25.167 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:25.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.212+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 realm 2024-09-12T00:31:25.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:25.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:25.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.216+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.220+0000 7fbf929b49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:25.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.220+0000 7fbf929b49c0 20 searching for the correct realm 2024-09-12T00:31:25.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.224+0000 7fbf90cbb640 0 -- 172.21.15.78:0/2706594005 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fbf80017070 msgr2=0x7fbf8007d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:25.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.435+0000 7fbf904ba640 0 -- 172.21.15.78:0/2706594005 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55845b598870 msgr2=0x55845b59ad00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:25.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.447+0000 7fbf929b49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:25.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.447+0000 7fbf929b49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:25.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.447+0000 7fbf929b49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:25.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.447+0000 7fbf929b49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:25.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.447+0000 7fbf929b49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:25.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.447+0000 7fbf929b49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:25.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.447+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:25.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:25.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 zone default found 2024-09-12T00:31:25.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 4 Realm: () 2024-09-12T00:31:25.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:25.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:25.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:25.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 zonegroup default 2024-09-12T00:31:25.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.451+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.455+0000 7fbf929b49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.455+0000 7fbf929b49c0 20 started sync module instance, tier type = 2024-09-12T00:31:25.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.455+0000 7fbf929b49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:25.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.475+0000 7fbf929b49c0 20 add_watcher() i=0 2024-09-12T00:31:25.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.475+0000 7fbf929b49c0 20 add_watcher() i=1 2024-09-12T00:31:25.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.475+0000 7fbf929b49c0 20 add_watcher() i=2 2024-09-12T00:31:25.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.475+0000 7fbf929b49c0 20 add_watcher() i=3 2024-09-12T00:31:25.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.475+0000 7fbf929b49c0 20 add_watcher() i=4 2024-09-12T00:31:25.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.475+0000 7fbf929b49c0 20 add_watcher() i=5 2024-09-12T00:31:25.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.475+0000 7fbf929b49c0 20 add_watcher() i=6 2024-09-12T00:31:25.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.479+0000 7fbf929b49c0 20 add_watcher() i=7 2024-09-12T00:31:25.479 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.479+0000 7fbf929b49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:25.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.483+0000 7fbe467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:25.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.483+0000 7fbf929b49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:25.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.483+0000 7fbf929b49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:25.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.483+0000 7fbf929b49c0 5 note: GC not initialized 2024-09-12T00:31:25.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.483+0000 7fbe457e2640 20 reqs_thread_entry: start 2024-09-12T00:31:25.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:25.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 20 Filter name: none 2024-09-12T00:31:25.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbdb6ffd640 20 reqs_thread_entry: start 2024-09-12T00:31:25.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 cache get: name=default.rgw.meta+root+error-at-block-writes : miss 2024-09-12T00:31:25.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:25.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 cache put: name=default.rgw.meta+root+error-at-block-writes info.flags=0x11 2024-09-12T00:31:25.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 adding default.rgw.meta+root+error-at-block-writes to cache LRU end 2024-09-12T00:31:25.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 : miss 2024-09-12T00:31:25.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:25.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:25.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:25.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:25.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:25.488 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.487+0000 7fbf929b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 2024-09-12T00:31:25.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.499+0000 7fbf929b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:25.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.499+0000 7fbf929b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:25.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.499+0000 7fbf929b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:25.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.499+0000 7fbf929b49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28, ofs0, ns] 2024-09-12T00:31:25.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbe6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398891 cookie 94026956708432 notifier 6635 bl.length()=915 2024-09-12T00:31:25.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbe6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:25.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbe6f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:25.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbe6f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:25.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_sources= new_sources= 2024-09-12T00:31:25.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential sources added=[] removed=[] 2024-09-12T00:31:25.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_dests= new_dests= 2024-09-12T00:31:25.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.503+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential dests added=[] removed=[] 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.0 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.0 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.1 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.1 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.2 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.2 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.3 2024-09-12T00:31:25.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.3 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.4 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.4 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.5 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.5 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.6 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.6 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.7 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.7 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.8 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.8 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.9 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.9 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.10 2024-09-12T00:31:25.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.10 2024-09-12T00:31:25.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.11 2024-09-12T00:31:25.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1.11 2024-09-12T00:31:25.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.0 2024-09-12T00:31:25.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.511+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1 2024-09-12T00:31:25.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.515+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.2 2024-09-12T00:31:25.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.515+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.3 2024-09-12T00:31:25.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.515+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.4 2024-09-12T00:31:25.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.515+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.5 2024-09-12T00:31:25.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.515+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.6 2024-09-12T00:31:25.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.519+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.7 2024-09-12T00:31:25.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.519+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.8 2024-09-12T00:31:25.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.519+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.9 2024-09-12T00:31:25.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.523+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.10 2024-09-12T00:31:25.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.527+0000 7fbf929b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:25.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.527+0000 7fbf929b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 2024-09-12T00:31:25.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbf929b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:25.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbf929b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:25.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbf929b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:25.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbf929b49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28, ofs0, ns] 2024-09-12T00:31:25.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbe6effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398892 cookie 94026956708432 notifier 6635 bl.length()=915 2024-09-12T00:31:25.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbe6effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:25.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbe6effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:25.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.531+0000 7fbe6effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:25.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.535+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_sources= new_sources= 2024-09-12T00:31:25.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.535+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential sources added=[] removed=[] 2024-09-12T00:31:25.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.535+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_dests= new_dests= 2024-09-12T00:31:25.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.535+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential dests added=[] removed=[] 2024-09-12T00:31:25.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.539+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.0 2024-09-12T00:31:25.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.539+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.1 2024-09-12T00:31:25.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.539+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.2 2024-09-12T00:31:25.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.539+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.3 2024-09-12T00:31:25.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.539+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.4 2024-09-12T00:31:25.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.5 2024-09-12T00:31:25.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.6 2024-09-12T00:31:25.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.7 2024-09-12T00:31:25.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.8 2024-09-12T00:31:25.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.9 2024-09-12T00:31:25.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28.10 2024-09-12T00:31:25.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:25.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.543+0000 7fbf929b49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 2024-09-12T00:31:25.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbf929b49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:25.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbf929b49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:25.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbf929b49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:25.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbf929b49c0 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28, ofs0, ns] 2024-09-12T00:31:25.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbe6f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398893 cookie 94026956708432 notifier 6635 bl.length()=883 2024-09-12T00:31:25.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbe6f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 info.flags=0x17 2024-09-12T00:31:25.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbe6f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 to cache LRU end 2024-09-12T00:31:25.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.547+0000 7fbe6f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:25.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.551+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_sources= new_sources= 2024-09-12T00:31:25.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.551+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential sources added=[] removed=[] 2024-09-12T00:31:25.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.551+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): orig_dests= new_dests= 2024-09-12T00:31:25.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.551+0000 7fbf929b49c0 20 handle_bi_update(): bucket=:error-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28]): potential dests added=[] removed=[] 2024-09-12T00:31:25.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.555+0000 7fbf929b49c0 1 execute INFO: reshard of bucket "error-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:31:25.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.559+0000 7fbe467e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:25.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.563+0000 7fbf929b49c0 20 remove_watcher() i=0 2024-09-12T00:31:25.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.563+0000 7fbf929b49c0 2 removed watcher, disabling cache 2024-09-12T00:31:25.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.563+0000 7fbf929b49c0 20 remove_watcher() i=1 2024-09-12T00:31:25.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.567+0000 7fbf929b49c0 20 remove_watcher() i=2 2024-09-12T00:31:25.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.567+0000 7fbf929b49c0 20 remove_watcher() i=3 2024-09-12T00:31:25.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.571+0000 7fbf929b49c0 20 remove_watcher() i=4 2024-09-12T00:31:25.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.571+0000 7fbf929b49c0 20 remove_watcher() i=5 2024-09-12T00:31:25.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.575+0000 7fbf929b49c0 20 remove_watcher() i=6 2024-09-12T00:31:25.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.575+0000 7fbf929b49c0 20 remove_watcher() i=7 2024-09-12T00:31:25.598 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-block-writes 2024-09-12T00:31:25.630 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:25.630 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:25.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.679+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 realm 2024-09-12T00:31:25.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:25.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:25.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:25.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.683+0000 7f03630bd9c0 20 searching for the correct realm 2024-09-12T00:31:25.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.687+0000 7f03603c2640 0 -- 172.21.15.78:0/2179141878 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x55dfc48c3080 msgr2=0x55dfc48c5470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:25.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.695+0000 7f0360bc3640 0 -- 172.21.15.78:0/2179141878 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f0354065040 msgr2=0x7f03540819a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:25.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:25.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:25.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:25.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:25.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:25.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:25.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.703+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:25.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:25.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 zone default found 2024-09-12T00:31:25.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 4 Realm: () 2024-09-12T00:31:25.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:25.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:25.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:25.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 zonegroup default 2024-09-12T00:31:25.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:25.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 started sync module instance, tier type = 2024-09-12T00:31:25.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.707+0000 7f03630bd9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:25.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.723+0000 7f03630bd9c0 20 add_watcher() i=0 2024-09-12T00:31:25.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.723+0000 7f03630bd9c0 20 add_watcher() i=1 2024-09-12T00:31:25.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.723+0000 7f03630bd9c0 20 add_watcher() i=2 2024-09-12T00:31:25.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.723+0000 7f03630bd9c0 20 add_watcher() i=3 2024-09-12T00:31:25.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.723+0000 7f03630bd9c0 20 add_watcher() i=4 2024-09-12T00:31:25.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.723+0000 7f03630bd9c0 20 add_watcher() i=5 2024-09-12T00:31:25.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.723+0000 7f03630bd9c0 20 add_watcher() i=6 2024-09-12T00:31:25.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.727+0000 7f03630bd9c0 20 add_watcher() i=7 2024-09-12T00:31:25.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.727+0000 7f03630bd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:25.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f0216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 5 note: GC not initialized 2024-09-12T00:31:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f0215fe3640 20 reqs_thread_entry: start 2024-09-12T00:31:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 20 Filter name: none 2024-09-12T00:31:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f01877fe640 20 reqs_thread_entry: start 2024-09-12T00:31:25.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:25.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.731+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.735+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:25.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.735+0000 7f03630bd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:25.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.735+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.735+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:25.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.735+0000 7f03630bd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:25.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.735+0000 7f03630bd9c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:25.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.735+0000 7f03630bd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:25.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.739+0000 7f0216fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:25.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.743+0000 7f03630bd9c0 20 remove_watcher() i=0 2024-09-12T00:31:25.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.743+0000 7f03630bd9c0 2 removed watcher, disabling cache 2024-09-12T00:31:25.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.743+0000 7f03630bd9c0 20 remove_watcher() i=1 2024-09-12T00:31:25.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.747+0000 7f03630bd9c0 20 remove_watcher() i=2 2024-09-12T00:31:25.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.747+0000 7f03630bd9c0 20 remove_watcher() i=3 2024-09-12T00:31:25.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.751+0000 7f03630bd9c0 20 remove_watcher() i=4 2024-09-12T00:31:25.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.751+0000 7f03630bd9c0 20 remove_watcher() i=5 2024-09-12T00:31:25.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.755+0000 7f03630bd9c0 20 remove_watcher() i=6 2024-09-12T00:31:25.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:25.759+0000 7f03630bd9c0 20 remove_watcher() i=7 2024-09-12T00:31:25.772 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:25.772 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:25.772 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-block-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.28 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:31:25.772 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:25.883 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at block_writes 2024-09-12T00:31:25.883 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:26.295 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:31:26.327 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:26.327 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:26.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.371+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 realm 2024-09-12T00:31:26.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:26.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:26.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:26.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.375+0000 7f7ec4f809c0 20 searching for the correct realm 2024-09-12T00:31:26.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.383+0000 7f7ec3287640 0 -- 172.21.15.78:0/1065488783 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7eb401c8d0 msgr2=0x7f7eb402b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:26.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.599+0000 7f7ec2a86640 0 -- 172.21.15.78:0/1065488783 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55bbdfedc5c0 msgr2=0x55bbdfedea00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:26.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.607+0000 7f7ec4f809c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:26.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.607+0000 7f7ec4f809c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:26.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.607+0000 7f7ec4f809c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:26.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.607+0000 7f7ec4f809c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:26.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.607+0000 7f7ec4f809c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:26.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.607+0000 7f7ec4f809c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:26.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.607+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:26.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:26.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 zone default found 2024-09-12T00:31:26.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 4 Realm: () 2024-09-12T00:31:26.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:26.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:26.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:26.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 zonegroup default 2024-09-12T00:31:26.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.611+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.615+0000 7f7ec4f809c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.615+0000 7f7ec4f809c0 20 started sync module instance, tier type = 2024-09-12T00:31:26.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.615+0000 7f7ec4f809c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:26.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.635+0000 7f7ec4f809c0 20 add_watcher() i=0 2024-09-12T00:31:26.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.635+0000 7f7ec4f809c0 20 add_watcher() i=1 2024-09-12T00:31:26.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.635+0000 7f7ec4f809c0 20 add_watcher() i=2 2024-09-12T00:31:26.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.635+0000 7f7ec4f809c0 20 add_watcher() i=3 2024-09-12T00:31:26.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.635+0000 7f7ec4f809c0 20 add_watcher() i=4 2024-09-12T00:31:26.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.635+0000 7f7ec4f809c0 20 add_watcher() i=5 2024-09-12T00:31:26.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.635+0000 7f7ec4f809c0 20 add_watcher() i=6 2024-09-12T00:31:26.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.639+0000 7f7ec4f809c0 20 add_watcher() i=7 2024-09-12T00:31:26.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.639+0000 7f7ec4f809c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.643+0000 7f7d797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:26.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.643+0000 7f7ec4f809c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:26.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.643+0000 7f7ec4f809c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:26.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.643+0000 7f7ec4f809c0 5 note: GC not initialized 2024-09-12T00:31:26.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.643+0000 7f7cf3fff640 20 reqs_thread_entry: start 2024-09-12T00:31:26.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.643+0000 7f7ec4f809c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:26.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 Filter name: none 2024-09-12T00:31:26.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7cf1ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:26.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:26.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:26.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:26.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:26.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.647+0000 7f7ec4f809c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.651+0000 7f7ec4f809c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:26.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.651+0000 7f7ec4f809c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:26.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.651+0000 7f7d797e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:26.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.655+0000 7f7ec4f809c0 20 remove_watcher() i=0 2024-09-12T00:31:26.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.655+0000 7f7ec4f809c0 2 removed watcher, disabling cache 2024-09-12T00:31:26.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.659+0000 7f7ec4f809c0 20 remove_watcher() i=1 2024-09-12T00:31:26.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.659+0000 7f7ec4f809c0 20 remove_watcher() i=2 2024-09-12T00:31:26.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.663+0000 7f7ec4f809c0 20 remove_watcher() i=3 2024-09-12T00:31:26.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.663+0000 7f7ec4f809c0 20 remove_watcher() i=4 2024-09-12T00:31:26.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.667+0000 7f7ec4f809c0 20 remove_watcher() i=5 2024-09-12T00:31:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.667+0000 7f7ec4f809c0 20 remove_watcher() i=6 2024-09-12T00:31:26.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.671+0000 7f7ec4f809c0 20 remove_watcher() i=7 2024-09-12T00:31:26.688 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:26.689 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:26.689 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-block-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:31:26.689 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:26.689 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at block_writes 2024-09-12T00:31:26.725 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:26.725 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:26.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.771+0000 7f365c1189c0 20 realm 2024-09-12T00:31:26.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.771+0000 7f365c1189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:26.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:26.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:26.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:26.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:26.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.775+0000 7f365c1189c0 20 searching for the correct realm 2024-09-12T00:31:26.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.779+0000 7f365a41f640 0 -- 172.21.15.78:0/3524482295 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f364c01a040 msgr2=0x7f364c0633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:26.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:26.991+0000 7f365a41f640 0 -- 172.21.15.78:0/3524482295 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563e0a817bd0 msgr2=0x563e0a81a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:27.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:27.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:27.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:27.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:27.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:27.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:27.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.003+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:27.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 zone default found 2024-09-12T00:31:27.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 4 Realm: () 2024-09-12T00:31:27.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:27.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:27.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:27.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 zonegroup default 2024-09-12T00:31:27.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.011+0000 7f365c1189c0 20 started sync module instance, tier type = 2024-09-12T00:31:27.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.011+0000 7f365c1189c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=0 2024-09-12T00:31:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=1 2024-09-12T00:31:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=2 2024-09-12T00:31:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=3 2024-09-12T00:31:27.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=4 2024-09-12T00:31:27.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=5 2024-09-12T00:31:27.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=6 2024-09-12T00:31:27.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.035+0000 7f365c1189c0 20 add_watcher() i=7 2024-09-12T00:31:27.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.035+0000 7f365c1189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:27.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.039+0000 7f350ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:27.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.039+0000 7f365c1189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.039+0000 7f365c1189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.039+0000 7f365c1189c0 5 note: GC not initialized 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f350efe5640 20 reqs_thread_entry: start 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:27.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 20 Filter name: none 2024-09-12T00:31:27.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f350cfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:27.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:31:27.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:27.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:31:27.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:31:27.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : miss 2024-09-12T00:31:27.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:27.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:27.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.043+0000 7f365c1189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:27.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f365c1189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f365c1189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94824464227152 notifier 7119 bl.length()=915 2024-09-12T00:31:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.0 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.0 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.1 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.1 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.2 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.2 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.3 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.3 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.4 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.4 2024-09-12T00:31:27.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.5 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.5 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.6 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.6 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.7 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.7 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.8 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.8 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.9 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.9 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.10 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.10 2024-09-12T00:31:27.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.11 2024-09-12T00:31:27.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.11 2024-09-12T00:31:27.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.0 2024-09-12T00:31:27.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1 2024-09-12T00:31:27.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2 2024-09-12T00:31:27.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.3 2024-09-12T00:31:27.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.4 2024-09-12T00:31:27.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.5 2024-09-12T00:31:27.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.6 2024-09-12T00:31:27.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.7 2024-09-12T00:31:27.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.8 2024-09-12T00:31:27.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.083+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.9 2024-09-12T00:31:27.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.083+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.10 2024-09-12T00:31:27.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.087+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:27.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.087+0000 7f365c1189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:27.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:27.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398966 cookie 94824464227152 notifier 7119 bl.length()=915 2024-09-12T00:31:27.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:27.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:27.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:27.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:27.092 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f365c1189c0 time 2024-09-12T00:31:27.096952+0000 2024-09-12T00:31:27.092 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:27.093 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.093 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f365f9f22eb] 2024-09-12T00:31:27.093 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.093 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.095+0000 7f365c1189c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f365c1189c0 time 2024-09-12T00:31:27.096952+0000 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f365f9f22eb] 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.094 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:31:27.095 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f365c1189c0 thread_name:radosgw-admin 2024-09-12T00:31:27.101 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f365e871520] 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f365f9f2345] 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.102 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.095+0000 7f365c1189c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f365c1189c0 thread_name:radosgw-admin 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f365e871520] 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f365f9f2345] 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.103 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 AuthRegistry(0x563e0a72ba20) adding con mode: crc 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 AuthRegistry(0x563e0a72ba20) adding con mode: secure 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:31:26.751+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:31:26.751+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.104 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key hook 0x563e0a72bb68 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a5db820 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a5e6a80 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a677170 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.088984s 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): get_auth_request con 0x563e0a5e6a80 auth_method 0 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.105 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a5db820 auth_method 0 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a677170 auth_method 0 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.106 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_done global_id 7110 payload 824 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:31:26.751+0000 7f365941d640 1 monclient: found mon.noname-a 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: dump: 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.107 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: dump: 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.108 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 monclient: authenticate success, global_id 7110 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:31:26.751+0000 7f3547e07640 4 set_mon_vals no callback set 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.109 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:31:26.751+0000 7f365c1189c0 1 librados: init done 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:31:26.751+0000 7f3546604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:31:26.751+0000 7f3546604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:31:26.751+0000 7f3546604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:31:26.755+0000 7f3659c1e640 10 monclient: get_auth_request con 0x7f3540070ae0 auth_method 0 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:31:26.755+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a773520 auth_method 0 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:31:26.755+0000 7f3659c1e640 10 monclient: get_auth_request con 0x563e0a776700 auth_method 0 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:31:26.755+0000 7f365941d640 10 monclient: get_auth_request con 0x563e0a77a8f0 auth_method 0 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a779fb0 auth_method 0 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: build_initial_monmap 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:31:26.759+0000 7f365c1189c0 1 build_initial for_mkfs: 0 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: monmap: 2024-09-12T00:31:27.110 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding auth protocol: cephx 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding auth protocol: cephx 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding auth protocol: cephx 2024-09-12T00:31:27.111 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:31:26.759+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e0a786290 EEXIST 2024-09-12T00:31:27.112 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: init 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding auth protocol: cephx 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding auth protocol: cephx 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding auth protocol: cephx 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.113 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:31:26.759+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:31:26.759+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key cmddesc rotate-key hook 0x563e0a781950 EEXIST 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a7aa440 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a7a9d70 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a7a8750 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.114 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.099260s 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a7a8750 auth_method 0 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a7a9d70 auth_method 0 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.115 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): get_auth_request con 0x563e0a7aa440 auth_method 0 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_done global_id 6677 payload 824 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:31:26.759+0000 7f3659c1e640 1 monclient: found mon.noname-c 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: dump: 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.116 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:27.117 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: dump: 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 monclient: authenticate success, global_id 6677 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:31:26.763+0000 7f365ac20640 4 set_mon_vals no callback set 2024-09-12T00:31:27.118 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:31:26.763+0000 7f353f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:31:26.763+0000 7f353f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:31:26.763+0000 7f353f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient: get_auth_request con 0x7f3534070a20 auth_method 0 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: get_monmap_and_config 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: build_initial_monmap 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:31:26.763+0000 7f365c1189c0 1 build_initial for_mkfs: 0 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: monmap: 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:31:27.119 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding auth protocol: cephx 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding auth protocol: cephx 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding auth protocol: cephx 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.120 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:31:26.763+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: init 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding auth protocol: cephx 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding auth protocol: cephx 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding auth protocol: cephx 2024-09-12T00:31:27.121 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:31:26.763+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:31:26.763+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.122 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff642989a8 EEXIST 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a7f84e0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a7cbeb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a7f9dc0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.103608s 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): get_auth_request con 0x563e0a7f84e0 auth_method 0 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.123 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a7f9dc0 auth_method 0 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a7cbeb0 auth_method 0 2024-09-12T00:31:27.124 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_done global_id 6680 payload 274 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:31:26.767+0000 7f365941d640 1 monclient: found mon.noname-c 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:31:26.767+0000 7f365941d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: dump: 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.125 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: dump: 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.126 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 monclient: authenticate success, global_id 6680 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: get_monmap_and_config success 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:31:26.767+0000 7f365c1189c0 4 set_mon_vals no callback set 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: shutdown 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: build_initial_monmap 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 build_initial for_mkfs: 0 2024-09-12T00:31:27.127 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: monmap: 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding auth protocol: cephx 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding auth protocol: cephx 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding auth protocol: cephx 2024-09-12T00:31:27.128 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.129 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:31:26.767+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: starting msgr at 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: starting objecter 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e0a7cfe20 EEXIST 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: setting wanted keys 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: calling monclient init 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: init 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding auth protocol: cephx 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding auth protocol: cephx 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding auth protocol: cephx 2024-09-12T00:31:27.130 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:31:26.767+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.131 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:31:26.767+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key cmddesc rotate-key hook 0x563e0a7ac3a8 EEXIST 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a7cbeb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a7f84e0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a7f9dc0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.106285s 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a7f84e0 auth_method 0 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.132 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a7f9dc0 auth_method 0 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_done global_id 7119 payload 824 2024-09-12T00:31:27.133 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:31:26.767+0000 7f3659c1e640 1 monclient: found mon.noname-a 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:31:26.767+0000 7f365941d640 10 monclient: get_auth_request con 0x563e0a7cbeb0 auth_method 0 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: dump: 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.134 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: dump: 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.135 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.136 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.136 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.136 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.136 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.136 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.136 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 monclient: authenticate success, global_id 7119 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:31:26.767+0000 7f353d7fa640 4 set_mon_vals no callback set 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: init done 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cr dump hook 0x563e0a7fcf98 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:31:26.771+0000 7f352b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:31:26.771+0000 7f352b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.137 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:31:26.771+0000 7f352b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:31:26.771+0000 7f365941d640 10 monclient: get_auth_request con 0x7f3524070b10 auth_method 0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:31:26.771+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a817bd0 auth_method 0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 realm 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:31:26.771+0000 7f365c1189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:31:26.775+0000 7f365941d640 10 monclient: get_auth_request con 0x563e0a81be00 auth_method 0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.138 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:31:26.775+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a81f680 auth_method 0 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 searching for the correct realm 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:31:26.775+0000 7f3659c1e640 10 monclient: get_auth_request con 0x563e0a824390 auth_method 0 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:31:26.779+0000 7f365941d640 10 monclient: get_auth_request con 0x7f364c027040 auth_method 0 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:31:26.779+0000 7f365a41f640 0 -- 172.21.15.78:0/3524482295 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f364c01a040 msgr2=0x7f364c0633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:31:26.983+0000 7f365a41f640 10 monclient: get_auth_request con 0x7f364c01a040 auth_method 0 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:31:26.987+0000 7f3659c1e640 10 monclient: get_auth_request con 0x7f3650008050 auth_method 0 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:31:26.991+0000 7f365941d640 10 monclient: get_auth_request con 0x7f364c009a20 auth_method 0 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:31:26.991+0000 7f365a41f640 0 -- 172.21.15.78:0/3524482295 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563e0a817bd0 msgr2=0x563e0a81a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:31:26.995+0000 7f352b7fe640 1 client.7119.objecter ms_handle_reset 0x563e0a817bd0 session 0x563e0a8174c0 osd.6 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:31:26.995+0000 7f352b7fe640 10 monclient: _renew_subs 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:31:26.995+0000 7f352b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.139 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:31:26.995+0000 7f365a41f640 10 monclient: get_auth_request con 0x7f3524080dc0 auth_method 0 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 zone default found 2024-09-12T00:31:27.140 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:31:27.007+0000 7f365c1189c0 4 Realm: () 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:31:27.007+0000 7f365c1189c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:31:27.007+0000 7f365c1189c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:31:27.007+0000 7f365c1189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 zonegroup default 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 started sync module instance, tier type = 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=0 2024-09-12T00:31:27.141 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=1 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=2 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=3 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=4 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=5 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=6 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:31:27.035+0000 7f365c1189c0 20 add_watcher() i=7 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:31:27.035+0000 7f365c1189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding auth protocol: cephx 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding auth protocol: cephx 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding auth protocol: cephx 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.142 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:31:27.039+0000 7f350ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:31:27.039+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:31:27.039+0000 7f365c1189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:31:27.039+0000 7f365c1189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache list hook 0x563e0a7f7600 2024-09-12T00:31:27.143 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache inspect hook 0x563e0a7f7600 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache erase hook 0x563e0a7f7600 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache zap hook 0x563e0a7f7600 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 note: GC not initialized 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:31:27.043+0000 7f350efe5640 20 reqs_thread_entry: start 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace show hook 0x7f36500043b0 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace history hook 0x7f36500043b0 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace active hook 0x7f36500043b0 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace active_short hook 0x7f36500043b0 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 Filter name: none 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:31:27.043+0000 7f350cfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:31:27.144 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : miss 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:31:27.047+0000 7f352b7fe640 1 client.7119.objecter ms_handle_reset 0x7f3650008050 session 0x7f3650058a80 osd.7 2024-09-12T00:31:27.145 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:31:27.051+0000 7f3659c1e640 10 monclient: get_auth_request con 0x563e0a817bd0 auth_method 0 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94824464227152 notifier 7119 bl.length()=915 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.0 2024-09-12T00:31:27.146 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.0 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.1 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.1 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.2 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.2 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.3 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.3 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.4 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.4 2024-09-12T00:31:27.147 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.5 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.5 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.6 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.6 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.7 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.7 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.8 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.8 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.9 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.9 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.10 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.10 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.11 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.11 2024-09-12T00:31:27.148 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.0 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.3 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.4 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.5 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.6 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.7 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.8 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:31:27.083+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.9 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:31:27.083+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.10 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:31:27.087+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:31:27.087+0000 7f365c1189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:27.149 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398966 cookie 94824464227152 notifier 7119 bl.length()=915 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:31:27.095+0000 7f365c1189c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f365c1189c0 time 2024-09-12T00:31:27.096952+0000 2024-09-12T00:31:27.150 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f365f9f22eb] 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:31:27.095+0000 7f365c1189c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:31:27.151 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f365c1189c0 thread_name:radosgw-admin 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f365e871520] 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f365f9f2345] 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:31:27.152 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:31:27.153 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:31:27.154 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:31:27.155 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:31:27.156 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:31:27.157 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:31:27.158 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:31:27.159 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f350cfe1640 / http_manager 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f350efe5640 / http_manager 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f350ffe7640 / rgw_dt_lg_renew 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f352b7fe640 / ms_dispatch 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f353d7fa640 / io_context_pool 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f353f7fe640 / ms_dispatch 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3546604640 / ms_dispatch 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3547e07640 / io_context_pool 2024-09-12T00:31:27.160 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365941d640 / msgr-worker-2 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3659c1e640 / msgr-worker-1 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365a41f640 / msgr-worker-0 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365ac20640 / io_context_pool 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365c1189c0 / radosgw-admin 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.104625.log 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 AuthRegistry(0x563e0a72ba20) adding con mode: crc 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 AuthRegistry(0x563e0a72ba20) adding con mode: secure 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:31:26.751+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:31:26.751+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.161 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key hook 0x563e0a72bb68 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a5db820 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a5e6a80 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a677170 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.088984s 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): get_auth_request con 0x563e0a5e6a80 auth_method 0 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.162 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a5db820 auth_method 0 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:31:26.751+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a677170 auth_method 0 2024-09-12T00:31:27.163 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:31:26.751+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient(hunting): handle_auth_done global_id 7110 payload 824 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:31:26.751+0000 7f365941d640 1 monclient: found mon.noname-a 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:31:26.751+0000 7f365941d640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: dump: 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.164 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:31:26.751+0000 7f3546604640 10 monclient: dump: 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.165 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:31:26.751+0000 7f365c1189c0 5 monclient: authenticate success, global_id 7110 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:31:26.751+0000 7f3547e07640 4 set_mon_vals no callback set 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.166 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:31:26.751+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:31:26.751+0000 7f365c1189c0 1 librados: init done 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:31:26.751+0000 7f3546604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:31:26.751+0000 7f3546604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:31:26.751+0000 7f3546604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:31:26.755+0000 7f3659c1e640 10 monclient: get_auth_request con 0x7f3540070ae0 auth_method 0 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:31:26.755+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a773520 auth_method 0 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:31:26.755+0000 7f3659c1e640 10 monclient: get_auth_request con 0x563e0a776700 auth_method 0 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:31:26.755+0000 7f365941d640 10 monclient: get_auth_request con 0x563e0a77a8f0 auth_method 0 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a779fb0 auth_method 0 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: build_initial_monmap 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:31:26.759+0000 7f365c1189c0 1 build_initial for_mkfs: 0 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: monmap: 2024-09-12T00:31:27.167 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding auth protocol: cephx 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding auth protocol: cephx 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding auth protocol: cephx 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.168 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: crc 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a782910) adding con mode: secure 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:31:26.759+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e0a786290 EEXIST 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: init 2024-09-12T00:31:27.169 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding auth protocol: cephx 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding auth protocol: cephx 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding auth protocol: cephx 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: crc 2024-09-12T00:31:27.170 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 AuthRegistry(0x563e0a781808) adding con mode: secure 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:31:26.759+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:31:26.759+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:31:26.759+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key cmddesc rotate-key hook 0x563e0a781950 EEXIST 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a7aa440 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a7a9d70 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a7a8750 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:31:26.759+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.099260s 2024-09-12T00:31:27.171 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a7a8750 auth_method 0 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a7a9d70 auth_method 0 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.172 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:31:26.759+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): get_auth_request con 0x563e0a7aa440 auth_method 0 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:31:26.759+0000 7f365941d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient(hunting): handle_auth_done global_id 6677 payload 824 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:31:26.759+0000 7f3659c1e640 1 monclient: found mon.noname-c 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:31:26.759+0000 7f3659c1e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: dump: 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.173 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:27.174 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:31:26.763+0000 7f353f7fe640 10 monclient: dump: 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 monclient: authenticate success, global_id 6677 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.175 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:31:26.763+0000 7f365ac20640 4 set_mon_vals no callback set 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:31:26.763+0000 7f353f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:31:26.763+0000 7f353f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:31:26.763+0000 7f353f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient: get_auth_request con 0x7f3534070a20 auth_method 0 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: get_monmap_and_config 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: build_initial_monmap 2024-09-12T00:31:27.176 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:31:26.763+0000 7f365c1189c0 1 build_initial for_mkfs: 0 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: monmap: 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding auth protocol: cephx 2024-09-12T00:31:27.177 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding auth protocol: cephx 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding auth protocol: cephx 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: crc 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7c9d90) adding con mode: secure 2024-09-12T00:31:27.178 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:31:26.763+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: init 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding auth protocol: cephx 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding auth protocol: cephx 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding auth protocol: cephx 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.179 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: crc 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298860) adding con mode: secure 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:31:26.763+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:31:26.763+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:31:26.763+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key cmddesc rotate-key hook 0x7fff642989a8 EEXIST 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a7f84e0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a7cbeb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a7f9dc0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.180 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:31:26.763+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.103608s 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): get_auth_request con 0x563e0a7f84e0 auth_method 0 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a7f9dc0 auth_method 0 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.181 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:31:26.763+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a7cbeb0 auth_method 0 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:31:26.763+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient(hunting): handle_auth_done global_id 6680 payload 274 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:31:26.763+0000 7f365941d640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:31:26.767+0000 7f365941d640 1 monclient: found mon.noname-c 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:31:26.767+0000 7f365941d640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:31:27.182 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: dump: 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.183 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:31:26.767+0000 7f353d7fa640 10 monclient: dump: 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.184 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 monclient: authenticate success, global_id 6680 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: get_monmap_and_config success 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:31:26.767+0000 7f365c1189c0 4 set_mon_vals no callback set 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: shutdown 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: build_initial_monmap 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 build_initial for_mkfs: 0 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: monmap: 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:31:27.185 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding auth protocol: cephx 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding auth protocol: cephx 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding auth protocol: cephx 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.186 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: crc 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7fda50) adding con mode: secure 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:31:26.767+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: starting msgr at 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: starting objecter 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command objecter_requests cmddesc objecter_requests hook 0x563e0a7cfe20 EEXIST 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: setting wanted keys 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: calling monclient init 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: init 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding auth protocol: cephx 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding auth protocol: cephx 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding auth protocol: cephx 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.187 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: crc 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 AuthRegistry(0x563e0a7ac260) adding con mode: secure 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:31:26.767+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:31:26.767+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command rotate-key cmddesc rotate-key hook 0x563e0a7ac3a8 EEXIST 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _reopen_session rank -1 2024-09-12T00:31:27.188 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-b con 0x563e0a7cbeb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-c con 0x563e0a7f84e0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): picked mon.noname-a con 0x563e0a7f9dc0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): _renew_subs 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient(hunting): authenticate will time out at 2211.106285s 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): get_auth_request con 0x563e0a7f84e0 auth_method 0 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.189 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): get_auth_request con 0x563e0a7f9dc0 auth_method 0 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:31:26.767+0000 7f365a41f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient(hunting): handle_auth_done global_id 7119 payload 824 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient: _finish_hunting 0 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:31:26.767+0000 7f3659c1e640 1 monclient: found mon.noname-a 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:31:26.767+0000 7f3659c1e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:31:26.767+0000 7f365941d640 10 monclient: get_auth_request con 0x563e0a7cbeb0 auth_method 0 2024-09-12T00:31:27.190 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: dump: 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:31:27.191 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:31:26.767+0000 7f352b7fe640 10 monclient: dump: 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 monclient: authenticate success, global_id 7119 2024-09-12T00:31:27.192 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:31:26.767+0000 7f353d7fa640 4 set_mon_vals no callback set 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _renew_subs 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:31:26.767+0000 7f365c1189c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:31:26.767+0000 7f365c1189c0 1 librados: init done 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:31:26.767+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cr dump hook 0x563e0a7fcf98 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:31:26.771+0000 7f352b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:31:26.771+0000 7f352b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:31:26.771+0000 7f352b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:31:26.771+0000 7f365941d640 10 monclient: get_auth_request con 0x7f3524070b10 auth_method 0 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:31:26.771+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a817bd0 auth_method 0 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 realm 2024-09-12T00:31:27.193 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:31:26.771+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:31:26.771+0000 7f365c1189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:31:26.775+0000 7f365941d640 10 monclient: get_auth_request con 0x563e0a81be00 auth_method 0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:31:26.775+0000 7f365a41f640 10 monclient: get_auth_request con 0x563e0a81f680 auth_method 0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:31:26.775+0000 7f365c1189c0 20 searching for the correct realm 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:31:26.775+0000 7f3659c1e640 10 monclient: get_auth_request con 0x563e0a824390 auth_method 0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:31:26.779+0000 7f365941d640 10 monclient: get_auth_request con 0x7f364c027040 auth_method 0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:31:26.779+0000 7f365a41f640 0 -- 172.21.15.78:0/3524482295 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f364c01a040 msgr2=0x7f364c0633a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:31:26.983+0000 7f365a41f640 10 monclient: get_auth_request con 0x7f364c01a040 auth_method 0 2024-09-12T00:31:27.194 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:31:26.987+0000 7f3659c1e640 10 monclient: get_auth_request con 0x7f3650008050 auth_method 0 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:31:26.991+0000 7f365941d640 10 monclient: get_auth_request con 0x7f364c009a20 auth_method 0 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:31:26.991+0000 7f365a41f640 0 -- 172.21.15.78:0/3524482295 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563e0a817bd0 msgr2=0x563e0a81a090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:31:26.995+0000 7f352b7fe640 1 client.7119.objecter ms_handle_reset 0x563e0a817bd0 session 0x563e0a8174c0 osd.6 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:31:26.995+0000 7f352b7fe640 10 monclient: _renew_subs 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:31:26.995+0000 7f352b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:31:26.995+0000 7f365a41f640 10 monclient: get_auth_request con 0x7f3524080dc0 auth_method 0 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:27.195 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:31:27.003+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 zone default found 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:31:27.007+0000 7f365c1189c0 4 Realm: () 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:31:27.007+0000 7f365c1189c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:31:27.007+0000 7f365c1189c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:31:27.007+0000 7f365c1189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 zonegroup default 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.196 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:31:27.007+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 started sync module instance, tier type = 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:31:27.011+0000 7f365c1189c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=0 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=1 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=2 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=3 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=4 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=5 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:31:27.031+0000 7f365c1189c0 20 add_watcher() i=6 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:31:27.035+0000 7f365c1189c0 20 add_watcher() i=7 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:31:27.035+0000 7f365c1189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding auth protocol: cephx 2024-09-12T00:31:27.197 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding auth protocol: cephx 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding auth protocol: cephx 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: crc 2024-09-12T00:31:27.198 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:31:27.039+0000 7f350ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 AuthRegistry(0x7fff64298d40) adding con mode: secure 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:31:27.039+0000 7f365c1189c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:31:27.039+0000 7f365c1189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:31:27.039+0000 7f365c1189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache list hook 0x563e0a7f7600 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache inspect hook 0x563e0a7f7600 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache erase hook 0x563e0a7f7600 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command cache zap hook 0x563e0a7f7600 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:31:27.039+0000 7f365c1189c0 5 note: GC not initialized 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:31:27.043+0000 7f350efe5640 20 reqs_thread_entry: start 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace show hook 0x7f36500043b0 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace history hook 0x7f36500043b0 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace active hook 0x7f36500043b0 2024-09-12T00:31:27.199 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:31:27.043+0000 7f365c1189c0 5 asok(0x563e0a51e2b0) register_command sync trace active_short hook 0x7f36500043b0 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 Filter name: none 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:31:27.043+0000 7f350cfe1640 20 reqs_thread_entry: start 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : miss 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:31:27.043+0000 7f365c1189c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.200 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:31:27.043+0000 7f365c1189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:31:27.047+0000 7f352b7fe640 1 client.7119.objecter ms_handle_reset 0x7f3650008050 session 0x7f3650058a80 osd.7 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:31:27.051+0000 7f3659c1e640 10 monclient: get_auth_request con 0x563e0a817bd0 auth_method 0 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:31:27.055+0000 7f365c1189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398965 cookie 94824464227152 notifier 7119 bl.length()=915 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.201 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:31:27.055+0000 7f353d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:31:27.059+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.0 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.0 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.1 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.1 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.2 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.2 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.3 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.3 2024-09-12T00:31:27.202 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.4 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.4 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.5 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.5 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.6 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.6 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.7 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.7 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.8 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.8 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.9 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.9 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.10 2024-09-12T00:31:27.203 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.10 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:31:27.071+0000 7f365c1189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.11 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1.11 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.0 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:31:27.071+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.3 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.4 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:31:27.075+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.5 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.6 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.7 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:31:27.079+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.8 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:31:27.083+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.9 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:31:27.083+0000 7f365c1189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.10 2024-09-12T00:31:27.204 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:31:27.087+0000 7f365c1189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:31:27.087+0000 7f365c1189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:31:27.091+0000 7f365c1189c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398966 cookie 94824464227152 notifier 7119 bl.length()=915 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:31:27.091+0000 7f353d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:31:27.091+0000 7f365c1189c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:27.205 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:31:27.095+0000 7f365c1189c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f365c1189c0 time 2024-09-12T00:31:27.096952+0000 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f365f9f22eb] 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.206 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:31:27.095+0000 7f365c1189c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f365c1189c0 thread_name:radosgw-admin 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f365e871520] 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f365f9f2345] 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f365f9f249f] 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x563e0759acc1] 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x19f6) [0x563e075af086] 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x563e075b06a4] 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f365e858d90] 2024-09-12T00:31:27.207 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:31:27.208 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:31:27.209 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:31:27.210 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:31:27.211 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:31:27.212 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:31:27.213 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:31:27.214 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f350cfe1640 / http_manager 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f350efe5640 / http_manager 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f350ffe7640 / rgw_dt_lg_renew 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f352b7fe640 / ms_dispatch 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f353d7fa640 / io_context_pool 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f353f7fe640 / ms_dispatch 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3546604640 / ms_dispatch 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3547e07640 / io_context_pool 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365941d640 / msgr-worker-2 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3659c1e640 / msgr-worker-1 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365a41f640 / msgr-worker-0 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365ac20640 / io_context_pool 2024-09-12T00:31:27.215 INFO:tasks.workunit.client.0.smithi078.stderr: 7f365c1189c0 / radosgw-admin 2024-09-12T00:31:27.216 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:31:27.216 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:31:27.216 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:31:27.099487Z_b6882f19-b767-4f1a-87cd-6bab990c163c/log 2024-09-12T00:31:27.216 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:31:27.217 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:31:27.217 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.175+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 realm 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.179+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.183+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:27.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.183+0000 7f4b7d1b59c0 20 searching for the correct realm 2024-09-12T00:31:27.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.187+0000 7f4b7b4bc640 0 -- 172.21.15.78:0/3558197396 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f4b6c067530 msgr2=0x7f4b6c07f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:27.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.399+0000 7f4b7a4ba640 0 -- 172.21.15.78:0/3558197396 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f4b6c08abb0 msgr2=0x7f4b6c085890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:27.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.415+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 zone default found 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 4 Realm: () 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 zonegroup default 2024-09-12T00:31:27.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 started sync module instance, tier type = 2024-09-12T00:31:27.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.419+0000 7f4b7d1b59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:27.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.443+0000 7f4b7d1b59c0 20 add_watcher() i=0 2024-09-12T00:31:27.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.443+0000 7f4b7d1b59c0 20 add_watcher() i=1 2024-09-12T00:31:27.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.443+0000 7f4b7d1b59c0 20 add_watcher() i=2 2024-09-12T00:31:27.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.443+0000 7f4b7d1b59c0 20 add_watcher() i=3 2024-09-12T00:31:27.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.443+0000 7f4b7d1b59c0 20 add_watcher() i=4 2024-09-12T00:31:27.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.443+0000 7f4b7d1b59c0 20 add_watcher() i=5 2024-09-12T00:31:27.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.443+0000 7f4b7d1b59c0 20 add_watcher() i=6 2024-09-12T00:31:27.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.447+0000 7f4b7d1b59c0 20 add_watcher() i=7 2024-09-12T00:31:27.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.447+0000 7f4b7d1b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:27.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f4a317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:27.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f4b7d1b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f4b7d1b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f4b7d1b59c0 5 note: GC not initialized 2024-09-12T00:31:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f49abfff640 20 reqs_thread_entry: start 2024-09-12T00:31:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f4b7d1b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f4b7d1b59c0 20 Filter name: none 2024-09-12T00:31:27.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f49a9ffb640 20 reqs_thread_entry: start 2024-09-12T00:31:27.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.451+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:27.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:31:27.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:27.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:27.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:31:27.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.455+0000 7f4b7d1b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:27.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.459+0000 7f4a317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:27.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.463+0000 7f4b7d1b59c0 20 remove_watcher() i=0 2024-09-12T00:31:27.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.463+0000 7f4b7d1b59c0 2 removed watcher, disabling cache 2024-09-12T00:31:27.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.467+0000 7f4b7d1b59c0 20 remove_watcher() i=1 2024-09-12T00:31:27.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.467+0000 7f4b7d1b59c0 20 remove_watcher() i=2 2024-09-12T00:31:27.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.471+0000 7f4b7d1b59c0 20 remove_watcher() i=3 2024-09-12T00:31:27.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.475+0000 7f4b7d1b59c0 20 remove_watcher() i=4 2024-09-12T00:31:27.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.475+0000 7f4b7d1b59c0 20 remove_watcher() i=5 2024-09-12T00:31:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.479+0000 7f4b7d1b59c0 20 remove_watcher() i=6 2024-09-12T00:31:27.480 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.479+0000 7f4b7d1b59c0 20 remove_watcher() i=7 2024-09-12T00:31:27.497 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.497 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:27.497 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-block-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:31:27.497 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:27.554 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:31:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:27.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.635+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 realm 2024-09-12T00:31:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:27.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.639+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.643+0000 7f746841f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.643+0000 7f746841f9c0 20 searching for the correct realm 2024-09-12T00:31:27.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.647+0000 7f7466726640 0 -- 172.21.15.78:0/1908602817 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f745807b510 msgr2=0x7f7458079680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:27.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.859+0000 7f7465f25640 0 -- 172.21.15.78:0/1908602817 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x56467d64a520 msgr2=0x56467d64c960 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:27.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:27.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:27.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:27.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:27.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:27.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:27.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:27.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.875+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 zone default found 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 4 Realm: () 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 zonegroup default 2024-09-12T00:31:27.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:27.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 started sync module instance, tier type = 2024-09-12T00:31:27.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.879+0000 7f746841f9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:27.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.903+0000 7f746841f9c0 20 add_watcher() i=0 2024-09-12T00:31:27.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.903+0000 7f746841f9c0 20 add_watcher() i=1 2024-09-12T00:31:27.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.903+0000 7f746841f9c0 20 add_watcher() i=2 2024-09-12T00:31:27.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.903+0000 7f746841f9c0 20 add_watcher() i=3 2024-09-12T00:31:27.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.903+0000 7f746841f9c0 20 add_watcher() i=4 2024-09-12T00:31:27.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.903+0000 7f746841f9c0 20 add_watcher() i=5 2024-09-12T00:31:27.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.903+0000 7f746841f9c0 20 add_watcher() i=6 2024-09-12T00:31:27.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.907+0000 7f746841f9c0 20 add_watcher() i=7 2024-09-12T00:31:27.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.907+0000 7f746841f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:27.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.911+0000 7f73177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:27.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.911+0000 7f746841f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:27.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.911+0000 7f746841f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:27.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.911+0000 7f746841f9c0 5 note: GC not initialized 2024-09-12T00:31:27.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.911+0000 7f73167fc640 20 reqs_thread_entry: start 2024-09-12T00:31:27.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.911+0000 7f746841f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:27.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.911+0000 7f746841f9c0 20 Filter name: none 2024-09-12T00:31:27.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f7287fff640 20 reqs_thread_entry: start 2024-09-12T00:31:27.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:31:27.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:27.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:31:27.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:31:27.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : miss 2024-09-12T00:31:27.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:27.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:31:27.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:27.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:27.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:27.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:27.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.915+0000 7f746841f9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:27.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.919+0000 7f746841f9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to be held by another RGW process; skipping for now 2024-09-12T00:31:27.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.919+0000 7f73177fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:27.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.923+0000 7f746841f9c0 20 remove_watcher() i=0 2024-09-12T00:31:27.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.923+0000 7f746841f9c0 2 removed watcher, disabling cache 2024-09-12T00:31:27.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.927+0000 7f746841f9c0 20 remove_watcher() i=1 2024-09-12T00:31:27.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.927+0000 7f746841f9c0 20 remove_watcher() i=2 2024-09-12T00:31:27.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.931+0000 7f746841f9c0 20 remove_watcher() i=3 2024-09-12T00:31:27.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.931+0000 7f746841f9c0 20 remove_watcher() i=4 2024-09-12T00:31:27.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.935+0000 7f746841f9c0 20 remove_watcher() i=5 2024-09-12T00:31:27.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.935+0000 7f746841f9c0 20 remove_watcher() i=6 2024-09-12T00:31:27.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:27.939+0000 7f746841f9c0 20 remove_watcher() i=7 2024-09-12T00:31:27.957 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:31:57.987 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-block-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:31:58.023 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:58.023 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:58.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.067+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 20 realm 2024-09-12T00:31:58.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:58.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.071+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.075+0000 7fc691c449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:58.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.075+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.075+0000 7fc691c449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:58.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.075+0000 7fc691c449c0 20 searching for the correct realm 2024-09-12T00:31:58.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.079+0000 7fc68ff4b640 0 -- 172.21.15.78:0/1514226919 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fc68005b5b0 msgr2=0x7fc680087120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:58.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.295+0000 7fc68f74a640 0 -- 172.21.15.78:0/1514226919 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ec740ec520 msgr2=0x55ec740ee9b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:58.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.303+0000 7fc691c449c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:58.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.303+0000 7fc691c449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:58.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.303+0000 7fc691c449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:58.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.303+0000 7fc691c449c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:58.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.303+0000 7fc691c449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:58.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.303+0000 7fc691c449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:58.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.303+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:58.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 zone default found 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 4 Realm: () 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 zonegroup default 2024-09-12T00:31:58.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 started sync module instance, tier type = 2024-09-12T00:31:58.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.307+0000 7fc691c449c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:58.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.331+0000 7fc691c449c0 20 add_watcher() i=0 2024-09-12T00:31:58.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.331+0000 7fc691c449c0 20 add_watcher() i=1 2024-09-12T00:31:58.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.331+0000 7fc691c449c0 20 add_watcher() i=2 2024-09-12T00:31:58.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.331+0000 7fc691c449c0 20 add_watcher() i=3 2024-09-12T00:31:58.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.331+0000 7fc691c449c0 20 add_watcher() i=4 2024-09-12T00:31:58.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.331+0000 7fc691c449c0 20 add_watcher() i=5 2024-09-12T00:31:58.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.331+0000 7fc691c449c0 20 add_watcher() i=6 2024-09-12T00:31:58.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.335+0000 7fc691c449c0 20 add_watcher() i=7 2024-09-12T00:31:58.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.335+0000 7fc691c449c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:58.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.335+0000 7fc545fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:58.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:58.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:58.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 5 note: GC not initialized 2024-09-12T00:31:58.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc544fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:58.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:58.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 20 Filter name: none 2024-09-12T00:31:58.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc4be7fc640 20 reqs_thread_entry: start 2024-09-12T00:31:58.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 10 cache get: name=default.rgw.meta+root+abort-at-block-writes : miss 2024-09-12T00:31:58.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:58.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 10 cache put: name=default.rgw.meta+root+abort-at-block-writes info.flags=0x11 2024-09-12T00:31:58.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 10 adding default.rgw.meta+root+abort-at-block-writes to cache LRU end 2024-09-12T00:31:58.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : miss 2024-09-12T00:31:58.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.339+0000 7fc691c449c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.343+0000 7fc691c449c0 20 rados_obj.operate() r=0 bl.length=443 2024-09-12T00:31:58.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.343+0000 7fc691c449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:58.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.343+0000 7fc691c449c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:58.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.343+0000 7fc691c449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:31:58.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.343+0000 7fc691c449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:58.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.343+0000 7fc691c449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:58.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.343+0000 7fc691c449c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:31:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:58.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc572ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398967 cookie 94474047831408 notifier 6734 bl.length()=915 2024-09-12T00:31:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc572ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc572ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:58.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc572ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:58.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:58.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:58.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:58.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.359+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.0 2024-09-12T00:31:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.0 2024-09-12T00:31:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.1 2024-09-12T00:31:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.1 2024-09-12T00:31:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.2 2024-09-12T00:31:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.2 2024-09-12T00:31:58.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.3 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.3 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.4 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.4 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.5 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.5 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.6 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.6 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.7 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.7 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.8 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.8 2024-09-12T00:31:58.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.9 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.9 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.10 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.10 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.11 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2.11 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.371+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.0 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.375+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.375+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.375+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.3 2024-09-12T00:31:58.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.375+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.4 2024-09-12T00:31:58.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.379+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.5 2024-09-12T00:31:58.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.379+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.6 2024-09-12T00:31:58.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.379+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.7 2024-09-12T00:31:58.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.379+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.8 2024-09-12T00:31:58.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.383+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.9 2024-09-12T00:31:58.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.383+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.10 2024-09-12T00:31:58.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:58.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:58.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc572ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398968 cookie 94474047831408 notifier 6734 bl.length()=915 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc572ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc572ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc572ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:58.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.391+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:58.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.399+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.0 2024-09-12T00:31:58.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.399+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.1 2024-09-12T00:31:58.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.399+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.2 2024-09-12T00:31:58.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.399+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.3 2024-09-12T00:31:58.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.399+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.4 2024-09-12T00:31:58.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.399+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.5 2024-09-12T00:31:58.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.403+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.6 2024-09-12T00:31:58.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.403+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.7 2024-09-12T00:31:58.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.403+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.8 2024-09-12T00:31:58.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.403+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.9 2024-09-12T00:31:58.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.403+0000 7fc691c449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29.10 2024-09-12T00:31:58.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 : hit (requested=0x17, cached=0x17) 2024-09-12T00:31:58.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 2024-09-12T00:31:58.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:58.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:58.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:58.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29, ofs0, ns] 2024-09-12T00:31:58.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc572ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398969 cookie 94474047831408 notifier 6734 bl.length()=883 2024-09-12T00:31:58.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc572ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 info.flags=0x17 2024-09-12T00:31:58.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc572ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-block-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 to cache LRU end 2024-09-12T00:31:58.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc572ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:31:58.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_sources= new_sources= 2024-09-12T00:31:58.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential sources added=[] removed=[] 2024-09-12T00:31:58.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): orig_dests= new_dests= 2024-09-12T00:31:58.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.407+0000 7fc691c449c0 20 handle_bi_update(): bucket=:abort-at-block-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29]): potential dests added=[] removed=[] 2024-09-12T00:31:58.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.415+0000 7fc691c449c0 1 execute INFO: reshard of bucket "abort-at-block-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:31:58.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.419+0000 7fc545fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:58.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.423+0000 7fc691c449c0 20 remove_watcher() i=0 2024-09-12T00:31:58.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.423+0000 7fc691c449c0 2 removed watcher, disabling cache 2024-09-12T00:31:58.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.423+0000 7fc691c449c0 20 remove_watcher() i=1 2024-09-12T00:31:58.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.427+0000 7fc691c449c0 20 remove_watcher() i=2 2024-09-12T00:31:58.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.427+0000 7fc691c449c0 20 remove_watcher() i=3 2024-09-12T00:31:58.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.431+0000 7fc691c449c0 20 remove_watcher() i=4 2024-09-12T00:31:58.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.431+0000 7fc691c449c0 20 remove_watcher() i=5 2024-09-12T00:31:58.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.435+0000 7fc691c449c0 20 remove_watcher() i=6 2024-09-12T00:31:58.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.439+0000 7fc691c449c0 20 remove_watcher() i=7 2024-09-12T00:31:58.452 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-block-writes 2024-09-12T00:31:58.481 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:58.481 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:58.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.523+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 realm 2024-09-12T00:31:58.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:58.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:58.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.527+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.531+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:58.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.531+0000 7f41557e09c0 20 searching for the correct realm 2024-09-12T00:31:58.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.535+0000 7f4153ae7640 0 -- 172.21.15.78:0/752856645 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f414402d8e0 msgr2=0x7f414400f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:58.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.747+0000 7f41532e6640 0 -- 172.21.15.78:0/752856645 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55e595a2c470 msgr2=0x55e595a2e8c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:58.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:58.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:58.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:58.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:58.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:58.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:58.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.759+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:58.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 zone default found 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 4 Realm: () 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 zonegroup default 2024-09-12T00:31:58.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:58.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 started sync module instance, tier type = 2024-09-12T00:31:58.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.763+0000 7f41557e09c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:58.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.787+0000 7f41557e09c0 20 add_watcher() i=0 2024-09-12T00:31:58.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.787+0000 7f41557e09c0 20 add_watcher() i=1 2024-09-12T00:31:58.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.787+0000 7f41557e09c0 20 add_watcher() i=2 2024-09-12T00:31:58.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.787+0000 7f41557e09c0 20 add_watcher() i=3 2024-09-12T00:31:58.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.787+0000 7f41557e09c0 20 add_watcher() i=4 2024-09-12T00:31:58.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.787+0000 7f41557e09c0 20 add_watcher() i=5 2024-09-12T00:31:58.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.787+0000 7f41557e09c0 20 add_watcher() i=6 2024-09-12T00:31:58.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.791+0000 7f41557e09c0 20 add_watcher() i=7 2024-09-12T00:31:58.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.791+0000 7f41557e09c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:58.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f4009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:58.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f41557e09c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:58.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f41557e09c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:58.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f41557e09c0 5 note: GC not initialized 2024-09-12T00:31:58.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f4008fe1640 20 reqs_thread_entry: start 2024-09-12T00:31:58.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f41557e09c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:58.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f41557e09c0 20 Filter name: none 2024-09-12T00:31:58.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f3f827fc640 20 reqs_thread_entry: start 2024-09-12T00:31:58.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.795+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:58.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:58.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:58.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=189 2024-09-12T00:31:58.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:58.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 rados_obj.operate() r=0 bl.length=411 2024-09-12T00:31:58.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.799+0000 7f41557e09c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:58.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.803+0000 7f4009fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:58.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.807+0000 7f41557e09c0 20 remove_watcher() i=0 2024-09-12T00:31:58.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.807+0000 7f41557e09c0 2 removed watcher, disabling cache 2024-09-12T00:31:58.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.811+0000 7f41557e09c0 20 remove_watcher() i=1 2024-09-12T00:31:58.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.811+0000 7f41557e09c0 20 remove_watcher() i=2 2024-09-12T00:31:58.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.815+0000 7f41557e09c0 20 remove_watcher() i=3 2024-09-12T00:31:58.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.815+0000 7f41557e09c0 20 remove_watcher() i=4 2024-09-12T00:31:58.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.819+0000 7f41557e09c0 20 remove_watcher() i=5 2024-09-12T00:31:58.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.819+0000 7f41557e09c0 20 remove_watcher() i=6 2024-09-12T00:31:58.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:58.823+0000 7f41557e09c0 20 remove_watcher() i=7 2024-09-12T00:31:58.841 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:58.841 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:58.841 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-block-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.29 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:31:58.841 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:58.948 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at commit_target_layout 2024-09-12T00:31:58.948 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:59.364 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:31:59.398 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:31:59.398 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:31:59.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.443+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.443+0000 7fa4d3b209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.443+0000 7fa4d3b209c0 20 realm 2024-09-12T00:31:59.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.443+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:31:59.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:59.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:31:59.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.447+0000 7fa4d3b209c0 20 searching for the correct realm 2024-09-12T00:31:59.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.455+0000 7fa4d1e27640 0 -- 172.21.15.78:0/3242277859 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fa4bc101080 msgr2=0x7fa4bc0f6700 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:31:59.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.667+0000 7fa4d0e25640 0 -- 172.21.15.78:0/3242277859 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fa4bc10db00 msgr2=0x7fa4bc125710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:31:59.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:31:59.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:31:59.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:31:59.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:31:59.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:31:59.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:31:59.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:31:59.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 zone default found 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 4 Realm: () 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 zonegroup default 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.887+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.891+0000 7fa4d3b209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.891+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.891+0000 7fa4d3b209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.891+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.891+0000 7fa4d3b209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:31:59.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.891+0000 7fa4d3b209c0 20 started sync module instance, tier type = 2024-09-12T00:31:59.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.891+0000 7fa4d3b209c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:31:59.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.915+0000 7fa4d3b209c0 20 add_watcher() i=0 2024-09-12T00:31:59.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.915+0000 7fa4d3b209c0 20 add_watcher() i=1 2024-09-12T00:31:59.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.915+0000 7fa4d3b209c0 20 add_watcher() i=2 2024-09-12T00:31:59.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.915+0000 7fa4d3b209c0 20 add_watcher() i=3 2024-09-12T00:31:59.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.915+0000 7fa4d3b209c0 20 add_watcher() i=4 2024-09-12T00:31:59.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.915+0000 7fa4d3b209c0 20 add_watcher() i=5 2024-09-12T00:31:59.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.915+0000 7fa4d3b209c0 20 add_watcher() i=6 2024-09-12T00:31:59.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.919+0000 7fa4d3b209c0 20 add_watcher() i=7 2024-09-12T00:31:59.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.919+0000 7fa4d3b209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:31:59.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa3877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:59.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa4d3b209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:31:59.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa4d3b209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:31:59.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa4d3b209c0 5 note: GC not initialized 2024-09-12T00:31:59.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa3867e4640 20 reqs_thread_entry: start 2024-09-12T00:31:59.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa4d3b209c0 20 init_complete bucket index max shards: 11 2024-09-12T00:31:59.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa4d3b209c0 20 Filter name: none 2024-09-12T00:31:59.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa2f7fff640 20 reqs_thread_entry: start 2024-09-12T00:31:59.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.923+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:59.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:59.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:59.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:31:59.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 rados->read ofs=0 len=0 2024-09-12T00:31:59.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:31:59.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.927+0000 7fa4d3b209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:31:59.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.931+0000 7fa3877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:31:59.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.935+0000 7fa4d3b209c0 20 remove_watcher() i=0 2024-09-12T00:31:59.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.935+0000 7fa4d3b209c0 2 removed watcher, disabling cache 2024-09-12T00:31:59.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.939+0000 7fa4d3b209c0 20 remove_watcher() i=1 2024-09-12T00:31:59.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.939+0000 7fa4d3b209c0 20 remove_watcher() i=2 2024-09-12T00:31:59.941 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.943+0000 7fa4d3b209c0 20 remove_watcher() i=3 2024-09-12T00:31:59.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.943+0000 7fa4d3b209c0 20 remove_watcher() i=4 2024-09-12T00:31:59.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.947+0000 7fa4d3b209c0 20 remove_watcher() i=5 2024-09-12T00:31:59.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.947+0000 7fa4d3b209c0 20 remove_watcher() i=6 2024-09-12T00:31:59.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:31:59.951+0000 7fa4d3b209c0 20 remove_watcher() i=7 2024-09-12T00:31:59.965 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:59.965 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:31:59.965 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:31:59.965 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:31:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout 2024-09-12T00:32:00.002 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:00.003 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:00.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.047+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 20 realm 2024-09-12T00:32:00.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:00.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.051+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.055+0000 7fa09f20c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:00.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.055+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.055+0000 7fa09f20c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:00.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.055+0000 7fa09f20c9c0 20 searching for the correct realm 2024-09-12T00:32:00.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.059+0000 7fa09d513640 0 -- 172.21.15.78:0/3200263756 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fa0840f9010 msgr2=0x7fa084100910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:00.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.271+0000 7fa09cd12640 0 -- 172.21.15.78:0/3200263756 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x564ce08de970 msgr2=0x564ce08e0d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:00.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:00.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:00.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:00.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:00.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:00.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:00.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.283+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:00.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:00.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 zone default found 2024-09-12T00:32:00.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 4 Realm: () 2024-09-12T00:32:00.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:00.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:00.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:00.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 zonegroup default 2024-09-12T00:32:00.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 started sync module instance, tier type = 2024-09-12T00:32:00.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.287+0000 7fa09f20c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:00.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.311+0000 7fa09f20c9c0 20 add_watcher() i=0 2024-09-12T00:32:00.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.311+0000 7fa09f20c9c0 20 add_watcher() i=1 2024-09-12T00:32:00.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.311+0000 7fa09f20c9c0 20 add_watcher() i=2 2024-09-12T00:32:00.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.311+0000 7fa09f20c9c0 20 add_watcher() i=3 2024-09-12T00:32:00.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.311+0000 7fa09f20c9c0 20 add_watcher() i=4 2024-09-12T00:32:00.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.311+0000 7fa09f20c9c0 20 add_watcher() i=5 2024-09-12T00:32:00.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.311+0000 7fa09f20c9c0 20 add_watcher() i=6 2024-09-12T00:32:00.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.315+0000 7fa09f20c9c0 20 add_watcher() i=7 2024-09-12T00:32:00.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.315+0000 7fa09f20c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:00.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7f9f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:00.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7fa09f20c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:00.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7fa09f20c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:00.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7fa09f20c9c0 5 note: GC not initialized 2024-09-12T00:32:00.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7f9f51fe3640 20 reqs_thread_entry: start 2024-09-12T00:32:00.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7fa09f20c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:00.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7fa09f20c9c0 20 Filter name: none 2024-09-12T00:32:00.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7f9ec37fe640 20 reqs_thread_entry: start 2024-09-12T00:32:00.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.319+0000 7fa09f20c9c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:32:00.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:00.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:32:00.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:32:00.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 : miss 2024-09-12T00:32:00.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:00.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:00.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:00.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:00.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:00.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.323+0000 7fa09f20c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 2024-09-12T00:32:00.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:00.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:00.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:00.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30, ofs0, ns] 2024-09-12T00:32:00.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7f9f73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398952 cookie 94888184973216 notifier 6785 bl.length()=931 2024-09-12T00:32:00.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7f9f73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:00.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7f9f73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:00.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7f9f73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:00.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_sources= new_sources= 2024-09-12T00:32:00.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential sources added=[] removed=[] 2024-09-12T00:32:00.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_dests= new_dests= 2024-09-12T00:32:00.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.335+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential dests added=[] removed=[] 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.0 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.0 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.1 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.1 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.2 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.2 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.3 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.3 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.4 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.4 2024-09-12T00:32:00.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.5 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.5 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.6 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.6 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.7 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.7 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.8 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.8 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.9 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.9 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.10 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.10 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.11 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1.11 2024-09-12T00:32:00.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.0 2024-09-12T00:32:00.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.347+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1 2024-09-12T00:32:00.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.351+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2 2024-09-12T00:32:00.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.351+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.3 2024-09-12T00:32:00.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.351+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.4 2024-09-12T00:32:00.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.351+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.5 2024-09-12T00:32:00.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.355+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.6 2024-09-12T00:32:00.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.355+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.7 2024-09-12T00:32:00.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.355+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.8 2024-09-12T00:32:00.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.355+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.9 2024-09-12T00:32:00.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.359+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.10 2024-09-12T00:32:00.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.363+0000 7fa09f20c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.363+0000 7fa09f20c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 2024-09-12T00:32:00.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:00.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:00.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:00.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30, ofs0, ns] 2024-09-12T00:32:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7f9f73fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398953 cookie 94888184973216 notifier 6785 bl.length()=931 2024-09-12T00:32:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7f9f73fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7f9f73fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:00.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7f9f73fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_sources= new_sources= 2024-09-12T00:32:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential sources added=[] removed=[] 2024-09-12T00:32:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_dests= new_dests= 2024-09-12T00:32:00.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.367+0000 7fa09f20c9c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential dests added=[] removed=[] 2024-09-12T00:32:00.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.375+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.0 2024-09-12T00:32:00.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.375+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1 2024-09-12T00:32:00.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.375+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2 2024-09-12T00:32:00.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.375+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.3 2024-09-12T00:32:00.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.379+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.4 2024-09-12T00:32:00.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.379+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.5 2024-09-12T00:32:00.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.379+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.6 2024-09-12T00:32:00.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.379+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.7 2024-09-12T00:32:00.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.379+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.8 2024-09-12T00:32:00.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.379+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.9 2024-09-12T00:32:00.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.383+0000 7fa09f20c9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.10 2024-09-12T00:32:00.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.383+0000 7fa09f20c9c0 -1 Injecting error=-5 at location=commit_target_layout 2024-09-12T00:32:00.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.383+0000 7fa09f20c9c0 0 ERROR: commit_reshard failed to commit target index layout: (5) Input/output error 2024-09-12T00:32:00.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.395+0000 7f9f52fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:00.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.399+0000 7fa09f20c9c0 20 remove_watcher() i=0 2024-09-12T00:32:00.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.399+0000 7fa09f20c9c0 2 removed watcher, disabling cache 2024-09-12T00:32:00.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.399+0000 7fa09f20c9c0 20 remove_watcher() i=1 2024-09-12T00:32:00.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.399+0000 7fa09f20c9c0 20 remove_watcher() i=2 2024-09-12T00:32:00.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.403+0000 7fa09f20c9c0 20 remove_watcher() i=3 2024-09-12T00:32:00.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.407+0000 7fa09f20c9c0 20 remove_watcher() i=4 2024-09-12T00:32:00.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.407+0000 7fa09f20c9c0 20 remove_watcher() i=5 2024-09-12T00:32:00.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.411+0000 7fa09f20c9c0 20 remove_watcher() i=6 2024-09-12T00:32:00.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.415+0000 7fa09f20c9c0 20 remove_watcher() i=7 2024-09-12T00:32:00.431 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:32:00.462 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:00.462 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:00.510 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.511+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.511+0000 7f8f237759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.511+0000 7f8f237759c0 20 realm 2024-09-12T00:32:00.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.511+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:00.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:00.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:00.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.515+0000 7f8f237759c0 20 searching for the correct realm 2024-09-12T00:32:00.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.519+0000 7f8f21a7c640 0 -- 172.21.15.78:0/1522078750 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f8f140093d0 msgr2=0x7f8f14009850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:00.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.731+0000 7f8f2127b640 0 -- 172.21.15.78:0/1522078750 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55c95e397750 msgr2=0x55c95e399b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:00.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:00.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:00.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:00.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:00.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:00.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:00.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 zone default found 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 4 Realm: () 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:00.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:00.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:00.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 zonegroup default 2024-09-12T00:32:00.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.743+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.747+0000 7f8f237759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.747+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.747+0000 7f8f237759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.747+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.747+0000 7f8f237759c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.747+0000 7f8f237759c0 20 started sync module instance, tier type = 2024-09-12T00:32:00.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.747+0000 7f8f237759c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=0 2024-09-12T00:32:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=1 2024-09-12T00:32:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=2 2024-09-12T00:32:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=3 2024-09-12T00:32:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=4 2024-09-12T00:32:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=5 2024-09-12T00:32:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=6 2024-09-12T00:32:00.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 20 add_watcher() i=7 2024-09-12T00:32:00.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.771+0000 7f8f237759c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:00.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.775+0000 7f8dd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:00.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:00.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:00.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 5 note: GC not initialized 2024-09-12T00:32:00.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8dd6fe5640 20 reqs_thread_entry: start 2024-09-12T00:32:00.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:00.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 Filter name: none 2024-09-12T00:32:00.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8dd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:00.779 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:00.780 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:32:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.779+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.783+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:00.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.783+0000 7f8f237759c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.783+0000 7f8f237759c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:32:00.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.783+0000 7f8f237759c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:00.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.783+0000 7f8dd7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:00.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.791+0000 7f8f237759c0 20 remove_watcher() i=0 2024-09-12T00:32:00.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.791+0000 7f8f237759c0 2 removed watcher, disabling cache 2024-09-12T00:32:00.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.791+0000 7f8f237759c0 20 remove_watcher() i=1 2024-09-12T00:32:00.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.795+0000 7f8f237759c0 20 remove_watcher() i=2 2024-09-12T00:32:00.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.795+0000 7f8f237759c0 20 remove_watcher() i=3 2024-09-12T00:32:00.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.799+0000 7f8f237759c0 20 remove_watcher() i=4 2024-09-12T00:32:00.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.799+0000 7f8f237759c0 20 remove_watcher() i=5 2024-09-12T00:32:00.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.803+0000 7f8f237759c0 20 remove_watcher() i=6 2024-09-12T00:32:00.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.807+0000 7f8f237759c0 20 remove_watcher() i=7 2024-09-12T00:32:00.821 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:00.821 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:00.821 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:00.821 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:00.874 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:32:00.907 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:00.908 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:00.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.955+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 realm 2024-09-12T00:32:00.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:00.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:00.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:00.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.959+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:00.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.963+0000 7fa5109469c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:00.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.963+0000 7fa5109469c0 20 searching for the correct realm 2024-09-12T00:32:00.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:00.967+0000 7fa50ec4d640 0 -- 172.21.15.78:0/339926599 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fa500101370 msgr2=0x7fa5000fef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:01.181 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.183+0000 7fa50e44c640 0 -- 172.21.15.78:0/339926599 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55613038ece0 msgr2=0x556130391170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:01.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:01.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:01.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:01.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:01.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:01.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:01.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:01.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 zone default found 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 4 Realm: () 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 zonegroup default 2024-09-12T00:32:01.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.195+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.199+0000 7fa5109469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.199+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.199+0000 7fa5109469c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.199+0000 7fa5109469c0 20 started sync module instance, tier type = 2024-09-12T00:32:01.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.199+0000 7fa5109469c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:01.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.219+0000 7fa5109469c0 20 add_watcher() i=0 2024-09-12T00:32:01.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.219+0000 7fa5109469c0 20 add_watcher() i=1 2024-09-12T00:32:01.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.219+0000 7fa5109469c0 20 add_watcher() i=2 2024-09-12T00:32:01.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.219+0000 7fa5109469c0 20 add_watcher() i=3 2024-09-12T00:32:01.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.219+0000 7fa5109469c0 20 add_watcher() i=4 2024-09-12T00:32:01.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.219+0000 7fa5109469c0 20 add_watcher() i=5 2024-09-12T00:32:01.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.219+0000 7fa5109469c0 20 add_watcher() i=6 2024-09-12T00:32:01.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.223+0000 7fa5109469c0 20 add_watcher() i=7 2024-09-12T00:32:01.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.223+0000 7fa5109469c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:01.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa3c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:01.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:01.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:01.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 5 note: GC not initialized 2024-09-12T00:32:01.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa33f7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:01.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:01.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 20 Filter name: none 2024-09-12T00:32:01.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa33d7fa640 20 reqs_thread_entry: start 2024-09-12T00:32:01.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:32:01.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 : miss 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.227+0000 7fa5109469c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.231+0000 7fa5109469c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.231+0000 7fa5109469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.231+0000 7fa5109469c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.231+0000 7fa5109469c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.231+0000 7fa5109469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:01.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.231+0000 7fa5109469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 2024-09-12T00:32:01.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.231+0000 7fa5109469c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:32:01.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:01.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:01.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:01.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30, ofs0, ns] 2024-09-12T00:32:01.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa3f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398954 cookie 93875909302208 notifier 6821 bl.length()=931 2024-09-12T00:32:01.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa3f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:01.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa3f1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:01.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa3f1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:01.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_sources= new_sources= 2024-09-12T00:32:01.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential sources added=[] removed=[] 2024-09-12T00:32:01.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_dests= new_dests= 2024-09-12T00:32:01.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.247+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential dests added=[] removed=[] 2024-09-12T00:32:01.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.0 2024-09-12T00:32:01.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.0 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.1 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.1 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.2 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.2 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.3 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.3 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.4 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.4 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.5 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.5 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.6 2024-09-12T00:32:01.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.6 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.7 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.7 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.8 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.8 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.9 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.9 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.10 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.10 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.11 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2.11 2024-09-12T00:32:01.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.259+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.0 2024-09-12T00:32:01.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.263+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1 2024-09-12T00:32:01.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.263+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2 2024-09-12T00:32:01.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.263+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.3 2024-09-12T00:32:01.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.263+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.4 2024-09-12T00:32:01.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.267+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.5 2024-09-12T00:32:01.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.267+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.6 2024-09-12T00:32:01.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.267+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.7 2024-09-12T00:32:01.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.271+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.8 2024-09-12T00:32:01.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.271+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.9 2024-09-12T00:32:01.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.271+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.10 2024-09-12T00:32:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa5109469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:01.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa5109469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 2024-09-12T00:32:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa5109469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa5109469c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa5109469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa5109469c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30, ofs0, ns] 2024-09-12T00:32:01.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa3f17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398955 cookie 93875909302208 notifier 6821 bl.length()=931 2024-09-12T00:32:01.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa3f17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:01.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa3f17fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:01.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.283+0000 7fa3f17fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:01.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.287+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_sources= new_sources= 2024-09-12T00:32:01.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.287+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential sources added=[] removed=[] 2024-09-12T00:32:01.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.287+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_dests= new_dests= 2024-09-12T00:32:01.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.287+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential dests added=[] removed=[] 2024-09-12T00:32:01.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.291+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.0 2024-09-12T00:32:01.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.295+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.1 2024-09-12T00:32:01.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.295+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.2 2024-09-12T00:32:01.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.295+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.3 2024-09-12T00:32:01.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.295+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.4 2024-09-12T00:32:01.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.295+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.5 2024-09-12T00:32:01.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.299+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.6 2024-09-12T00:32:01.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.299+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.7 2024-09-12T00:32:01.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.299+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.8 2024-09-12T00:32:01.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.299+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.9 2024-09-12T00:32:01.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.299+0000 7fa5109469c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30.10 2024-09-12T00:32:01.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa5109469c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:01.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa5109469c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 2024-09-12T00:32:01.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa5109469c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:01.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa5109469c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:01.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa5109469c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:01.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa5109469c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30, ofs0, ns] 2024-09-12T00:32:01.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa3f1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398956 cookie 93875909302208 notifier 6821 bl.length()=899 2024-09-12T00:32:01.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa3f1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 info.flags=0x17 2024-09-12T00:32:01.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa3f1ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 to cache LRU end 2024-09-12T00:32:01.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.303+0000 7fa3f1ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:01.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.307+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_sources= new_sources= 2024-09-12T00:32:01.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.307+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential sources added=[] removed=[] 2024-09-12T00:32:01.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.307+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): orig_dests= new_dests= 2024-09-12T00:32:01.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.307+0000 7fa5109469c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30]): potential dests added=[] removed=[] 2024-09-12T00:32:01.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.311+0000 7fa5109469c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:32:01.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.315+0000 7fa3c4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:01.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.319+0000 7fa5109469c0 20 remove_watcher() i=0 2024-09-12T00:32:01.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.319+0000 7fa5109469c0 2 removed watcher, disabling cache 2024-09-12T00:32:01.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.323+0000 7fa5109469c0 20 remove_watcher() i=1 2024-09-12T00:32:01.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.323+0000 7fa5109469c0 20 remove_watcher() i=2 2024-09-12T00:32:01.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.327+0000 7fa5109469c0 20 remove_watcher() i=3 2024-09-12T00:32:01.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.331+0000 7fa5109469c0 20 remove_watcher() i=4 2024-09-12T00:32:01.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.331+0000 7fa5109469c0 20 remove_watcher() i=5 2024-09-12T00:32:01.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.335+0000 7fa5109469c0 20 remove_watcher() i=6 2024-09-12T00:32:01.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.339+0000 7fa5109469c0 20 remove_watcher() i=7 2024-09-12T00:32:01.354 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:32:01.385 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:01.385 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:01.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.427+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 realm 2024-09-12T00:32:01.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:01.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:01.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.431+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.435+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:01.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.435+0000 7f540a5159c0 20 searching for the correct realm 2024-09-12T00:32:01.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.439+0000 7f540881c640 0 -- 172.21.15.78:0/2981114947 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f53f80abc20 msgr2=0x7f53f80cf900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:01.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.655+0000 7f540881c640 0 -- 172.21.15.78:0/2981114947 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x56360a5f3a50 msgr2=0x56360a5f5e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:01.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.663+0000 7f540a5159c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:01.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.663+0000 7f540a5159c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:01.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.663+0000 7f540a5159c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:01.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.663+0000 7f540a5159c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:01.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.663+0000 7f540a5159c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:01.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.663+0000 7f540a5159c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:01.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:01.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:01.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 zone default found 2024-09-12T00:32:01.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 4 Realm: () 2024-09-12T00:32:01.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:01.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:01.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:01.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 zonegroup default 2024-09-12T00:32:01.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.667+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.671+0000 7f540a5159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.671+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.671+0000 7f540a5159c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:01.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.671+0000 7f540a5159c0 20 started sync module instance, tier type = 2024-09-12T00:32:01.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.671+0000 7f540a5159c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:01.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.691+0000 7f540a5159c0 20 add_watcher() i=0 2024-09-12T00:32:01.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.691+0000 7f540a5159c0 20 add_watcher() i=1 2024-09-12T00:32:01.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.691+0000 7f540a5159c0 20 add_watcher() i=2 2024-09-12T00:32:01.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.691+0000 7f540a5159c0 20 add_watcher() i=3 2024-09-12T00:32:01.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.691+0000 7f540a5159c0 20 add_watcher() i=4 2024-09-12T00:32:01.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.691+0000 7f540a5159c0 20 add_watcher() i=5 2024-09-12T00:32:01.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.691+0000 7f540a5159c0 20 add_watcher() i=6 2024-09-12T00:32:01.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.695+0000 7f540a5159c0 20 add_watcher() i=7 2024-09-12T00:32:01.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.695+0000 7f540a5159c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:01.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.699+0000 7f52befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:01.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.699+0000 7f540a5159c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:01.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:01.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 5 note: GC not initialized 2024-09-12T00:32:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f52bdfdb640 20 reqs_thread_entry: start 2024-09-12T00:32:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:01.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 Filter name: none 2024-09-12T00:32:01.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f522f7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:01.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:01.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:01.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:01.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:01.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:01.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:01.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.703+0000 7f540a5159c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:01.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.707+0000 7f52befdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.711+0000 7f540a5159c0 20 remove_watcher() i=0 2024-09-12T00:32:01.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.711+0000 7f540a5159c0 2 removed watcher, disabling cache 2024-09-12T00:32:01.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.715+0000 7f540a5159c0 20 remove_watcher() i=1 2024-09-12T00:32:01.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.719+0000 7f540a5159c0 20 remove_watcher() i=2 2024-09-12T00:32:01.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.719+0000 7f540a5159c0 20 remove_watcher() i=3 2024-09-12T00:32:01.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.723+0000 7f540a5159c0 20 remove_watcher() i=4 2024-09-12T00:32:01.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.727+0000 7f540a5159c0 20 remove_watcher() i=5 2024-09-12T00:32:01.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.727+0000 7f540a5159c0 20 remove_watcher() i=6 2024-09-12T00:32:01.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:01.731+0000 7f540a5159c0 20 remove_watcher() i=7 2024-09-12T00:32:01.747 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:01.747 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:01.747 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.30 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:32:01.747 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:01.862 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with ECANCELED injected at commit_target_layout 2024-09-12T00:32:01.862 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:02.270 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:32:02.303 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:02.303 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:02.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.347+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 realm 2024-09-12T00:32:02.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:02.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:02.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:02.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.351+0000 7fd017a299c0 20 searching for the correct realm 2024-09-12T00:32:02.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.355+0000 7fd014d2e640 0 -- 172.21.15.78:0/2569425034 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fd008079cf0 msgr2=0x7fd00808d450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:02.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.571+0000 7fd01552f640 0 -- 172.21.15.78:0/2569425034 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fd00c053070 msgr2=0x7fd00c01c980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:02.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:02.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 zone default found 2024-09-12T00:32:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 4 Realm: () 2024-09-12T00:32:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:02.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 zonegroup default 2024-09-12T00:32:02.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.791+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.795+0000 7fd017a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.795+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.795+0000 7fd017a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.795+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.795+0000 7fd017a299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.795+0000 7fd017a299c0 20 started sync module instance, tier type = 2024-09-12T00:32:02.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.795+0000 7fd017a299c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:02.819 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.819+0000 7fd017a299c0 20 add_watcher() i=0 2024-09-12T00:32:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.819+0000 7fd017a299c0 20 add_watcher() i=1 2024-09-12T00:32:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.819+0000 7fd017a299c0 20 add_watcher() i=2 2024-09-12T00:32:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.819+0000 7fd017a299c0 20 add_watcher() i=3 2024-09-12T00:32:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.819+0000 7fd017a299c0 20 add_watcher() i=4 2024-09-12T00:32:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.819+0000 7fd017a299c0 20 add_watcher() i=5 2024-09-12T00:32:02.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.819+0000 7fd017a299c0 20 add_watcher() i=6 2024-09-12T00:32:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.823+0000 7fd017a299c0 20 add_watcher() i=7 2024-09-12T00:32:02.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.823+0000 7fd017a299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:02.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fcecb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:02.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:02.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:02.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 5 note: GC not initialized 2024-09-12T00:32:02.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fceca7e4640 20 reqs_thread_entry: start 2024-09-12T00:32:02.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:02.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 20 Filter name: none 2024-09-12T00:32:02.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fce3bfff640 20 reqs_thread_entry: start 2024-09-12T00:32:02.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:02.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.827+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.831+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.831+0000 7fd017a299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.831+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.831+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.831+0000 7fd017a299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.831+0000 7fd017a299c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:02.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.831+0000 7fd017a299c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:02.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.835+0000 7fcecb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:02.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.839+0000 7fd017a299c0 20 remove_watcher() i=0 2024-09-12T00:32:02.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.839+0000 7fd017a299c0 2 removed watcher, disabling cache 2024-09-12T00:32:02.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.839+0000 7fd017a299c0 20 remove_watcher() i=1 2024-09-12T00:32:02.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.843+0000 7fd017a299c0 20 remove_watcher() i=2 2024-09-12T00:32:02.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.843+0000 7fd017a299c0 20 remove_watcher() i=3 2024-09-12T00:32:02.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.847+0000 7fd017a299c0 20 remove_watcher() i=4 2024-09-12T00:32:02.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.847+0000 7fd017a299c0 20 remove_watcher() i=5 2024-09-12T00:32:02.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.851+0000 7fd017a299c0 20 remove_watcher() i=6 2024-09-12T00:32:02.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.855+0000 7fd017a299c0 20 remove_watcher() i=7 2024-09-12T00:32:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:02.868 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:02.868 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:02.868 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:02.869 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at commit_target_layout --inject-error-code 125 2024-09-12T00:32:02.902 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:02.903 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:02.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 realm 2024-09-12T00:32:02.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:02.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:02.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.947+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.951+0000 7f9b26e819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:02.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.951+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:02.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.951+0000 7f9b26e819c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:02.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.951+0000 7f9b26e819c0 20 searching for the correct realm 2024-09-12T00:32:02.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:02.955+0000 7f9b25188640 0 -- 172.21.15.78:0/3375955935 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f9b140cf910 msgr2=0x7f9b140b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:03.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.171+0000 7f9b24987640 0 -- 172.21.15.78:0/3375955935 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x561afebda4a0 msgr2=0x561afebdc920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:03.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:03.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:03.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:03.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:03.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:03.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:03.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:03.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 zone default found 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 4 Realm: () 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 zonegroup default 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.183+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.187+0000 7f9b26e819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.187+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.187+0000 7f9b26e819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.187+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.187+0000 7f9b26e819c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.187+0000 7f9b26e819c0 20 started sync module instance, tier type = 2024-09-12T00:32:03.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.187+0000 7f9b26e819c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:03.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=0 2024-09-12T00:32:03.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=1 2024-09-12T00:32:03.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=2 2024-09-12T00:32:03.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=3 2024-09-12T00:32:03.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=4 2024-09-12T00:32:03.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=5 2024-09-12T00:32:03.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=6 2024-09-12T00:32:03.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 20 add_watcher() i=7 2024-09-12T00:32:03.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.211+0000 7f9b26e819c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:03.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f99dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:03.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:03.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:03.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 5 note: GC not initialized 2024-09-12T00:32:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f99d9fe3640 20 reqs_thread_entry: start 2024-09-12T00:32:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 20 Filter name: none 2024-09-12T00:32:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f994b7fe640 20 reqs_thread_entry: start 2024-09-12T00:32:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 10 cache get: name=default.rgw.meta+root+error-at-commit-target-layout : miss 2024-09-12T00:32:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 10 cache put: name=default.rgw.meta+root+error-at-commit-target-layout info.flags=0x11 2024-09-12T00:32:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 10 adding default.rgw.meta+root+error-at-commit-target-layout to cache LRU end 2024-09-12T00:32:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 : miss 2024-09-12T00:32:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.219+0000 7f9b26e819c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.223+0000 7f9b26e819c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.223+0000 7f9b26e819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 info.flags=0x17 2024-09-12T00:32:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.223+0000 7f9b26e819c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 to cache LRU end 2024-09-12T00:32:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.223+0000 7f9b26e819c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.223+0000 7f9b26e819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.223+0000 7f9b26e819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 2024-09-12T00:32:03.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.231+0000 7f9b26e819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 info.flags=0x17 2024-09-12T00:32:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.231+0000 7f9b26e819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 to cache LRU end 2024-09-12T00:32:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.231+0000 7f9b26e819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.231+0000 7f9b26e819c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31, ofs0, ns] 2024-09-12T00:32:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f99fb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398959 cookie 94673943053376 notifier 7323 bl.length()=931 2024-09-12T00:32:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f99fb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 info.flags=0x17 2024-09-12T00:32:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f99fb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 to cache LRU end 2024-09-12T00:32:03.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f99fb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:03.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): orig_sources= new_sources= 2024-09-12T00:32:03.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): potential sources added=[] removed=[] 2024-09-12T00:32:03.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): orig_dests= new_dests= 2024-09-12T00:32:03.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.235+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): potential dests added=[] removed=[] 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.0 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.0 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.1 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.1 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.2 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.2 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.3 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.3 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.4 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.4 2024-09-12T00:32:03.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.5 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.5 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.6 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.6 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.7 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.7 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.8 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.8 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.9 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.9 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.10 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.10 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.11 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1.11 2024-09-12T00:32:03.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.0 2024-09-12T00:32:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.243+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1 2024-09-12T00:32:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.247+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.2 2024-09-12T00:32:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.247+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.3 2024-09-12T00:32:03.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.247+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.4 2024-09-12T00:32:03.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.247+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.5 2024-09-12T00:32:03.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.247+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.6 2024-09-12T00:32:03.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.251+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.7 2024-09-12T00:32:03.250 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.251+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.8 2024-09-12T00:32:03.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.251+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.9 2024-09-12T00:32:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.251+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.10 2024-09-12T00:32:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.259+0000 7f9b26e819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:03.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.259+0000 7f9b26e819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 2024-09-12T00:32:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 info.flags=0x17 2024-09-12T00:32:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 to cache LRU end 2024-09-12T00:32:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:03.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31, ofs0, ns] 2024-09-12T00:32:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f99fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398960 cookie 94673943053376 notifier 7323 bl.length()=931 2024-09-12T00:32:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f99fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 info.flags=0x17 2024-09-12T00:32:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f99fbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 to cache LRU end 2024-09-12T00:32:03.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f99fbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): orig_sources= new_sources= 2024-09-12T00:32:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): potential sources added=[] removed=[] 2024-09-12T00:32:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): orig_dests= new_dests= 2024-09-12T00:32:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.263+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): potential dests added=[] removed=[] 2024-09-12T00:32:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.267+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.0 2024-09-12T00:32:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.271+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.1 2024-09-12T00:32:03.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.271+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.2 2024-09-12T00:32:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.271+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.3 2024-09-12T00:32:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.271+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.4 2024-09-12T00:32:03.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.271+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.5 2024-09-12T00:32:03.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.271+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.6 2024-09-12T00:32:03.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.275+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.7 2024-09-12T00:32:03.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.275+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.8 2024-09-12T00:32:03.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.275+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.9 2024-09-12T00:32:03.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.275+0000 7f9b26e819c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31.10 2024-09-12T00:32:03.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.275+0000 7f9b26e819c0 -1 Injecting error=-125 at location=commit_target_layout 2024-09-12T00:32:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.275+0000 7f9b26e819c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:03.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.275+0000 7f9b26e819c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 2024-09-12T00:32:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f9b26e819c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 info.flags=0x17 2024-09-12T00:32:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f9b26e819c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 to cache LRU end 2024-09-12T00:32:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f9b26e819c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f9b26e819c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31, ofs0, ns] 2024-09-12T00:32:03.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f99fbfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398961 cookie 94673943053376 notifier 7323 bl.length()=899 2024-09-12T00:32:03.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f99fbfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 info.flags=0x17 2024-09-12T00:32:03.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f99fbfff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 to cache LRU end 2024-09-12T00:32:03.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.279+0000 7f99fbfff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:03.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.283+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): orig_sources= new_sources= 2024-09-12T00:32:03.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.283+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): potential sources added=[] removed=[] 2024-09-12T00:32:03.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.283+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): orig_dests= new_dests= 2024-09-12T00:32:03.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.283+0000 7f9b26e819c0 20 handle_bi_update(): bucket=:error-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31]): potential dests added=[] removed=[] 2024-09-12T00:32:03.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.287+0000 7f9b26e819c0 1 execute INFO: reshard of bucket "error-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:32:03.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.287+0000 7f99dafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:03.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.291+0000 7f9b26e819c0 20 remove_watcher() i=0 2024-09-12T00:32:03.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.291+0000 7f9b26e819c0 2 removed watcher, disabling cache 2024-09-12T00:32:03.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.295+0000 7f9b26e819c0 20 remove_watcher() i=1 2024-09-12T00:32:03.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.295+0000 7f9b26e819c0 20 remove_watcher() i=2 2024-09-12T00:32:03.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.299+0000 7f9b26e819c0 20 remove_watcher() i=3 2024-09-12T00:32:03.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.299+0000 7f9b26e819c0 20 remove_watcher() i=4 2024-09-12T00:32:03.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.303+0000 7f9b26e819c0 20 remove_watcher() i=5 2024-09-12T00:32:03.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.307+0000 7f9b26e819c0 20 remove_watcher() i=6 2024-09-12T00:32:03.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.311+0000 7f9b26e819c0 20 remove_watcher() i=7 2024-09-12T00:32:03.324 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-commit-target-layout 2024-09-12T00:32:03.354 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:03.354 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:03.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.399+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.399+0000 7f87edaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.399+0000 7f87edaa39c0 20 realm 2024-09-12T00:32:03.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.399+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:03.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:03.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:03.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.403+0000 7f87edaa39c0 20 searching for the correct realm 2024-09-12T00:32:03.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.407+0000 7f87ebdaa640 0 -- 172.21.15.78:0/707698157 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f87dc00e070 msgr2=0x7f87dc065040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:03.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.619+0000 7f87eb5a9640 0 -- 172.21.15.78:0/707698157 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5638190ddd50 msgr2=0x5638190e0190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.631+0000 7f87edaa39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.631+0000 7f87edaa39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.631+0000 7f87edaa39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.631+0000 7f87edaa39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.631+0000 7f87edaa39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.631+0000 7f87edaa39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.631+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:03.634 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:03.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 zone default found 2024-09-12T00:32:03.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 4 Realm: () 2024-09-12T00:32:03.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:03.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:03.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:03.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 zonegroup default 2024-09-12T00:32:03.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.635+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.639+0000 7f87edaa39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.639+0000 7f87edaa39c0 20 started sync module instance, tier type = 2024-09-12T00:32:03.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.639+0000 7f87edaa39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.659+0000 7f87edaa39c0 20 add_watcher() i=0 2024-09-12T00:32:03.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.659+0000 7f87edaa39c0 20 add_watcher() i=1 2024-09-12T00:32:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.659+0000 7f87edaa39c0 20 add_watcher() i=2 2024-09-12T00:32:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.659+0000 7f87edaa39c0 20 add_watcher() i=3 2024-09-12T00:32:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.659+0000 7f87edaa39c0 20 add_watcher() i=4 2024-09-12T00:32:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.659+0000 7f87edaa39c0 20 add_watcher() i=5 2024-09-12T00:32:03.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.659+0000 7f87edaa39c0 20 add_watcher() i=6 2024-09-12T00:32:03.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.663+0000 7f87edaa39c0 20 add_watcher() i=7 2024-09-12T00:32:03.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.663+0000 7f87edaa39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.667+0000 7f86a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:03.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.667+0000 7f87edaa39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:03.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.667+0000 7f87edaa39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:03.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.667+0000 7f87edaa39c0 5 note: GC not initialized 2024-09-12T00:32:03.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.667+0000 7f86a0fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:03.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.667+0000 7f87edaa39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:03.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.667+0000 7f87edaa39c0 20 Filter name: none 2024-09-12T00:32:03.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f861a7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:03.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:03.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:03.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:03.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:03.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:03.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:03.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.671+0000 7f87edaa39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:03.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.675+0000 7f86a1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:03.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.679+0000 7f87edaa39c0 20 remove_watcher() i=0 2024-09-12T00:32:03.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.679+0000 7f87edaa39c0 2 removed watcher, disabling cache 2024-09-12T00:32:03.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.679+0000 7f87edaa39c0 20 remove_watcher() i=1 2024-09-12T00:32:03.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.683+0000 7f87edaa39c0 20 remove_watcher() i=2 2024-09-12T00:32:03.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.683+0000 7f87edaa39c0 20 remove_watcher() i=3 2024-09-12T00:32:03.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.687+0000 7f87edaa39c0 20 remove_watcher() i=4 2024-09-12T00:32:03.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.687+0000 7f87edaa39c0 20 remove_watcher() i=5 2024-09-12T00:32:03.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.691+0000 7f87edaa39c0 20 remove_watcher() i=6 2024-09-12T00:32:03.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:03.695+0000 7f87edaa39c0 20 remove_watcher() i=7 2024-09-12T00:32:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:03.709 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:03.709 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.31 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:32:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:03.812 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at commit_target_layout 2024-09-12T00:32:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:04.236 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:32:04.268 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:04.268 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:04.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.315+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.315+0000 7fa67303b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.315+0000 7fa67303b9c0 20 realm 2024-09-12T00:32:04.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.315+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.315+0000 7fa67303b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.315+0000 7fa67303b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:04.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.319+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.319+0000 7fa67303b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.319+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.319+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:04.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.319+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.319+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:04.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.319+0000 7fa67303b9c0 20 searching for the correct realm 2024-09-12T00:32:04.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.323+0000 7fa671342640 0 -- 172.21.15.78:0/2599210653 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fa66000e070 msgr2=0x7fa660063fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:04.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.535+0000 7fa671342640 0 -- 172.21.15.78:0/2599210653 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563251a27890 msgr2=0x563251a29d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:04.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.547+0000 7fa67303b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:04.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.547+0000 7fa67303b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:04.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.547+0000 7fa67303b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:04.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.547+0000 7fa67303b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:04.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.547+0000 7fa67303b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:04.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.547+0000 7fa67303b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:04.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:04.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:04.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 zone default found 2024-09-12T00:32:04.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 4 Realm: () 2024-09-12T00:32:04.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:04.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:04.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:04.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 zonegroup default 2024-09-12T00:32:04.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.551+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.555+0000 7fa67303b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.555+0000 7fa67303b9c0 20 started sync module instance, tier type = 2024-09-12T00:32:04.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.555+0000 7fa67303b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:04.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.575+0000 7fa67303b9c0 20 add_watcher() i=0 2024-09-12T00:32:04.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.575+0000 7fa67303b9c0 20 add_watcher() i=1 2024-09-12T00:32:04.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.575+0000 7fa67303b9c0 20 add_watcher() i=2 2024-09-12T00:32:04.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.575+0000 7fa67303b9c0 20 add_watcher() i=3 2024-09-12T00:32:04.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.575+0000 7fa67303b9c0 20 add_watcher() i=4 2024-09-12T00:32:04.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.575+0000 7fa67303b9c0 20 add_watcher() i=5 2024-09-12T00:32:04.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.575+0000 7fa67303b9c0 20 add_watcher() i=6 2024-09-12T00:32:04.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.579+0000 7fa67303b9c0 20 add_watcher() i=7 2024-09-12T00:32:04.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.579+0000 7fa67303b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:04.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.583+0000 7fa526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:04.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.583+0000 7fa67303b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.583+0000 7fa67303b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:04.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.583+0000 7fa67303b9c0 5 note: GC not initialized 2024-09-12T00:32:04.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.583+0000 7fa525fe3640 20 reqs_thread_entry: start 2024-09-12T00:32:04.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:04.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 Filter name: none 2024-09-12T00:32:04.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa4977fe640 20 reqs_thread_entry: start 2024-09-12T00:32:04.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:04.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:04.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.587+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.591+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:04.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.591+0000 7fa67303b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.591+0000 7fa67303b9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:04.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.591+0000 7fa67303b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:04.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.595+0000 7fa526fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:04.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.599+0000 7fa67303b9c0 20 remove_watcher() i=0 2024-09-12T00:32:04.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.599+0000 7fa67303b9c0 2 removed watcher, disabling cache 2024-09-12T00:32:04.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.599+0000 7fa67303b9c0 20 remove_watcher() i=1 2024-09-12T00:32:04.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.603+0000 7fa67303b9c0 20 remove_watcher() i=2 2024-09-12T00:32:04.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.603+0000 7fa67303b9c0 20 remove_watcher() i=3 2024-09-12T00:32:04.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.607+0000 7fa67303b9c0 20 remove_watcher() i=4 2024-09-12T00:32:04.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.607+0000 7fa67303b9c0 20 remove_watcher() i=5 2024-09-12T00:32:04.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.611+0000 7fa67303b9c0 20 remove_watcher() i=6 2024-09-12T00:32:04.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.615+0000 7fa67303b9c0 20 remove_watcher() i=7 2024-09-12T00:32:04.630 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:04.630 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:04.630 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:04.631 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:04.631 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at commit_target_layout 2024-09-12T00:32:04.664 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:04.664 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:04.707 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.707+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 realm 2024-09-12T00:32:04.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:04.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:04.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:04.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:04.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:04.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.711+0000 7f26652f49c0 20 searching for the correct realm 2024-09-12T00:32:04.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:04.719+0000 7f26635fb640 0 -- 172.21.15.78:0/3714171238 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f2654062fc0 msgr2=0x7f2654065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.135+0000 7f26625f9640 0 -- 172.21.15.78:0/3714171238 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f2654088a30 msgr2=0x7f265407d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:05.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:05.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:05.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:05.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:05.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:05.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.147+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:05.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 zone default found 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 4 Realm: () 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 zonegroup default 2024-09-12T00:32:05.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.155+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.155+0000 7f26652f49c0 20 started sync module instance, tier type = 2024-09-12T00:32:05.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.155+0000 7f26652f49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=0 2024-09-12T00:32:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=1 2024-09-12T00:32:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=2 2024-09-12T00:32:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=3 2024-09-12T00:32:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=4 2024-09-12T00:32:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=5 2024-09-12T00:32:05.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=6 2024-09-12T00:32:05.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.179+0000 7f26652f49c0 20 add_watcher() i=7 2024-09-12T00:32:05.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.179+0000 7f26652f49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:05.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f25197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:05.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:05.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:05.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f26652f49c0 5 note: GC not initialized 2024-09-12T00:32:05.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f2493fff640 20 reqs_thread_entry: start 2024-09-12T00:32:05.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f26652f49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:05.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f26652f49c0 20 Filter name: none 2024-09-12T00:32:05.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f2491ffb640 20 reqs_thread_entry: start 2024-09-12T00:32:05.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:32:05.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:05.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:32:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:32:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : miss 2024-09-12T00:32:05.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:05.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:05.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.187+0000 7f26652f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:05.198 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:05.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398977 cookie 94126695926752 notifier 6923 bl.length()=931 2024-09-12T00:32:05.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:05.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:05.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:05.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:05.211 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:05.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:05.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:05.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:05.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:05.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:05.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:05.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:05.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:05.216 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:05.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:05.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:05.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:05.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:05.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:05.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.227+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:05.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.227+0000 7f26652f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398978 cookie 94126695926752 notifier 6923 bl.length()=931 2024-09-12T00:32:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:05.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:05.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:05.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:05.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:05.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:05.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:05.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:05.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:05.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:05.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:05.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:05.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:05.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.247+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:05.246 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26652f49c0 time 2024-09-12T00:32:05.251417+0000 2024-09-12T00:32:05.246 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:05.247 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.247 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2668bce2eb] 2024-09-12T00:32:05.247 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f26652f49c0 thread_name:radosgw-admin 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.247+0000 7f26652f49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26652f49c0 time 2024-09-12T00:32:05.251417+0000 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:05.248 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2668bce2eb] 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:05.249 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2667a4d520] 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2668bce345] 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.256 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.247+0000 7f26652f49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f26652f49c0 thread_name:radosgw-admin 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2667a4d520] 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:05.257 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2668bce345] 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:32:05.258 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:32:04.687+0000 7f26652f49c0 5 AuthRegistry(0x559b94362d50) adding con mode: secure 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:32:04.687+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:32:04.687+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:32:04.687+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key hook 0x559b94362e98 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b94213300 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b9421cbf0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b9421e850 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.026885s 2024-09-12T00:32:05.259 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b94213300 auth_method 0 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): get_auth_request con 0x559b9421e850 auth_method 0 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.260 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_done global_id 6914 payload 824 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:32:04.687+0000 7f2662dfa640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: dump: 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.261 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: dump: 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.262 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:32:04.687+0000 7f2550e09640 4 set_mon_vals no callback set 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:32:04.691+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6914 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:32:04.691+0000 7f26652f49c0 1 librados: init done 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:32:04.691+0000 7f254f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:05.263 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:32:04.691+0000 7f254f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:32:04.691+0000 7f254f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:32:04.691+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f2548070b10 auth_method 0 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:32:04.691+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b943955f0 auth_method 0 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:32:04.695+0000 7f2662dfa640 10 monclient: get_auth_request con 0x559b943ad9c0 auth_method 0 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:32:04.695+0000 7f26625f9640 10 monclient: get_auth_request con 0x559b943b1bb0 auth_method 0 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:32:04.695+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b943b11f0 auth_method 0 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:32:04.695+0000 7f26652f49c0 10 monclient: build_initial_monmap 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:32:04.695+0000 7f26652f49c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:32:04.695+0000 7f26652f49c0 10 monclient: monmap: 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:05.264 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding auth protocol: cephx 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding auth protocol: cephx 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding auth protocol: cephx 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.265 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:32:04.699+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command objecter_requests cmddesc objecter_requests hook 0x559b943bd5b0 EEXIST 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: init 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding auth protocol: cephx 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding auth protocol: cephx 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding auth protocol: cephx 2024-09-12T00:32:05.266 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:32:04.699+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:32:04.699+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key cmddesc rotate-key hook 0x559b943b8c10 EEXIST 2024-09-12T00:32:05.267 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b943e1760 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b943e1090 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b943dfa70 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.036886s 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): get_auth_request con 0x559b943e1760 auth_method 0 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.268 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.269 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.269 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b943dfa70 auth_method 0 2024-09-12T00:32:05.269 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.269 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.269 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.269 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.269 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): get_auth_request con 0x559b943e1090 auth_method 0 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_done global_id 6917 payload 824 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:32:04.699+0000 7f26625f9640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.270 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: dump: 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.271 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: dump: 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.272 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6917 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:32:04.699+0000 7f2663dfc640 4 set_mon_vals no callback set 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:32:04.699+0000 7f254ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:32:04.699+0000 7f254ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:32:04.699+0000 7f254ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient: get_auth_request con 0x7f253c070a20 auth_method 0 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: get_monmap_and_config 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: build_initial_monmap 2024-09-12T00:32:05.273 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: monmap: 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding auth protocol: cephx 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding auth protocol: cephx 2024-09-12T00:32:05.274 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding auth protocol: cephx 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.275 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: init 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding auth protocol: cephx 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding auth protocol: cephx 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding auth protocol: cephx 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.276 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key cmddesc rotate-key hook 0x7fff78b6e9a8 EEXIST 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b94404fe0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b944053c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b9442fa30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.277 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.041102s 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): get_auth_request con 0x559b944053c0 auth_method 0 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b9442fa30 auth_method 0 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.278 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_done global_id 6920 payload 274 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:32:04.703+0000 7f26635fb640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: dump: 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.279 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6920 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: get_monmap_and_config success 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:32:04.703+0000 7f26652f49c0 4 set_mon_vals no callback set 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: dump: 2024-09-12T00:32:05.280 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: shutdown 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: build_initial_monmap 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:05.281 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: monmap: 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding auth protocol: cephx 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding auth protocol: cephx 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding auth protocol: cephx 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.282 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: starting msgr at 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: starting objecter 2024-09-12T00:32:05.283 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command objecter_requests cmddesc objecter_requests hook 0x559b944308f0 EEXIST 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: setting wanted keys 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: calling monclient init 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: init 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding auth protocol: cephx 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding auth protocol: cephx 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding auth protocol: cephx 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.284 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key cmddesc rotate-key hook 0x559b943e36c8 EEXIST 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b94404fe0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b9442fa30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b944295c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.285 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.043617s 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b944295c0 auth_method 0 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): get_auth_request con 0x559b94404fe0 auth_method 0 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.286 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_done global_id 6923 payload 824 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:32:04.707+0000 7f2662dfa640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:32:04.707+0000 7f2662dfa640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:32:04.707+0000 7f2662dfa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.287 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: dump: 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.288 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: dump: 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:32:04.707+0000 7f25467fc640 4 set_mon_vals no callback set 2024-09-12T00:32:05.289 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:32:04.707+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6923 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:32:04.707+0000 7f26652f49c0 1 librados: init done 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:32:04.707+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cr dump hook 0x559b94429ac8 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:32:04.707+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:32:04.707+0000 7f2544ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:32:04.707+0000 7f2544ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:32:04.707+0000 7f2544ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.290 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:32:04.707+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f252c070ae0 auth_method 0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:32:04.707+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b9444fdf0 auth_method 0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 realm 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:32:04.711+0000 7f26652f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:32:04.711+0000 7f26625f9640 10 monclient: get_auth_request con 0x559b944540b0 auth_method 0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.291 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:32:04.711+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b94457910 auth_method 0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 searching for the correct realm 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:32:04.715+0000 7f2662dfa640 10 monclient: get_auth_request con 0x559b9445c5f0 auth_method 0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:32:04.715+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f265406b250 auth_method 0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:32:04.719+0000 7f26635fb640 10 monclient: get_auth_request con 0x7f2654062fc0 auth_method 0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:32:04.719+0000 7f26635fb640 0 -- 172.21.15.78:0/3714171238 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f2654062fc0 msgr2=0x7f2654065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:32:04.923+0000 7f26635fb640 10 monclient: get_auth_request con 0x7f2654062fc0 auth_method 0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:32:04.927+0000 7f2662dfa640 10 monclient: get_auth_request con 0x7f264c035030 auth_method 0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:32:05.135+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f2654088a30 auth_method 0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:32:05.135+0000 7f26625f9640 0 -- 172.21.15.78:0/3714171238 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f2654088a30 msgr2=0x7f265407d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:32:05.135+0000 7f2544ff9640 1 client.6923.objecter ms_handle_reset 0x7f2654088a30 session 0x7f265400def0 osd.3 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:32:05.135+0000 7f2544ff9640 10 monclient: _renew_subs 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:32:05.135+0000 7f2544ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.292 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:32:05.135+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f252c080d90 auth_method 0 2024-09-12T00:32:05.293 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:05.293 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:05.293 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:05.293 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:05.293 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:05.293 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:05.294 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.294 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.294 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.294 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:05.294 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.294 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:05.295 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 zone default found 2024-09-12T00:32:05.295 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:32:05.151+0000 7f26652f49c0 4 Realm: () 2024-09-12T00:32:05.295 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:32:05.151+0000 7f26652f49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:05.295 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:32:05.151+0000 7f26652f49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:05.295 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:32:05.151+0000 7f26652f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:05.295 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 zonegroup default 2024-09-12T00:32:05.296 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.296 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.296 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.296 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.296 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.296 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:32:05.155+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.297 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:32:05.155+0000 7f26652f49c0 20 started sync module instance, tier type = 2024-09-12T00:32:05.297 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:32:05.155+0000 7f26652f49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:05.297 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=0 2024-09-12T00:32:05.297 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=1 2024-09-12T00:32:05.297 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=2 2024-09-12T00:32:05.297 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=3 2024-09-12T00:32:05.298 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=4 2024-09-12T00:32:05.298 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=5 2024-09-12T00:32:05.298 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=6 2024-09-12T00:32:05.298 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:32:05.179+0000 7f26652f49c0 20 add_watcher() i=7 2024-09-12T00:32:05.298 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:32:05.179+0000 7f26652f49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:05.298 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding auth protocol: cephx 2024-09-12T00:32:05.299 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding auth protocol: cephx 2024-09-12T00:32:05.299 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding auth protocol: cephx 2024-09-12T00:32:05.299 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.299 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.299 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.300 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.300 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.300 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.300 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:32:05.183+0000 7f25197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:05.300 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.300 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.301 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.301 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.301 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.301 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.301 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:32:05.183+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.301 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:05.302 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:05.302 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache list hook 0x559b9442e8f0 2024-09-12T00:32:05.302 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache inspect hook 0x559b9442e8f0 2024-09-12T00:32:05.302 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache erase hook 0x559b9442e8f0 2024-09-12T00:32:05.302 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache zap hook 0x559b9442e8f0 2024-09-12T00:32:05.303 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 note: GC not initialized 2024-09-12T00:32:05.303 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:32:05.183+0000 7f2493fff640 20 reqs_thread_entry: start 2024-09-12T00:32:05.303 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace show hook 0x7f265c0ace80 2024-09-12T00:32:05.303 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace history hook 0x7f265c0ace80 2024-09-12T00:32:05.303 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace active hook 0x7f265c0ace80 2024-09-12T00:32:05.303 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace active_short hook 0x7f265c0ace80 2024-09-12T00:32:05.304 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:05.304 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 Filter name: none 2024-09-12T00:32:05.304 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:32:05.183+0000 7f2491ffb640 20 reqs_thread_entry: start 2024-09-12T00:32:05.304 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:32:05.183+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:32:05.304 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.305 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:05.305 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:32:05.305 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:32:05.305 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : miss 2024-09-12T00:32:05.305 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.305 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:05.306 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.306 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.306 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:05.306 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.306 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:05.306 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.307 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.307 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.307 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:05.307 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398977 cookie 94126695926752 notifier 6923 bl.length()=931 2024-09-12T00:32:05.307 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.307 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.308 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.308 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:05.308 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:05.308 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:05.308 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:05.309 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:05.309 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:05.309 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:05.309 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:05.309 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:05.309 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:05.310 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:05.310 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:05.310 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:05.310 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:05.310 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:05.310 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:05.311 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:05.311 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:05.311 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:05.311 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:05.311 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:05.311 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:05.312 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:05.312 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:05.312 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:05.312 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:05.312 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:05.312 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:05.313 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:05.313 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:05.313 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:05.313 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:05.313 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:05.314 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:05.314 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:05.314 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:05.314 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:05.314 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:05.314 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:05.315 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:32:05.227+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:05.315 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:32:05.227+0000 7f26652f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:05.315 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.315 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.315 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.315 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:05.316 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398978 cookie 94126695926752 notifier 6923 bl.length()=931 2024-09-12T00:32:05.316 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.316 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.316 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.316 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:05.316 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:05.316 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:05.317 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:05.317 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:05.317 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:05.317 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:05.317 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:05.317 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:32:05.247+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:32:05.247+0000 7f26652f49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26652f49c0 time 2024-09-12T00:32:05.251417+0000 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.318 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2668bce2eb] 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:32:05.247+0000 7f26652f49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f26652f49c0 thread_name:radosgw-admin 2024-09-12T00:32:05.319 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2667a4d520] 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2668bce345] 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:05.320 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:32:05.321 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:32:05.322 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:32:05.323 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:32:05.324 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:32:05.325 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:32:05.326 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:32:05.327 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2491ffb640 / http_manager 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2493fff640 / http_manager 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7f25197e2640 / rgw_dt_lg_renew 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2544ff9640 / ms_dispatch 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7f25467fc640 / io_context_pool 2024-09-12T00:32:05.328 INFO:tasks.workunit.client.0.smithi078.stderr: 7f254ce01640 / ms_dispatch 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7f254f606640 / ms_dispatch 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2550e09640 / io_context_pool 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7f26625f9640 / msgr-worker-2 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2662dfa640 / msgr-worker-1 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7f26635fb640 / msgr-worker-0 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2663dfc640 / io_context_pool 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: 7f26652f49c0 / radosgw-admin 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:32:05.329 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.112887.log 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:32:04.687+0000 7f26652f49c0 5 AuthRegistry(0x559b94362d50) adding con mode: secure 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:32:04.687+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:32:04.687+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:32:04.687+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key hook 0x559b94362e98 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b94213300 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b9421cbf0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b9421e850 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.330 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:32:04.687+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.026885s 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b94213300 auth_method 0 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): get_auth_request con 0x559b9421e850 auth_method 0 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.331 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:32:04.687+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient(hunting): handle_auth_done global_id 6914 payload 824 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:32:04.687+0000 7f2662dfa640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:32:04.687+0000 7f2662dfa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: dump: 2024-09-12T00:32:05.332 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.333 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:32:04.687+0000 7f254f606640 10 monclient: dump: 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:32:04.687+0000 7f2550e09640 4 set_mon_vals no callback set 2024-09-12T00:32:05.334 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:32:04.691+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6914 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:32:04.691+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:32:04.691+0000 7f26652f49c0 1 librados: init done 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:32:04.691+0000 7f254f606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:32:04.691+0000 7f254f606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:32:04.691+0000 7f254f606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:32:04.691+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f2548070b10 auth_method 0 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:32:04.691+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b943955f0 auth_method 0 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:32:04.695+0000 7f2662dfa640 10 monclient: get_auth_request con 0x559b943ad9c0 auth_method 0 2024-09-12T00:32:05.335 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:32:04.695+0000 7f26625f9640 10 monclient: get_auth_request con 0x559b943b1bb0 auth_method 0 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:32:04.695+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b943b11f0 auth_method 0 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:32:04.695+0000 7f26652f49c0 10 monclient: build_initial_monmap 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:32:04.695+0000 7f26652f49c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:32:04.695+0000 7f26652f49c0 10 monclient: monmap: 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:05.336 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding auth protocol: cephx 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding auth protocol: cephx 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding auth protocol: cephx 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.337 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: crc 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:32:04.695+0000 7f26652f49c0 5 AuthRegistry(0x559b943b9c70) adding con mode: secure 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:32:04.699+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command objecter_requests cmddesc objecter_requests hook 0x559b943bd5b0 EEXIST 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: init 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding auth protocol: cephx 2024-09-12T00:32:05.338 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding auth protocol: cephx 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding auth protocol: cephx 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: crc 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 AuthRegistry(0x559b943b8ac8) adding con mode: secure 2024-09-12T00:32:05.339 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:32:04.699+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:32:04.699+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key cmddesc rotate-key hook 0x559b943b8c10 EEXIST 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b943e1760 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b943e1090 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b943dfa70 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.036886s 2024-09-12T00:32:05.340 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): get_auth_request con 0x559b943e1760 auth_method 0 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b943dfa70 auth_method 0 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:32:04.699+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.341 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): get_auth_request con 0x559b943e1090 auth_method 0 2024-09-12T00:32:05.342 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.342 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.342 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.342 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient(hunting): handle_auth_done global_id 6917 payload 824 2024-09-12T00:32:05.342 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.342 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:32:04.699+0000 7f26625f9640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:32:04.699+0000 7f26625f9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: dump: 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.343 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:32:04.699+0000 7f254ce01640 10 monclient: dump: 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.344 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:32:04.699+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6917 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:32:04.699+0000 7f2663dfc640 4 set_mon_vals no callback set 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.345 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:32:04.699+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:32:04.699+0000 7f254ce01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:32:04.699+0000 7f254ce01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:32:04.699+0000 7f254ce01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:32:04.699+0000 7f26635fb640 10 monclient: get_auth_request con 0x7f253c070a20 auth_method 0 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: get_monmap_and_config 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: build_initial_monmap 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: monmap: 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:05.346 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding auth protocol: cephx 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding auth protocol: cephx 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding auth protocol: cephx 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.347 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: crc 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b944010f0) adding con mode: secure 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: init 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding auth protocol: cephx 2024-09-12T00:32:05.348 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding auth protocol: cephx 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding auth protocol: cephx 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: crc 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6e860) adding con mode: secure 2024-09-12T00:32:05.349 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key cmddesc rotate-key hook 0x7fff78b6e9a8 EEXIST 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b94404fe0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b944053c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b9442fa30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.041102s 2024-09-12T00:32:05.350 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): get_auth_request con 0x559b944053c0 auth_method 0 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b9442fa30 auth_method 0 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.351 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient(hunting): handle_auth_done global_id 6920 payload 274 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:32:04.703+0000 7f26635fb640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:32:04.703+0000 7f26635fb640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: dump: 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.352 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6920 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: get_monmap_and_config success 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:32:04.703+0000 7f26652f49c0 4 set_mon_vals no callback set 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:32:04.703+0000 7f25467fc640 10 monclient: dump: 2024-09-12T00:32:05.353 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: shutdown 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: build_initial_monmap 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: monmap: 2024-09-12T00:32:05.354 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding auth protocol: cephx 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding auth protocol: cephx 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding auth protocol: cephx 2024-09-12T00:32:05.355 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: crc 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b94434cc0) adding con mode: secure 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.356 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: starting msgr at 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: starting objecter 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command objecter_requests cmddesc objecter_requests hook 0x559b944308f0 EEXIST 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: setting wanted keys 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:32:04.703+0000 7f26652f49c0 1 librados: calling monclient init 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: init 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding auth protocol: cephx 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding auth protocol: cephx 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding auth protocol: cephx 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.357 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: crc 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 AuthRegistry(0x559b943e3580) adding con mode: secure 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:32:04.703+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:32:04.703+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command rotate-key cmddesc rotate-key hook 0x559b943e36c8 EEXIST 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-a con 0x559b94404fe0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:05.358 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-b con 0x559b9442fa30 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): picked mon.noname-c con 0x559b944295c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:32:04.703+0000 7f26652f49c0 10 monclient(hunting): authenticate will time out at 2249.043617s 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request con 0x559b944295c0 auth_method 0 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): get_auth_request con 0x559b94404fe0 auth_method 0 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:05.359 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:32:04.703+0000 7f26625f9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:32:04.703+0000 7f2662dfa640 10 monclient(hunting): handle_auth_done global_id 6923 payload 824 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:32:04.707+0000 7f2662dfa640 10 monclient: _finish_hunting 0 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:32:04.707+0000 7f2662dfa640 1 monclient: found mon.noname-c 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:32:04.707+0000 7f2662dfa640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:05.360 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: dump: 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: _finish_auth 0 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:05.361 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:32:04.707+0000 7f2544ff9640 10 monclient: dump: 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.362 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:32:04.707+0000 7f25467fc640 4 set_mon_vals no callback set 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:32:04.707+0000 7f26652f49c0 5 monclient: authenticate success, global_id 6923 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _renew_subs 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:32:04.707+0000 7f26652f49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:32:04.707+0000 7f26652f49c0 1 librados: init done 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:32:04.707+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cr dump hook 0x559b94429ac8 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:32:04.707+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:32:04.707+0000 7f2544ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:32:04.707+0000 7f2544ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:32:04.707+0000 7f2544ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:32:04.707+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f252c070ae0 auth_method 0 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:32:04.707+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b9444fdf0 auth_method 0 2024-09-12T00:32:05.363 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 realm 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:32:04.711+0000 7f26652f49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:32:04.711+0000 7f26625f9640 10 monclient: get_auth_request con 0x559b944540b0 auth_method 0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:32:04.711+0000 7f26635fb640 10 monclient: get_auth_request con 0x559b94457910 auth_method 0 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:32:04.711+0000 7f26652f49c0 20 searching for the correct realm 2024-09-12T00:32:05.364 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:32:04.715+0000 7f2662dfa640 10 monclient: get_auth_request con 0x559b9445c5f0 auth_method 0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:32:04.715+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f265406b250 auth_method 0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:32:04.719+0000 7f26635fb640 10 monclient: get_auth_request con 0x7f2654062fc0 auth_method 0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:32:04.719+0000 7f26635fb640 0 -- 172.21.15.78:0/3714171238 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f2654062fc0 msgr2=0x7f2654065a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:32:04.923+0000 7f26635fb640 10 monclient: get_auth_request con 0x7f2654062fc0 auth_method 0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:32:04.927+0000 7f2662dfa640 10 monclient: get_auth_request con 0x7f264c035030 auth_method 0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:32:05.135+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f2654088a30 auth_method 0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:32:05.135+0000 7f26625f9640 0 -- 172.21.15.78:0/3714171238 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f2654088a30 msgr2=0x7f265407d0b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:32:05.135+0000 7f2544ff9640 1 client.6923.objecter ms_handle_reset 0x7f2654088a30 session 0x7f265400def0 osd.3 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:32:05.135+0000 7f2544ff9640 10 monclient: _renew_subs 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:32:05.135+0000 7f2544ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:32:05.135+0000 7f26625f9640 10 monclient: get_auth_request con 0x7f252c080d90 auth_method 0 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:05.365 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:32:05.147+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 zone default found 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:32:05.151+0000 7f26652f49c0 4 Realm: () 2024-09-12T00:32:05.366 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:32:05.151+0000 7f26652f49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:32:05.151+0000 7f26652f49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:32:05.151+0000 7f26652f49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 zonegroup default 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:32:05.151+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:32:05.155+0000 7f26652f49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:32:05.155+0000 7f26652f49c0 20 started sync module instance, tier type = 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:32:05.155+0000 7f26652f49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:05.367 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=0 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=1 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=2 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=3 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=4 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=5 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:32:05.175+0000 7f26652f49c0 20 add_watcher() i=6 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:32:05.179+0000 7f26652f49c0 20 add_watcher() i=7 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:32:05.179+0000 7f26652f49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding auth protocol: cephx 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding auth protocol: cephx 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding auth protocol: cephx 2024-09-12T00:32:05.368 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:32:05.183+0000 7f25197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: crc 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 AuthRegistry(0x7fff78b6ed40) adding con mode: secure 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:32:05.183+0000 7f26652f49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:05.369 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache list hook 0x559b9442e8f0 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache inspect hook 0x559b9442e8f0 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache erase hook 0x559b9442e8f0 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command cache zap hook 0x559b9442e8f0 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 note: GC not initialized 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:32:05.183+0000 7f2493fff640 20 reqs_thread_entry: start 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace show hook 0x7f265c0ace80 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace history hook 0x7f265c0ace80 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace active hook 0x7f265c0ace80 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:32:05.183+0000 7f26652f49c0 5 asok(0x559b941582b0) register_command sync trace active_short hook 0x7f265c0ace80 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:05.370 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 Filter name: none 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:32:05.183+0000 7f2491ffb640 20 reqs_thread_entry: start 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:32:05.183+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:32:05.183+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : miss 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:32:05.187+0000 7f26652f49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:05.371 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:32:05.187+0000 7f26652f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:32:05.199+0000 7f26652f49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398977 cookie 94126695926752 notifier 6923 bl.length()=931 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:32:05.199+0000 7f25467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:05.372 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:32:05.199+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:05.373 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:32:05.211+0000 7f26652f49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:05.374 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:32:05.211+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:32:05.215+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:32:05.219+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:32:05.227+0000 7f26652f49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:32:05.227+0000 7f26652f49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.375 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:32:05.231+0000 7f26652f49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398978 cookie 94126695926752 notifier 6923 bl.length()=931 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:32:05.231+0000 7f25467fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:32:05.231+0000 7f26652f49c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:05.376 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:32:05.239+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:32:05.243+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:32:05.247+0000 7f26652f49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:32:05.247+0000 7f26652f49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f26652f49c0 time 2024-09-12T00:32:05.251417+0000 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f2668bce2eb] 2024-09-12T00:32:05.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:32:05.247+0000 7f26652f49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f26652f49c0 thread_name:radosgw-admin 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f2667a4d520] 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:05.378 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f2668bce345] 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f2668bce49f] 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x559b9130dcc1] 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x3e7) [0x559b91322fc7] 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f2667a34d90] 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:32:05.379 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:32:05.380 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:32:05.381 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:32:05.382 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:32:05.383 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:32:05.384 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:32:05.385 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:32:05.386 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2491ffb640 / http_manager 2024-09-12T00:32:05.387 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2493fff640 / http_manager 2024-09-12T00:32:05.387 INFO:tasks.workunit.client.0.smithi078.stderr: 7f25197e2640 / rgw_dt_lg_renew 2024-09-12T00:32:05.387 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2544ff9640 / ms_dispatch 2024-09-12T00:32:05.387 INFO:tasks.workunit.client.0.smithi078.stderr: 7f25467fc640 / io_context_pool 2024-09-12T00:32:05.387 INFO:tasks.workunit.client.0.smithi078.stderr: 7f254ce01640 / ms_dispatch 2024-09-12T00:32:05.387 INFO:tasks.workunit.client.0.smithi078.stderr: 7f254f606640 / ms_dispatch 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2550e09640 / io_context_pool 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: 7f26625f9640 / msgr-worker-2 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2662dfa640 / msgr-worker-1 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: 7f26635fb640 / msgr-worker-0 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: 7f2663dfc640 / io_context_pool 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: 7f26652f49c0 / radosgw-admin 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:32:05.253471Z_5d1d1eee-212f-429a-85a4-af0ec5364dd9/log 2024-09-12T00:32:05.388 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:32:05.392 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:32:05.392 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:32:05.392 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.335+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 realm 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:05.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.339+0000 7f1d43eed9c0 20 searching for the correct realm 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.347+0000 7f1d421f4640 0 -- 172.21.15.78:0/3826870259 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1d34115250 msgr2=0x7f1d3412da00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.351+0000 7f1d411f2640 0 -- 172.21.15.78:0/3826870259 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f1d341143f0 msgr2=0x7f1d340a5a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.359+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 zone default found 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 4 Realm: () 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 zonegroup default 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 started sync module instance, tier type = 2024-09-12T00:32:05.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.363+0000 7f1d43eed9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=0 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=1 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=2 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=3 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=4 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=5 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=6 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 20 add_watcher() i=7 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.383+0000 7f1d43eed9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1bf37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1d43eed9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1d43eed9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1d43eed9c0 5 note: GC not initialized 2024-09-12T00:32:05.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1bf27fc640 20 reqs_thread_entry: start 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1d43eed9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1d43eed9c0 20 Filter name: none 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1b63fff640 20 reqs_thread_entry: start 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.387+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:05.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:05.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:32:05.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.391+0000 7f1d43eed9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:05.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.395+0000 7f1bf37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:05.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.399+0000 7f1d43eed9c0 20 remove_watcher() i=0 2024-09-12T00:32:05.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.399+0000 7f1d43eed9c0 2 removed watcher, disabling cache 2024-09-12T00:32:05.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.403+0000 7f1d43eed9c0 20 remove_watcher() i=1 2024-09-12T00:32:05.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.403+0000 7f1d43eed9c0 20 remove_watcher() i=2 2024-09-12T00:32:05.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.407+0000 7f1d43eed9c0 20 remove_watcher() i=3 2024-09-12T00:32:05.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.407+0000 7f1d43eed9c0 20 remove_watcher() i=4 2024-09-12T00:32:05.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.411+0000 7f1d43eed9c0 20 remove_watcher() i=5 2024-09-12T00:32:05.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.411+0000 7f1d43eed9c0 20 remove_watcher() i=6 2024-09-12T00:32:05.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:05.415+0000 7f1d43eed9c0 20 remove_watcher() i=7 2024-09-12T00:32:05.429 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:05.429 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:05.429 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:05.429 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:35.551 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-commit-target-layout --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:32:35.587 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:35.587 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:35.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.630+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:35.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 realm 2024-09-12T00:32:35.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:35.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:35.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:35.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:35.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.634+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.638+0000 7fd121c999c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:35.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.638+0000 7fd121c999c0 20 searching for the correct realm 2024-09-12T00:32:35.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.642+0000 7fd11ffa0640 0 -- 172.21.15.78:0/2438421348 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fd110065be0 msgr2=0x7fd11006d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:35.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.858+0000 7fd11f79f640 0 -- 172.21.15.78:0/2438421348 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x558113f7fce0 msgr2=0x558113f820d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:35.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:35.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:35.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:35.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:35.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:35.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:35.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:35.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:35.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:35.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 zone default found 2024-09-12T00:32:35.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 4 Realm: () 2024-09-12T00:32:35.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:35.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:35.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:35.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 zonegroup default 2024-09-12T00:32:35.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.870+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.874+0000 7fd121c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:35.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.874+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.874+0000 7fd121c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:35.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.874+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.874+0000 7fd121c999c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:35.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.874+0000 7fd121c999c0 20 started sync module instance, tier type = 2024-09-12T00:32:35.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.874+0000 7fd121c999c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:35.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.894+0000 7fd121c999c0 20 add_watcher() i=0 2024-09-12T00:32:35.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.894+0000 7fd121c999c0 20 add_watcher() i=1 2024-09-12T00:32:35.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.894+0000 7fd121c999c0 20 add_watcher() i=2 2024-09-12T00:32:35.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.894+0000 7fd121c999c0 20 add_watcher() i=3 2024-09-12T00:32:35.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.894+0000 7fd121c999c0 20 add_watcher() i=4 2024-09-12T00:32:35.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.894+0000 7fd121c999c0 20 add_watcher() i=5 2024-09-12T00:32:35.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.898+0000 7fd121c999c0 20 add_watcher() i=6 2024-09-12T00:32:35.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.898+0000 7fd121c999c0 20 add_watcher() i=7 2024-09-12T00:32:35.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.898+0000 7fd121c999c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:35.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.902+0000 7fcfd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:35.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:35.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:35.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 5 note: GC not initialized 2024-09-12T00:32:35.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fcfd4fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:35.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:35.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 Filter name: none 2024-09-12T00:32:35.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fcf4e7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:35.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 10 cache get: name=default.rgw.meta+root+abort-at-commit-target-layout : miss 2024-09-12T00:32:35.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:35.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 10 cache put: name=default.rgw.meta+root+abort-at-commit-target-layout info.flags=0x11 2024-09-12T00:32:35.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 10 adding default.rgw.meta+root+abort-at-commit-target-layout to cache LRU end 2024-09-12T00:32:35.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : miss 2024-09-12T00:32:35.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:35.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:35.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:35.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.906+0000 7fd121c999c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:35.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.910+0000 7fd121c999c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:35.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.910+0000 7fd121c999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:35.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.910+0000 7fd121c999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:35.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.918+0000 7fd121c999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:35.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.918+0000 7fd121c999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:35.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.918+0000 7fd121c999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:35.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.918+0000 7fd121c999c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:35.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd0027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398980 cookie 94012874232304 notifier 7416 bl.length()=931 2024-09-12T00:32:35.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd0027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:35.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd0027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:35.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd0027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:35.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:35.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:35.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:35.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.922+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.0 2024-09-12T00:32:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.1 2024-09-12T00:32:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:35.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.2 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.3 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.4 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.5 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.6 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.7 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.8 2024-09-12T00:32:35.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.9 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.10 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1.11 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.934+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:35.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.938+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:35.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.938+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:35.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.938+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:35.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.942+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:35.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.942+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:35.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.942+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:35.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.946+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:35.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.946+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:35.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.946+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:35.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.954+0000 7fd121c999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:35.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.954+0000 7fd121c999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:35.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.954+0000 7fd121c999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:35.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.954+0000 7fd121c999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:35.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.954+0000 7fd121c999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:35.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.954+0000 7fd121c999c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:35.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd002ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398981 cookie 94012874232304 notifier 7416 bl.length()=931 2024-09-12T00:32:35.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd002ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:35.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd002ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:35.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd002ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:35.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:35.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:35.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:35.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.958+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:35.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.962+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.0 2024-09-12T00:32:35.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.962+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.1 2024-09-12T00:32:35.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.966+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.2 2024-09-12T00:32:35.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.966+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.3 2024-09-12T00:32:35.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.966+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.4 2024-09-12T00:32:35.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.966+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.5 2024-09-12T00:32:35.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.970+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.6 2024-09-12T00:32:35.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.970+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.7 2024-09-12T00:32:35.972 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.970+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.8 2024-09-12T00:32:35.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.970+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.9 2024-09-12T00:32:35.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.974+0000 7fd121c999c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32.10 2024-09-12T00:32:35.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.974+0000 7fd121c999c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:35.975 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.974+0000 7fd121c999c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 2024-09-12T00:32:35.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:35.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:35.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:35.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32, ofs0, ns] 2024-09-12T00:32:35.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd0027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398982 cookie 94012874232304 notifier 7416 bl.length()=899 2024-09-12T00:32:35.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd0027fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 info.flags=0x17 2024-09-12T00:32:35.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd0027fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-commit-target-layout:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 to cache LRU end 2024-09-12T00:32:35.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd0027fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:35.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_sources= new_sources= 2024-09-12T00:32:35.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential sources added=[] removed=[] 2024-09-12T00:32:35.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): orig_dests= new_dests= 2024-09-12T00:32:35.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.978+0000 7fd121c999c0 20 handle_bi_update(): bucket=:abort-at-commit-target-layout[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32]): potential dests added=[] removed=[] 2024-09-12T00:32:35.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.986+0000 7fd121c999c0 1 execute INFO: reshard of bucket "abort-at-commit-target-layout" from 11 shards to 12 shards completed successfully 2024-09-12T00:32:35.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.990+0000 7fcfd5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:35.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.994+0000 7fd121c999c0 20 remove_watcher() i=0 2024-09-12T00:32:35.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.994+0000 7fd121c999c0 2 removed watcher, disabling cache 2024-09-12T00:32:35.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.994+0000 7fd121c999c0 20 remove_watcher() i=1 2024-09-12T00:32:35.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.998+0000 7fd121c999c0 20 remove_watcher() i=2 2024-09-12T00:32:36.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:35.998+0000 7fd121c999c0 20 remove_watcher() i=3 2024-09-12T00:32:36.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.002+0000 7fd121c999c0 20 remove_watcher() i=4 2024-09-12T00:32:36.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.002+0000 7fd121c999c0 20 remove_watcher() i=5 2024-09-12T00:32:36.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.006+0000 7fd121c999c0 20 remove_watcher() i=6 2024-09-12T00:32:36.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.010+0000 7fd121c999c0 20 remove_watcher() i=7 2024-09-12T00:32:36.029 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-commit-target-layout 2024-09-12T00:32:36.056 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:36.056 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:36.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.098+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:36.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 realm 2024-09-12T00:32:36.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:36.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:36.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:36.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:36.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:36.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.102+0000 7fc83fa799c0 20 searching for the correct realm 2024-09-12T00:32:36.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.110+0000 7fc83dd80640 0 -- 172.21.15.78:0/1390530558 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fc830103fc0 msgr2=0x7fc83012e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:36.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.318+0000 7fc83d57f640 0 -- 172.21.15.78:0/1390530558 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ad8564de30 msgr2=0x55ad856502b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:36.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.330+0000 7fc83fa799c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:36.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.330+0000 7fc83fa799c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:36.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.330+0000 7fc83fa799c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:36.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.330+0000 7fc83fa799c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:36.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.330+0000 7fc83fa799c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:36.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.330+0000 7fc83fa799c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:36.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.330+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:36.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:36.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:36.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 zone default found 2024-09-12T00:32:36.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 4 Realm: () 2024-09-12T00:32:36.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:36.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:36.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:36.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 zonegroup default 2024-09-12T00:32:36.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:36.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.334+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.338+0000 7fc83fa799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:36.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.338+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.338+0000 7fc83fa799c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:36.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.338+0000 7fc83fa799c0 20 started sync module instance, tier type = 2024-09-12T00:32:36.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.338+0000 7fc83fa799c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:36.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.358+0000 7fc83fa799c0 20 add_watcher() i=0 2024-09-12T00:32:36.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.358+0000 7fc83fa799c0 20 add_watcher() i=1 2024-09-12T00:32:36.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.358+0000 7fc83fa799c0 20 add_watcher() i=2 2024-09-12T00:32:36.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.358+0000 7fc83fa799c0 20 add_watcher() i=3 2024-09-12T00:32:36.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.358+0000 7fc83fa799c0 20 add_watcher() i=4 2024-09-12T00:32:36.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.358+0000 7fc83fa799c0 20 add_watcher() i=5 2024-09-12T00:32:36.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.358+0000 7fc83fa799c0 20 add_watcher() i=6 2024-09-12T00:32:36.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.362+0000 7fc83fa799c0 20 add_watcher() i=7 2024-09-12T00:32:36.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.362+0000 7fc83fa799c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:36.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.366+0000 7fc6f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:36.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.366+0000 7fc83fa799c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:36.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.366+0000 7fc83fa799c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:36.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.366+0000 7fc83fa799c0 5 note: GC not initialized 2024-09-12T00:32:36.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.366+0000 7fc6f27e4640 20 reqs_thread_entry: start 2024-09-12T00:32:36.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.366+0000 7fc83fa799c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:36.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.366+0000 7fc83fa799c0 20 Filter name: none 2024-09-12T00:32:36.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.370+0000 7fc663fff640 20 reqs_thread_entry: start 2024-09-12T00:32:36.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.370+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.370+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:36.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.370+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.370+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:36.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.370+0000 7fc83fa799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:36.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.370+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.374+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:32:36.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.374+0000 7fc83fa799c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:36.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.374+0000 7fc83fa799c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:32:36.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.374+0000 7fc83fa799c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:36.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.378+0000 7fc6f37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:36.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.382+0000 7fc83fa799c0 20 remove_watcher() i=0 2024-09-12T00:32:36.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.382+0000 7fc83fa799c0 2 removed watcher, disabling cache 2024-09-12T00:32:36.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.382+0000 7fc83fa799c0 20 remove_watcher() i=1 2024-09-12T00:32:36.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.386+0000 7fc83fa799c0 20 remove_watcher() i=2 2024-09-12T00:32:36.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.386+0000 7fc83fa799c0 20 remove_watcher() i=3 2024-09-12T00:32:36.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.390+0000 7fc83fa799c0 20 remove_watcher() i=4 2024-09-12T00:32:36.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.390+0000 7fc83fa799c0 20 remove_watcher() i=5 2024-09-12T00:32:36.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.394+0000 7fc83fa799c0 20 remove_watcher() i=6 2024-09-12T00:32:36.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:36.398+0000 7fc83fa799c0 20 remove_watcher() i=7 2024-09-12T00:32:36.413 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:36.414 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:36.414 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-commit-target-layout id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.32 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:32:36.414 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:36.524 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at do_reshard 2024-09-12T00:32:36.524 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:36.998 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:32:37.031 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:37.031 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:37.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.282+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 realm 2024-09-12T00:32:37.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:37.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:37.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.286+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.290+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:37.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.290+0000 7f798e0e89c0 20 searching for the correct realm 2024-09-12T00:32:37.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.294+0000 7f798c3ef640 0 -- 172.21.15.78:0/1045389114 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x562990942dd0 msgr2=0x5629909451c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:37.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.298+0000 7f798b3ed640 0 -- 172.21.15.78:0/1045389114 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f797c11b0c0 msgr2=0x7f797c11c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:37.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 zone default found 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 4 Realm: () 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 zonegroup default 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.518+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.522+0000 7f798e0e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.522+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.522+0000 7f798e0e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.522+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.522+0000 7f798e0e89c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.522+0000 7f798e0e89c0 20 started sync module instance, tier type = 2024-09-12T00:32:37.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.522+0000 7f798e0e89c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.546+0000 7f798e0e89c0 20 add_watcher() i=0 2024-09-12T00:32:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.546+0000 7f798e0e89c0 20 add_watcher() i=1 2024-09-12T00:32:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.546+0000 7f798e0e89c0 20 add_watcher() i=2 2024-09-12T00:32:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.546+0000 7f798e0e89c0 20 add_watcher() i=3 2024-09-12T00:32:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.546+0000 7f798e0e89c0 20 add_watcher() i=4 2024-09-12T00:32:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.546+0000 7f798e0e89c0 20 add_watcher() i=5 2024-09-12T00:32:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.546+0000 7f798e0e89c0 20 add_watcher() i=6 2024-09-12T00:32:37.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.550+0000 7f798e0e89c0 20 add_watcher() i=7 2024-09-12T00:32:37.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.550+0000 7f798e0e89c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:37.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f7841fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:37.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 5 note: GC not initialized 2024-09-12T00:32:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f7840fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 20 Filter name: none 2024-09-12T00:32:37.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f77ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:37.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:37.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.554+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.558+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:37.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.558+0000 7f798e0e89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:37.558 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.558+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.558+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:37.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.558+0000 7f798e0e89c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.558+0000 7f798e0e89c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:37.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.558+0000 7f798e0e89c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:37.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.562+0000 7f7841fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:37.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.566+0000 7f798e0e89c0 20 remove_watcher() i=0 2024-09-12T00:32:37.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.566+0000 7f798e0e89c0 2 removed watcher, disabling cache 2024-09-12T00:32:37.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.570+0000 7f798e0e89c0 20 remove_watcher() i=1 2024-09-12T00:32:37.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.570+0000 7f798e0e89c0 20 remove_watcher() i=2 2024-09-12T00:32:37.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.574+0000 7f798e0e89c0 20 remove_watcher() i=3 2024-09-12T00:32:37.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.574+0000 7f798e0e89c0 20 remove_watcher() i=4 2024-09-12T00:32:37.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.578+0000 7f798e0e89c0 20 remove_watcher() i=5 2024-09-12T00:32:37.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.582+0000 7f798e0e89c0 20 remove_watcher() i=6 2024-09-12T00:32:37.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.582+0000 7f798e0e89c0 20 remove_watcher() i=7 2024-09-12T00:32:37.603 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:37.603 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:37.603 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-do-reshard id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:37.603 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:37.603 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at do_reshard 2024-09-12T00:32:37.640 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:37.640 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:37.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.682+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 realm 2024-09-12T00:32:37.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:37.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:37.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.686+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.690+0000 7efc5c1429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:37.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.690+0000 7efc5c1429c0 20 searching for the correct realm 2024-09-12T00:32:37.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.694+0000 7efc5a449640 0 -- 172.21.15.78:0/3168687212 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7efc4c06dbc0 msgr2=0x7efc4c076a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:37.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.906+0000 7efc59c48640 0 -- 172.21.15.78:0/3168687212 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5612b368a790 msgr2=0x5612b368cbe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:37.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.918+0000 7efc5c1429c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:37.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.918+0000 7efc5c1429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:37.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.918+0000 7efc5c1429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:37.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.918+0000 7efc5c1429c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:37.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.918+0000 7efc5c1429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:37.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.918+0000 7efc5c1429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:37.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.918+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:37.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:37.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 zone default found 2024-09-12T00:32:37.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 4 Realm: () 2024-09-12T00:32:37.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:37.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:37.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:37.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 zonegroup default 2024-09-12T00:32:37.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.922+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.926+0000 7efc5c1429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:37.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.926+0000 7efc5c1429c0 20 started sync module instance, tier type = 2024-09-12T00:32:37.927 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.926+0000 7efc5c1429c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:37.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.946+0000 7efc5c1429c0 20 add_watcher() i=0 2024-09-12T00:32:37.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.946+0000 7efc5c1429c0 20 add_watcher() i=1 2024-09-12T00:32:37.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.946+0000 7efc5c1429c0 20 add_watcher() i=2 2024-09-12T00:32:37.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.946+0000 7efc5c1429c0 20 add_watcher() i=3 2024-09-12T00:32:37.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.946+0000 7efc5c1429c0 20 add_watcher() i=4 2024-09-12T00:32:37.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.946+0000 7efc5c1429c0 20 add_watcher() i=5 2024-09-12T00:32:37.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.946+0000 7efc5c1429c0 20 add_watcher() i=6 2024-09-12T00:32:37.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.950+0000 7efc5c1429c0 20 add_watcher() i=7 2024-09-12T00:32:37.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.950+0000 7efc5c1429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:37.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.954+0000 7efb0bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:37.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.954+0000 7efc5c1429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:37.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.954+0000 7efc5c1429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.954+0000 7efc5c1429c0 5 note: GC not initialized 2024-09-12T00:32:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.954+0000 7efb0affd640 20 reqs_thread_entry: start 2024-09-12T00:32:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 20 Filter name: none 2024-09-12T00:32:37.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efb08ff9640 20 reqs_thread_entry: start 2024-09-12T00:32:37.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:32:37.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:37.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:32:37.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:32:37.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 : miss 2024-09-12T00:32:37.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:37.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:37.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:37.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:37.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:37.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:37.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.958+0000 7efc5c1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 2024-09-12T00:32:37.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:37.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:37.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:37.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33, ofs0, ns] 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efb3cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398986 cookie 94638319444640 notifier 7010 bl.length()=911 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efb3cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efb3cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efb3cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_sources= new_sources= 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential sources added=[] removed=[] 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_dests= new_dests= 2024-09-12T00:32:37.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.974+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential dests added=[] removed=[] 2024-09-12T00:32:37.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.982+0000 7efc5c1429c0 -1 Injecting error=-5 at location=do_reshard 2024-09-12T00:32:38.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.998+0000 7efc5c1429c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:38.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:37.998+0000 7efc5c1429c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 2024-09-12T00:32:38.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efc5c1429c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efc5c1429c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efc5c1429c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efc5c1429c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33, ofs0, ns] 2024-09-12T00:32:38.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efb3cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398987 cookie 94638319444640 notifier 7010 bl.length()=879 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efb3cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efb3cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.002+0000 7efb3cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.006+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_sources= new_sources= 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.006+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential sources added=[] removed=[] 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.006+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_dests= new_dests= 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.006+0000 7efc5c1429c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential dests added=[] removed=[] 2024-09-12T00:32:38.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.006+0000 7efc5c1429c0 1 execute INFO: reshard of bucket "error-at-do-reshard" canceled due to errors 2024-09-12T00:32:38.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.006+0000 7efb0bfff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:38.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.010+0000 7efc5c1429c0 20 remove_watcher() i=0 2024-09-12T00:32:38.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.010+0000 7efc5c1429c0 2 removed watcher, disabling cache 2024-09-12T00:32:38.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.014+0000 7efc5c1429c0 20 remove_watcher() i=1 2024-09-12T00:32:38.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.014+0000 7efc5c1429c0 20 remove_watcher() i=2 2024-09-12T00:32:38.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.018+0000 7efc5c1429c0 20 remove_watcher() i=3 2024-09-12T00:32:38.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.018+0000 7efc5c1429c0 20 remove_watcher() i=4 2024-09-12T00:32:38.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.022+0000 7efc5c1429c0 20 remove_watcher() i=5 2024-09-12T00:32:38.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.022+0000 7efc5c1429c0 20 remove_watcher() i=6 2024-09-12T00:32:38.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.026+0000 7efc5c1429c0 20 remove_watcher() i=7 2024-09-12T00:32:38.041 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:32:38.071 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:38.071 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:38.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.114+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.114+0000 7f642e8fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.114+0000 7f642e8fe9c0 20 realm 2024-09-12T00:32:38.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.114+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.114+0000 7f642e8fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.114+0000 7f642e8fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:38.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.114+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.118+0000 7f642e8fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.118+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.118+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:38.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.118+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.118+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:38.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.118+0000 7f642e8fe9c0 20 searching for the correct realm 2024-09-12T00:32:38.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.122+0000 7f642cc05640 0 -- 172.21.15.78:0/267798217 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f641c0c2c10 msgr2=0x7f641c0fe420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:38.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.334+0000 7f642cc05640 0 -- 172.21.15.78:0/267798217 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55b77ba07c80 msgr2=0x55b77ba0a110 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.346+0000 7f642e8fe9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.346+0000 7f642e8fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.346+0000 7f642e8fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.346+0000 7f642e8fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.346+0000 7f642e8fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.346+0000 7f642e8fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.346+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:38.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:38.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 zone default found 2024-09-12T00:32:38.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 4 Realm: () 2024-09-12T00:32:38.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:38.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:38.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:38.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 zonegroup default 2024-09-12T00:32:38.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.350+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.354+0000 7f642e8fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.354+0000 7f642e8fe9c0 20 started sync module instance, tier type = 2024-09-12T00:32:38.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.354+0000 7f642e8fe9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:38.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.374+0000 7f642e8fe9c0 20 add_watcher() i=0 2024-09-12T00:32:38.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.374+0000 7f642e8fe9c0 20 add_watcher() i=1 2024-09-12T00:32:38.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.374+0000 7f642e8fe9c0 20 add_watcher() i=2 2024-09-12T00:32:38.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.374+0000 7f642e8fe9c0 20 add_watcher() i=3 2024-09-12T00:32:38.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.374+0000 7f642e8fe9c0 20 add_watcher() i=4 2024-09-12T00:32:38.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.374+0000 7f642e8fe9c0 20 add_watcher() i=5 2024-09-12T00:32:38.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.374+0000 7f642e8fe9c0 20 add_watcher() i=6 2024-09-12T00:32:38.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.378+0000 7f642e8fe9c0 20 add_watcher() i=7 2024-09-12T00:32:38.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.378+0000 7f642e8fe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:38.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.382+0000 7f62e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:38.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.382+0000 7f642e8fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:38.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.382+0000 7f642e8fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:38.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.382+0000 7f642e8fe9c0 5 note: GC not initialized 2024-09-12T00:32:38.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.382+0000 7f62e1fdb640 20 reqs_thread_entry: start 2024-09-12T00:32:38.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.382+0000 7f642e8fe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:38.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.382+0000 7f642e8fe9c0 20 Filter name: none 2024-09-12T00:32:38.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f62537fe640 20 reqs_thread_entry: start 2024-09-12T00:32:38.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:38.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:38.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:38.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:38.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.386+0000 7f642e8fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.390+0000 7f642e8fe9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:38.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.390+0000 7f642e8fe9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:38.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.390+0000 7f62e2fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:38.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.394+0000 7f642e8fe9c0 20 remove_watcher() i=0 2024-09-12T00:32:38.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.394+0000 7f642e8fe9c0 2 removed watcher, disabling cache 2024-09-12T00:32:38.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.398+0000 7f642e8fe9c0 20 remove_watcher() i=1 2024-09-12T00:32:38.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.398+0000 7f642e8fe9c0 20 remove_watcher() i=2 2024-09-12T00:32:38.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.402+0000 7f642e8fe9c0 20 remove_watcher() i=3 2024-09-12T00:32:38.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.406+0000 7f642e8fe9c0 20 remove_watcher() i=4 2024-09-12T00:32:38.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.406+0000 7f642e8fe9c0 20 remove_watcher() i=5 2024-09-12T00:32:38.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.410+0000 7f642e8fe9c0 20 remove_watcher() i=6 2024-09-12T00:32:38.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.410+0000 7f642e8fe9c0 20 remove_watcher() i=7 2024-09-12T00:32:38.428 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:38.428 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:38.428 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-do-reshard id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:38.428 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:38.483 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:32:38.517 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:38.518 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:38.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.562+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.562+0000 7fe213af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.562+0000 7fe213af39c0 20 realm 2024-09-12T00:32:38.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.562+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:38.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:38.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:38.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.566+0000 7fe213af39c0 20 searching for the correct realm 2024-09-12T00:32:38.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.570+0000 7fe211dfa640 0 -- 172.21.15.78:0/1587143056 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fe204033910 msgr2=0x7fe204018400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:38.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.786+0000 7fe210df8640 0 -- 172.21.15.78:0/1587143056 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fe204042970 msgr2=0x7fe2040263f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:38.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:38.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:38.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:38.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:38.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:38.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:38.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:38.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.798+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:38.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 zone default found 2024-09-12T00:32:38.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 4 Realm: () 2024-09-12T00:32:38.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:38.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:38.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:38.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 zonegroup default 2024-09-12T00:32:38.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:38.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 started sync module instance, tier type = 2024-09-12T00:32:38.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.802+0000 7fe213af39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:38.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.826+0000 7fe213af39c0 20 add_watcher() i=0 2024-09-12T00:32:38.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.826+0000 7fe213af39c0 20 add_watcher() i=1 2024-09-12T00:32:38.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.826+0000 7fe213af39c0 20 add_watcher() i=2 2024-09-12T00:32:38.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.826+0000 7fe213af39c0 20 add_watcher() i=3 2024-09-12T00:32:38.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.826+0000 7fe213af39c0 20 add_watcher() i=4 2024-09-12T00:32:38.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.826+0000 7fe213af39c0 20 add_watcher() i=5 2024-09-12T00:32:38.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.826+0000 7fe213af39c0 20 add_watcher() i=6 2024-09-12T00:32:38.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.830+0000 7fe213af39c0 20 add_watcher() i=7 2024-09-12T00:32:38.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.830+0000 7fe213af39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:38.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe0c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:38.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:38.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:38.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 5 note: GC not initialized 2024-09-12T00:32:38.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe0c6fe5640 20 reqs_thread_entry: start 2024-09-12T00:32:38.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:38.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 Filter name: none 2024-09-12T00:32:38.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe0c4fe1640 20 reqs_thread_entry: start 2024-09-12T00:32:38.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 cache get: name=default.rgw.meta+root+error-at-do-reshard : miss 2024-09-12T00:32:38.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:38.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 cache put: name=default.rgw.meta+root+error-at-do-reshard info.flags=0x11 2024-09-12T00:32:38.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 adding default.rgw.meta+root+error-at-do-reshard to cache LRU end 2024-09-12T00:32:38.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 : miss 2024-09-12T00:32:38.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:38.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:38.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:38.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.834+0000 7fe213af39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 2024-09-12T00:32:38.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33, ofs0, ns] 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe0f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398988 cookie 94743755590480 notifier 7043 bl.length()=911 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe0f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe0f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe0f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_sources= new_sources= 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential sources added=[] removed=[] 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_dests= new_dests= 2024-09-12T00:32:38.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.846+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential dests added=[] removed=[] 2024-09-12T00:32:38.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.0 2024-09-12T00:32:38.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.0 2024-09-12T00:32:38.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.1 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.1 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.2 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.2 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.3 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.3 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.4 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.4 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.5 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.5 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.6 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.6 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.7 2024-09-12T00:32:38.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.7 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.8 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.8 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.9 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.9 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.10 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.10 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.11 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1.11 2024-09-12T00:32:38.862 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.858+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.0 2024-09-12T00:32:38.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.862+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1 2024-09-12T00:32:38.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.862+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.2 2024-09-12T00:32:38.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.862+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.3 2024-09-12T00:32:38.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.862+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.4 2024-09-12T00:32:38.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.866+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.5 2024-09-12T00:32:38.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.866+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.6 2024-09-12T00:32:38.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.866+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.7 2024-09-12T00:32:38.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.866+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.8 2024-09-12T00:32:38.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.866+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.9 2024-09-12T00:32:38.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.870+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.10 2024-09-12T00:32:38.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.874+0000 7fe213af39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:38.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.874+0000 7fe213af39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 2024-09-12T00:32:38.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33, ofs0, ns] 2024-09-12T00:32:38.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe0f4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398989 cookie 94743755590480 notifier 7043 bl.length()=911 2024-09-12T00:32:38.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe0f4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe0f4ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe0f4ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_sources= new_sources= 2024-09-12T00:32:38.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential sources added=[] removed=[] 2024-09-12T00:32:38.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_dests= new_dests= 2024-09-12T00:32:38.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.878+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential dests added=[] removed=[] 2024-09-12T00:32:38.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.886+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.0 2024-09-12T00:32:38.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.886+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.1 2024-09-12T00:32:38.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.886+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.2 2024-09-12T00:32:38.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.886+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.3 2024-09-12T00:32:38.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.890+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.4 2024-09-12T00:32:38.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.890+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.5 2024-09-12T00:32:38.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.890+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.6 2024-09-12T00:32:38.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.890+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.7 2024-09-12T00:32:38.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.890+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.8 2024-09-12T00:32:38.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.890+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.9 2024-09-12T00:32:38.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.894+0000 7fe213af39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33.10 2024-09-12T00:32:38.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.894+0000 7fe213af39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 : hit (requested=0x17, cached=0x17) 2024-09-12T00:32:38.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.894+0000 7fe213af39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 2024-09-12T00:32:38.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33, ofs0, ns] 2024-09-12T00:32:38.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe0e3fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398990 cookie 94743755590480 notifier 7043 bl.length()=879 2024-09-12T00:32:38.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe0e3fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 info.flags=0x17 2024-09-12T00:32:38.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe0e3fff640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 to cache LRU end 2024-09-12T00:32:38.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe0e3fff640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:38.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_sources= new_sources= 2024-09-12T00:32:38.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential sources added=[] removed=[] 2024-09-12T00:32:38.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): orig_dests= new_dests= 2024-09-12T00:32:38.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.898+0000 7fe213af39c0 20 handle_bi_update(): bucket=:error-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33]): potential dests added=[] removed=[] 2024-09-12T00:32:38.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.902+0000 7fe213af39c0 1 execute INFO: reshard of bucket "error-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:32:38.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.906+0000 7fe0c7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:38.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.910+0000 7fe213af39c0 20 remove_watcher() i=0 2024-09-12T00:32:38.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.910+0000 7fe213af39c0 2 removed watcher, disabling cache 2024-09-12T00:32:38.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.914+0000 7fe213af39c0 20 remove_watcher() i=1 2024-09-12T00:32:38.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.914+0000 7fe213af39c0 20 remove_watcher() i=2 2024-09-12T00:32:38.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.918+0000 7fe213af39c0 20 remove_watcher() i=3 2024-09-12T00:32:38.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.918+0000 7fe213af39c0 20 remove_watcher() i=4 2024-09-12T00:32:38.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.922+0000 7fe213af39c0 20 remove_watcher() i=5 2024-09-12T00:32:38.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.926+0000 7fe213af39c0 20 remove_watcher() i=6 2024-09-12T00:32:38.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:38.926+0000 7fe213af39c0 20 remove_watcher() i=7 2024-09-12T00:32:38.943 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-do-reshard 2024-09-12T00:32:38.971 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:38.971 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:39.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.014+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:39.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 realm 2024-09-12T00:32:39.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:39.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:39.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:39.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:39.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:39.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.018+0000 7f232b5c19c0 20 searching for the correct realm 2024-09-12T00:32:39.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.230+0000 7f23298c8640 0 -- 172.21.15.78:0/3415457487 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f231c0d0070 msgr2=0x7f231c11fa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:39.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.642+0000 7f23298c8640 0 -- 172.21.15.78:0/3415457487 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559220aa95a0 msgr2=0x559220aaba20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:39.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:39.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:39.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 zone default found 2024-09-12T00:32:39.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 4 Realm: () 2024-09-12T00:32:39.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:39.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:39.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:39.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 zonegroup default 2024-09-12T00:32:39.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:39.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.654+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.658+0000 7f232b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:39.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.658+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.658+0000 7f232b5c19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:39.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.658+0000 7f232b5c19c0 20 started sync module instance, tier type = 2024-09-12T00:32:39.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.658+0000 7f232b5c19c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.678+0000 7f232b5c19c0 20 add_watcher() i=0 2024-09-12T00:32:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.678+0000 7f232b5c19c0 20 add_watcher() i=1 2024-09-12T00:32:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.678+0000 7f232b5c19c0 20 add_watcher() i=2 2024-09-12T00:32:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.678+0000 7f232b5c19c0 20 add_watcher() i=3 2024-09-12T00:32:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.678+0000 7f232b5c19c0 20 add_watcher() i=4 2024-09-12T00:32:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.678+0000 7f232b5c19c0 20 add_watcher() i=5 2024-09-12T00:32:39.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.678+0000 7f232b5c19c0 20 add_watcher() i=6 2024-09-12T00:32:39.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.682+0000 7f232b5c19c0 20 add_watcher() i=7 2024-09-12T00:32:39.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.682+0000 7f232b5c19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:39.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.686+0000 7f21df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:39.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.686+0000 7f232b5c19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:39.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.686+0000 7f232b5c19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:39.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.686+0000 7f232b5c19c0 5 note: GC not initialized 2024-09-12T00:32:39.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.686+0000 7f21de7e4640 20 reqs_thread_entry: start 2024-09-12T00:32:39.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.686+0000 7f232b5c19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:39.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.686+0000 7f232b5c19c0 20 Filter name: none 2024-09-12T00:32:39.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.690+0000 7f214ffff640 20 reqs_thread_entry: start 2024-09-12T00:32:39.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.690+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.690+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:39.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.690+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.690+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.690+0000 7f232b5c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:39.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.690+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.694+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:39.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.694+0000 7f232b5c19c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:39.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.694+0000 7f232b5c19c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:39.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.694+0000 7f232b5c19c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:39.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.698+0000 7f21df7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:39.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.702+0000 7f232b5c19c0 20 remove_watcher() i=0 2024-09-12T00:32:39.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.702+0000 7f232b5c19c0 2 removed watcher, disabling cache 2024-09-12T00:32:39.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.702+0000 7f232b5c19c0 20 remove_watcher() i=1 2024-09-12T00:32:39.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.706+0000 7f232b5c19c0 20 remove_watcher() i=2 2024-09-12T00:32:39.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.706+0000 7f232b5c19c0 20 remove_watcher() i=3 2024-09-12T00:32:39.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.710+0000 7f232b5c19c0 20 remove_watcher() i=4 2024-09-12T00:32:39.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.714+0000 7f232b5c19c0 20 remove_watcher() i=5 2024-09-12T00:32:39.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.714+0000 7f232b5c19c0 20 remove_watcher() i=6 2024-09-12T00:32:39.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:39.718+0000 7f232b5c19c0 20 remove_watcher() i=7 2024-09-12T00:32:39.735 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:39.736 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:39.736 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-do-reshard id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.33 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:32:39.736 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:39.845 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at do_reshard 2024-09-12T00:32:39.845 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.269 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:32:40.302 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:40.302 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:40.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.346+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.346+0000 7f1b3819b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.346+0000 7f1b3819b9c0 20 realm 2024-09-12T00:32:40.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.346+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.346+0000 7f1b3819b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.346+0000 7f1b3819b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:40.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.346+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.350+0000 7f1b3819b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.350+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.350+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.350+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.350+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:40.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.350+0000 7f1b3819b9c0 20 searching for the correct realm 2024-09-12T00:32:40.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.358+0000 7f1b364a2640 0 -- 172.21.15.78:0/1484288828 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1b280d5930 msgr2=0x7f1b280b73d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.362+0000 7f1b35ca1640 0 -- 172.21.15.78:0/1484288828 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x555d9c2bf820 msgr2=0x555d9c2c1c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:40.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:40.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 zone default found 2024-09-12T00:32:40.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 4 Realm: () 2024-09-12T00:32:40.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:40.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:40.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:40.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 zonegroup default 2024-09-12T00:32:40.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.370+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.374+0000 7f1b3819b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.374+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.374+0000 7f1b3819b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.374+0000 7f1b3819b9c0 20 started sync module instance, tier type = 2024-09-12T00:32:40.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.374+0000 7f1b3819b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:40.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.390+0000 7f1b3819b9c0 20 add_watcher() i=0 2024-09-12T00:32:40.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.390+0000 7f1b3819b9c0 20 add_watcher() i=1 2024-09-12T00:32:40.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.390+0000 7f1b3819b9c0 20 add_watcher() i=2 2024-09-12T00:32:40.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.390+0000 7f1b3819b9c0 20 add_watcher() i=3 2024-09-12T00:32:40.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.390+0000 7f1b3819b9c0 20 add_watcher() i=4 2024-09-12T00:32:40.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.390+0000 7f1b3819b9c0 20 add_watcher() i=5 2024-09-12T00:32:40.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.390+0000 7f1b3819b9c0 20 add_watcher() i=6 2024-09-12T00:32:40.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.394+0000 7f1b3819b9c0 20 add_watcher() i=7 2024-09-12T00:32:40.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.394+0000 7f1b3819b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:40.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f19e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:40.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:40.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:40.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 5 note: GC not initialized 2024-09-12T00:32:40.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f19e67fc640 20 reqs_thread_entry: start 2024-09-12T00:32:40.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:40.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 Filter name: none 2024-09-12T00:32:40.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1957fff640 20 reqs_thread_entry: start 2024-09-12T00:32:40.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:40.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:40.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:40.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.398+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.402+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:40.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.402+0000 7f1b3819b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.402+0000 7f1b3819b9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:40.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.402+0000 7f1b3819b9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:40.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.402+0000 7f19e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.406+0000 7f1b3819b9c0 20 remove_watcher() i=0 2024-09-12T00:32:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.406+0000 7f1b3819b9c0 2 removed watcher, disabling cache 2024-09-12T00:32:40.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.410+0000 7f1b3819b9c0 20 remove_watcher() i=1 2024-09-12T00:32:40.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.410+0000 7f1b3819b9c0 20 remove_watcher() i=2 2024-09-12T00:32:40.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.414+0000 7f1b3819b9c0 20 remove_watcher() i=3 2024-09-12T00:32:40.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.414+0000 7f1b3819b9c0 20 remove_watcher() i=4 2024-09-12T00:32:40.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.418+0000 7f1b3819b9c0 20 remove_watcher() i=5 2024-09-12T00:32:40.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.418+0000 7f1b3819b9c0 20 remove_watcher() i=6 2024-09-12T00:32:40.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.422+0000 7f1b3819b9c0 20 remove_watcher() i=7 2024-09-12T00:32:40.437 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.437 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:40.437 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-do-reshard id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:40.437 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.438 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:32:40.470 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:40.470 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:40.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.514+0000 7f34548299c0 20 realm 2024-09-12T00:32:40.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.514+0000 7f34548299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:40.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:40.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.518+0000 7f34548299c0 20 searching for the correct realm 2024-09-12T00:32:40.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.522+0000 7f3452b30640 0 -- 172.21.15.78:0/4121228369 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f34440659b0 msgr2=0x7f3444063b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.738+0000 7f3452b30640 0 -- 172.21.15.78:0/4121228369 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5641dd5ee240 msgr2=0x5641dd5f0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:40.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:40.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:40.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:40.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:40.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:40.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:40.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 zone default found 2024-09-12T00:32:40.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 4 Realm: () 2024-09-12T00:32:40.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:40.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:40.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:40.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 zonegroup default 2024-09-12T00:32:40.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 started sync module instance, tier type = 2024-09-12T00:32:40.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.754+0000 7f34548299c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:40.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=0 2024-09-12T00:32:40.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=1 2024-09-12T00:32:40.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=2 2024-09-12T00:32:40.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=3 2024-09-12T00:32:40.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=4 2024-09-12T00:32:40.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=5 2024-09-12T00:32:40.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=6 2024-09-12T00:32:40.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.786+0000 7f34548299c0 20 add_watcher() i=7 2024-09-12T00:32:40.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.786+0000 7f34548299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:40.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f3308fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:40.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f34548299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:40.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f34548299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:40.792 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f34548299c0 5 note: GC not initialized 2024-09-12T00:32:40.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f32837fe640 20 reqs_thread_entry: start 2024-09-12T00:32:40.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f34548299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:40.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f34548299c0 20 Filter name: none 2024-09-12T00:32:40.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.790+0000 7f32817fa640 20 reqs_thread_entry: start 2024-09-12T00:32:40.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:32:40.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 : miss 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.794+0000 7f34548299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 2024-09-12T00:32:40.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34, ofs0, ns] 2024-09-12T00:32:40.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94840886853984 notifier 7094 bl.length()=911 2024-09-12T00:32:40.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_sources= new_sources= 2024-09-12T00:32:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential sources added=[] removed=[] 2024-09-12T00:32:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_dests= new_dests= 2024-09-12T00:32:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential dests added=[] removed=[] 2024-09-12T00:32:40.818 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34548299c0 time 2024-09-12T00:32:40.823557+0000 2024-09-12T00:32:40.819 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:40.821 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34581032eb] 2024-09-12T00:32:40.821 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.821 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.821 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.822+0000 7f34548299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34548299c0 time 2024-09-12T00:32:40.823557+0000 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34581032eb] 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.822 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.823 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:40.823 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.823 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:40.823 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:40.823 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.823 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:32:40.823 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f34548299c0 thread_name:radosgw-admin 2024-09-12T00:32:40.824 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.824 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3456f82520] 2024-09-12T00:32:40.824 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3458103345] 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.822+0000 7f34548299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f34548299c0 thread_name:radosgw-admin 2024-09-12T00:32:40.825 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3456f82520] 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3458103345] 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:40.826 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:40.827 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:40.827 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.827 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:32:40.872 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:32:40.490+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.872 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:32:40.490+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.872 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:32:40.490+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.872 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:32:40.490+0000 7f3452b30640 10 monclient(hunting): handle_auth_done global_id 7551 payload 274 2024-09-12T00:32:40.872 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:32:40.490+0000 7f3452b30640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.872 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:32:40.490+0000 7f3452b30640 1 monclient: found mon.noname-a 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:32:40.490+0000 7f3452b30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: dump: 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.873 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: dump: 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.874 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:32:40.490+0000 7f34548299c0 5 monclient: authenticate success, global_id 7551 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:32:40.490+0000 7f34548299c0 10 monclient: get_monmap_and_config success 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:32:40.490+0000 7f34548299c0 4 set_mon_vals no callback set 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:32:40.490+0000 7f34548299c0 10 monclient: shutdown 2024-09-12T00:32:40.875 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:32:40.490+0000 7f34548299c0 5 asok(0x5641dd2f72b0) unregister_commands rotate-key 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.876 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding auth protocol: cephx 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding auth protocol: cephx 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding auth protocol: cephx 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.877 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:32:40.494+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: starting msgr at 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: starting objecter 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command objecter_requests hook 0x5641dd26fd70 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: setting wanted keys 2024-09-12T00:32:40.878 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: calling monclient init 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding auth protocol: cephx 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding auth protocol: cephx 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding auth protocol: cephx 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.879 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:32:40.494+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:32:40.494+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key hook 0x5641dd501288 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd37f290 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd3b18a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd44d010 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.880 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.833330s 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): get_auth_request con 0x5641dd37f290 auth_method 0 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): get_auth_request con 0x5641dd3b18a0 auth_method 0 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.881 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_done global_id 7554 payload 824 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:32:40.494+0000 7f3449b2e640 1 monclient: found mon.noname-a 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: dump: 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.882 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 monclient: authenticate success, global_id 7554 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.883 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: dump: 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.884 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:32:40.494+0000 7f3340608640 4 set_mon_vals no callback set 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: init done 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:32:40.498+0000 7f333ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:32:40.498+0000 7f333ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:32:40.498+0000 7f333ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:32:40.498+0000 7f345232f640 10 monclient: get_auth_request con 0x7f3338070b10 auth_method 0 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:32:40.498+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd542240 auth_method 0 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:32:40.498+0000 7f345232f640 10 monclient: get_auth_request con 0x5641dd54b730 auth_method 0 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:32:40.498+0000 7f3449b2e640 10 monclient: get_auth_request con 0x5641dd54fa90 auth_method 0 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd553cd0 auth_method 0 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:32:40.502+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding auth protocol: cephx 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding auth protocol: cephx 2024-09-12T00:32:40.886 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding auth protocol: cephx 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:32:40.502+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.887 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641dd55b4d0 EEXIST 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding auth protocol: cephx 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding auth protocol: cephx 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding auth protocol: cephx 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.888 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:32:40.502+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:32:40.502+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key cmddesc rotate-key hook 0x5641dd556b60 EEXIST 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd584f70 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd57f9d0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd57da50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.889 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.843501s 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): get_auth_request con 0x5641dd584f70 auth_method 0 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): get_auth_request con 0x5641dd57f9d0 auth_method 0 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.890 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): get_auth_request con 0x5641dd57da50 auth_method 0 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_done global_id 7088 payload 824 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:32:40.506+0000 7f3449b2e640 1 monclient: found mon.noname-c 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.891 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: dump: 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.892 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: dump: 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.893 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 monclient: authenticate success, global_id 7088 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:32:40.506+0000 7f3453331640 4 set_mon_vals no callback set 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:32:40.506+0000 7f3337fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:32:40.506+0000 7f3337fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:32:40.506+0000 7f3337fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f332c0709f0 auth_method 0 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: get_monmap_and_config 2024-09-12T00:32:40.894 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:32:40.506+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding auth protocol: cephx 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding auth protocol: cephx 2024-09-12T00:32:40.895 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding auth protocol: cephx 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:32:40.506+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.896 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding auth protocol: cephx 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding auth protocol: cephx 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding auth protocol: cephx 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.897 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:32:40.506+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:32:40.506+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd681e00c8 EEXIST 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd5a4160 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd5cf9c0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd5c5140 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.898 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.847594s 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): get_auth_request con 0x5641dd5cf9c0 auth_method 0 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): get_auth_request con 0x5641dd5a4160 auth_method 0 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.899 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_done global_id 7560 payload 274 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:32:40.506+0000 7f3452b30640 1 monclient: found mon.noname-a 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: dump: 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.900 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 monclient: authenticate success, global_id 7560 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: get_monmap_and_config success 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:32:40.510+0000 7f34548299c0 4 set_mon_vals no callback set 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.901 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: dump: 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.902 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: shutdown 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.903 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding auth protocol: cephx 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding auth protocol: cephx 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding auth protocol: cephx 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.904 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:32:40.510+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: starting msgr at 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: starting objecter 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641dd5ce400 EEXIST 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: setting wanted keys 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: calling monclient init 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding auth protocol: cephx 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding auth protocol: cephx 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding auth protocol: cephx 2024-09-12T00:32:40.905 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:32:40.510+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:32:40.510+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.906 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key cmddesc rotate-key hook 0x5641dd3ba358 EEXIST 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd5a4160 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd5c5140 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd5cf9c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.850137s 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): get_auth_request con 0x5641dd5cf9c0 auth_method 0 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.907 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): get_auth_request con 0x5641dd5c5140 auth_method 0 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_done global_id 7094 payload 824 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.908 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:32:40.510+0000 7f345232f640 1 monclient: found mon.noname-c 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: dump: 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.909 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: dump: 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.910 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:32:40.510+0000 7f3335ffb640 4 set_mon_vals no callback set 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 monclient: authenticate success, global_id 7094 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: init done 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cr dump hook 0x5641dd5a21a8 2024-09-12T00:32:40.911 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:32:40.514+0000 7f3323fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:32:40.514+0000 7f3323fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:32:40.514+0000 7f3323fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:32:40.514+0000 7f3449b2e640 10 monclient: get_auth_request con 0x7f331c070ae0 auth_method 0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:32:40.514+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd5ee240 auth_method 0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 realm 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:32:40.514+0000 7f34548299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.912 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:32:40.518+0000 7f3449b2e640 10 monclient: get_auth_request con 0x5641dd5f2410 auth_method 0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:32:40.518+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd5f5c50 auth_method 0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 searching for the correct realm 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:32:40.518+0000 7f345232f640 10 monclient: get_auth_request con 0x5641dd5fa740 auth_method 0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:32:40.522+0000 7f3449b2e640 10 monclient: get_auth_request con 0x7f3444008040 auth_method 0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:32:40.522+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f34440659b0 auth_method 0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:32:40.522+0000 7f3452b30640 0 -- 172.21.15.78:0/4121228369 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f34440659b0 msgr2=0x7f3444063b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:32:40.726+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f34440659b0 auth_method 0 2024-09-12T00:32:40.913 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:32:40.734+0000 7f345232f640 10 monclient: get_auth_request con 0x7f343c008050 auth_method 0 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:32:40.734+0000 7f3449b2e640 10 monclient: get_auth_request con 0x7f344406e550 auth_method 0 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:32:40.738+0000 7f3452b30640 0 -- 172.21.15.78:0/4121228369 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5641dd5ee240 msgr2=0x5641dd5f0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:32:40.738+0000 7f3323fff640 1 client.7094.objecter ms_handle_reset 0x5641dd5ee240 session 0x5641dd5edb70 osd.6 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:32:40.738+0000 7f3323fff640 10 monclient: _renew_subs 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:32:40.738+0000 7f3323fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:32:40.738+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f331c080d90 auth_method 0 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:40.914 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 zone default found 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:32:40.754+0000 7f34548299c0 4 Realm: () 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:32:40.754+0000 7f34548299c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:32:40.754+0000 7f34548299c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:32:40.754+0000 7f34548299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 zonegroup default 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.915 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 started sync module instance, tier type = 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=0 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=1 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=2 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=3 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=4 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=5 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=6 2024-09-12T00:32:40.916 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:32:40.786+0000 7f34548299c0 20 add_watcher() i=7 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:32:40.786+0000 7f34548299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding auth protocol: cephx 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding auth protocol: cephx 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding auth protocol: cephx 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.917 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:32:40.790+0000 7f3308fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:32:40.790+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache list hook 0x5641dd5ccd10 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache inspect hook 0x5641dd5ccd10 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache erase hook 0x5641dd5ccd10 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache zap hook 0x5641dd5ccd10 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 note: GC not initialized 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:32:40.790+0000 7f32837fe640 20 reqs_thread_entry: start 2024-09-12T00:32:40.918 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace show hook 0x7f3444004500 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace history hook 0x7f3444004500 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace active hook 0x7f3444004500 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace active_short hook 0x7f3444004500 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 Filter name: none 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:32:40.790+0000 7f32817fa640 20 reqs_thread_entry: start 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 : miss 2024-09-12T00:32:40.919 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34, ofs0, ns] 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94840886853984 notifier 7094 bl.length()=911 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.920 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_sources= new_sources= 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential sources added=[] removed=[] 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_dests= new_dests= 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential dests added=[] removed=[] 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:32:40.822+0000 7f34548299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34548299c0 time 2024-09-12T00:32:40.823557+0000 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34581032eb] 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.921 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:32:40.822+0000 7f34548299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f34548299c0 thread_name:radosgw-admin 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3456f82520] 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:40.922 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3458103345] 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:32:40.923 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:32:40.924 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:32:40.925 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:32:40.926 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:32:40.927 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:32:40.928 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:32:40.929 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 7f32817fa640 / http_manager 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 7f32837fe640 / http_manager 2024-09-12T00:32:40.930 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3308fe1640 / rgw_dt_lg_renew 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3323fff640 / ms_dispatch 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f33357fa640 / io_context_pool 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3335ffb640 / io_context_pool 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3337fff640 / ms_dispatch 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f333ee05640 / ms_dispatch 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3340608640 / io_context_pool 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3449b2e640 / msgr-worker-2 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f345232f640 / msgr-worker-1 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3452b30640 / msgr-worker-0 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3453331640 / io_context_pool 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34548299c0 / radosgw-admin 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:32:40.931 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.118787.log 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:32:40.490+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:32:40.490+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:32:40.490+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:32:40.490+0000 7f3452b30640 10 monclient(hunting): handle_auth_done global_id 7551 payload 274 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:32:40.490+0000 7f3452b30640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:32:40.490+0000 7f3452b30640 1 monclient: found mon.noname-a 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:32:40.490+0000 7f3452b30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:40.932 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: dump: 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.933 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:32:40.490+0000 7f3340608640 10 monclient: dump: 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.934 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:32:40.490+0000 7f34548299c0 5 monclient: authenticate success, global_id 7551 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:32:40.490+0000 7f34548299c0 10 monclient: get_monmap_and_config success 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:32:40.490+0000 7f34548299c0 4 set_mon_vals no callback set 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:32:40.490+0000 7f34548299c0 10 monclient: shutdown 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:32:40.490+0000 7f34548299c0 5 asok(0x5641dd2f72b0) unregister_commands rotate-key 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.935 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding auth protocol: cephx 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding auth protocol: cephx 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding auth protocol: cephx 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.936 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: crc 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd503fb0) adding con mode: secure 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:32:40.494+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: starting msgr at 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: starting objecter 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command objecter_requests hook 0x5641dd26fd70 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: setting wanted keys 2024-09-12T00:32:40.937 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: calling monclient init 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding auth protocol: cephx 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding auth protocol: cephx 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding auth protocol: cephx 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.938 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: crc 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 AuthRegistry(0x5641dd501140) adding con mode: secure 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:32:40.494+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:32:40.494+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key hook 0x5641dd501288 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd37f290 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd3b18a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd44d010 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.939 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.833330s 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): get_auth_request con 0x5641dd37f290 auth_method 0 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): get_auth_request con 0x5641dd3b18a0 auth_method 0 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.940 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:32:40.494+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient(hunting): handle_auth_done global_id 7554 payload 824 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:32:40.494+0000 7f3449b2e640 1 monclient: found mon.noname-a 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:32:40.494+0000 7f3449b2e640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: dump: 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.941 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:32:40.494+0000 7f34548299c0 5 monclient: authenticate success, global_id 7554 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.942 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:32:40.494+0000 7f333ee05640 10 monclient: dump: 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:32:40.494+0000 7f3340608640 4 set_mon_vals no callback set 2024-09-12T00:32:40.943 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:32:40.494+0000 7f34548299c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:32:40.494+0000 7f34548299c0 1 librados: init done 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:32:40.498+0000 7f333ee05640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:32:40.498+0000 7f333ee05640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:32:40.498+0000 7f333ee05640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:32:40.498+0000 7f345232f640 10 monclient: get_auth_request con 0x7f3338070b10 auth_method 0 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:32:40.498+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd542240 auth_method 0 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:32:40.498+0000 7f345232f640 10 monclient: get_auth_request con 0x5641dd54b730 auth_method 0 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:32:40.498+0000 7f3449b2e640 10 monclient: get_auth_request con 0x5641dd54fa90 auth_method 0 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd553cd0 auth_method 0 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:32:40.502+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.944 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding auth protocol: cephx 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding auth protocol: cephx 2024-09-12T00:32:40.945 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding auth protocol: cephx 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: crc 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd557b20) adding con mode: secure 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:32:40.502+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.946 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641dd55b4d0 EEXIST 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding auth protocol: cephx 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding auth protocol: cephx 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding auth protocol: cephx 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.947 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: crc 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 AuthRegistry(0x5641dd556a18) adding con mode: secure 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:32:40.502+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:32:40.502+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:32:40.502+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key cmddesc rotate-key hook 0x5641dd556b60 EEXIST 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd584f70 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd57f9d0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd57da50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.948 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:32:40.502+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.843501s 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): get_auth_request con 0x5641dd584f70 auth_method 0 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): get_auth_request con 0x5641dd57f9d0 auth_method 0 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.949 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:32:40.502+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:32:40.502+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): get_auth_request con 0x5641dd57da50 auth_method 0 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:32:40.502+0000 7f345232f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_done global_id 7088 payload 824 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:32:40.506+0000 7f3449b2e640 1 monclient: found mon.noname-c 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:40.950 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: dump: 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.951 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:32:40.506+0000 7f3337fff640 10 monclient: dump: 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.952 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 monclient: authenticate success, global_id 7088 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:32:40.506+0000 7f3453331640 4 set_mon_vals no callback set 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:32:40.506+0000 7f3337fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:32:40.506+0000 7f3337fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:32:40.506+0000 7f3337fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f332c0709f0 auth_method 0 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: get_monmap_and_config 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:32:40.506+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.953 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding auth protocol: cephx 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding auth protocol: cephx 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding auth protocol: cephx 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.954 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: crc 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x5641dd5a0190) adding con mode: secure 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:32:40.506+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding auth protocol: cephx 2024-09-12T00:32:40.955 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding auth protocol: cephx 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding auth protocol: cephx 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: crc 2024-09-12T00:32:40.956 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 AuthRegistry(0x7ffd681dff80) adding con mode: secure 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:32:40.506+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:32:40.506+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:32:40.506+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd681e00c8 EEXIST 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd5a4160 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd5cf9c0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd5c5140 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.957 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:32:40.506+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.847594s 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): get_auth_request con 0x5641dd5cf9c0 auth_method 0 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): get_auth_request con 0x5641dd5a4160 auth_method 0 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.958 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:32:40.506+0000 7f3449b2e640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient(hunting): handle_auth_done global_id 7560 payload 274 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:32:40.506+0000 7f3452b30640 1 monclient: found mon.noname-a 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:32:40.506+0000 7f3452b30640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: dump: 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.959 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 monclient: authenticate success, global_id 7560 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: get_monmap_and_config success 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:32:40.510+0000 7f34548299c0 4 set_mon_vals no callback set 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:32:40.510+0000 7f3335ffb640 10 monclient: dump: 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.960 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: shutdown 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: build_initial_monmap 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 build_initial for_mkfs: 0 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: monmap: 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:32:40.961 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding auth protocol: cephx 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding auth protocol: cephx 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding auth protocol: cephx 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.962 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: crc 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd5ce6e0) adding con mode: secure 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:32:40.510+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: starting msgr at 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: starting objecter 2024-09-12T00:32:40.963 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command objecter_requests cmddesc objecter_requests hook 0x5641dd5ce400 EEXIST 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: setting wanted keys 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: calling monclient init 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: init 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding auth protocol: cephx 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding auth protocol: cephx 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding auth protocol: cephx 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.964 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: crc 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 AuthRegistry(0x5641dd3ba210) adding con mode: secure 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:32:40.510+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:32:40.510+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.965 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command rotate-key cmddesc rotate-key hook 0x5641dd3ba358 EEXIST 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _reopen_session rank -1 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-b con 0x5641dd5a4160 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-a con 0x5641dd5c5140 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): picked mon.noname-c con 0x5641dd5cf9c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): _renew_subs 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient(hunting): authenticate will time out at 2284.850137s 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): get_auth_request con 0x5641dd5cf9c0 auth_method 0 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.966 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): get_auth_request con 0x5641dd5c5140 auth_method 0 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:32:40.510+0000 7f3452b30640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient(hunting): handle_auth_done global_id 7094 payload 824 2024-09-12T00:32:40.967 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient: _finish_hunting 0 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:32:40.510+0000 7f345232f640 1 monclient: found mon.noname-c 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:32:40.510+0000 7f345232f640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: dump: 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: _finish_auth 0 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: _check_auth_tickets 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:32:40.510+0000 7f3323fff640 10 monclient: dump: 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:32:40.969 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:32:40.510+0000 7f3335ffb640 4 set_mon_vals no callback set 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 monclient: authenticate success, global_id 7094 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _renew_subs 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:32:40.510+0000 7f34548299c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.970 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:32:40.510+0000 7f34548299c0 1 librados: init done 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:32:40.510+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cr dump hook 0x5641dd5a21a8 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:32:40.514+0000 7f3323fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:32:40.514+0000 7f3323fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:32:40.514+0000 7f3323fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:32:40.514+0000 7f3449b2e640 10 monclient: get_auth_request con 0x7f331c070ae0 auth_method 0 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:32:40.514+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd5ee240 auth_method 0 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 realm 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:32:40.514+0000 7f34548299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:32:40.514+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.971 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:32:40.518+0000 7f3449b2e640 10 monclient: get_auth_request con 0x5641dd5f2410 auth_method 0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:32:40.518+0000 7f3452b30640 10 monclient: get_auth_request con 0x5641dd5f5c50 auth_method 0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:32:40.518+0000 7f34548299c0 20 searching for the correct realm 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:32:40.518+0000 7f345232f640 10 monclient: get_auth_request con 0x5641dd5fa740 auth_method 0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:32:40.522+0000 7f3449b2e640 10 monclient: get_auth_request con 0x7f3444008040 auth_method 0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:32:40.522+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f34440659b0 auth_method 0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:32:40.522+0000 7f3452b30640 0 -- 172.21.15.78:0/4121228369 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f34440659b0 msgr2=0x7f3444063b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:32:40.726+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f34440659b0 auth_method 0 2024-09-12T00:32:40.972 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:32:40.734+0000 7f345232f640 10 monclient: get_auth_request con 0x7f343c008050 auth_method 0 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:32:40.734+0000 7f3449b2e640 10 monclient: get_auth_request con 0x7f344406e550 auth_method 0 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:32:40.738+0000 7f3452b30640 0 -- 172.21.15.78:0/4121228369 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5641dd5ee240 msgr2=0x5641dd5f0690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:32:40.738+0000 7f3323fff640 1 client.7094.objecter ms_handle_reset 0x5641dd5ee240 session 0x5641dd5edb70 osd.6 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:32:40.738+0000 7f3323fff640 10 monclient: _renew_subs 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:32:40.738+0000 7f3323fff640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:32:40.738+0000 7f3452b30640 10 monclient: get_auth_request con 0x7f331c080d90 auth_method 0 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:40.973 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:32:40.750+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 zone default found 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:32:40.754+0000 7f34548299c0 4 Realm: () 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:32:40.754+0000 7f34548299c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:32:40.754+0000 7f34548299c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:32:40.754+0000 7f34548299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 zonegroup default 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.974 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 started sync module instance, tier type = 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:32:40.754+0000 7f34548299c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=0 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=1 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=2 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=3 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=4 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=5 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:32:40.782+0000 7f34548299c0 20 add_watcher() i=6 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:32:40.786+0000 7f34548299c0 20 add_watcher() i=7 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:32:40.786+0000 7f34548299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:40.975 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding auth protocol: cephx 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding auth protocol: cephx 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding auth protocol: cephx 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.976 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: crc 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 AuthRegistry(0x7ffd681e0460) adding con mode: secure 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:32:40.790+0000 7f3308fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:32:40.790+0000 7f34548299c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache list hook 0x5641dd5ccd10 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache inspect hook 0x5641dd5ccd10 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache erase hook 0x5641dd5ccd10 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command cache zap hook 0x5641dd5ccd10 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 note: GC not initialized 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:32:40.790+0000 7f32837fe640 20 reqs_thread_entry: start 2024-09-12T00:32:40.977 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace show hook 0x7f3444004500 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace history hook 0x7f3444004500 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace active hook 0x7f3444004500 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:32:40.790+0000 7f34548299c0 5 asok(0x5641dd2f72b0) register_command sync trace active_short hook 0x7f3444004500 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:32:40.790+0000 7f34548299c0 20 Filter name: none 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:32:40.790+0000 7f32817fa640 20 reqs_thread_entry: start 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 : miss 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.978 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:32:40.794+0000 7f34548299c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:32:40.794+0000 7f34548299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:32:40.806+0000 7f34548299c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34, ofs0, ns] 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 94840886853984 notifier 7094 bl.length()=911 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:40.979 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:32:40.806+0000 7f33357fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_sources= new_sources= 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential sources added=[] removed=[] 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_dests= new_dests= 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:32:40.806+0000 7f34548299c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential dests added=[] removed=[] 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:32:40.822+0000 7f34548299c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f34548299c0 time 2024-09-12T00:32:40.823557+0000 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f34581032eb] 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.980 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:32:40.822+0000 7f34548299c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f34548299c0 thread_name:radosgw-admin 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f3456f82520] 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:32:40.981 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f3458103345] 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f345810349f] 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5641db089cc1] 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x5641db09ed5a] 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f3456f69d90] 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:32:40.982 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:32:40.983 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:32:40.984 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:32:40.985 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:32:40.986 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:32:40.987 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:32:40.988 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f32817fa640 / http_manager 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f32837fe640 / http_manager 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3308fe1640 / rgw_dt_lg_renew 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3323fff640 / ms_dispatch 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f33357fa640 / io_context_pool 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3335ffb640 / io_context_pool 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3337fff640 / ms_dispatch 2024-09-12T00:32:40.989 INFO:tasks.workunit.client.0.smithi078.stderr: 7f333ee05640 / ms_dispatch 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3340608640 / io_context_pool 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3449b2e640 / msgr-worker-2 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: 7f345232f640 / msgr-worker-1 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3452b30640 / msgr-worker-0 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: 7f3453331640 / io_context_pool 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34548299c0 / radosgw-admin 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:32:40.829143Z_e8022ff8-c60d-4a72-9985-285abc2ea70d/log 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:40.990 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:40.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.910+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 realm 2024-09-12T00:32:40.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.914+0000 7fbc6043a9c0 20 searching for the correct realm 2024-09-12T00:32:40.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:40.922+0000 7fbc5e741640 0 -- 172.21.15.78:0/2230819401 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fbc50008050 msgr2=0x7fbc50053750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:41.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.138+0000 7fbc5df40640 0 -- 172.21.15.78:0/2230819401 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55843fc6d940 msgr2=0x55843fc6fdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:41.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:41.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:41.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:41.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:41.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:41.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:41.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:41.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 zone default found 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 4 Realm: () 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 zonegroup default 2024-09-12T00:32:41.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.150+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.154+0000 7fbc6043a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.154+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.154+0000 7fbc6043a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.154+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.154+0000 7fbc6043a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.154+0000 7fbc6043a9c0 20 started sync module instance, tier type = 2024-09-12T00:32:41.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.154+0000 7fbc6043a9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:41.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.182+0000 7fbc6043a9c0 20 add_watcher() i=0 2024-09-12T00:32:41.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.182+0000 7fbc6043a9c0 20 add_watcher() i=1 2024-09-12T00:32:41.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.182+0000 7fbc6043a9c0 20 add_watcher() i=2 2024-09-12T00:32:41.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.182+0000 7fbc6043a9c0 20 add_watcher() i=3 2024-09-12T00:32:41.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.182+0000 7fbc6043a9c0 20 add_watcher() i=4 2024-09-12T00:32:41.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.182+0000 7fbc6043a9c0 20 add_watcher() i=5 2024-09-12T00:32:41.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.182+0000 7fbc6043a9c0 20 add_watcher() i=6 2024-09-12T00:32:41.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.186+0000 7fbc6043a9c0 20 add_watcher() i=7 2024-09-12T00:32:41.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.186+0000 7fbc6043a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:41.191 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.190+0000 7fbb0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:41.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.190+0000 7fbc6043a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:41.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.190+0000 7fbc6043a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:41.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.190+0000 7fbc6043a9c0 5 note: GC not initialized 2024-09-12T00:32:41.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.190+0000 7fbb0e7fc640 20 reqs_thread_entry: start 2024-09-12T00:32:41.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.190+0000 7fbc6043a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:41.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.190+0000 7fbc6043a9c0 20 Filter name: none 2024-09-12T00:32:41.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fba7ffff640 20 reqs_thread_entry: start 2024-09-12T00:32:41.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:41.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:32:41.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:41.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:41.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:32:41.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.194+0000 7fbc6043a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:32:41.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.198+0000 7fbb0f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:41.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.202+0000 7fbc6043a9c0 20 remove_watcher() i=0 2024-09-12T00:32:41.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.202+0000 7fbc6043a9c0 2 removed watcher, disabling cache 2024-09-12T00:32:41.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.206+0000 7fbc6043a9c0 20 remove_watcher() i=1 2024-09-12T00:32:41.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.210+0000 7fbc6043a9c0 20 remove_watcher() i=2 2024-09-12T00:32:41.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.210+0000 7fbc6043a9c0 20 remove_watcher() i=3 2024-09-12T00:32:41.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.218+0000 7fbc6043a9c0 20 remove_watcher() i=4 2024-09-12T00:32:41.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.218+0000 7fbc6043a9c0 20 remove_watcher() i=5 2024-09-12T00:32:41.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.222+0000 7fbc6043a9c0 20 remove_watcher() i=6 2024-09-12T00:32:41.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.226+0000 7fbc6043a9c0 20 remove_watcher() i=7 2024-09-12T00:32:41.242 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:41.242 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:32:41.242 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-do-reshard id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:32:41.242 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:32:41.298 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:32:41.335 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:32:41.335 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:32:41.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.378+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 realm 2024-09-12T00:32:41.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:32:41.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:41.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.382+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.386+0000 7f2d9252e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:32:41.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.386+0000 7f2d9252e9c0 20 searching for the correct realm 2024-09-12T00:32:41.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.390+0000 7f2d90835640 0 -- 172.21.15.78:0/3309225073 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f2d80132220 msgr2=0x7f2d800e5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:32:41.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.602+0000 7f2d90034640 0 -- 172.21.15.78:0/3309225073 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55a6e2d77510 msgr2=0x55a6e2d79900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:32:41.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:32:41.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:32:41.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:32:41.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:32:41.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:32:41.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:32:41.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.614+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:32:41.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:32:41.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 zone default found 2024-09-12T00:32:41.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 4 Realm: () 2024-09-12T00:32:41.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:32:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:32:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:32:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 zonegroup default 2024-09-12T00:32:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.618+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.622+0000 7f2d9252e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:32:41.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.622+0000 7f2d9252e9c0 20 started sync module instance, tier type = 2024-09-12T00:32:41.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.622+0000 7f2d9252e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:32:41.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.642+0000 7f2d9252e9c0 20 add_watcher() i=0 2024-09-12T00:32:41.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.642+0000 7f2d9252e9c0 20 add_watcher() i=1 2024-09-12T00:32:41.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.642+0000 7f2d9252e9c0 20 add_watcher() i=2 2024-09-12T00:32:41.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.642+0000 7f2d9252e9c0 20 add_watcher() i=3 2024-09-12T00:32:41.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.642+0000 7f2d9252e9c0 20 add_watcher() i=4 2024-09-12T00:32:41.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.642+0000 7f2d9252e9c0 20 add_watcher() i=5 2024-09-12T00:32:41.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.642+0000 7f2d9252e9c0 20 add_watcher() i=6 2024-09-12T00:32:41.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.646+0000 7f2d9252e9c0 20 add_watcher() i=7 2024-09-12T00:32:41.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.646+0000 7f2d9252e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:32:41.652 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.650+0000 7f2c46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:41.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.650+0000 7f2d9252e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:32:41.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.650+0000 7f2d9252e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:32:41.653 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.650+0000 7f2d9252e9c0 5 note: GC not initialized 2024-09-12T00:32:41.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2c45fdb640 20 reqs_thread_entry: start 2024-09-12T00:32:41.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:32:41.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 20 Filter name: none 2024-09-12T00:32:41.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2bb77fe640 20 reqs_thread_entry: start 2024-09-12T00:32:41.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:32:41.654 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:32:41.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:32:41.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:32:41.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 : miss 2024-09-12T00:32:41.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:32:41.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:32:41.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:32:41.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:32:41.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:32:41.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:32:41.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.654+0000 7f2d9252e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 2024-09-12T00:32:41.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.658+0000 7f2d9252e9c0 0 INFO: RGWReshardLock::lock found lock on abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to be held by another RGW process; skipping for now 2024-09-12T00:32:41.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.658+0000 7f2c46fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:32:41.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.662+0000 7f2d9252e9c0 20 remove_watcher() i=0 2024-09-12T00:32:41.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.662+0000 7f2d9252e9c0 2 removed watcher, disabling cache 2024-09-12T00:32:41.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.666+0000 7f2d9252e9c0 20 remove_watcher() i=1 2024-09-12T00:32:41.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.666+0000 7f2d9252e9c0 20 remove_watcher() i=2 2024-09-12T00:32:41.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.670+0000 7f2d9252e9c0 20 remove_watcher() i=3 2024-09-12T00:32:41.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.670+0000 7f2d9252e9c0 20 remove_watcher() i=4 2024-09-12T00:32:41.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.674+0000 7f2d9252e9c0 20 remove_watcher() i=5 2024-09-12T00:32:41.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.678+0000 7f2d9252e9c0 20 remove_watcher() i=6 2024-09-12T00:32:41.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:32:41.678+0000 7f2d9252e9c0 20 remove_watcher() i=7 2024-09-12T00:32:41.695 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:33:11.711 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-do-reshard --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:11.748 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:12.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.002+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 realm 2024-09-12T00:33:12.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:12.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:12.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:12.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.006+0000 7f6f082e39c0 20 searching for the correct realm 2024-09-12T00:33:12.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.010+0000 7f6f05de9640 0 -- 172.21.15.78:0/1119481178 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x558851f32ca0 msgr2=0x558851f35140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:12.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.018+0000 7f6f05de9640 0 -- 172.21.15.78:0/1119481178 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f6ef00d5070 msgr2=0x7f6ef01329e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:12.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:12.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:12.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:12.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:12.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:12.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:12.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.241 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.238+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:12.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 zone default found 2024-09-12T00:33:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 4 Realm: () 2024-09-12T00:33:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:12.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 zonegroup default 2024-09-12T00:33:12.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.242+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.246+0000 7f6f082e39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.246+0000 7f6f082e39c0 20 started sync module instance, tier type = 2024-09-12T00:33:12.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.246+0000 7f6f082e39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:12.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.266+0000 7f6f082e39c0 20 add_watcher() i=0 2024-09-12T00:33:12.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.266+0000 7f6f082e39c0 20 add_watcher() i=1 2024-09-12T00:33:12.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.266+0000 7f6f082e39c0 20 add_watcher() i=2 2024-09-12T00:33:12.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.266+0000 7f6f082e39c0 20 add_watcher() i=3 2024-09-12T00:33:12.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.266+0000 7f6f082e39c0 20 add_watcher() i=4 2024-09-12T00:33:12.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.266+0000 7f6f082e39c0 20 add_watcher() i=5 2024-09-12T00:33:12.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.266+0000 7f6f082e39c0 20 add_watcher() i=6 2024-09-12T00:33:12.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.270+0000 7f6f082e39c0 20 add_watcher() i=7 2024-09-12T00:33:12.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.270+0000 7f6f082e39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:12.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.274+0000 7f6db77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:12.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:12.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:12.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 5 note: GC not initialized 2024-09-12T00:33:12.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6db67fc640 20 reqs_thread_entry: start 2024-09-12T00:33:12.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:12.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 Filter name: none 2024-09-12T00:33:12.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6d27fff640 20 reqs_thread_entry: start 2024-09-12T00:33:12.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 cache get: name=default.rgw.meta+root+abort-at-do-reshard : miss 2024-09-12T00:33:12.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:12.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 cache put: name=default.rgw.meta+root+abort-at-do-reshard info.flags=0x11 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 adding default.rgw.meta+root+abort-at-do-reshard to cache LRU end 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 : miss 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 20 rados_obj.operate() r=0 bl.length=441 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:12.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.278+0000 7f6f082e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 2024-09-12T00:33:12.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.282+0000 7f6f082e39c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:33:12.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:33:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:33:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34, ofs0, ns] 2024-09-12T00:33:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6de8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94043978810192 notifier 7148 bl.length()=911 2024-09-12T00:33:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6de8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:33:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6de8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:33:12.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6de8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:12.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_sources= new_sources= 2024-09-12T00:33:12.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential sources added=[] removed=[] 2024-09-12T00:33:12.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_dests= new_dests= 2024-09-12T00:33:12.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.298+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential dests added=[] removed=[] 2024-09-12T00:33:12.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.0 2024-09-12T00:33:12.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.0 2024-09-12T00:33:12.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.1 2024-09-12T00:33:12.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.1 2024-09-12T00:33:12.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.2 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.2 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.3 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.3 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.4 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.4 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.5 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.5 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.6 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.6 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.7 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.7 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.8 2024-09-12T00:33:12.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.8 2024-09-12T00:33:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.9 2024-09-12T00:33:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.9 2024-09-12T00:33:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.10 2024-09-12T00:33:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.10 2024-09-12T00:33:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.11 2024-09-12T00:33:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2.11 2024-09-12T00:33:12.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.0 2024-09-12T00:33:12.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.1 2024-09-12T00:33:12.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2 2024-09-12T00:33:12.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.310+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.3 2024-09-12T00:33:12.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.314+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.4 2024-09-12T00:33:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.314+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.5 2024-09-12T00:33:12.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.314+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.6 2024-09-12T00:33:12.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.314+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.7 2024-09-12T00:33:12.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.314+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.8 2024-09-12T00:33:12.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.314+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.9 2024-09-12T00:33:12.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.318+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.10 2024-09-12T00:33:12.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.322+0000 7f6f082e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:12.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.322+0000 7f6f082e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 2024-09-12T00:33:12.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:33:12.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:33:12.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:12.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34, ofs0, ns] 2024-09-12T00:33:12.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6de8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398875 cookie 94043978810192 notifier 7148 bl.length()=911 2024-09-12T00:33:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6de8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:33:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6de8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:33:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6de8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_sources= new_sources= 2024-09-12T00:33:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential sources added=[] removed=[] 2024-09-12T00:33:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_dests= new_dests= 2024-09-12T00:33:12.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.326+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential dests added=[] removed=[] 2024-09-12T00:33:12.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.330+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.0 2024-09-12T00:33:12.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.330+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.1 2024-09-12T00:33:12.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.330+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.2 2024-09-12T00:33:12.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.3 2024-09-12T00:33:12.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.4 2024-09-12T00:33:12.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.5 2024-09-12T00:33:12.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.6 2024-09-12T00:33:12.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.7 2024-09-12T00:33:12.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.8 2024-09-12T00:33:12.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.9 2024-09-12T00:33:12.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.334+0000 7f6f082e39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34.10 2024-09-12T00:33:12.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:12.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 2024-09-12T00:33:12.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:33:12.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:33:12.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:12.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34, ofs0, ns] 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6de97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398876 cookie 94043978810192 notifier 7148 bl.length()=879 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6de97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 info.flags=0x17 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6de97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-do-reshard:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 to cache LRU end 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6de97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_sources= new_sources= 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential sources added=[] removed=[] 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): orig_dests= new_dests= 2024-09-12T00:33:12.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.338+0000 7f6f082e39c0 20 handle_bi_update(): bucket=:abort-at-do-reshard[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34]): potential dests added=[] removed=[] 2024-09-12T00:33:12.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.346+0000 7f6f082e39c0 1 execute INFO: reshard of bucket "abort-at-do-reshard" from 11 shards to 12 shards completed successfully 2024-09-12T00:33:12.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.350+0000 7f6db77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:12.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.354+0000 7f6f082e39c0 20 remove_watcher() i=0 2024-09-12T00:33:12.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.354+0000 7f6f082e39c0 2 removed watcher, disabling cache 2024-09-12T00:33:12.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.354+0000 7f6f082e39c0 20 remove_watcher() i=1 2024-09-12T00:33:12.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.358+0000 7f6f082e39c0 20 remove_watcher() i=2 2024-09-12T00:33:12.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.358+0000 7f6f082e39c0 20 remove_watcher() i=3 2024-09-12T00:33:12.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.362+0000 7f6f082e39c0 20 remove_watcher() i=4 2024-09-12T00:33:12.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.366+0000 7f6f082e39c0 20 remove_watcher() i=5 2024-09-12T00:33:12.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.366+0000 7f6f082e39c0 20 remove_watcher() i=6 2024-09-12T00:33:12.371 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.370+0000 7f6f082e39c0 20 remove_watcher() i=7 2024-09-12T00:33:12.386 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-do-reshard 2024-09-12T00:33:12.414 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:12.414 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:12.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.458+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 realm 2024-09-12T00:33:12.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:12.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:12.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:12.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.462+0000 7fef130ae9c0 20 searching for the correct realm 2024-09-12T00:33:12.470 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.470+0000 7fef113b5640 0 -- 172.21.15.78:0/436302791 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fef0005cbc0 msgr2=0x7fef00081a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:12.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.682+0000 7fef10bb4640 0 -- 172.21.15.78:0/436302791 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x556cd5842970 msgr2=0x556cd5844d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.694+0000 7fef130ae9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.694+0000 7fef130ae9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.694+0000 7fef130ae9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.694+0000 7fef130ae9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.694+0000 7fef130ae9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.694+0000 7fef130ae9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:12.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.694+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:12.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 zone default found 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 4 Realm: () 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 zonegroup default 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:12.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 started sync module instance, tier type = 2024-09-12T00:33:12.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.698+0000 7fef130ae9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.722+0000 7fef130ae9c0 20 add_watcher() i=0 2024-09-12T00:33:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.722+0000 7fef130ae9c0 20 add_watcher() i=1 2024-09-12T00:33:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.722+0000 7fef130ae9c0 20 add_watcher() i=2 2024-09-12T00:33:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.722+0000 7fef130ae9c0 20 add_watcher() i=3 2024-09-12T00:33:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.722+0000 7fef130ae9c0 20 add_watcher() i=4 2024-09-12T00:33:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.722+0000 7fef130ae9c0 20 add_watcher() i=5 2024-09-12T00:33:12.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.722+0000 7fef130ae9c0 20 add_watcher() i=6 2024-09-12T00:33:12.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.726+0000 7fef130ae9c0 20 add_watcher() i=7 2024-09-12T00:33:12.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.726+0000 7fef130ae9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:12.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.730+0000 7fedc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:12.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.730+0000 7fef130ae9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:12.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.730+0000 7fef130ae9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:12.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.730+0000 7fef130ae9c0 5 note: GC not initialized 2024-09-12T00:33:12.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.730+0000 7fedc5fe3640 20 reqs_thread_entry: start 2024-09-12T00:33:12.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.730+0000 7fef130ae9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:12.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.730+0000 7fef130ae9c0 20 Filter name: none 2024-09-12T00:33:12.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fed377fe640 20 reqs_thread_entry: start 2024-09-12T00:33:12.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:12.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:12.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:12.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=187 2024-09-12T00:33:12.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:12.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 rados_obj.operate() r=0 bl.length=409 2024-09-12T00:33:12.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.734+0000 7fef130ae9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:12.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.738+0000 7fedc6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.742+0000 7fef130ae9c0 20 remove_watcher() i=0 2024-09-12T00:33:12.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.742+0000 7fef130ae9c0 2 removed watcher, disabling cache 2024-09-12T00:33:12.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.742+0000 7fef130ae9c0 20 remove_watcher() i=1 2024-09-12T00:33:12.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.746+0000 7fef130ae9c0 20 remove_watcher() i=2 2024-09-12T00:33:12.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.746+0000 7fef130ae9c0 20 remove_watcher() i=3 2024-09-12T00:33:12.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.750+0000 7fef130ae9c0 20 remove_watcher() i=4 2024-09-12T00:33:12.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.750+0000 7fef130ae9c0 20 remove_watcher() i=5 2024-09-12T00:33:12.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.754+0000 7fef130ae9c0 20 remove_watcher() i=6 2024-09-12T00:33:12.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:12.758+0000 7fef130ae9c0 20 remove_watcher() i=7 2024-09-12T00:33:12.772 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:12.772 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:12.772 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-do-reshard id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.34 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:33:12.773 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:12.879 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at logrecord_writes 2024-09-12T00:33:12.879 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:13.305 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:33:13.337 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:13.337 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:13.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.382+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.382+0000 7f6a5c7f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.382+0000 7f6a5c7f69c0 20 realm 2024-09-12T00:33:13.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.382+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:13.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:13.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.386+0000 7f6a5c7f69c0 20 searching for the correct realm 2024-09-12T00:33:13.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.598+0000 7f6a5a2fc640 0 -- 172.21.15.78:0/1208684349 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55f8fc597140 msgr2=0x55f8fc5995e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:13.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.606+0000 7f6a59afb640 0 -- 172.21.15.78:0/1208684349 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f6a4c10cc20 msgr2=0x7f6a4c009ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:13.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:13.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:13.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:13.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:13.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:13.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:13.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:13.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.826+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:13.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 zone default found 2024-09-12T00:33:13.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 4 Realm: () 2024-09-12T00:33:13.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:13.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:13.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:13.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 zonegroup default 2024-09-12T00:33:13.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 started sync module instance, tier type = 2024-09-12T00:33:13.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.830+0000 7f6a5c7f69c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:13.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.854+0000 7f6a5c7f69c0 20 add_watcher() i=0 2024-09-12T00:33:13.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.854+0000 7f6a5c7f69c0 20 add_watcher() i=1 2024-09-12T00:33:13.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.854+0000 7f6a5c7f69c0 20 add_watcher() i=2 2024-09-12T00:33:13.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.854+0000 7f6a5c7f69c0 20 add_watcher() i=3 2024-09-12T00:33:13.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.854+0000 7f6a5c7f69c0 20 add_watcher() i=4 2024-09-12T00:33:13.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.854+0000 7f6a5c7f69c0 20 add_watcher() i=5 2024-09-12T00:33:13.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.854+0000 7f6a5c7f69c0 20 add_watcher() i=6 2024-09-12T00:33:13.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.858+0000 7f6a5c7f69c0 20 add_watcher() i=7 2024-09-12T00:33:13.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.858+0000 7f6a5c7f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:13.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f6910fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:13.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f6a5c7f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:13.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f6a5c7f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:13.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f6a5c7f69c0 5 note: GC not initialized 2024-09-12T00:33:13.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f688b7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:13.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f6a5c7f69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:13.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f6a5c7f69c0 20 Filter name: none 2024-09-12T00:33:13.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f68897fa640 20 reqs_thread_entry: start 2024-09-12T00:33:13.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.862+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:13.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:13.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:13.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:13.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:13.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.866+0000 7f6a5c7f69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:13.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.870+0000 7f6910fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.874+0000 7f6a5c7f69c0 20 remove_watcher() i=0 2024-09-12T00:33:13.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.874+0000 7f6a5c7f69c0 2 removed watcher, disabling cache 2024-09-12T00:33:13.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.878+0000 7f6a5c7f69c0 20 remove_watcher() i=1 2024-09-12T00:33:13.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.878+0000 7f6a5c7f69c0 20 remove_watcher() i=2 2024-09-12T00:33:13.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.882+0000 7f6a5c7f69c0 20 remove_watcher() i=3 2024-09-12T00:33:13.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.882+0000 7f6a5c7f69c0 20 remove_watcher() i=4 2024-09-12T00:33:13.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.886+0000 7f6a5c7f69c0 20 remove_watcher() i=5 2024-09-12T00:33:13.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.886+0000 7f6a5c7f69c0 20 remove_watcher() i=6 2024-09-12T00:33:13.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.890+0000 7f6a5c7f69c0 20 remove_watcher() i=7 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-logrecord-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:13.909 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:13.910 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at logrecord_writes 2024-09-12T00:33:13.947 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:13.947 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:13.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.994+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 realm 2024-09-12T00:33:13.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:13.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:13.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:14.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:14.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:13.998+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.002+0000 7f06bc2fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:14.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.002+0000 7f06bc2fe9c0 20 searching for the correct realm 2024-09-12T00:33:14.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.006+0000 7f06ba605640 0 -- 172.21.15.78:0/3924028163 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f06ac06eed0 msgr2=0x7f06ac0637a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:14.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.218+0000 7f06ba605640 0 -- 172.21.15.78:0/3924028163 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563b69f1a4a0 msgr2=0x563b69f1c890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:14.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:14.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:14.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.233 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.230+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:14.234 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 zone default found 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 4 Realm: () 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 zonegroup default 2024-09-12T00:33:14.235 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.234+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.238+0000 7f06bc2fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.238+0000 7f06bc2fe9c0 20 started sync module instance, tier type = 2024-09-12T00:33:14.237 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.238+0000 7f06bc2fe9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:14.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=0 2024-09-12T00:33:14.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=1 2024-09-12T00:33:14.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=2 2024-09-12T00:33:14.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=3 2024-09-12T00:33:14.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=4 2024-09-12T00:33:14.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=5 2024-09-12T00:33:14.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=6 2024-09-12T00:33:14.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 20 add_watcher() i=7 2024-09-12T00:33:14.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.262+0000 7f06bc2fe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:14.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f056ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:14.270 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:14.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:14.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 5 note: GC not initialized 2024-09-12T00:33:14.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f056efe5640 20 reqs_thread_entry: start 2024-09-12T00:33:14.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:14.272 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 20 Filter name: none 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f056cfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 : miss 2024-09-12T00:33:14.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.270+0000 7f06bc2fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.274+0000 7f06bc2fe9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:14.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.274+0000 7f06bc2fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:14.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.274+0000 7f06bc2fe9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:14.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.274+0000 7f06bc2fe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:14.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.274+0000 7f06bc2fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:14.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.274+0000 7f06bc2fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35, ofs0, ns] 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f059d7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398994 cookie 94813180577008 notifier 7193 bl.length()=923 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f059d7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f059d7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:14.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f059d7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:14.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_sources= new_sources= 2024-09-12T00:33:14.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential sources added=[] removed=[] 2024-09-12T00:33:14.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_dests= new_dests= 2024-09-12T00:33:14.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.286+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential dests added=[] removed=[] 2024-09-12T00:33:14.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.290+0000 7f06bc2fe9c0 -1 Injecting error=-5 at location=logrecord_writes 2024-09-12T00:33:14.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.290+0000 7f06bc2fe9c0 0 ERROR: init_reshard failed to pause writes to the current index: (5) Input/output error 2024-09-12T00:33:14.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f06bc2fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:14.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f06bc2fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 2024-09-12T00:33:14.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f06bc2fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:14.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f06bc2fe9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:14.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f06bc2fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:14.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f06bc2fe9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35, ofs0, ns] 2024-09-12T00:33:14.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f059cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398995 cookie 94813180577008 notifier 7193 bl.length()=891 2024-09-12T00:33:14.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f059cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:14.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f059cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:14.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.306+0000 7f059cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:14.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.310+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_sources= new_sources= 2024-09-12T00:33:14.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.310+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential sources added=[] removed=[] 2024-09-12T00:33:14.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.310+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_dests= new_dests= 2024-09-12T00:33:14.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.310+0000 7f06bc2fe9c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential dests added=[] removed=[] 2024-09-12T00:33:14.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.314+0000 7f056ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:14.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.318+0000 7f06bc2fe9c0 20 remove_watcher() i=0 2024-09-12T00:33:14.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.318+0000 7f06bc2fe9c0 2 removed watcher, disabling cache 2024-09-12T00:33:14.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.318+0000 7f06bc2fe9c0 20 remove_watcher() i=1 2024-09-12T00:33:14.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.322+0000 7f06bc2fe9c0 20 remove_watcher() i=2 2024-09-12T00:33:14.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.326+0000 7f06bc2fe9c0 20 remove_watcher() i=3 2024-09-12T00:33:14.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.326+0000 7f06bc2fe9c0 20 remove_watcher() i=4 2024-09-12T00:33:14.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.330+0000 7f06bc2fe9c0 20 remove_watcher() i=5 2024-09-12T00:33:14.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.330+0000 7f06bc2fe9c0 20 remove_watcher() i=6 2024-09-12T00:33:14.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.334+0000 7f06bc2fe9c0 20 remove_watcher() i=7 2024-09-12T00:33:14.352 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:33:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:14.383 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:14.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.614+0000 7f34d8f7f640 0 --2- 172.21.15.78:0/3466122434 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x55987b4db410 0x55987b4ed660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:33:14.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.642+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 realm 2024-09-12T00:33:14.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:14.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:14.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:14.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.646+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:14.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.650+0000 7f34d9f81640 0 -- 172.21.15.78:0/2410984299 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x55987b59a5d0 msgr2=0x55987b59c9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:14.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.854+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:14.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.854+0000 7f34dbc7a9c0 20 searching for the correct realm 2024-09-12T00:33:14.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:14.862+0000 7f34d9f81640 0 -- 172.21.15.78:0/2410984299 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f34cc0f6240 msgr2=0x7f34cc0fda90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:15.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:15.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:15.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:15.090 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:15.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:15.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:15.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:15.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:15.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 zone default found 2024-09-12T00:33:15.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 4 Realm: () 2024-09-12T00:33:15.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:15.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:15.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:15.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 zonegroup default 2024-09-12T00:33:15.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.090+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.094+0000 7f34dbc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.094+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.094+0000 7f34dbc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.094+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.095 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.094+0000 7f34dbc7a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.094+0000 7f34dbc7a9c0 20 started sync module instance, tier type = 2024-09-12T00:33:15.096 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.094+0000 7f34dbc7a9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.114+0000 7f34dbc7a9c0 20 add_watcher() i=0 2024-09-12T00:33:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.114+0000 7f34dbc7a9c0 20 add_watcher() i=1 2024-09-12T00:33:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.114+0000 7f34dbc7a9c0 20 add_watcher() i=2 2024-09-12T00:33:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.114+0000 7f34dbc7a9c0 20 add_watcher() i=3 2024-09-12T00:33:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.114+0000 7f34dbc7a9c0 20 add_watcher() i=4 2024-09-12T00:33:15.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.114+0000 7f34dbc7a9c0 20 add_watcher() i=5 2024-09-12T00:33:15.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.118+0000 7f34dbc7a9c0 20 add_watcher() i=6 2024-09-12T00:33:15.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.118+0000 7f34dbc7a9c0 20 add_watcher() i=7 2024-09-12T00:33:15.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.118+0000 7f34dbc7a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:15.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.122+0000 7f338f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.122+0000 7f34dbc7a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.122+0000 7f34dbc7a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:15.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.122+0000 7f34dbc7a9c0 5 note: GC not initialized 2024-09-12T00:33:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f338e7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 Filter name: none 2024-09-12T00:33:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f32fffff640 20 reqs_thread_entry: start 2024-09-12T00:33:15.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:15.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:15.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:15.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:15.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.126+0000 7f34dbc7a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.130+0000 7f34dbc7a9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:15.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.130+0000 7f34dbc7a9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:15.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.134+0000 7f338f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:15.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.138+0000 7f34dbc7a9c0 20 remove_watcher() i=0 2024-09-12T00:33:15.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.138+0000 7f34dbc7a9c0 2 removed watcher, disabling cache 2024-09-12T00:33:15.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.138+0000 7f34dbc7a9c0 20 remove_watcher() i=1 2024-09-12T00:33:15.142 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.142+0000 7f34dbc7a9c0 20 remove_watcher() i=2 2024-09-12T00:33:15.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.142+0000 7f34dbc7a9c0 20 remove_watcher() i=3 2024-09-12T00:33:15.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.146+0000 7f34dbc7a9c0 20 remove_watcher() i=4 2024-09-12T00:33:15.148 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.146+0000 7f34dbc7a9c0 20 remove_watcher() i=5 2024-09-12T00:33:15.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.150+0000 7f34dbc7a9c0 20 remove_watcher() i=6 2024-09-12T00:33:15.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.154+0000 7f34dbc7a9c0 20 remove_watcher() i=7 2024-09-12T00:33:15.168 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:15.168 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:15.169 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-logrecord-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:15.169 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:15.222 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:15.257 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:15.257 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:15.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.302+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 realm 2024-09-12T00:33:15.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:15.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:15.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:15.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.306+0000 7fceba3c39c0 20 searching for the correct realm 2024-09-12T00:33:15.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.310+0000 7fceb86ca640 0 -- 172.21.15.78:0/2380732846 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x56202d68b710 msgr2=0x56202d68db20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:15.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.318+0000 7fceb76c8640 0 -- 172.21.15.78:0/2380732846 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fceb007d740 msgr2=0x7fceb00585a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:15.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.538+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 zone default found 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 4 Realm: () 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 zonegroup default 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.542 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 started sync module instance, tier type = 2024-09-12T00:33:15.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.542+0000 7fceba3c39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:15.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.566+0000 7fceba3c39c0 20 add_watcher() i=0 2024-09-12T00:33:15.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.566+0000 7fceba3c39c0 20 add_watcher() i=1 2024-09-12T00:33:15.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.566+0000 7fceba3c39c0 20 add_watcher() i=2 2024-09-12T00:33:15.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.566+0000 7fceba3c39c0 20 add_watcher() i=3 2024-09-12T00:33:15.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.566+0000 7fceba3c39c0 20 add_watcher() i=4 2024-09-12T00:33:15.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.566+0000 7fceba3c39c0 20 add_watcher() i=5 2024-09-12T00:33:15.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.566+0000 7fceba3c39c0 20 add_watcher() i=6 2024-09-12T00:33:15.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.570+0000 7fceba3c39c0 20 add_watcher() i=7 2024-09-12T00:33:15.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.570+0000 7fceba3c39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:15.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fcd6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:15.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:15.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:15.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 5 note: GC not initialized 2024-09-12T00:33:15.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fcd6cfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:15.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:15.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 20 Filter name: none 2024-09-12T00:33:15.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fcce67fc640 20 reqs_thread_entry: start 2024-09-12T00:33:15.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 10 cache get: name=default.rgw.meta+root+error-at-logrecord-writes : miss 2024-09-12T00:33:15.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.574+0000 7fceba3c39c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:15.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 cache put: name=default.rgw.meta+root+error-at-logrecord-writes info.flags=0x11 2024-09-12T00:33:15.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 adding default.rgw.meta+root+error-at-logrecord-writes to cache LRU end 2024-09-12T00:33:15.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 : miss 2024-09-12T00:33:15.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:15.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:15.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:15.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:15.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:15.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.578+0000 7fceba3c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 2024-09-12T00:33:15.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fceba3c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:15.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fceba3c39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:15.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fceba3c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:15.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fceba3c39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35, ofs0, ns] 2024-09-12T00:33:15.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fcd967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398996 cookie 94696200822608 notifier 7713 bl.length()=923 2024-09-12T00:33:15.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fcd967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:15.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fcd967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:15.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.590+0000 7fcd967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:15.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.594+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_sources= new_sources= 2024-09-12T00:33:15.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.594+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential sources added=[] removed=[] 2024-09-12T00:33:15.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.594+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_dests= new_dests= 2024-09-12T00:33:15.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.594+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential dests added=[] removed=[] 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.0 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.0 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.1 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.1 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.2 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.2 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.3 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.3 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.4 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.4 2024-09-12T00:33:15.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.5 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.5 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.6 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.6 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.7 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.7 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.8 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.8 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.9 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.9 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.10 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.10 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.11 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1.11 2024-09-12T00:33:15.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.0 2024-09-12T00:33:15.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1 2024-09-12T00:33:15.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.2 2024-09-12T00:33:15.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.602+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.3 2024-09-12T00:33:15.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.606+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.4 2024-09-12T00:33:15.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.606+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.5 2024-09-12T00:33:15.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.606+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.6 2024-09-12T00:33:15.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.606+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.7 2024-09-12T00:33:15.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.610+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.8 2024-09-12T00:33:15.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.610+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.9 2024-09-12T00:33:15.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.610+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.10 2024-09-12T00:33:15.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.618+0000 7fceba3c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:15.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.618+0000 7fceba3c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 2024-09-12T00:33:15.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:15.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:15.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:15.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35, ofs0, ns] 2024-09-12T00:33:15.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fcd967fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398997 cookie 94696200822608 notifier 7713 bl.length()=923 2024-09-12T00:33:15.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fcd967fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:15.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fcd967fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:15.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fcd967fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:15.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_sources= new_sources= 2024-09-12T00:33:15.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential sources added=[] removed=[] 2024-09-12T00:33:15.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_dests= new_dests= 2024-09-12T00:33:15.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.622+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential dests added=[] removed=[] 2024-09-12T00:33:15.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.626+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.0 2024-09-12T00:33:15.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.630+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.1 2024-09-12T00:33:15.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.630+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.2 2024-09-12T00:33:15.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.630+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.3 2024-09-12T00:33:15.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.630+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.4 2024-09-12T00:33:15.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.630+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.5 2024-09-12T00:33:15.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.630+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.6 2024-09-12T00:33:15.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.634+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.7 2024-09-12T00:33:15.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.634+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.8 2024-09-12T00:33:15.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.634+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.9 2024-09-12T00:33:15.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.634+0000 7fceba3c39c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35.10 2024-09-12T00:33:15.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.634+0000 7fceba3c39c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:15.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.634+0000 7fceba3c39c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 2024-09-12T00:33:15.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:15.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:15.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:15.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35, ofs0, ns] 2024-09-12T00:33:15.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fcd96ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398998 cookie 94696200822608 notifier 7713 bl.length()=891 2024-09-12T00:33:15.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fcd96ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 info.flags=0x17 2024-09-12T00:33:15.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fcd96ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 to cache LRU end 2024-09-12T00:33:15.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fcd96ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:15.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_sources= new_sources= 2024-09-12T00:33:15.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential sources added=[] removed=[] 2024-09-12T00:33:15.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): orig_dests= new_dests= 2024-09-12T00:33:15.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.638+0000 7fceba3c39c0 20 handle_bi_update(): bucket=:error-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35]): potential dests added=[] removed=[] 2024-09-12T00:33:15.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.646+0000 7fceba3c39c0 1 execute INFO: reshard of bucket "error-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:33:15.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.650+0000 7fcd6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:15.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.654+0000 7fceba3c39c0 20 remove_watcher() i=0 2024-09-12T00:33:15.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.654+0000 7fceba3c39c0 2 removed watcher, disabling cache 2024-09-12T00:33:15.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.658+0000 7fceba3c39c0 20 remove_watcher() i=1 2024-09-12T00:33:15.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.658+0000 7fceba3c39c0 20 remove_watcher() i=2 2024-09-12T00:33:15.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.662+0000 7fceba3c39c0 20 remove_watcher() i=3 2024-09-12T00:33:15.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.662+0000 7fceba3c39c0 20 remove_watcher() i=4 2024-09-12T00:33:15.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.666+0000 7fceba3c39c0 20 remove_watcher() i=5 2024-09-12T00:33:15.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.670+0000 7fceba3c39c0 20 remove_watcher() i=6 2024-09-12T00:33:15.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.670+0000 7fceba3c39c0 20 remove_watcher() i=7 2024-09-12T00:33:15.689 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-logrecord-writes 2024-09-12T00:33:15.717 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:15.717 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:15.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 realm 2024-09-12T00:33:15.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:15.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.762+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.766+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:15.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.766+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.766+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:15.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.766+0000 7f1fcb3a39c0 20 searching for the correct realm 2024-09-12T00:33:15.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.770+0000 7f1fc8ea9640 0 -- 172.21.15.78:0/2915283932 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55c847c7d9f0 msgr2=0x55c847c7fe90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:15.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.774+0000 7f1fc86a8640 0 -- 172.21.15.78:0/2915283932 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f1fb8073920 msgr2=0x7f1fb8089900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:15.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:15.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:15.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:15.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.990+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:15.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 zone default found 2024-09-12T00:33:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 4 Realm: () 2024-09-12T00:33:15.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 zonegroup default 2024-09-12T00:33:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:15.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 started sync module instance, tier type = 2024-09-12T00:33:15.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:15.994+0000 7f1fcb3a39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:16.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.018+0000 7f1fcb3a39c0 20 add_watcher() i=0 2024-09-12T00:33:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.018+0000 7f1fcb3a39c0 20 add_watcher() i=1 2024-09-12T00:33:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.018+0000 7f1fcb3a39c0 20 add_watcher() i=2 2024-09-12T00:33:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.018+0000 7f1fcb3a39c0 20 add_watcher() i=3 2024-09-12T00:33:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.018+0000 7f1fcb3a39c0 20 add_watcher() i=4 2024-09-12T00:33:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.018+0000 7f1fcb3a39c0 20 add_watcher() i=5 2024-09-12T00:33:16.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.018+0000 7f1fcb3a39c0 20 add_watcher() i=6 2024-09-12T00:33:16.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.022+0000 7f1fcb3a39c0 20 add_watcher() i=7 2024-09-12T00:33:16.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.022+0000 7f1fcb3a39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:16.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1e7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:16.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:16.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:16.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 5 note: GC not initialized 2024-09-12T00:33:16.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1e7dfe3640 20 reqs_thread_entry: start 2024-09-12T00:33:16.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:16.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 20 Filter name: none 2024-09-12T00:33:16.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1def7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:16.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:16.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.026+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.030+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:16.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.030+0000 7f1fcb3a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:16.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.030+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.030+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:16.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.030+0000 7f1fcb3a39c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.030+0000 7f1fcb3a39c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:16.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.030+0000 7f1fcb3a39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:16.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.034+0000 7f1e7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:16.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.038+0000 7f1fcb3a39c0 20 remove_watcher() i=0 2024-09-12T00:33:16.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.038+0000 7f1fcb3a39c0 2 removed watcher, disabling cache 2024-09-12T00:33:16.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.042+0000 7f1fcb3a39c0 20 remove_watcher() i=1 2024-09-12T00:33:16.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.042+0000 7f1fcb3a39c0 20 remove_watcher() i=2 2024-09-12T00:33:16.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.046+0000 7f1fcb3a39c0 20 remove_watcher() i=3 2024-09-12T00:33:16.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.046+0000 7f1fcb3a39c0 20 remove_watcher() i=4 2024-09-12T00:33:16.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.050+0000 7f1fcb3a39c0 20 remove_watcher() i=5 2024-09-12T00:33:16.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.050+0000 7f1fcb3a39c0 20 remove_watcher() i=6 2024-09-12T00:33:16.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.054+0000 7f1fcb3a39c0 20 remove_watcher() i=7 2024-09-12T00:33:16.069 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:16.069 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:16.069 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-logrecord-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.35 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:33:16.069 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:16.184 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at logrecord_writes 2024-09-12T00:33:16.184 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:16.599 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:33:16.631 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:16.632 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:16.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.678+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.678+0000 7f3e478479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.678+0000 7f3e478479c0 20 realm 2024-09-12T00:33:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.678+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:16.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:16.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:16.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:16.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.682+0000 7f3e478479c0 20 searching for the correct realm 2024-09-12T00:33:16.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.686+0000 7f3e45b4e640 0 -- 172.21.15.78:0/1873873082 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f3e3800a3e0 msgr2=0x7f3e3800a860 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:16.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.898+0000 7f3e4534d640 0 -- 172.21.15.78:0/1873873082 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x557d4518b7c0 msgr2=0x557d4518dc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:16.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:16.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:16.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:16.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:16.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:16.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:16.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:16.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.910+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:16.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 zone default found 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 4 Realm: () 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 zonegroup default 2024-09-12T00:33:16.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:16.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:16.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:16.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 started sync module instance, tier type = 2024-09-12T00:33:16.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.914+0000 7f3e478479c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:16.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.938+0000 7f3e478479c0 20 add_watcher() i=0 2024-09-12T00:33:16.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.938+0000 7f3e478479c0 20 add_watcher() i=1 2024-09-12T00:33:16.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.938+0000 7f3e478479c0 20 add_watcher() i=2 2024-09-12T00:33:16.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.938+0000 7f3e478479c0 20 add_watcher() i=3 2024-09-12T00:33:16.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.938+0000 7f3e478479c0 20 add_watcher() i=4 2024-09-12T00:33:16.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.938+0000 7f3e478479c0 20 add_watcher() i=5 2024-09-12T00:33:16.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.938+0000 7f3e478479c0 20 add_watcher() i=6 2024-09-12T00:33:16.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.942+0000 7f3e478479c0 20 add_watcher() i=7 2024-09-12T00:33:16.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.942+0000 7f3e478479c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:16.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3cfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:16.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3e478479c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:16.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3e478479c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:16.947 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3e478479c0 5 note: GC not initialized 2024-09-12T00:33:16.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3cfa7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:16.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3e478479c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:16.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3e478479c0 20 Filter name: none 2024-09-12T00:33:16.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3c6bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:16.948 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.946+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:16.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:16.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:16.950 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:16.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:16.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:16.951 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.950+0000 7f3e478479c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:16.954 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.954+0000 7f3cfb7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:16.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.958+0000 7f3e478479c0 20 remove_watcher() i=0 2024-09-12T00:33:16.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.958+0000 7f3e478479c0 2 removed watcher, disabling cache 2024-09-12T00:33:16.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.958+0000 7f3e478479c0 20 remove_watcher() i=1 2024-09-12T00:33:16.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.962+0000 7f3e478479c0 20 remove_watcher() i=2 2024-09-12T00:33:16.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.962+0000 7f3e478479c0 20 remove_watcher() i=3 2024-09-12T00:33:16.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.966+0000 7f3e478479c0 20 remove_watcher() i=4 2024-09-12T00:33:16.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.966+0000 7f3e478479c0 20 remove_watcher() i=5 2024-09-12T00:33:16.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.970+0000 7f3e478479c0 20 remove_watcher() i=6 2024-09-12T00:33:16.974 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:16.974+0000 7f3e478479c0 20 remove_watcher() i=7 2024-09-12T00:33:16.988 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:16.989 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:16.989 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-logrecord-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:16.989 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:16.989 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:33:17.022 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:17.022 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:17.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 realm 2024-09-12T00:33:17.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:17.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:17.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 searching for the correct realm 2024-09-12T00:33:17.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.074+0000 7ffad3cb0640 0 -- 172.21.15.78:0/405433380 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x5570ebbe9610 msgr2=0x5570ebbeba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:17.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.082+0000 7ffad2cae640 0 -- 172.21.15.78:0/405433380 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7ffac4015420 msgr2=0x7ffac4015860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:17.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 zone default found 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 Realm: () 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:17.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:17.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:17.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 zonegroup default 2024-09-12T00:33:17.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 started sync module instance, tier type = 2024-09-12T00:33:17.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:17.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=0 2024-09-12T00:33:17.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=1 2024-09-12T00:33:17.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=2 2024-09-12T00:33:17.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=3 2024-09-12T00:33:17.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=4 2024-09-12T00:33:17.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=5 2024-09-12T00:33:17.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=6 2024-09-12T00:33:17.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.330+0000 7ffad59a99c0 20 add_watcher() i=7 2024-09-12T00:33:17.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.330+0000 7ffad59a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:17.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.334+0000 7ff989fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:17.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:17.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:17.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 note: GC not initialized 2024-09-12T00:33:17.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.334+0000 7ff988fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:17.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:17.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 Filter name: none 2024-09-12T00:33:17.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ff9027fc640 20 reqs_thread_entry: start 2024-09-12T00:33:17.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:33:17.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:17.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:33:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:33:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 : miss 2024-09-12T00:33:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.339 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:17.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 2024-09-12T00:33:17.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36, ofs0, ns] 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 93943479873872 notifier 7773 bl.length()=923 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_sources= new_sources= 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential sources added=[] removed=[] 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_dests= new_dests= 2024-09-12T00:33:17.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential dests added=[] removed=[] 2024-09-12T00:33:17.355 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffad59a99c0 time 2024-09-12T00:33:17.360199+0000 2024-09-12T00:33:17.355 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffad92832eb] 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ffad59a99c0 thread_name:radosgw-admin 2024-09-12T00:33:17.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.354+0000 7ffad59a99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffad59a99c0 time 2024-09-12T00:33:17.360199+0000 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffad92832eb] 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:17.358 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.365 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.365 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffad8102520] 2024-09-12T00:33:17.365 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:17.365 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffad9283345] 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.358+0000 7ffad59a99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ffad59a99c0 thread_name:radosgw-admin 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.366 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffad8102520] 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffad9283345] 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:17.367 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: dump: 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.368 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7262 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 4 set_mon_vals no callback set 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 10 monclient: shutdown 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) unregister_commands rotate-key 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.369 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding auth protocol: cephx 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding auth protocol: cephx 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding auth protocol: cephx 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.370 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: starting msgr at 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: starting objecter 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command objecter_requests hook 0x5570ebaf6ba0 2024-09-12T00:33:17.371 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: setting wanted keys 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: calling monclient init 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding auth protocol: cephx 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding auth protocol: cephx 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding auth protocol: cephx 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.372 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key hook 0x5570ebaf54c8 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570eb986900 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570eba3df60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570eba3e370 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.373 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.385319s 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570eba3df60 auth_method 0 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570eba3e370 auth_method 0 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.374 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570eb986900 auth_method 0 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_done global_id 7265 payload 824 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:33:17.046+0000 7ffad2cae640 1 monclient: found mon.noname-c 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:17.375 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: dump: 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.376 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: dump: 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.377 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7265 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:33:17.046+0000 7ff9c160a640 4 set_mon_vals no callback set 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: init done 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:33:17.050+0000 7ff9bfe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:33:17.050+0000 7ff9bfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:33:17.050+0000 7ff9bfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:33:17.050+0000 7ffad34af640 10 monclient: get_auth_request con 0x7ff9b8070ae0 auth_method 0 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:33:17.050+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x5570ebb24490 auth_method 0 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:33:17.050+0000 7ffad34af640 10 monclient: get_auth_request con 0x5570ebb40260 auth_method 0 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:33:17.050+0000 7ffad2cae640 10 monclient: get_auth_request con 0x5570ebb445c0 auth_method 0 2024-09-12T00:33:17.378 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x5570ebb43b10 auth_method 0 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.379 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding auth protocol: cephx 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding auth protocol: cephx 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding auth protocol: cephx 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.380 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5570ebb500d0 EEXIST 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding auth protocol: cephx 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding auth protocol: cephx 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding auth protocol: cephx 2024-09-12T00:33:17.381 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.382 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5570ebb4b700 EEXIST 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570ebb74280 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570ebb73bb0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570ebb72590 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.395377s 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570ebb74280 auth_method 0 2024-09-12T00:33:17.383 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570ebb73bb0 auth_method 0 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.384 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570ebb72590 auth_method 0 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_done global_id 7268 payload 824 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:33:17.054+0000 7ffad2cae640 1 monclient: found mon.noname-c 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: dump: 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.385 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:17.386 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: dump: 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:33:17.058+0000 7ffad44b1640 4 set_mon_vals no callback set 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7268 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.387 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:33:17.058+0000 7ff9bd602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:33:17.058+0000 7ff9bd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:33:17.058+0000 7ff9bd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:33:17.058+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x7ff9ac070a20 auth_method 0 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: get_monmap_and_config 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.388 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding auth protocol: cephx 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding auth protocol: cephx 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding auth protocol: cephx 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.389 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding auth protocol: cephx 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding auth protocol: cephx 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding auth protocol: cephx 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.390 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc4039ded8 EEXIST 2024-09-12T00:33:17.391 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570ebb97c50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570ebbc34b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570ebbb8c30 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.400024s 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570ebbb8c30 auth_method 0 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.392 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570ebbc34b0 auth_method 0 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.393 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570ebb97c50 auth_method 0 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_done global_id 7770 payload 274 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 1 monclient: found mon.noname-a 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: dump: 2024-09-12T00:33:17.394 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7770 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.395 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 4 set_mon_vals no callback set 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: dump: 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.396 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: shutdown 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.397 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding auth protocol: cephx 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding auth protocol: cephx 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding auth protocol: cephx 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.398 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: starting msgr at 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: starting objecter 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5570ebb98f40 EEXIST 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: setting wanted keys 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: calling monclient init 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding auth protocol: cephx 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding auth protocol: cephx 2024-09-12T00:33:17.399 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding auth protocol: cephx 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.400 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5570ebb761e8 EEXIST 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570ebb97c50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570ebbb8c30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570ebbc34b0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.402728s 2024-09-12T00:33:17.401 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570ebbb8c30 auth_method 0 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570ebbc34b0 auth_method 0 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.402 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570ebb97c50 auth_method 0 2024-09-12T00:33:17.403 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_done global_id 7773 payload 824 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 1 monclient: found mon.noname-a 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.404 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: dump: 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.405 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: dump: 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7773 2024-09-12T00:33:17.406 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 4 set_mon_vals no callback set 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: init done 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cr dump hook 0x5570ebbc3e48 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:33:17.066+0000 7ff9b57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:33:17.066+0000 7ff9b57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:33:17.066+0000 7ff9b57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:33:17.066+0000 7ffad2cae640 10 monclient: get_auth_request con 0x7ff99c070ae0 auth_method 0 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:33:17.066+0000 7ffad34af640 10 monclient: get_auth_request con 0x5570ebbe1bc0 auth_method 0 2024-09-12T00:33:17.407 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 realm 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:33:17.070+0000 7ffad2cae640 10 monclient: get_auth_request con 0x5570ebbe5ef0 auth_method 0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:33:17.070+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x5570ebbe9610 auth_method 0 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 searching for the correct realm 2024-09-12T00:33:17.408 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:33:17.070+0000 7ffad34af640 10 monclient: get_auth_request con 0x5570ebbee390 auth_method 0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:33:17.074+0000 7ffad2cae640 10 monclient: get_auth_request con 0x7ffac4008050 auth_method 0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:33:17.074+0000 7ffad3cb0640 0 -- 172.21.15.78:0/405433380 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x5570ebbe9610 msgr2=0x5570ebbeba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:33:17.074+0000 7ff9b57fa640 1 client.7773.objecter ms_handle_reset 0x5570ebbe9610 session 0x5570ebbe5750 osd.0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:33:17.074+0000 7ff9b57fa640 10 monclient: _renew_subs 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:33:17.074+0000 7ff9b57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:33:17.074+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x7ff99c080d90 auth_method 0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:33:17.074+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x7ffac404d400 auth_method 0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:33:17.078+0000 7ffad34af640 10 monclient: get_auth_request con 0x7ffac800e070 auth_method 0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:33:17.082+0000 7ffad2cae640 0 -- 172.21.15.78:0/405433380 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7ffac4015420 msgr2=0x7ffac4015860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:33:17.286+0000 7ffad2cae640 10 monclient: get_auth_request con 0x7ffac4015420 auth_method 0 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:17.409 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 zone default found 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 Realm: () 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:17.410 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 zonegroup default 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 started sync module instance, tier type = 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=0 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=1 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=2 2024-09-12T00:33:17.411 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=3 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=4 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=5 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=6 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:33:17.330+0000 7ffad59a99c0 20 add_watcher() i=7 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:33:17.330+0000 7ffad59a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding auth protocol: cephx 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding auth protocol: cephx 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding auth protocol: cephx 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.412 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:33:17.334+0000 7ff989fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache list hook 0x5570ebb96b30 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache inspect hook 0x5570ebb96b30 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache erase hook 0x5570ebb96b30 2024-09-12T00:33:17.413 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache zap hook 0x5570ebb96b30 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 note: GC not initialized 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:33:17.334+0000 7ff988fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace show hook 0x7ffacc0acee0 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace history hook 0x7ffacc0acee0 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace active hook 0x7ffacc0acee0 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace active_short hook 0x7ffacc0acee0 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 Filter name: none 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:33:17.338+0000 7ff9027fc640 20 reqs_thread_entry: start 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:33:17.414 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 : miss 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36, ofs0, ns] 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 93943479873872 notifier 7773 bl.length()=923 2024-09-12T00:33:17.415 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_sources= new_sources= 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential sources added=[] removed=[] 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_dests= new_dests= 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential dests added=[] removed=[] 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:33:17.354+0000 7ffad59a99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffad59a99c0 time 2024-09-12T00:33:17.360199+0000 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffad92832eb] 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.416 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:33:17.358+0000 7ffad59a99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ffad59a99c0 thread_name:radosgw-admin 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffad8102520] 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:17.417 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffad9283345] 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:33:17.418 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:17.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:33:17.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:17.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:33:17.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:17.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:17.424 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9027fc640 / http_manager 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff988fe1640 / http_manager 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff989fe3640 / rgw_dt_lg_renew 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9b57fa640 / ms_dispatch 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9b67fc640 / io_context_pool 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9b6ffd640 / io_context_pool 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9bd602640 / ms_dispatch 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9bfe07640 / ms_dispatch 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9c160a640 / io_context_pool 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad2cae640 / msgr-worker-2 2024-09-12T00:33:17.425 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad34af640 / msgr-worker-1 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad3cb0640 / msgr-worker-0 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad44b1640 / io_context_pool 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad59a99c0 / radosgw-admin 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.125277.log 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:17.426 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:33:17.042+0000 7ff9c160a640 10 monclient: dump: 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7262 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 4 set_mon_vals no callback set 2024-09-12T00:33:17.427 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 10 monclient: shutdown 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:33:17.042+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) unregister_commands rotate-key 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.428 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding auth protocol: cephx 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding auth protocol: cephx 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding auth protocol: cephx 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.429 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: crc 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb26420) adding con mode: secure 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: starting msgr at 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: starting objecter 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command objecter_requests hook 0x5570ebaf6ba0 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: setting wanted keys 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: calling monclient init 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding auth protocol: cephx 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding auth protocol: cephx 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding auth protocol: cephx 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.430 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: crc 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebaf5380) adding con mode: secure 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key hook 0x5570ebaf54c8 2024-09-12T00:33:17.431 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570eb986900 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570eba3df60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570eba3e370 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.385319s 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570eba3df60 auth_method 0 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.432 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570eba3e370 auth_method 0 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:33:17.046+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570eb986900 auth_method 0 2024-09-12T00:33:17.433 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:33:17.046+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient(hunting): handle_auth_done global_id 7265 payload 824 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:33:17.046+0000 7ffad2cae640 1 monclient: found mon.noname-c 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:33:17.046+0000 7ffad2cae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: dump: 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.434 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:33:17.046+0000 7ff9bfe07640 10 monclient: dump: 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.435 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7265 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:33:17.046+0000 7ff9c160a640 4 set_mon_vals no callback set 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.436 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:33:17.046+0000 7ffad59a99c0 1 librados: init done 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:33:17.050+0000 7ff9bfe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:33:17.050+0000 7ff9bfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:33:17.050+0000 7ff9bfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:33:17.050+0000 7ffad34af640 10 monclient: get_auth_request con 0x7ff9b8070ae0 auth_method 0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:33:17.050+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x5570ebb24490 auth_method 0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:33:17.050+0000 7ffad34af640 10 monclient: get_auth_request con 0x5570ebb40260 auth_method 0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:33:17.050+0000 7ffad2cae640 10 monclient: get_auth_request con 0x5570ebb445c0 auth_method 0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x5570ebb43b10 auth_method 0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.437 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding auth protocol: cephx 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding auth protocol: cephx 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding auth protocol: cephx 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.438 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: crc 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4c6c0) adding con mode: secure 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.439 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5570ebb500d0 EEXIST 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding auth protocol: cephx 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding auth protocol: cephx 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding auth protocol: cephx 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.440 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: crc 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb4b5b8) adding con mode: secure 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5570ebb4b700 EEXIST 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570ebb74280 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570ebb73bb0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570ebb72590 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.441 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:33:17.054+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.395377s 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570ebb74280 auth_method 0 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570ebb73bb0 auth_method 0 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.442 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:33:17.054+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570ebb72590 auth_method 0 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:33:17.054+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient(hunting): handle_auth_done global_id 7268 payload 824 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:33:17.054+0000 7ffad2cae640 1 monclient: found mon.noname-c 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:33:17.054+0000 7ffad2cae640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:17.443 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: dump: 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.444 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:33:17.058+0000 7ff9bd602640 10 monclient: dump: 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.445 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:33:17.058+0000 7ffad44b1640 4 set_mon_vals no callback set 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7268 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:33:17.058+0000 7ff9bd602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:33:17.058+0000 7ff9bd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.446 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:33:17.058+0000 7ff9bd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:33:17.058+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x7ff9ac070a20 auth_method 0 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: get_monmap_and_config 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.447 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding auth protocol: cephx 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding auth protocol: cephx 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding auth protocol: cephx 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.448 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: crc 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb93c00) adding con mode: secure 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding auth protocol: cephx 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding auth protocol: cephx 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding auth protocol: cephx 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.449 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: crc 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039dd90) adding con mode: secure 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc4039ded8 EEXIST 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570ebb97c50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:33:17.058+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570ebbc34b0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570ebbb8c30 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.450 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.400024s 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570ebbb8c30 auth_method 0 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570ebbc34b0 auth_method 0 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.451 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570ebb97c50 auth_method 0 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_done global_id 7770 payload 274 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 1 monclient: found mon.noname-a 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.452 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: dump: 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.453 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7770 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: get_monmap_and_config success 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 4 set_mon_vals no callback set 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 10 monclient: dump: 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.454 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: shutdown 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: build_initial_monmap 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: monmap: 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:17.455 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding auth protocol: cephx 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding auth protocol: cephx 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding auth protocol: cephx 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.456 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: crc 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebbc21d0) adding con mode: secure 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: starting msgr at 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: starting objecter 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command objecter_requests cmddesc objecter_requests hook 0x5570ebb98f40 EEXIST 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: setting wanted keys 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: calling monclient init 2024-09-12T00:33:17.457 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: init 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding auth protocol: cephx 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding auth protocol: cephx 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding auth protocol: cephx 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.458 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: crc 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 AuthRegistry(0x5570ebb760a0) adding con mode: secure 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command rotate-key cmddesc rotate-key hook 0x5570ebb761e8 EEXIST 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-b con 0x5570ebb97c50 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-a con 0x5570ebbb8c30 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): picked mon.noname-c con 0x5570ebbc34b0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:17.459 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient(hunting): authenticate will time out at 2321.402728s 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request con 0x5570ebbb8c30 auth_method 0 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request con 0x5570ebbc34b0 auth_method 0 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.460 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:33:17.062+0000 7ffad34af640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request con 0x5570ebb97c50 auth_method 0 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:33:17.062+0000 7ffad2cae640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient(hunting): handle_auth_done global_id 7773 payload 824 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _finish_hunting 0 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 1 monclient: found mon.noname-a 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:33:17.062+0000 7ffad3cb0640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.461 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: dump: 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: _finish_auth 0 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:33:17.462 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:33:17.062+0000 7ff9b57fa640 10 monclient: dump: 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.463 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 monclient: authenticate success, global_id 7773 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:33:17.062+0000 7ff9b6ffd640 4 set_mon_vals no callback set 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _renew_subs 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 1 librados: init done 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:33:17.062+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cr dump hook 0x5570ebbc3e48 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:33:17.066+0000 7ff9b57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:33:17.066+0000 7ff9b57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:33:17.066+0000 7ff9b57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:33:17.066+0000 7ffad2cae640 10 monclient: get_auth_request con 0x7ff99c070ae0 auth_method 0 2024-09-12T00:33:17.464 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:33:17.066+0000 7ffad34af640 10 monclient: get_auth_request con 0x5570ebbe1bc0 auth_method 0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 realm 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:33:17.066+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:33:17.070+0000 7ffad2cae640 10 monclient: get_auth_request con 0x5570ebbe5ef0 auth_method 0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:33:17.070+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x5570ebbe9610 auth_method 0 2024-09-12T00:33:17.465 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:33:17.070+0000 7ffad59a99c0 20 searching for the correct realm 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:33:17.070+0000 7ffad34af640 10 monclient: get_auth_request con 0x5570ebbee390 auth_method 0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:33:17.074+0000 7ffad2cae640 10 monclient: get_auth_request con 0x7ffac4008050 auth_method 0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:33:17.074+0000 7ffad3cb0640 0 -- 172.21.15.78:0/405433380 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x5570ebbe9610 msgr2=0x5570ebbeba00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:33:17.074+0000 7ff9b57fa640 1 client.7773.objecter ms_handle_reset 0x5570ebbe9610 session 0x5570ebbe5750 osd.0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:33:17.074+0000 7ff9b57fa640 10 monclient: _renew_subs 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:33:17.074+0000 7ff9b57fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:33:17.074+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x7ff99c080d90 auth_method 0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:33:17.074+0000 7ffad3cb0640 10 monclient: get_auth_request con 0x7ffac404d400 auth_method 0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:33:17.078+0000 7ffad34af640 10 monclient: get_auth_request con 0x7ffac800e070 auth_method 0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:33:17.082+0000 7ffad2cae640 0 -- 172.21.15.78:0/405433380 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7ffac4015420 msgr2=0x7ffac4015860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:33:17.286+0000 7ffad2cae640 10 monclient: get_auth_request con 0x7ffac4015420 auth_method 0 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:17.466 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 zone default found 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 Realm: () 2024-09-12T00:33:17.467 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 zonegroup default 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:33:17.302+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 started sync module instance, tier type = 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:33:17.306+0000 7ffad59a99c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:17.468 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=0 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=1 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=2 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=3 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=4 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=5 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:33:17.326+0000 7ffad59a99c0 20 add_watcher() i=6 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:33:17.330+0000 7ffad59a99c0 20 add_watcher() i=7 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:33:17.330+0000 7ffad59a99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding auth protocol: cephx 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding auth protocol: cephx 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding auth protocol: cephx 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.469 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: crc 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 AuthRegistry(0x7ffc4039e270) adding con mode: secure 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:33:17.334+0000 7ff989fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:17.470 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache list hook 0x5570ebb96b30 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache inspect hook 0x5570ebb96b30 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache erase hook 0x5570ebb96b30 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command cache zap hook 0x5570ebb96b30 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 note: GC not initialized 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:33:17.334+0000 7ff988fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace show hook 0x7ffacc0acee0 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace history hook 0x7ffacc0acee0 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace active hook 0x7ffacc0acee0 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 5 asok(0x5570eb8ea2b0) register_command sync trace active_short hook 0x7ffacc0acee0 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:33:17.334+0000 7ffad59a99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 Filter name: none 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:33:17.338+0000 7ff9027fc640 20 reqs_thread_entry: start 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:33:17.471 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 : miss 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:33:17.338+0000 7ffad59a99c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.472 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:33:17.346+0000 7ffad59a99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36, ofs0, ns] 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398873 cookie 93943479873872 notifier 7773 bl.length()=923 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:33:17.350+0000 7ff9b67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_sources= new_sources= 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential sources added=[] removed=[] 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_dests= new_dests= 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:33:17.350+0000 7ffad59a99c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential dests added=[] removed=[] 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:33:17.354+0000 7ffad59a99c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7ffad59a99c0 time 2024-09-12T00:33:17.360199+0000 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:17.473 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7ffad92832eb] 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:33:17.358+0000 7ffad59a99c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:17.474 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7ffad59a99c0 thread_name:radosgw-admin 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7ffad8102520] 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7ffad9283345] 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7ffad928349f] 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5570e90c5cc1] 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x5570e9b23aac] 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x5570e90daced] 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7ffad80e9d90] 2024-09-12T00:33:17.475 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:17.476 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:33:17.477 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:33:17.478 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:17.479 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:33:17.480 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:17.481 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:17.482 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9027fc640 / http_manager 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff988fe1640 / http_manager 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff989fe3640 / rgw_dt_lg_renew 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9b57fa640 / ms_dispatch 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9b67fc640 / io_context_pool 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9b6ffd640 / io_context_pool 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9bd602640 / ms_dispatch 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9bfe07640 / ms_dispatch 2024-09-12T00:33:17.483 INFO:tasks.workunit.client.0.smithi078.stderr: 7ff9c160a640 / io_context_pool 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad2cae640 / msgr-worker-2 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad34af640 / msgr-worker-1 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad3cb0640 / msgr-worker-0 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad44b1640 / io_context_pool 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: 7ffad59a99c0 / radosgw-admin 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:33:17.362685Z_241e61ec-a9bc-4ce6-881d-097aff1df297/log 2024-09-12T00:33:17.484 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.438+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 realm 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.442+0000 7fd6cb8429c0 20 searching for the correct realm 2024-09-12T00:33:17.487 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.450+0000 7fd6c9b49640 0 -- 172.21.15.78:0/3690451683 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fd6c4082b50 msgr2=0x7fd6c40761d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:17.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.662+0000 7fd6c9b49640 0 -- 172.21.15.78:0/3690451683 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559f9ff70510 msgr2=0x559f9ff72990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:17.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:17.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:17.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:17.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:17.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:17.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:17.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:17.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 zone default found 2024-09-12T00:33:17.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 4 Realm: () 2024-09-12T00:33:17.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:17.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:17.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:17.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 zonegroup default 2024-09-12T00:33:17.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.678+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.682+0000 7fd6cb8429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.682+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.682+0000 7fd6cb8429c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.682+0000 7fd6cb8429c0 20 started sync module instance, tier type = 2024-09-12T00:33:17.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.682+0000 7fd6cb8429c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:17.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=0 2024-09-12T00:33:17.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=1 2024-09-12T00:33:17.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=2 2024-09-12T00:33:17.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=3 2024-09-12T00:33:17.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=4 2024-09-12T00:33:17.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=5 2024-09-12T00:33:17.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=6 2024-09-12T00:33:17.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 20 add_watcher() i=7 2024-09-12T00:33:17.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.706+0000 7fd6cb8429c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:17.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.710+0000 7fd57f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:17.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.710+0000 7fd6cb8429c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:17.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.710+0000 7fd6cb8429c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:17.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd6cb8429c0 5 note: GC not initialized 2024-09-12T00:33:17.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd57e7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:17.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd6cb8429c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:17.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd6cb8429c0 20 Filter name: none 2024-09-12T00:33:17.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd4effff640 20 reqs_thread_entry: start 2024-09-12T00:33:17.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:17.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.714+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.718+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:17.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.718+0000 7fd6cb8429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:17.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.718+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.718+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:17.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.718+0000 7fd6cb8429c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.718+0000 7fd6cb8429c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:17.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.718+0000 7fd6cb8429c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:17.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.722+0000 7fd57f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:17.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.726+0000 7fd6cb8429c0 20 remove_watcher() i=0 2024-09-12T00:33:17.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.726+0000 7fd6cb8429c0 2 removed watcher, disabling cache 2024-09-12T00:33:17.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.726+0000 7fd6cb8429c0 20 remove_watcher() i=1 2024-09-12T00:33:17.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.730+0000 7fd6cb8429c0 20 remove_watcher() i=2 2024-09-12T00:33:17.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.730+0000 7fd6cb8429c0 20 remove_watcher() i=3 2024-09-12T00:33:17.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.734+0000 7fd6cb8429c0 20 remove_watcher() i=4 2024-09-12T00:33:17.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.738+0000 7fd6cb8429c0 20 remove_watcher() i=5 2024-09-12T00:33:17.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.738+0000 7fd6cb8429c0 20 remove_watcher() i=6 2024-09-12T00:33:17.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.742+0000 7fd6cb8429c0 20 remove_watcher() i=7 2024-09-12T00:33:17.767 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.767 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:17.767 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-logrecord-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:17.767 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:17.827 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:17.864 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:17.864 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:17.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.906+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 realm 2024-09-12T00:33:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:17.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:17.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:17.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.910+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:17.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.914+0000 7fe77d4e19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:17.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.914+0000 7fe77d4e19c0 20 searching for the correct realm 2024-09-12T00:33:17.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.914+0000 7fe77a7e6640 0 -- 172.21.15.78:0/4061303720 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x564925713fe0 msgr2=0x564925716410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:17.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:17.922+0000 7fe77a7e6640 0 -- 172.21.15.78:0/4061303720 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fe76c04bbe0 msgr2=0x7fe76c00e8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:18.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:18.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:18.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.142+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 zone default found 2024-09-12T00:33:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 4 Realm: () 2024-09-12T00:33:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 zonegroup default 2024-09-12T00:33:18.146 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:18.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:18.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:18.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 started sync module instance, tier type = 2024-09-12T00:33:18.147 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.146+0000 7fe77d4e19c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:18.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=0 2024-09-12T00:33:18.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=1 2024-09-12T00:33:18.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=2 2024-09-12T00:33:18.169 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=3 2024-09-12T00:33:18.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=4 2024-09-12T00:33:18.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=5 2024-09-12T00:33:18.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=6 2024-09-12T00:33:18.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 20 add_watcher() i=7 2024-09-12T00:33:18.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.170+0000 7fe77d4e19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:18.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.174+0000 7fe6317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:18.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.174+0000 7fe77d4e19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:18.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.174+0000 7fe77d4e19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:18.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.174+0000 7fe77d4e19c0 5 note: GC not initialized 2024-09-12T00:33:18.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.174+0000 7fe5abfff640 20 reqs_thread_entry: start 2024-09-12T00:33:18.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:18.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 20 Filter name: none 2024-09-12T00:33:18.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe5a9ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:18.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:33:18.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 : miss 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:18.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.178+0000 7fe77d4e19c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 2024-09-12T00:33:18.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.182+0000 7fe77d4e19c0 0 INFO: RGWReshardLock::lock found lock on abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to be held by another RGW process; skipping for now 2024-09-12T00:33:18.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.182+0000 7fe6317e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:18.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.186+0000 7fe77d4e19c0 20 remove_watcher() i=0 2024-09-12T00:33:18.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.186+0000 7fe77d4e19c0 2 removed watcher, disabling cache 2024-09-12T00:33:18.190 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.190+0000 7fe77d4e19c0 20 remove_watcher() i=1 2024-09-12T00:33:18.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.190+0000 7fe77d4e19c0 20 remove_watcher() i=2 2024-09-12T00:33:18.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.194+0000 7fe77d4e19c0 20 remove_watcher() i=3 2024-09-12T00:33:18.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.194+0000 7fe77d4e19c0 20 remove_watcher() i=4 2024-09-12T00:33:18.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.198+0000 7fe77d4e19c0 20 remove_watcher() i=5 2024-09-12T00:33:18.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.202+0000 7fe77d4e19c0 20 remove_watcher() i=6 2024-09-12T00:33:18.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:18.202+0000 7fe77d4e19c0 20 remove_watcher() i=7 2024-09-12T00:33:18.220 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:33:48.240 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-logrecord-writes --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:48.276 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:48.276 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:48.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.325+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.325+0000 7f95496499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.325+0000 7f95496499c0 20 realm 2024-09-12T00:33:48.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.325+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.325+0000 7f95496499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.325+0000 7f95496499c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:48.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.325+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.329+0000 7f95496499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.329+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.329+0000 7f95496499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.329+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.329+0000 7f95496499c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:48.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.329+0000 7f95496499c0 20 searching for the correct realm 2024-09-12T00:33:48.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.329+0000 7f954714f640 0 -- 172.21.15.78:0/2778785071 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55f6b3b109e0 msgr2=0x55f6b3b12ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:48.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.337+0000 7f9547950640 0 -- 172.21.15.78:0/2778785071 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55f6b3b041f0 msgr2=0x55f6b3b06660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:48.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:48.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:48.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:48.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:48.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:48.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:48.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.349+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:48.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 zone default found 2024-09-12T00:33:48.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 4 Realm: () 2024-09-12T00:33:48.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:48.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:48.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:48.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 zonegroup default 2024-09-12T00:33:48.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 started sync module instance, tier type = 2024-09-12T00:33:48.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.353+0000 7f95496499c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:48.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=0 2024-09-12T00:33:48.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=1 2024-09-12T00:33:48.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=2 2024-09-12T00:33:48.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=3 2024-09-12T00:33:48.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=4 2024-09-12T00:33:48.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=5 2024-09-12T00:33:48.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=6 2024-09-12T00:33:48.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 20 add_watcher() i=7 2024-09-12T00:33:48.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.373+0000 7f95496499c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:48.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.377+0000 7f93fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.377+0000 7f95496499c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:48.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.377+0000 7f95496499c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:48.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.377+0000 7f95496499c0 5 note: GC not initialized 2024-09-12T00:33:48.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.377+0000 7f93fcfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:48.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.377+0000 7f95496499c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:48.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.377+0000 7f95496499c0 20 Filter name: none 2024-09-12T00:33:48.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f93767fc640 20 reqs_thread_entry: start 2024-09-12T00:33:48.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 cache get: name=default.rgw.meta+root+abort-at-logrecord-writes : miss 2024-09-12T00:33:48.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:48.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 cache put: name=default.rgw.meta+root+abort-at-logrecord-writes info.flags=0x11 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 adding default.rgw.meta+root+abort-at-logrecord-writes to cache LRU end 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 : miss 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 20 rados_obj.operate() r=0 bl.length=447 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:48.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 2024-09-12T00:33:48.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.381+0000 7f95496499c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:33:48.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:48.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:48.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:48.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36, ofs0, ns] 2024-09-12T00:33:48.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f942a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398874 cookie 94518065041888 notifier 7325 bl.length()=923 2024-09-12T00:33:48.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f942a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:48.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f942a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:48.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f942a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:48.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_sources= new_sources= 2024-09-12T00:33:48.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential sources added=[] removed=[] 2024-09-12T00:33:48.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_dests= new_dests= 2024-09-12T00:33:48.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.397+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential dests added=[] removed=[] 2024-09-12T00:33:48.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.0 2024-09-12T00:33:48.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.0 2024-09-12T00:33:48.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.1 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.1 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.2 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.2 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.3 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.3 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.4 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.4 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.5 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.5 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.6 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.6 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.7 2024-09-12T00:33:48.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.7 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.8 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.8 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.9 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.9 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.10 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.10 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.11 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2.11 2024-09-12T00:33:48.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.0 2024-09-12T00:33:48.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.1 2024-09-12T00:33:48.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.409+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2 2024-09-12T00:33:48.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.413+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.3 2024-09-12T00:33:48.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.413+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.4 2024-09-12T00:33:48.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.413+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.5 2024-09-12T00:33:48.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.413+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.6 2024-09-12T00:33:48.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.413+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.7 2024-09-12T00:33:48.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.413+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.8 2024-09-12T00:33:48.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.417+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.9 2024-09-12T00:33:48.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.417+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.10 2024-09-12T00:33:48.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.425+0000 7f95496499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:48.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.425+0000 7f95496499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 2024-09-12T00:33:48.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.425+0000 7f95496499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:48.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.425+0000 7f95496499c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:48.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.425+0000 7f95496499c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:48.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.425+0000 7f95496499c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36, ofs0, ns] 2024-09-12T00:33:48.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f942a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398875 cookie 94518065041888 notifier 7325 bl.length()=923 2024-09-12T00:33:48.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f942a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:48.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f942a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:48.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f942a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:48.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_sources= new_sources= 2024-09-12T00:33:48.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential sources added=[] removed=[] 2024-09-12T00:33:48.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_dests= new_dests= 2024-09-12T00:33:48.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.429+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential dests added=[] removed=[] 2024-09-12T00:33:48.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.433+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.0 2024-09-12T00:33:48.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.437+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.1 2024-09-12T00:33:48.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.437+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.2 2024-09-12T00:33:48.434 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.437+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.3 2024-09-12T00:33:48.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.437+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.4 2024-09-12T00:33:48.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.437+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.5 2024-09-12T00:33:48.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.437+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.6 2024-09-12T00:33:48.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.437+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.7 2024-09-12T00:33:48.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.8 2024-09-12T00:33:48.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.9 2024-09-12T00:33:48.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36.10 2024-09-12T00:33:48.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:48.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 2024-09-12T00:33:48.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:48.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:48.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:48.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.441+0000 7f95496499c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36, ofs0, ns] 2024-09-12T00:33:48.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f942affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398876 cookie 94518065041888 notifier 7325 bl.length()=891 2024-09-12T00:33:48.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f942affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 info.flags=0x17 2024-09-12T00:33:48.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f942affd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-logrecord-writes:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 to cache LRU end 2024-09-12T00:33:48.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f942affd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:48.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_sources= new_sources= 2024-09-12T00:33:48.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential sources added=[] removed=[] 2024-09-12T00:33:48.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): orig_dests= new_dests= 2024-09-12T00:33:48.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.445+0000 7f95496499c0 20 handle_bi_update(): bucket=:abort-at-logrecord-writes[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36]): potential dests added=[] removed=[] 2024-09-12T00:33:48.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.449+0000 7f95496499c0 1 execute INFO: reshard of bucket "abort-at-logrecord-writes" from 11 shards to 12 shards completed successfully 2024-09-12T00:33:48.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.453+0000 7f93fdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.457+0000 7f95496499c0 20 remove_watcher() i=0 2024-09-12T00:33:48.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.457+0000 7f95496499c0 2 removed watcher, disabling cache 2024-09-12T00:33:48.457 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.461+0000 7f95496499c0 20 remove_watcher() i=1 2024-09-12T00:33:48.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.461+0000 7f95496499c0 20 remove_watcher() i=2 2024-09-12T00:33:48.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.465+0000 7f95496499c0 20 remove_watcher() i=3 2024-09-12T00:33:48.464 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.465+0000 7f95496499c0 20 remove_watcher() i=4 2024-09-12T00:33:48.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.469+0000 7f95496499c0 20 remove_watcher() i=5 2024-09-12T00:33:48.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.469+0000 7f95496499c0 20 remove_watcher() i=6 2024-09-12T00:33:48.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.473+0000 7f95496499c0 20 remove_watcher() i=7 2024-09-12T00:33:48.489 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-logrecord-writes 2024-09-12T00:33:48.519 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:48.520 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:48.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.565+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 realm 2024-09-12T00:33:48.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:48.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:48.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.569+0000 7fe3e0f2e9c0 20 searching for the correct realm 2024-09-12T00:33:48.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.573+0000 7fe3df235640 0 -- 172.21.15.78:0/1440512193 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x55a48f569940 msgr2=0x55a48f56bd30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:48.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.581+0000 7fe3de233640 0 -- 172.21.15.78:0/1440512193 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fe3d00e9910 msgr2=0x7fe3d00b7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:48.797 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:48.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 zone default found 2024-09-12T00:33:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 4 Realm: () 2024-09-12T00:33:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:48.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 zonegroup default 2024-09-12T00:33:48.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.801+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.805+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.805+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.805+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:48.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.805+0000 7fe3e0f2e9c0 20 started sync module instance, tier type = 2024-09-12T00:33:48.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.805+0000 7fe3e0f2e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:48.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=0 2024-09-12T00:33:48.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=1 2024-09-12T00:33:48.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=2 2024-09-12T00:33:48.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=3 2024-09-12T00:33:48.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=4 2024-09-12T00:33:48.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=5 2024-09-12T00:33:48.827 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=6 2024-09-12T00:33:48.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 20 add_watcher() i=7 2024-09-12T00:33:48.829 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.829+0000 7fe3e0f2e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:48.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe2957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe3e0f2e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:48.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe3e0f2e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:48.836 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe3e0f2e9c0 5 note: GC not initialized 2024-09-12T00:33:48.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe20ffff640 20 reqs_thread_entry: start 2024-09-12T00:33:48.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe3e0f2e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:48.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe3e0f2e9c0 20 Filter name: none 2024-09-12T00:33:48.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe20dffb640 20 reqs_thread_entry: start 2024-09-12T00:33:48.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.837+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:48.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:48.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:48.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=193 2024-09-12T00:33:48.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:48.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 rados_obj.operate() r=0 bl.length=415 2024-09-12T00:33:48.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.841+0000 7fe3e0f2e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:48.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.845+0000 7fe2957e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:48.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.849+0000 7fe3e0f2e9c0 20 remove_watcher() i=0 2024-09-12T00:33:48.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.849+0000 7fe3e0f2e9c0 2 removed watcher, disabling cache 2024-09-12T00:33:48.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.853+0000 7fe3e0f2e9c0 20 remove_watcher() i=1 2024-09-12T00:33:48.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.853+0000 7fe3e0f2e9c0 20 remove_watcher() i=2 2024-09-12T00:33:48.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.857+0000 7fe3e0f2e9c0 20 remove_watcher() i=3 2024-09-12T00:33:48.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.857+0000 7fe3e0f2e9c0 20 remove_watcher() i=4 2024-09-12T00:33:48.858 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.861+0000 7fe3e0f2e9c0 20 remove_watcher() i=5 2024-09-12T00:33:48.860 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.861+0000 7fe3e0f2e9c0 20 remove_watcher() i=6 2024-09-12T00:33:48.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:48.865+0000 7fe3e0f2e9c0 20 remove_watcher() i=7 2024-09-12T00:33:48.879 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:48.880 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:48.880 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-logrecord-writes id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.36 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:33:48.880 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:48.990 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with EIO injected at change_reshard_state 2024-09-12T00:33:48.990 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:49.402 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:33:49.436 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:49.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 realm 2024-09-12T00:33:49.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:49.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.485+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.489+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.489+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.489+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:49.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.489+0000 7f90258b69c0 20 searching for the correct realm 2024-09-12T00:33:49.490 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.493+0000 7f90233bc640 0 -- 172.21.15.78:0/653819452 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55790667ddf0 msgr2=0x5579066802b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.497+0000 7f9022bbb640 0 -- 172.21.15.78:0/653819452 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f9014046e80 msgr2=0x7f9014090fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:49.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:49.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 zone default found 2024-09-12T00:33:49.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 4 Realm: () 2024-09-12T00:33:49.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:49.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:49.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:49.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 zonegroup default 2024-09-12T00:33:49.717 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.717+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.721+0000 7f90258b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.721+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.721+0000 7f90258b69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.721+0000 7f90258b69c0 20 started sync module instance, tier type = 2024-09-12T00:33:49.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.721+0000 7f90258b69c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=0 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=1 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=2 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=3 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=4 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=5 2024-09-12T00:33:49.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=6 2024-09-12T00:33:49.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 20 add_watcher() i=7 2024-09-12T00:33:49.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.745+0000 7f90258b69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:49.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f8ed9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:49.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:49.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 5 note: GC not initialized 2024-09-12T00:33:49.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f8ed8fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:49.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:49.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 20 Filter name: none 2024-09-12T00:33:49.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f8e527fc640 20 reqs_thread_entry: start 2024-09-12T00:33:49.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:49.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.753+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.757+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:49.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.757+0000 7f90258b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:49.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.757+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.757+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:49.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.757+0000 7f90258b69c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.757+0000 7f90258b69c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:49.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.757+0000 7f90258b69c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:49.758 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.761+0000 7f8ed9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:49.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.765+0000 7f90258b69c0 20 remove_watcher() i=0 2024-09-12T00:33:49.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.765+0000 7f90258b69c0 2 removed watcher, disabling cache 2024-09-12T00:33:49.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.765+0000 7f90258b69c0 20 remove_watcher() i=1 2024-09-12T00:33:49.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.769+0000 7f90258b69c0 20 remove_watcher() i=2 2024-09-12T00:33:49.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.769+0000 7f90258b69c0 20 remove_watcher() i=3 2024-09-12T00:33:49.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.773+0000 7f90258b69c0 20 remove_watcher() i=4 2024-09-12T00:33:49.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.773+0000 7f90258b69c0 20 remove_watcher() i=5 2024-09-12T00:33:49.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.777+0000 7f90258b69c0 20 remove_watcher() i=6 2024-09-12T00:33:49.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.781+0000 7f90258b69c0 20 remove_watcher() i=7 2024-09-12T00:33:49.793 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:49.793 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:49.793 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:49.793 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:49.793 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state 2024-09-12T00:33:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:49.826 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:49.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.873+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.873+0000 7fd7fb8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.873+0000 7fd7fb8189c0 20 realm 2024-09-12T00:33:49.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.873+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:49.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:49.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:49.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:49.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:49.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.877+0000 7fd7fb8189c0 20 searching for the correct realm 2024-09-12T00:33:49.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:49.881+0000 7fd7f8b1d640 0 -- 172.21.15.78:0/1761917919 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fd7ec0cb7d0 msgr2=0x7fd7ec102ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.093+0000 7fd7f931e640 0 -- 172.21.15.78:0/1761917919 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fd7f001b040 msgr2=0x7fd7f00678b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:50.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:50.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.317+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 zone default found 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 4 Realm: () 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 zonegroup default 2024-09-12T00:33:50.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.321+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.325+0000 7fd7fb8189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.325+0000 7fd7fb8189c0 20 started sync module instance, tier type = 2024-09-12T00:33:50.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.325+0000 7fd7fb8189c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:50.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=0 2024-09-12T00:33:50.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=1 2024-09-12T00:33:50.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=2 2024-09-12T00:33:50.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=3 2024-09-12T00:33:50.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=4 2024-09-12T00:33:50.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=5 2024-09-12T00:33:50.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=6 2024-09-12T00:33:50.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 20 add_watcher() i=7 2024-09-12T00:33:50.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.349+0000 7fd7fb8189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.353+0000 7fd6abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:50.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:50.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 5 note: GC not initialized 2024-09-12T00:33:50.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd6aafe5640 20 reqs_thread_entry: start 2024-09-12T00:33:50.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:50.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 Filter name: none 2024-09-12T00:33:50.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd6a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:50.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:33:50.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:50.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:33:50.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:33:50.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 : miss 2024-09-12T00:33:50.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:50.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.357+0000 7fd7fb8189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 2024-09-12T00:33:50.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:50.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37, ofs0, ns] 2024-09-12T00:33:50.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd6dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399003 cookie 94694195489104 notifier 7376 bl.length()=931 2024-09-12T00:33:50.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd6dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:50.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd6dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:50.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd6dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:50.369 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_sources= new_sources= 2024-09-12T00:33:50.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential sources added=[] removed=[] 2024-09-12T00:33:50.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_dests= new_dests= 2024-09-12T00:33:50.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.369+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential dests added=[] removed=[] 2024-09-12T00:33:50.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.0 2024-09-12T00:33:50.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.0 2024-09-12T00:33:50.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.1 2024-09-12T00:33:50.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.1 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.2 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.2 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.3 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.3 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.4 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.4 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.5 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.5 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.6 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.6 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.7 2024-09-12T00:33:50.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.7 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.8 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.8 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.9 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.9 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.10 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.10 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.11 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.11 2024-09-12T00:33:50.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.0 2024-09-12T00:33:50.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.381+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1 2024-09-12T00:33:50.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.385+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.2 2024-09-12T00:33:50.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.385+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.3 2024-09-12T00:33:50.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.385+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.4 2024-09-12T00:33:50.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.385+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.5 2024-09-12T00:33:50.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.389+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.6 2024-09-12T00:33:50.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.389+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.7 2024-09-12T00:33:50.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.389+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.8 2024-09-12T00:33:50.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.389+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.9 2024-09-12T00:33:50.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.393+0000 7fd7fb8189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.10 2024-09-12T00:33:50.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.397+0000 7fd7fb8189c0 -1 Injecting error=-5 at location=change_reshard_state 2024-09-12T00:33:50.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.397+0000 7fd7fb8189c0 0 ERROR: change_reshard_state failed to commit target index layout: (5) Input/output error 2024-09-12T00:33:50.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd7fb8189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:50.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd7fb8189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd7fb8189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd7fb8189c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd7fb8189c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd7fb8189c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37, ofs0, ns] 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd6dcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399004 cookie 94694195489104 notifier 7376 bl.length()=899 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd6dcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd6dcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:50.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.421+0000 7fd6dcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:50.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.425+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_sources= new_sources= 2024-09-12T00:33:50.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.425+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential sources added=[] removed=[] 2024-09-12T00:33:50.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.425+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_dests= new_dests= 2024-09-12T00:33:50.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.425+0000 7fd7fb8189c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential dests added=[] removed=[] 2024-09-12T00:33:50.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.425+0000 7fd7fb8189c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" canceled due to errors 2024-09-12T00:33:50.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.425+0000 7fd6abfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.433+0000 7fd7fb8189c0 20 remove_watcher() i=0 2024-09-12T00:33:50.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.433+0000 7fd7fb8189c0 2 removed watcher, disabling cache 2024-09-12T00:33:50.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.433+0000 7fd7fb8189c0 20 remove_watcher() i=1 2024-09-12T00:33:50.433 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.437+0000 7fd7fb8189c0 20 remove_watcher() i=2 2024-09-12T00:33:50.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.437+0000 7fd7fb8189c0 20 remove_watcher() i=3 2024-09-12T00:33:50.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.441+0000 7fd7fb8189c0 20 remove_watcher() i=4 2024-09-12T00:33:50.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.441+0000 7fd7fb8189c0 20 remove_watcher() i=5 2024-09-12T00:33:50.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.445+0000 7fd7fb8189c0 20 remove_watcher() i=6 2024-09-12T00:33:50.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.449+0000 7fd7fb8189c0 20 remove_watcher() i=7 2024-09-12T00:33:50.461 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:33:50.491 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:50.491 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:50.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.537+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 realm 2024-09-12T00:33:50.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:50.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:50.541 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.541+0000 7fbbb8e179c0 20 searching for the correct realm 2024-09-12T00:33:50.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.549+0000 7fbbb711e640 0 -- 172.21.15.78:0/2868982561 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fbba8008040 msgr2=0x7fbba8076960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:50.761 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.765+0000 7fbbb691d640 0 -- 172.21.15.78:0/2868982561 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55dd3841e070 msgr2=0x55dd38420480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.773+0000 7fbbb8e179c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.773+0000 7fbbb8e179c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.773+0000 7fbbb8e179c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:50.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.773+0000 7fbbb8e179c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.773+0000 7fbbb8e179c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.773+0000 7fbbb8e179c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 zone default found 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 4 Realm: () 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 zonegroup default 2024-09-12T00:33:50.776 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.777+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.781+0000 7fbbb8e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.781+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.781+0000 7fbbb8e179c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.781+0000 7fbbb8e179c0 20 started sync module instance, tier type = 2024-09-12T00:33:50.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.781+0000 7fbbb8e179c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:50.800 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.801+0000 7fbbb8e179c0 20 add_watcher() i=0 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.801+0000 7fbbb8e179c0 20 add_watcher() i=1 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.801+0000 7fbbb8e179c0 20 add_watcher() i=2 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.801+0000 7fbbb8e179c0 20 add_watcher() i=3 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.801+0000 7fbbb8e179c0 20 add_watcher() i=4 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.801+0000 7fbbb8e179c0 20 add_watcher() i=5 2024-09-12T00:33:50.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.801+0000 7fbbb8e179c0 20 add_watcher() i=6 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.805+0000 7fbbb8e179c0 20 add_watcher() i=7 2024-09-12T00:33:50.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.805+0000 7fbbb8e179c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:50.807 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fba6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fbbb8e179c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fbbb8e179c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:50.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fbbb8e179c0 5 note: GC not initialized 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fb9e7fff640 20 reqs_thread_entry: start 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fbbb8e179c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fbbb8e179c0 20 Filter name: none 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.809+0000 7fb9e5ffb640 20 reqs_thread_entry: start 2024-09-12T00:33:50.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:50.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:50.811 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:50.812 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:50.813 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.813+0000 7fbbb8e179c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:50.815 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.817+0000 7fba6d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.821+0000 7fbbb8e179c0 20 remove_watcher() i=0 2024-09-12T00:33:50.820 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.821+0000 7fbbb8e179c0 2 removed watcher, disabling cache 2024-09-12T00:33:50.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.825+0000 7fbbb8e179c0 20 remove_watcher() i=1 2024-09-12T00:33:50.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.825+0000 7fbbb8e179c0 20 remove_watcher() i=2 2024-09-12T00:33:50.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.829+0000 7fbbb8e179c0 20 remove_watcher() i=3 2024-09-12T00:33:50.828 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.829+0000 7fbbb8e179c0 20 remove_watcher() i=4 2024-09-12T00:33:50.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.833+0000 7fbbb8e179c0 20 remove_watcher() i=5 2024-09-12T00:33:50.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.837+0000 7fbbb8e179c0 20 remove_watcher() i=6 2024-09-12T00:33:50.835 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.837+0000 7fbbb8e179c0 20 remove_watcher() i=7 2024-09-12T00:33:50.851 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:50.851 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:50.851 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:50.851 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:50.907 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:50.943 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:50.943 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:50.988 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.989+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 realm 2024-09-12T00:33:50.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.990 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:50.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:50.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:50.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:50.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:50.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:50.993+0000 7f4b5d4ff9c0 20 searching for the correct realm 2024-09-12T00:33:50.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.001+0000 7f4b5b806640 0 -- 172.21.15.78:0/1069734734 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f4b4c00e3a0 msgr2=0x7f4b4c00e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.213+0000 7f4b5b005640 0 -- 172.21.15.78:0/1069734734 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55bde0437ca0 msgr2=0x55bde043a0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.225+0000 7f4b5d4ff9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:51.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.225+0000 7f4b5d4ff9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:51.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.225+0000 7f4b5d4ff9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:51.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.225+0000 7f4b5d4ff9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:51.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.225+0000 7f4b5d4ff9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:51.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.225+0000 7f4b5d4ff9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:51.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.225+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 zone default found 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 4 Realm: () 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 zonegroup default 2024-09-12T00:33:51.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.229+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.233+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.233+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.233+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.233+0000 7f4b5d4ff9c0 20 started sync module instance, tier type = 2024-09-12T00:33:51.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.233+0000 7f4b5d4ff9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:51.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.253+0000 7f4b5d4ff9c0 20 add_watcher() i=0 2024-09-12T00:33:51.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.253+0000 7f4b5d4ff9c0 20 add_watcher() i=1 2024-09-12T00:33:51.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.253+0000 7f4b5d4ff9c0 20 add_watcher() i=2 2024-09-12T00:33:51.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.253+0000 7f4b5d4ff9c0 20 add_watcher() i=3 2024-09-12T00:33:51.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.253+0000 7f4b5d4ff9c0 20 add_watcher() i=4 2024-09-12T00:33:51.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.253+0000 7f4b5d4ff9c0 20 add_watcher() i=5 2024-09-12T00:33:51.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.253+0000 7f4b5d4ff9c0 20 add_watcher() i=6 2024-09-12T00:33:51.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.257+0000 7f4b5d4ff9c0 20 add_watcher() i=7 2024-09-12T00:33:51.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.257+0000 7f4b5d4ff9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:51.258 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4a11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:51.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:51.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 5 note: GC not initialized 2024-09-12T00:33:51.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4a10fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:51.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:51.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 20 Filter name: none 2024-09-12T00:33:51.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f498a7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:51.260 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:33:51.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.261+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:51.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:33:51.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:33:51.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 : miss 2024-09-12T00:33:51.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:51.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:51.262 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:51.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:51.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:51.263 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.265+0000 7f4b5d4ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 2024-09-12T00:33:51.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:51.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:51.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:51.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37, ofs0, ns] 2024-09-12T00:33:51.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4a3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399005 cookie 94273999773136 notifier 7409 bl.length()=931 2024-09-12T00:33:51.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4a3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:51.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4a3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:51.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4a3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:51.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_sources= new_sources= 2024-09-12T00:33:51.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential sources added=[] removed=[] 2024-09-12T00:33:51.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_dests= new_dests= 2024-09-12T00:33:51.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.277+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential dests added=[] removed=[] 2024-09-12T00:33:51.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.0 2024-09-12T00:33:51.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.0 2024-09-12T00:33:51.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.1 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.1 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.2 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.2 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.3 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.3 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.4 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.4 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.5 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.5 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.6 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.6 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.7 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.7 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.8 2024-09-12T00:33:51.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.8 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.9 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.9 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.10 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.10 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.11 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1.11 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.0 2024-09-12T00:33:51.288 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1 2024-09-12T00:33:51.289 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.289+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.2 2024-09-12T00:33:51.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.293+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.3 2024-09-12T00:33:51.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.293+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.4 2024-09-12T00:33:51.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.293+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.5 2024-09-12T00:33:51.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.293+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.6 2024-09-12T00:33:51.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.297+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.7 2024-09-12T00:33:51.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.297+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.8 2024-09-12T00:33:51.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.297+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.9 2024-09-12T00:33:51.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.297+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.10 2024-09-12T00:33:51.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.305+0000 7f4b5d4ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:51.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.305+0000 7f4b5d4ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 2024-09-12T00:33:51.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:51.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:51.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:51.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37, ofs0, ns] 2024-09-12T00:33:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4a3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399006 cookie 94273999773136 notifier 7409 bl.length()=931 2024-09-12T00:33:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4a3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4a3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:51.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4a3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_sources= new_sources= 2024-09-12T00:33:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential sources added=[] removed=[] 2024-09-12T00:33:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_dests= new_dests= 2024-09-12T00:33:51.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.309+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential dests added=[] removed=[] 2024-09-12T00:33:51.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.313+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.0 2024-09-12T00:33:51.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.317+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.1 2024-09-12T00:33:51.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.317+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.2 2024-09-12T00:33:51.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.317+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.3 2024-09-12T00:33:51.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.317+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.4 2024-09-12T00:33:51.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.317+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.5 2024-09-12T00:33:51.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.317+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.6 2024-09-12T00:33:51.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.321+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.7 2024-09-12T00:33:51.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.321+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.8 2024-09-12T00:33:51.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.321+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.9 2024-09-12T00:33:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.321+0000 7f4b5d4ff9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37.10 2024-09-12T00:33:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.321+0000 7f4b5d4ff9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:51.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.321+0000 7f4b5d4ff9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 2024-09-12T00:33:51.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:51.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:51.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:51.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37, ofs0, ns] 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4a3effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399007 cookie 94273999773136 notifier 7409 bl.length()=899 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4a3effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 info.flags=0x17 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4a3effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 to cache LRU end 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4a3effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_sources= new_sources= 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential sources added=[] removed=[] 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): orig_dests= new_dests= 2024-09-12T00:33:51.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.325+0000 7f4b5d4ff9c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37]): potential dests added=[] removed=[] 2024-09-12T00:33:51.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.333+0000 7f4b5d4ff9c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:33:51.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.333+0000 7f4a11fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.337+0000 7f4b5d4ff9c0 20 remove_watcher() i=0 2024-09-12T00:33:51.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.337+0000 7f4b5d4ff9c0 2 removed watcher, disabling cache 2024-09-12T00:33:51.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.341+0000 7f4b5d4ff9c0 20 remove_watcher() i=1 2024-09-12T00:33:51.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.341+0000 7f4b5d4ff9c0 20 remove_watcher() i=2 2024-09-12T00:33:51.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.345+0000 7f4b5d4ff9c0 20 remove_watcher() i=3 2024-09-12T00:33:51.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.345+0000 7f4b5d4ff9c0 20 remove_watcher() i=4 2024-09-12T00:33:51.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.349+0000 7f4b5d4ff9c0 20 remove_watcher() i=5 2024-09-12T00:33:51.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.353+0000 7f4b5d4ff9c0 20 remove_watcher() i=6 2024-09-12T00:33:51.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.353+0000 7f4b5d4ff9c0 20 remove_watcher() i=7 2024-09-12T00:33:51.370 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:33:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:51.397 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:51.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.441+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 20 realm 2024-09-12T00:33:51.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.445+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.449+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.449+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.449+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:51.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.449+0000 7f029b2369c0 20 searching for the correct realm 2024-09-12T00:33:51.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.453+0000 7f029953d640 0 -- 172.21.15.78:0/3822634615 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0288008070 msgr2=0x7f028809a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.669+0000 7f0298d3c640 0 -- 172.21.15.78:0/3822634615 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559610d5f3d0 msgr2=0x559610d61830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:51.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 zone default found 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 4 Realm: () 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 zonegroup default 2024-09-12T00:33:51.680 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.681+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.685+0000 7f029b2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.685+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.685+0000 7f029b2369c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:51.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.685+0000 7f029b2369c0 20 started sync module instance, tier type = 2024-09-12T00:33:51.682 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.685+0000 7f029b2369c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:51.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.705+0000 7f029b2369c0 20 add_watcher() i=0 2024-09-12T00:33:51.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.705+0000 7f029b2369c0 20 add_watcher() i=1 2024-09-12T00:33:51.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.705+0000 7f029b2369c0 20 add_watcher() i=2 2024-09-12T00:33:51.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.705+0000 7f029b2369c0 20 add_watcher() i=3 2024-09-12T00:33:51.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.705+0000 7f029b2369c0 20 add_watcher() i=4 2024-09-12T00:33:51.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.705+0000 7f029b2369c0 20 add_watcher() i=5 2024-09-12T00:33:51.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.705+0000 7f029b2369c0 20 add_watcher() i=6 2024-09-12T00:33:51.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.709+0000 7f029b2369c0 20 add_watcher() i=7 2024-09-12T00:33:51.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.709+0000 7f029b2369c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:51.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f014efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f029b2369c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:51.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f029b2369c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:51.711 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f029b2369c0 5 note: GC not initialized 2024-09-12T00:33:51.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f014dfe3640 20 reqs_thread_entry: start 2024-09-12T00:33:51.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f029b2369c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:51.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f029b2369c0 20 Filter name: none 2024-09-12T00:33:51.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f00bf7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:51.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.713+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:51.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:51.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:51.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:51.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:51.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:51.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.717+0000 7f029b2369c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:51.719 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.721+0000 7f014efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:51.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.725+0000 7f029b2369c0 20 remove_watcher() i=0 2024-09-12T00:33:51.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.725+0000 7f029b2369c0 2 removed watcher, disabling cache 2024-09-12T00:33:51.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.729+0000 7f029b2369c0 20 remove_watcher() i=1 2024-09-12T00:33:51.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.729+0000 7f029b2369c0 20 remove_watcher() i=2 2024-09-12T00:33:51.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.733+0000 7f029b2369c0 20 remove_watcher() i=3 2024-09-12T00:33:51.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.733+0000 7f029b2369c0 20 remove_watcher() i=4 2024-09-12T00:33:51.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.737+0000 7f029b2369c0 20 remove_watcher() i=5 2024-09-12T00:33:51.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.737+0000 7f029b2369c0 20 remove_watcher() i=6 2024-09-12T00:33:51.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:51.741+0000 7f029b2369c0 20 remove_watcher() i=7 2024-09-12T00:33:51.755 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:51.755 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:51.755 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.37 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:33:51.755 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:51.859 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with ECANCELED injected at change_reshard_state 2024-09-12T00:33:51.859 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:52.255 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:33:52.287 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:52.287 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:52.332 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.333+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 realm 2024-09-12T00:33:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.337+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.341+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:52.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.341+0000 7f1b439139c0 20 searching for the correct realm 2024-09-12T00:33:52.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.345+0000 7f1b41c1a640 0 -- 172.21.15.78:0/4151263800 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1b34117b60 msgr2=0x7f1b341189f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:52.348 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.349+0000 7f1b41c1a640 0 -- 172.21.15.78:0/4151263800 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559c39b43540 msgr2=0x559c39b459e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:52.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.357+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 zone default found 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 4 Realm: () 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 zonegroup default 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 started sync module instance, tier type = 2024-09-12T00:33:52.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.361+0000 7f1b439139c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:52.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=0 2024-09-12T00:33:52.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=1 2024-09-12T00:33:52.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=2 2024-09-12T00:33:52.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=3 2024-09-12T00:33:52.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=4 2024-09-12T00:33:52.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=5 2024-09-12T00:33:52.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=6 2024-09-12T00:33:52.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 20 add_watcher() i=7 2024-09-12T00:33:52.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.381+0000 7f1b439139c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:52.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f19f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f1b439139c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:52.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f1b439139c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:52.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f1b439139c0 5 note: GC not initialized 2024-09-12T00:33:52.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f19f67e4640 20 reqs_thread_entry: start 2024-09-12T00:33:52.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f1b439139c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:52.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f1b439139c0 20 Filter name: none 2024-09-12T00:33:52.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.385+0000 7f1967fff640 20 reqs_thread_entry: start 2024-09-12T00:33:52.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:52.386 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f1b439139c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:52.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.389+0000 7f19f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.397+0000 7f1b439139c0 20 remove_watcher() i=0 2024-09-12T00:33:52.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.397+0000 7f1b439139c0 2 removed watcher, disabling cache 2024-09-12T00:33:52.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.397+0000 7f1b439139c0 20 remove_watcher() i=1 2024-09-12T00:33:52.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.401+0000 7f1b439139c0 20 remove_watcher() i=2 2024-09-12T00:33:52.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.401+0000 7f1b439139c0 20 remove_watcher() i=3 2024-09-12T00:33:52.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.405+0000 7f1b439139c0 20 remove_watcher() i=4 2024-09-12T00:33:52.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.405+0000 7f1b439139c0 20 remove_watcher() i=5 2024-09-12T00:33:52.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.409+0000 7f1b439139c0 20 remove_watcher() i=6 2024-09-12T00:33:52.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.409+0000 7f1b439139c0 20 remove_watcher() i=7 2024-09-12T00:33:52.422 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:52.422 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:52.422 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:52.422 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:52.422 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket error-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-error-at change_reshard_state --inject-error-code 125 2024-09-12T00:33:52.456 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:52.456 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:52.498 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.501+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.500 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.501+0000 7f461a3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.501+0000 7f461a3a49c0 20 realm 2024-09-12T00:33:52.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.501+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.501+0000 7f461a3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.501+0000 7f461a3a49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:52.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.505+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.505+0000 7f461a3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.505+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.505+0000 7f461a3a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.505+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.505+0000 7f461a3a49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:52.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.505+0000 7f461a3a49c0 20 searching for the correct realm 2024-09-12T00:33:52.508 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.509+0000 7f46186ab640 0 -- 172.21.15.78:0/4150886189 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f4600065410 msgr2=0x7f4600063020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:52.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.517+0000 7f4617eaa640 0 -- 172.21.15.78:0/4150886189 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560fc6ef9530 msgr2=0x560fc6efb9d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:52.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:52.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:52.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:52.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:52.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:52.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:52.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 zone default found 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 4 Realm: () 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 zonegroup default 2024-09-12T00:33:52.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.525+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.529+0000 7f461a3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.529+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.529+0000 7f461a3a49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.529+0000 7f461a3a49c0 20 started sync module instance, tier type = 2024-09-12T00:33:52.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.529+0000 7f461a3a49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:52.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.545+0000 7f461a3a49c0 20 add_watcher() i=0 2024-09-12T00:33:52.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.545+0000 7f461a3a49c0 20 add_watcher() i=1 2024-09-12T00:33:52.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.545+0000 7f461a3a49c0 20 add_watcher() i=2 2024-09-12T00:33:52.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.545+0000 7f461a3a49c0 20 add_watcher() i=3 2024-09-12T00:33:52.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.545+0000 7f461a3a49c0 20 add_watcher() i=4 2024-09-12T00:33:52.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.545+0000 7f461a3a49c0 20 add_watcher() i=5 2024-09-12T00:33:52.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.545+0000 7f461a3a49c0 20 add_watcher() i=6 2024-09-12T00:33:52.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.549+0000 7f461a3a49c0 20 add_watcher() i=7 2024-09-12T00:33:52.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.549+0000 7f461a3a49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:52.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f44cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:52.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:52.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 5 note: GC not initialized 2024-09-12T00:33:52.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f44ccfe1640 20 reqs_thread_entry: start 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 20 Filter name: none 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f44467fc640 20 reqs_thread_entry: start 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 10 cache get: name=default.rgw.meta+root+error-at-change-reshard-state : miss 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 10 cache put: name=default.rgw.meta+root+error-at-change-reshard-state info.flags=0x11 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 10 adding default.rgw.meta+root+error-at-change-reshard-state to cache LRU end 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 : miss 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.553+0000 7f461a3a49c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.557+0000 7f461a3a49c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.557+0000 7f461a3a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 info.flags=0x17 2024-09-12T00:33:52.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.557+0000 7f461a3a49c0 10 adding default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 to cache LRU end 2024-09-12T00:33:52.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.557+0000 7f461a3a49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:52.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.557+0000 7f461a3a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:52.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.557+0000 7f461a3a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 2024-09-12T00:33:52.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 info.flags=0x17 2024-09-12T00:33:52.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 to cache LRU end 2024-09-12T00:33:52.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:52.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38, ofs0, ns] 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f44f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399012 cookie 94625762161408 notifier 7460 bl.length()=931 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f44f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 info.flags=0x17 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f44f6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 to cache LRU end 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f44f6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): orig_sources= new_sources= 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): potential sources added=[] removed=[] 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): orig_dests= new_dests= 2024-09-12T00:33:52.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.565+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): potential dests added=[] removed=[] 2024-09-12T00:33:52.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.0 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.0 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.1 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.1 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.2 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.2 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.3 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.3 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.4 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.4 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.5 2024-09-12T00:33:52.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.5 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.6 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.6 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.7 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.7 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.8 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.8 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.9 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.9 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.10 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.10 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.11 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1.11 2024-09-12T00:33:52.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.0 2024-09-12T00:33:52.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1 2024-09-12T00:33:52.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.2 2024-09-12T00:33:52.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.577+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.3 2024-09-12T00:33:52.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.581+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.4 2024-09-12T00:33:52.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.581+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.5 2024-09-12T00:33:52.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.581+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.6 2024-09-12T00:33:52.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.581+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.7 2024-09-12T00:33:52.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.581+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.8 2024-09-12T00:33:52.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.585+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.9 2024-09-12T00:33:52.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.585+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.10 2024-09-12T00:33:52.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.593+0000 7f461a3a49c0 -1 Injecting error=-125 at location=change_reshard_state 2024-09-12T00:33:52.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.593+0000 7f461a3a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:52.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.593+0000 7f461a3a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 2024-09-12T00:33:52.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.593+0000 7f461a3a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 info.flags=0x17 2024-09-12T00:33:52.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f461a3a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 to cache LRU end 2024-09-12T00:33:52.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f461a3a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:52.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f461a3a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38, ofs0, ns] 2024-09-12T00:33:52.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f44f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399013 cookie 94625762161408 notifier 7460 bl.length()=931 2024-09-12T00:33:52.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f44f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 info.flags=0x17 2024-09-12T00:33:52.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f44f6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 to cache LRU end 2024-09-12T00:33:52.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f44f6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:52.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): orig_sources= new_sources= 2024-09-12T00:33:52.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): potential sources added=[] removed=[] 2024-09-12T00:33:52.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): orig_dests= new_dests= 2024-09-12T00:33:52.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.597+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): potential dests added=[] removed=[] 2024-09-12T00:33:52.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.601+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.0 2024-09-12T00:33:52.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.601+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.1 2024-09-12T00:33:52.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.601+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.2 2024-09-12T00:33:52.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.601+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.3 2024-09-12T00:33:52.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.601+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.4 2024-09-12T00:33:52.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.5 2024-09-12T00:33:52.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.6 2024-09-12T00:33:52.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.7 2024-09-12T00:33:52.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.8 2024-09-12T00:33:52.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.9 2024-09-12T00:33:52.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38.10 2024-09-12T00:33:52.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 : hit (requested=0x17, cached=0x17) 2024-09-12T00:33:52.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.605+0000 7f461a3a49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 info.flags=0x17 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 10 moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 to cache LRU end 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38, ofs0, ns] 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f44f6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399014 cookie 94625762161408 notifier 7460 bl.length()=899 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f44f6ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 info.flags=0x17 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f44f6ffd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.error-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 to cache LRU end 2024-09-12T00:33:52.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f44f6ffd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:52.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): orig_sources= new_sources= 2024-09-12T00:33:52.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): potential sources added=[] removed=[] 2024-09-12T00:33:52.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): orig_dests= new_dests= 2024-09-12T00:33:52.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.609+0000 7f461a3a49c0 20 handle_bi_update(): bucket=:error-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38]): potential dests added=[] removed=[] 2024-09-12T00:33:52.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.613+0000 7f461a3a49c0 1 execute INFO: reshard of bucket "error-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:33:52.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.617+0000 7f44cdfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.621+0000 7f461a3a49c0 20 remove_watcher() i=0 2024-09-12T00:33:52.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.621+0000 7f461a3a49c0 2 removed watcher, disabling cache 2024-09-12T00:33:52.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.625+0000 7f461a3a49c0 20 remove_watcher() i=1 2024-09-12T00:33:52.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.625+0000 7f461a3a49c0 20 remove_watcher() i=2 2024-09-12T00:33:52.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.629+0000 7f461a3a49c0 20 remove_watcher() i=3 2024-09-12T00:33:52.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.629+0000 7f461a3a49c0 20 remove_watcher() i=4 2024-09-12T00:33:52.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.633+0000 7f461a3a49c0 20 remove_watcher() i=5 2024-09-12T00:33:52.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.633+0000 7f461a3a49c0 20 remove_watcher() i=6 2024-09-12T00:33:52.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.637+0000 7f461a3a49c0 20 remove_watcher() i=7 2024-09-12T00:33:52.649 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket error-at-change-reshard-state 2024-09-12T00:33:52.678 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:52.678 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:52.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.721+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 realm 2024-09-12T00:33:52.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:52.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.725+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.729+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:52.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.729+0000 7fab6b8cf9c0 20 searching for the correct realm 2024-09-12T00:33:52.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.733+0000 7fab68bd4640 0 -- 172.21.15.78:0/4127256146 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fab5c124b40 msgr2=0x7fab5c101fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:33:52.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.741+0000 7fab68bd4640 0 -- 172.21.15.78:0/4127256146 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fab5c101fd0 msgr2=0x7fab5c11c000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.745+0000 7fab6b8cf9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.745+0000 7fab6b8cf9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.745+0000 7fab6b8cf9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.745+0000 7fab6b8cf9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.745+0000 7fab6b8cf9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.745+0000 7fab6b8cf9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:52.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.745+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:52.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:52.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 zone default found 2024-09-12T00:33:52.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 4 Realm: () 2024-09-12T00:33:52.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:52.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 zonegroup default 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:52.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 started sync module instance, tier type = 2024-09-12T00:33:52.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.749+0000 7fab6b8cf9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:52.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=0 2024-09-12T00:33:52.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=1 2024-09-12T00:33:52.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=2 2024-09-12T00:33:52.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=3 2024-09-12T00:33:52.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=4 2024-09-12T00:33:52.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=5 2024-09-12T00:33:52.766 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=6 2024-09-12T00:33:52.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 20 add_watcher() i=7 2024-09-12T00:33:52.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.769+0000 7fab6b8cf9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:52.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7faa1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:52.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:52.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 5 note: GC not initialized 2024-09-12T00:33:52.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7faa1e7e4640 20 reqs_thread_entry: start 2024-09-12T00:33:52.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:52.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 20 Filter name: none 2024-09-12T00:33:52.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fa98ffff640 20 reqs_thread_entry: start 2024-09-12T00:33:52.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.773+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.777+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.777+0000 7fab6b8cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.777+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.777+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.777+0000 7fab6b8cf9c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.777+0000 7fab6b8cf9c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:52.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.777+0000 7fab6b8cf9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:52.777 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.781+0000 7faa1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:52.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.785+0000 7fab6b8cf9c0 20 remove_watcher() i=0 2024-09-12T00:33:52.781 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.785+0000 7fab6b8cf9c0 2 removed watcher, disabling cache 2024-09-12T00:33:52.783 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.785+0000 7fab6b8cf9c0 20 remove_watcher() i=1 2024-09-12T00:33:52.785 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.785+0000 7fab6b8cf9c0 20 remove_watcher() i=2 2024-09-12T00:33:52.787 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.789+0000 7fab6b8cf9c0 20 remove_watcher() i=3 2024-09-12T00:33:52.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.789+0000 7fab6b8cf9c0 20 remove_watcher() i=4 2024-09-12T00:33:52.791 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.793+0000 7fab6b8cf9c0 20 remove_watcher() i=5 2024-09-12T00:33:52.794 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.797+0000 7fab6b8cf9c0 20 remove_watcher() i=6 2024-09-12T00:33:52.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:52.797+0000 7fab6b8cf9c0 20 remove_watcher() i=7 2024-09-12T00:33:52.810 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:52.810 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:52.810 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: error-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.38 num_objects: 20 size_kb: 1 num_shards: 12 2024-09-12T00:33:52.810 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:52.907 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: reshard bucket with abort at change_reshard_state 2024-09-12T00:33:52.907 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:53.318 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:33:53.351 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:53.351 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:53.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.397+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:53.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 realm 2024-09-12T00:33:53.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:53.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:53.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:53.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:53.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.401+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.405+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:53.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.405+0000 7fd765d289c0 20 searching for the correct realm 2024-09-12T00:33:53.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.409+0000 7fd76402f640 0 -- 172.21.15.78:0/396778179 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fd754107b20 msgr2=0x7fd7540fd1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:53.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.625+0000 7fd76382e640 0 -- 172.21.15.78:0/396778179 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x56290ffb40a0 msgr2=0x56290ffb6560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:53.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 zone default found 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 4 Realm: () 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 zonegroup default 2024-09-12T00:33:53.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.637+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.641+0000 7fd765d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:53.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.641+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.641+0000 7fd765d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:53.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.641+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.641+0000 7fd765d289c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:53.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.641+0000 7fd765d289c0 20 started sync module instance, tier type = 2024-09-12T00:33:53.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.641+0000 7fd765d289c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:53.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=0 2024-09-12T00:33:53.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=1 2024-09-12T00:33:53.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=2 2024-09-12T00:33:53.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=3 2024-09-12T00:33:53.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=4 2024-09-12T00:33:53.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=5 2024-09-12T00:33:53.662 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=6 2024-09-12T00:33:53.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 20 add_watcher() i=7 2024-09-12T00:33:53.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.665+0000 7fd765d289c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:53.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.669+0000 7fd619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:53.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.669+0000 7fd765d289c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:53.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.669+0000 7fd765d289c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:53.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.669+0000 7fd765d289c0 5 note: GC not initialized 2024-09-12T00:33:53.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd618fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:53.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:53.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 Filter name: none 2024-09-12T00:33:53.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd5927fc640 20 reqs_thread_entry: start 2024-09-12T00:33:53.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:53.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:53.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:53.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.673+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.677+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:53.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.677+0000 7fd765d289c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:53.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.677+0000 7fd765d289c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:53.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.677+0000 7fd765d289c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:53.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.681+0000 7fd619fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:53.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.685+0000 7fd765d289c0 20 remove_watcher() i=0 2024-09-12T00:33:53.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.685+0000 7fd765d289c0 2 removed watcher, disabling cache 2024-09-12T00:33:53.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.685+0000 7fd765d289c0 20 remove_watcher() i=1 2024-09-12T00:33:53.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.689+0000 7fd765d289c0 20 remove_watcher() i=2 2024-09-12T00:33:53.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.689+0000 7fd765d289c0 20 remove_watcher() i=3 2024-09-12T00:33:53.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.693+0000 7fd765d289c0 20 remove_watcher() i=4 2024-09-12T00:33:53.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.693+0000 7fd765d289c0 20 remove_watcher() i=5 2024-09-12T00:33:53.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.697+0000 7fd765d289c0 20 remove_watcher() i=6 2024-09-12T00:33:53.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:53.701+0000 7fd765d289c0 20 remove_watcher() i=7 2024-09-12T00:33:53.717 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:53.717 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:53.717 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:53.717 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:53.717 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:33:53.756 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:53.756 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:54.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.421+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 realm 2024-09-12T00:33:54.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:54.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.429+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:54.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.429+0000 7f5e522639c0 20 searching for the correct realm 2024-09-12T00:33:54.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.429+0000 7f5e4fd69640 0 -- 172.21.15.78:0/4202249150 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x564eece673a0 msgr2=0x564eece69860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:54.642 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.645+0000 7f5e5056a640 0 -- 172.21.15.78:0/4202249150 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x564eece5abd0 msgr2=0x564eece5d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:54.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:54.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:54.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:54.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:54.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:54.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:54.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 zone default found 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 4 Realm: () 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 zonegroup default 2024-09-12T00:33:54.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 started sync module instance, tier type = 2024-09-12T00:33:54.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.669+0000 7f5e522639c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=0 2024-09-12T00:33:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=1 2024-09-12T00:33:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=2 2024-09-12T00:33:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=3 2024-09-12T00:33:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=4 2024-09-12T00:33:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=5 2024-09-12T00:33:54.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=6 2024-09-12T00:33:54.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.697+0000 7f5e522639c0 20 add_watcher() i=7 2024-09-12T00:33:54.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.697+0000 7f5e522639c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:54.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5d05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5e522639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5e522639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5e522639c0 5 note: GC not initialized 2024-09-12T00:33:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5d04fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:54.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5e522639c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:54.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5e522639c0 20 Filter name: none 2024-09-12T00:33:54.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.701+0000 7f5c7e7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:54.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:33:54.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:54.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:33:54.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:33:54.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 : miss 2024-09-12T00:33:54.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:54.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:54.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.705+0000 7f5e522639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 2024-09-12T00:33:54.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39, ofs0, ns] 2024-09-12T00:33:54.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94896981918400 notifier 8040 bl.length()=931 2024-09-12T00:33:54.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_sources= new_sources= 2024-09-12T00:33:54.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential sources added=[] removed=[] 2024-09-12T00:33:54.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_dests= new_dests= 2024-09-12T00:33:54.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential dests added=[] removed=[] 2024-09-12T00:33:54.727 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.0 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.0 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.1 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.1 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.2 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.2 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.3 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.3 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.4 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.4 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.5 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.5 2024-09-12T00:33:54.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.6 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.6 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.7 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.7 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.8 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.8 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.9 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.9 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.10 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.10 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.11 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.11 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.0 2024-09-12T00:33:54.729 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1 2024-09-12T00:33:54.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2 2024-09-12T00:33:54.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.733+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.3 2024-09-12T00:33:54.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.733+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.4 2024-09-12T00:33:54.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.5 2024-09-12T00:33:54.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.6 2024-09-12T00:33:54.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.7 2024-09-12T00:33:54.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.8 2024-09-12T00:33:54.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.9 2024-09-12T00:33:54.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.741+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.10 2024-09-12T00:33:54.744 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5e522639c0 time 2024-09-12T00:33:54.749106+0000 2024-09-12T00:33:54.744 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:54.745 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.745 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5e55b3d2eb] 2024-09-12T00:33:54.745 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.745 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5e522639c0 thread_name:radosgw-admin 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.749+0000 7f5e522639c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5e522639c0 time 2024-09-12T00:33:54.749106+0000 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.746 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5e55b3d2eb] 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:54.747 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.764 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.764 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5e549bc520] 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5e55b3d345] 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:54.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.749+0000 7f5e522639c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5e522639c0 thread_name:radosgw-admin 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5e549bc520] 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5e55b3d345] 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.766 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.767 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:33:53.785+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:33:53.785+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key hook 0x564eecd6e558 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eecd711e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eecd9ca10 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x7f5e38002350 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.768 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.120817s 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eecd9ca10 auth_method 0 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eecd711e0 auth_method 0 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.769 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x7f5e38002350 auth_method 0 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_done global_id 7499 payload 824 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:33:53.785+0000 7f5e4f568640 1 monclient: found mon.noname-c 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.770 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: dump: 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.771 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: dump: 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.772 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:33:53.785+0000 7f5d3de0b640 4 set_mon_vals no callback set 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 monclient: authenticate success, global_id 7499 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:33:53.785+0000 7f5e522639c0 1 librados: init done 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:33:53.789+0000 7f5d37fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:33:53.789+0000 7f5d37fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:33:53.789+0000 7f5d37fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:33:53.789+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x7f5d38070b10 auth_method 0 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:33:53.789+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdaf6a0 auth_method 0 2024-09-12T00:33:54.773 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:33:53.993+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdaf6a0 auth_method 0 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:33:54.397+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdaf6a0 auth_method 0 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:33:54.397+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x564eecdb90f0 auth_method 0 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:33:54.401+0000 7f5e4f568640 10 monclient: get_auth_request con 0x564eecdbd490 auth_method 0 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:33:54.405+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdbc9a0 auth_method 0 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:33:54.405+0000 7f5e522639c0 10 monclient: build_initial_monmap 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:33:54.405+0000 7f5e522639c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:33:54.405+0000 7f5e522639c0 10 monclient: monmap: 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:54.774 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding auth protocol: cephx 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding auth protocol: cephx 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding auth protocol: cephx 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.775 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:33:54.405+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command objecter_requests cmddesc objecter_requests hook 0x564eecdc9010 EEXIST 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:33:54.405+0000 7f5e522639c0 10 monclient: init 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding auth protocol: cephx 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding auth protocol: cephx 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding auth protocol: cephx 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.776 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:33:54.409+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.777 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:33:54.409+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:33:54.409+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key cmddesc rotate-key hook 0x564eecdc4670 EEXIST 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eecded1c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eecdecaf0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x564eecdeb4d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.745041s 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eecded1c0 auth_method 0 2024-09-12T00:33:54.778 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x564eecdecaf0 auth_method 0 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eecdeb4d0 auth_method 0 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.779 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_done global_id 7502 payload 824 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:33:54.409+0000 7f5e4f568640 1 monclient: found mon.noname-c 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: dump: 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.780 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:33:54.409+0000 7f5e522639c0 5 monclient: authenticate success, global_id 7502 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: dump: 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.781 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:33:54.409+0000 7f5e50d6b640 4 set_mon_vals no callback set 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:33:54.413+0000 7f5d357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:33:54.413+0000 7f5d357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.782 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:33:54.413+0000 7f5d357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient: get_auth_request con 0x7f5d28070a20 auth_method 0 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: get_monmap_and_config 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: build_initial_monmap 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:33:54.413+0000 7f5e522639c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: monmap: 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:54.783 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding auth protocol: cephx 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding auth protocol: cephx 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding auth protocol: cephx 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.784 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:33:54.413+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: init 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding auth protocol: cephx 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding auth protocol: cephx 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding auth protocol: cephx 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.785 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:33:54.413+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:33:54.413+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1fe067e8 EEXIST 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x564eece40a00 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eece3bdf0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eece3c770 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.786 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.751395s 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x564eece3bdf0 auth_method 0 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eece3c770 auth_method 0 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.787 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eece40a00 auth_method 0 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_done global_id 7505 payload 274 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.788 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:33:54.417+0000 7f5e5056a640 1 monclient: found mon.noname-c 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: dump: 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.789 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: dump: 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.790 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 monclient: authenticate success, global_id 7505 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: get_monmap_and_config success 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:33:54.417+0000 7f5e522639c0 4 set_mon_vals no callback set 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: shutdown 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: build_initial_monmap 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: monmap: 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:54.791 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding auth protocol: cephx 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding auth protocol: cephx 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding auth protocol: cephx 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.792 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:33:54.417+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: starting msgr at 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: starting objecter 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command objecter_requests cmddesc objecter_requests hook 0x564eece3a390 EEXIST 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: setting wanted keys 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: calling monclient init 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: init 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding auth protocol: cephx 2024-09-12T00:33:54.793 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding auth protocol: cephx 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding auth protocol: cephx 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.794 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:33:54.417+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:33:54.417+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key cmddesc rotate-key hook 0x564eecdef128 EEXIST 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x564eece3bdf0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eece3c770 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eece40a00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.755020s 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x564eece3c770 auth_method 0 2024-09-12T00:33:54.795 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eece40a00 auth_method 0 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eece3bdf0 auth_method 0 2024-09-12T00:33:54.796 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_done global_id 8040 payload 824 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 1 monclient: found mon.noname-a 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: dump: 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.797 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:33:54.421+0000 7f5e522639c0 5 monclient: authenticate success, global_id 8040 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.798 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: dump: 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:33:54.421+0000 7f5d2effd640 4 set_mon_vals no callback set 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.799 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:33:54.421+0000 7f5e522639c0 1 librados: init done 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:33:54.421+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cr dump hook 0x564eece3b228 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:33:54.421+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:33:54.421+0000 7f5e4f568640 10 monclient: get_auth_request con 0x7f5d18070ae0 auth_method 0 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:33:54.421+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eece5abd0 auth_method 0 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 realm 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:33:54.425+0000 7f5e522639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:54.800 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:33:54.425+0000 7f5e4f568640 10 monclient: get_auth_request con 0x564eece5ee40 auth_method 0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:33:54.425+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eece626a0 auth_method 0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:33:54.429+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:33:54.429+0000 7f5e522639c0 20 searching for the correct realm 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:33:54.429+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x564eece673a0 auth_method 0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:33:54.429+0000 7f5e4fd69640 0 -- 172.21.15.78:0/4202249150 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x564eece673a0 msgr2=0x564eece69860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:33:54.633+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x564eece673a0 auth_method 0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:33:54.633+0000 7f5e4f568640 10 monclient: get_auth_request con 0x7f5e400fefc0 auth_method 0 2024-09-12T00:33:54.801 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:33:54.641+0000 7f5e5056a640 10 monclient: get_auth_request con 0x7f5e40107b60 auth_method 0 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:33:54.645+0000 7f5e5056a640 0 -- 172.21.15.78:0/4202249150 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x564eece5abd0 msgr2=0x564eece5d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:33:54.645+0000 7f5d2d7fa640 1 client.8040.objecter ms_handle_reset 0x564eece5abd0 session 0x564eece5a4c0 osd.6 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:33:54.645+0000 7f5d2d7fa640 10 monclient: _renew_subs 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:33:54.645+0000 7f5d2d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:33:54.645+0000 7f5e5056a640 10 monclient: get_auth_request con 0x7f5d18080d10 auth_method 0 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:33:54.649+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x7f5e44089f30 auth_method 0 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:33:54.649+0000 7f5e4f568640 10 monclient: get_auth_request con 0x7f5e40104760 auth_method 0 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:54.802 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 zone default found 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:33:54.669+0000 7f5e522639c0 4 Realm: () 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:33:54.669+0000 7f5e522639c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:33:54.669+0000 7f5e522639c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:33:54.669+0000 7f5e522639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 zonegroup default 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.803 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 started sync module instance, tier type = 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=0 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=1 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=2 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=3 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=4 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=5 2024-09-12T00:33:54.804 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=6 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:33:54.697+0000 7f5e522639c0 20 add_watcher() i=7 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:33:54.697+0000 7f5e522639c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding auth protocol: cephx 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding auth protocol: cephx 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding auth protocol: cephx 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:33:54.701+0000 7f5d05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.805 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:33:54.701+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache list hook 0x564eece393d0 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache inspect hook 0x564eece393d0 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache erase hook 0x564eece393d0 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache zap hook 0x564eece393d0 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 note: GC not initialized 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:33:54.701+0000 7f5d04fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:54.806 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace show hook 0x7f5e44001030 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace history hook 0x7f5e44001030 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace active hook 0x7f5e44001030 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace active_short hook 0x7f5e44001030 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 Filter name: none 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:33:54.701+0000 7f5c7e7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 : miss 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.807 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39, ofs0, ns] 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94896981918400 notifier 8040 bl.length()=931 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.808 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_sources= new_sources= 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential sources added=[] removed=[] 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_dests= new_dests= 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential dests added=[] removed=[] 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.0 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.0 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.1 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.1 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.2 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.2 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.3 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.3 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.4 2024-09-12T00:33:54.809 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.4 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.5 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.5 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.6 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.6 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.7 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.7 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.8 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.8 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.9 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.9 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.10 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.10 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.11 2024-09-12T00:33:54.810 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.11 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.0 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:33:54.733+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.3 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:33:54.733+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.4 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.5 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.6 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.7 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.8 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.9 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:33:54.741+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.10 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:33:54.749+0000 7f5e522639c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5e522639c0 time 2024-09-12T00:33:54.749106+0000 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:54.811 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5e55b3d2eb] 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:33:54.749+0000 7f5e522639c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:54.812 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5e522639c0 thread_name:radosgw-admin 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5e549bc520] 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5e55b3d345] 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.813 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:33:54.814 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:54.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:33:54.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:33:54.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:33:54.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:54.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:54.820 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c7e7fc640 / http_manager 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d04fe1640 / http_manager 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d05fe3640 / rgw_dt_lg_renew 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d2d7fa640 / ms_dispatch 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d2effd640 / io_context_pool 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d357fa640 / ms_dispatch 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d37fff640 / ms_dispatch 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d3de0b640 / io_context_pool 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e4f568640 / msgr-worker-2 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e4fd69640 / msgr-worker-1 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e5056a640 / msgr-worker-0 2024-09-12T00:33:54.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e50d6b640 / io_context_pool 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e522639c0 / radosgw-admin 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.133538.log 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.822 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: crc 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 AuthRegistry(0x564eecd6e410) adding con mode: secure 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:33:53.785+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:33:53.785+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key hook 0x564eecd6e558 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eecd711e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eecd9ca10 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x7f5e38002350 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.823 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.120817s 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eecd9ca10 auth_method 0 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eecd711e0 auth_method 0 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.824 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:33:53.785+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x7f5e38002350 auth_method 0 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:33:53.785+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient(hunting): handle_auth_done global_id 7499 payload 824 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:33:53.785+0000 7f5e4f568640 1 monclient: found mon.noname-c 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:33:53.785+0000 7f5e4f568640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.825 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: dump: 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.826 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:33:53.785+0000 7f5d37fff640 10 monclient: dump: 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.827 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:33:53.785+0000 7f5d3de0b640 4 set_mon_vals no callback set 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:33:53.785+0000 7f5e522639c0 5 monclient: authenticate success, global_id 7499 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:33:53.785+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:33:53.785+0000 7f5e522639c0 1 librados: init done 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:33:53.789+0000 7f5d37fff640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:33:53.789+0000 7f5d37fff640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:33:53.789+0000 7f5d37fff640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:33:53.789+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x7f5d38070b10 auth_method 0 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:33:53.789+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdaf6a0 auth_method 0 2024-09-12T00:33:54.828 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:33:53.993+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdaf6a0 auth_method 0 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:33:54.397+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdaf6a0 auth_method 0 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:33:54.397+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x564eecdb90f0 auth_method 0 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:33:54.401+0000 7f5e4f568640 10 monclient: get_auth_request con 0x564eecdbd490 auth_method 0 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:33:54.405+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eecdbc9a0 auth_method 0 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:33:54.405+0000 7f5e522639c0 10 monclient: build_initial_monmap 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:33:54.405+0000 7f5e522639c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:33:54.405+0000 7f5e522639c0 10 monclient: monmap: 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.829 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding auth protocol: cephx 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding auth protocol: cephx 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding auth protocol: cephx 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.830 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: crc 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc56d0) adding con mode: secure 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:33:54.405+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command objecter_requests cmddesc objecter_requests hook 0x564eecdc9010 EEXIST 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:33:54.405+0000 7f5e522639c0 10 monclient: init 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding auth protocol: cephx 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding auth protocol: cephx 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding auth protocol: cephx 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.831 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: crc 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:33:54.405+0000 7f5e522639c0 5 AuthRegistry(0x564eecdc4528) adding con mode: secure 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:33:54.409+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:33:54.409+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:33:54.409+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key cmddesc rotate-key hook 0x564eecdc4670 EEXIST 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.832 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _add_conns ranks=[2,0,1] 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eecded1c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eecdecaf0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x564eecdeb4d0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.745041s 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eecded1c0 auth_method 0 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.833 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x564eecdecaf0 auth_method 0 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:33:54.409+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eecdeb4d0 auth_method 0 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:33:54.409+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient(hunting): handle_auth_done global_id 7502 payload 824 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:33:54.409+0000 7f5e4f568640 1 monclient: found mon.noname-c 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:33:54.409+0000 7f5e4f568640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.834 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: dump: 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.835 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:33:54.409+0000 7f5e522639c0 5 monclient: authenticate success, global_id 7502 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:33:54.409+0000 7f5d357fa640 10 monclient: dump: 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.836 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:33:54.409+0000 7f5e50d6b640 4 set_mon_vals no callback set 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:33:54.409+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:33:54.413+0000 7f5d357fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:33:54.413+0000 7f5d357fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:33:54.413+0000 7f5d357fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient: get_auth_request con 0x7f5d28070a20 auth_method 0 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: get_monmap_and_config 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: build_initial_monmap 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:33:54.413+0000 7f5e522639c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:54.837 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: monmap: 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding auth protocol: cephx 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding auth protocol: cephx 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding auth protocol: cephx 2024-09-12T00:33:54.838 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: crc 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x564eece0c590) adding con mode: secure 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:33:54.413+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: init 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding auth protocol: cephx 2024-09-12T00:33:54.839 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding auth protocol: cephx 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding auth protocol: cephx 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: crc 2024-09-12T00:33:54.840 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe066a0) adding con mode: secure 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:33:54.413+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:33:54.413+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:33:54.413+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key cmddesc rotate-key hook 0x7fff1fe067e8 EEXIST 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x564eece40a00 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eece3bdf0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eece3c770 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.841 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:33:54.413+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.751395s 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x564eece3bdf0 auth_method 0 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eece3c770 auth_method 0 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eece40a00 auth_method 0 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.842 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:33:54.413+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:33:54.413+0000 7f5e4f568640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:33:54.413+0000 7f5e5056a640 10 monclient(hunting): handle_auth_done global_id 7505 payload 274 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:33:54.417+0000 7f5e5056a640 1 monclient: found mon.noname-c 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: dump: 2024-09-12T00:33:54.843 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.844 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:33:54.417+0000 7f5d2effd640 10 monclient: dump: 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 monclient: authenticate success, global_id 7505 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: get_monmap_and_config success 2024-09-12T00:33:54.845 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:33:54.417+0000 7f5e522639c0 4 set_mon_vals no callback set 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: shutdown 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: build_initial_monmap 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 build_initial for_mkfs: 0 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: monmap: 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:33:54.846 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding auth protocol: cephx 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding auth protocol: cephx 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding auth protocol: cephx 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.847 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: crc 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eece33040) adding con mode: secure 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:33:54.417+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: starting msgr at 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: starting objecter 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command objecter_requests cmddesc objecter_requests hook 0x564eece3a390 EEXIST 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: setting wanted keys 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:33:54.417+0000 7f5e522639c0 1 librados: calling monclient init 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: init 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding auth protocol: cephx 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding auth protocol: cephx 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding auth protocol: cephx 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.848 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: crc 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 AuthRegistry(0x564eecdeefe0) adding con mode: secure 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:33:54.417+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:33:54.417+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:33:54.417+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command rotate-key cmddesc rotate-key hook 0x564eecdef128 EEXIST 2024-09-12T00:33:54.849 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: _reopen_session rank -1 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-b con 0x564eece3bdf0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-c con 0x564eece3c770 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): picked mon.noname-a con 0x564eece40a00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): _renew_subs 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:33:54.417+0000 7f5e522639c0 10 monclient(hunting): authenticate will time out at 2358.755020s 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): get_auth_request con 0x564eece3c770 auth_method 0 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request con 0x564eece40a00 auth_method 0 2024-09-12T00:33:54.850 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:33:54.417+0000 7f5e5056a640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): get_auth_request con 0x564eece3bdf0 auth_method 0 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:33:54.417+0000 7f5e4f568640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient(hunting): handle_auth_done global_id 8040 payload 824 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient: _finish_hunting 0 2024-09-12T00:33:54.851 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 1 monclient: found mon.noname-a 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:33:54.417+0000 7f5e4fd69640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: dump: 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.852 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:33:54.421+0000 7f5e522639c0 5 monclient: authenticate success, global_id 8040 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 10 monclient: dump: 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.853 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:33:54.421+0000 7f5d2effd640 4 set_mon_vals no callback set 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _renew_subs 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:33:54.421+0000 7f5e522639c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:33:54.421+0000 7f5e522639c0 1 librados: init done 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:33:54.421+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cr dump hook 0x564eece3b228 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:33:54.421+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:33:54.854 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:33:54.421+0000 7f5d2d7fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:33:54.421+0000 7f5e4f568640 10 monclient: get_auth_request con 0x7f5d18070ae0 auth_method 0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:33:54.421+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eece5abd0 auth_method 0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 realm 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:33:54.425+0000 7f5e522639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:33:54.425+0000 7f5e4f568640 10 monclient: get_auth_request con 0x564eece5ee40 auth_method 0 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.855 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:33:54.425+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:33:54.425+0000 7f5e5056a640 10 monclient: get_auth_request con 0x564eece626a0 auth_method 0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:33:54.429+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:33:54.429+0000 7f5e522639c0 20 searching for the correct realm 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:33:54.429+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x564eece673a0 auth_method 0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:33:54.429+0000 7f5e4fd69640 0 -- 172.21.15.78:0/4202249150 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x564eece673a0 msgr2=0x564eece69860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:33:54.633+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x564eece673a0 auth_method 0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:33:54.633+0000 7f5e4f568640 10 monclient: get_auth_request con 0x7f5e400fefc0 auth_method 0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:33:54.641+0000 7f5e5056a640 10 monclient: get_auth_request con 0x7f5e40107b60 auth_method 0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:33:54.645+0000 7f5e5056a640 0 -- 172.21.15.78:0/4202249150 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x564eece5abd0 msgr2=0x564eece5d090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:33:54.645+0000 7f5d2d7fa640 1 client.8040.objecter ms_handle_reset 0x564eece5abd0 session 0x564eece5a4c0 osd.6 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:33:54.645+0000 7f5d2d7fa640 10 monclient: _renew_subs 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:33:54.645+0000 7f5d2d7fa640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:33:54.645+0000 7f5e5056a640 10 monclient: get_auth_request con 0x7f5d18080d10 auth_method 0 2024-09-12T00:33:54.856 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:33:54.649+0000 7f5e4fd69640 10 monclient: get_auth_request con 0x7f5e44089f30 auth_method 0 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:33:54.649+0000 7f5e4f568640 10 monclient: get_auth_request con 0x7f5e40104760 auth_method 0 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:33:54.665+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 zone default found 2024-09-12T00:33:54.857 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:33:54.669+0000 7f5e522639c0 4 Realm: () 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:33:54.669+0000 7f5e522639c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:33:54.669+0000 7f5e522639c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:33:54.669+0000 7f5e522639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 zonegroup default 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 started sync module instance, tier type = 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:33:54.669+0000 7f5e522639c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=0 2024-09-12T00:33:54.858 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=1 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=2 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=3 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=4 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=5 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:33:54.693+0000 7f5e522639c0 20 add_watcher() i=6 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:33:54.697+0000 7f5e522639c0 20 add_watcher() i=7 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:33:54.697+0000 7f5e522639c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding auth protocol: cephx 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding auth protocol: cephx 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding auth protocol: cephx 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.859 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:33:54.701+0000 7f5d05fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: crc 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 AuthRegistry(0x7fff1fe06b80) adding con mode: secure 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:33:54.701+0000 7f5e522639c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:54.860 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache list hook 0x564eece393d0 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache inspect hook 0x564eece393d0 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache erase hook 0x564eece393d0 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command cache zap hook 0x564eece393d0 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 note: GC not initialized 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:33:54.701+0000 7f5d04fe1640 20 reqs_thread_entry: start 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace show hook 0x7f5e44001030 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace history hook 0x7f5e44001030 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace active hook 0x7f5e44001030 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:33:54.701+0000 7f5e522639c0 5 asok(0x564eecb632b0) register_command sync trace active_short hook 0x7f5e44001030 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:33:54.701+0000 7f5e522639c0 20 Filter name: none 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:33:54.701+0000 7f5c7e7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:33:54.861 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.862 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:54.862 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:33:54.862 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:33:54.862 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 : miss 2024-09-12T00:33:54.862 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.862 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:33:54.705+0000 7f5e522639c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:33:54.705+0000 7f5e522639c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.864 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:33:54.717+0000 7f5e522639c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39, ofs0, ns] 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398879 cookie 94896981918400 notifier 8040 bl.length()=931 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:33:54.717+0000 7f5d2effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_sources= new_sources= 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential sources added=[] removed=[] 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_dests= new_dests= 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:33:54.717+0000 7f5e522639c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential dests added=[] removed=[] 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.0 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.0 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.1 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.1 2024-09-12T00:33:54.865 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.2 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.2 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.3 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.3 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.4 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.4 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.5 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.5 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.6 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.6 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.7 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.7 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.8 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.8 2024-09-12T00:33:54.866 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.9 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.9 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.10 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.10 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:33:54.729+0000 7f5e522639c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.11 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1.11 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.0 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:33:54.729+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:33:54.733+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.3 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:33:54.733+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.4 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.5 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.6 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.7 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.8 2024-09-12T00:33:54.867 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:33:54.737+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.9 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:33:54.741+0000 7f5e522639c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.10 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:33:54.749+0000 7f5e522639c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f5e522639c0 time 2024-09-12T00:33:54.749106+0000 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f5e55b3d2eb] 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.868 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:33:54.749+0000 7f5e522639c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f5e522639c0 thread_name:radosgw-admin 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f5e549bc520] 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f5e55b3d345] 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f5e55b3d49f] 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x564eeb855cc1] 2024-09-12T00:33:54.869 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x564eeb86a01c] 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x564eeb86b6a4] 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5e549a3d90] 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:33:54.870 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:33:54.871 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:33:54.872 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:33:54.873 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:33:54.874 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:33:54.875 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:33:54.876 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5c7e7fc640 / http_manager 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d04fe1640 / http_manager 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d05fe3640 / rgw_dt_lg_renew 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d2d7fa640 / ms_dispatch 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d2effd640 / io_context_pool 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d357fa640 / ms_dispatch 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d37fff640 / ms_dispatch 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5d3de0b640 / io_context_pool 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e4f568640 / msgr-worker-2 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e4fd69640 / msgr-worker-1 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e5056a640 / msgr-worker-0 2024-09-12T00:33:54.877 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e50d6b640 / io_context_pool 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi078.stderr: 7f5e522639c0 / radosgw-admin 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:33:54.751505Z_386e02f0-cc3c-4bcd-8154-3c8f6d13898a/log 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:33:54.878 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:33:54.879 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:54.879 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.837+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.837+0000 7f4e9cbe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.837+0000 7f4e9cbe79c0 20 realm 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.837+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:54.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.841+0000 7f4e9cbe79c0 20 searching for the correct realm 2024-09-12T00:33:54.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:54.845+0000 7f4e9aeee640 0 -- 172.21.15.78:0/1355343373 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f4e8c0e1920 msgr2=0x7f4e8c0e03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.061+0000 7f4e9a6ed640 0 -- 172.21.15.78:0/1355343373 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5604d84973c0 msgr2=0x5604d8499840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:55.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.073+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 zone default found 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 4 Realm: () 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 zonegroup default 2024-09-12T00:33:55.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.075 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 started sync module instance, tier type = 2024-09-12T00:33:55.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.077+0000 7f4e9cbe79c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:55.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.101+0000 7f4e9cbe79c0 20 add_watcher() i=0 2024-09-12T00:33:55.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.101+0000 7f4e9cbe79c0 20 add_watcher() i=1 2024-09-12T00:33:55.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.101+0000 7f4e9cbe79c0 20 add_watcher() i=2 2024-09-12T00:33:55.100 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.101+0000 7f4e9cbe79c0 20 add_watcher() i=3 2024-09-12T00:33:55.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.101+0000 7f4e9cbe79c0 20 add_watcher() i=4 2024-09-12T00:33:55.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.101+0000 7f4e9cbe79c0 20 add_watcher() i=5 2024-09-12T00:33:55.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.101+0000 7f4e9cbe79c0 20 add_watcher() i=6 2024-09-12T00:33:55.102 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.105+0000 7f4e9cbe79c0 20 add_watcher() i=7 2024-09-12T00:33:55.103 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.105+0000 7f4e9cbe79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:55.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4d50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4e9cbe79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:55.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4e9cbe79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:55.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4e9cbe79c0 5 note: GC not initialized 2024-09-12T00:33:55.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4ccb7fe640 20 reqs_thread_entry: start 2024-09-12T00:33:55.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4e9cbe79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:55.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4e9cbe79c0 20 Filter name: none 2024-09-12T00:33:55.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4cc97fa640 20 reqs_thread_entry: start 2024-09-12T00:33:55.109 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.109+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.113+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:55.110 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.113+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.113+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:33:55.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.113+0000 7f4e9cbe79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:55.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.113+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.113+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:55.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.113+0000 7f4e9cbe79c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.117+0000 7f4e9cbe79c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:33:55.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.117+0000 7f4e9cbe79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:33:55.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.121+0000 7f4d50fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.121 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.125+0000 7f4e9cbe79c0 20 remove_watcher() i=0 2024-09-12T00:33:55.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.125+0000 7f4e9cbe79c0 2 removed watcher, disabling cache 2024-09-12T00:33:55.124 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.125+0000 7f4e9cbe79c0 20 remove_watcher() i=1 2024-09-12T00:33:55.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.129+0000 7f4e9cbe79c0 20 remove_watcher() i=2 2024-09-12T00:33:55.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.129+0000 7f4e9cbe79c0 20 remove_watcher() i=3 2024-09-12T00:33:55.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.133+0000 7f4e9cbe79c0 20 remove_watcher() i=4 2024-09-12T00:33:55.132 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.133+0000 7f4e9cbe79c0 20 remove_watcher() i=5 2024-09-12T00:33:55.135 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.137+0000 7f4e9cbe79c0 20 remove_watcher() i=6 2024-09-12T00:33:55.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.141+0000 7f4e9cbe79c0 20 remove_watcher() i=7 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:55.152 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:33:55.153 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 num_objects: 20 size_kb: 1 num_shards: 11 2024-09-12T00:33:55.153 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:33:55.210 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:33:55.247 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:33:55.247 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:33:55.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.293+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 realm 2024-09-12T00:33:55.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:33:55.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.295 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:55.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:33:55.297 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.297+0000 7fd90c0219c0 20 searching for the correct realm 2024-09-12T00:33:55.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.305+0000 7fd90a328640 0 -- 172.21.15.78:0/4231869062 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fd8fc0cb030 msgr2=0x7fd8fc0d0030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.521+0000 7fd909b27640 0 -- 172.21.15.78:0/4231869062 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5626323f1790 msgr2=0x5626323f3bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:33:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.529+0000 7fd90c0219c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:33:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.529+0000 7fd90c0219c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:33:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.529+0000 7fd90c0219c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:33:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.529+0000 7fd90c0219c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:33:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.529+0000 7fd90c0219c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:33:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.529+0000 7fd90c0219c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:33:55.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.529+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:33:55.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:33:55.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 zone default found 2024-09-12T00:33:55.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 4 Realm: () 2024-09-12T00:33:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:33:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:33:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:33:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 zonegroup default 2024-09-12T00:33:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.533+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.537+0000 7fd90c0219c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:33:55.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.537+0000 7fd90c0219c0 20 started sync module instance, tier type = 2024-09-12T00:33:55.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.537+0000 7fd90c0219c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:33:55.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.561+0000 7fd90c0219c0 20 add_watcher() i=0 2024-09-12T00:33:55.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.561+0000 7fd90c0219c0 20 add_watcher() i=1 2024-09-12T00:33:55.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.561+0000 7fd90c0219c0 20 add_watcher() i=2 2024-09-12T00:33:55.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.561+0000 7fd90c0219c0 20 add_watcher() i=3 2024-09-12T00:33:55.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.561+0000 7fd90c0219c0 20 add_watcher() i=4 2024-09-12T00:33:55.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.561+0000 7fd90c0219c0 20 add_watcher() i=5 2024-09-12T00:33:55.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.561+0000 7fd90c0219c0 20 add_watcher() i=6 2024-09-12T00:33:55.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.565+0000 7fd90c0219c0 20 add_watcher() i=7 2024-09-12T00:33:55.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.565+0000 7fd90c0219c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:33:55.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.569+0000 7fd7bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.569+0000 7fd90c0219c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:33:55.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.569+0000 7fd90c0219c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:33:55.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.569+0000 7fd90c0219c0 5 note: GC not initialized 2024-09-12T00:33:55.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.569+0000 7fd7ba7fc640 20 reqs_thread_entry: start 2024-09-12T00:33:55.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 20 init_complete bucket index max shards: 11 2024-09-12T00:33:55.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 20 Filter name: none 2024-09-12T00:33:55.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd72bfff640 20 reqs_thread_entry: start 2024-09-12T00:33:55.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:33:55.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:33:55.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:33:55.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:33:55.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 : miss 2024-09-12T00:33:55.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 20 rados->read ofs=0 len=0 2024-09-12T00:33:55.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:33:55.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:33:55.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:33:55.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:33:55.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:33:55.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.573+0000 7fd90c0219c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 2024-09-12T00:33:55.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.577+0000 7fd90c0219c0 0 INFO: RGWReshardLock::lock found lock on abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to be held by another RGW process; skipping for now 2024-09-12T00:33:55.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.577+0000 7fd7bb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:33:55.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.581+0000 7fd90c0219c0 20 remove_watcher() i=0 2024-09-12T00:33:55.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.581+0000 7fd90c0219c0 2 removed watcher, disabling cache 2024-09-12T00:33:55.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.585+0000 7fd90c0219c0 20 remove_watcher() i=1 2024-09-12T00:33:55.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.585+0000 7fd90c0219c0 20 remove_watcher() i=2 2024-09-12T00:33:55.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.589+0000 7fd90c0219c0 20 remove_watcher() i=3 2024-09-12T00:33:55.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.593+0000 7fd90c0219c0 20 remove_watcher() i=4 2024-09-12T00:33:55.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.593+0000 7fd90c0219c0 20 remove_watcher() i=5 2024-09-12T00:33:55.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.597+0000 7fd90c0219c0 20 remove_watcher() i=6 2024-09-12T00:33:55.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:33:55.601+0000 7fd90c0219c0 20 remove_watcher() i=7 2024-09-12T00:33:55.615 INFO:tasks.workunit.client.0.smithi078.stderr:waiting 30 seconds for reshard lock to expire... 2024-09-12T00:34:25.647 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket abort-at-change-reshard-state --num-shards 12 --rgw-reshard-bucket-lock-duration 30 2024-09-12T00:34:25.683 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:25.683 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:25.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.729+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 realm 2024-09-12T00:34:25.730 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:25.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:25.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:25.733 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.733+0000 7f9da90009c0 20 searching for the correct realm 2024-09-12T00:34:25.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.741+0000 7f9da7307640 0 -- 172.21.15.78:0/356323326 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f9d98067b70 msgr2=0x7f9d98079340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:25.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.953+0000 7f9da6b06640 0 -- 172.21.15.78:0/356323326 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55aeff295220 msgr2=0x55aeff2976e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:25.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.965+0000 7f9da90009c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:25.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.965+0000 7f9da90009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:25.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.965+0000 7f9da90009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:25.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:25.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 zone default found 2024-09-12T00:34:25.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 4 Realm: () 2024-09-12T00:34:25.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:25.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:25.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:25.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 zonegroup default 2024-09-12T00:34:25.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.969+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:25.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.973+0000 7f9da90009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:25.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.973+0000 7f9da90009c0 20 started sync module instance, tier type = 2024-09-12T00:34:25.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:25.973+0000 7f9da90009c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:25.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.001+0000 7f9da90009c0 20 add_watcher() i=0 2024-09-12T00:34:25.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.001+0000 7f9da90009c0 20 add_watcher() i=1 2024-09-12T00:34:25.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.001+0000 7f9da90009c0 20 add_watcher() i=2 2024-09-12T00:34:25.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.001+0000 7f9da90009c0 20 add_watcher() i=3 2024-09-12T00:34:25.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.001+0000 7f9da90009c0 20 add_watcher() i=4 2024-09-12T00:34:25.999 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.001+0000 7f9da90009c0 20 add_watcher() i=5 2024-09-12T00:34:26.000 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.001+0000 7f9da90009c0 20 add_watcher() i=6 2024-09-12T00:34:26.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.005+0000 7f9da90009c0 20 add_watcher() i=7 2024-09-12T00:34:26.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.005+0000 7f9da90009c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:26.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.009+0000 7f9c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.009+0000 7f9da90009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.009+0000 7f9da90009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.009+0000 7f9da90009c0 5 note: GC not initialized 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.009+0000 7f9c5cfe1640 20 reqs_thread_entry: start 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.009+0000 7f9da90009c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:26.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.009+0000 7f9da90009c0 20 Filter name: none 2024-09-12T00:34:26.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9c55ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:26.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 cache get: name=default.rgw.meta+root+abort-at-change-reshard-state : miss 2024-09-12T00:34:26.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:34:26.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 cache put: name=default.rgw.meta+root+abort-at-change-reshard-state info.flags=0x11 2024-09-12T00:34:26.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 adding default.rgw.meta+root+abort-at-change-reshard-state to cache LRU end 2024-09-12T00:34:26.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 : miss 2024-09-12T00:34:26.011 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 20 rados_obj.operate() r=0 bl.length=451 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 adding default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:26.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.013+0000 7f9da90009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 2024-09-12T00:34:26.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.017+0000 7f9da90009c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:34:26.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9da90009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:34:26.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9da90009c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:34:26.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9da90009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:26.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9da90009c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39, ofs0, ns] 2024-09-12T00:34:26.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9c89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398880 cookie 94210093576640 notifier 7562 bl.length()=931 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9c89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9c89ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.029+0000 7f9c89ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.033+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_sources= new_sources= 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.033+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential sources added=[] removed=[] 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.033+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_dests= new_dests= 2024-09-12T00:34:26.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.033+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential dests added=[] removed=[] 2024-09-12T00:34:26.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.0 2024-09-12T00:34:26.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.0 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.1 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.1 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.2 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.2 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.3 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.3 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.4 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.4 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.5 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.5 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.6 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.6 2024-09-12T00:34:26.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.7 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.7 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.8 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.8 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.9 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.9 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.10 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.10 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.11 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2.11 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.041+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.0 2024-09-12T00:34:26.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.045+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1 2024-09-12T00:34:26.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.045+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2 2024-09-12T00:34:26.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.045+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.3 2024-09-12T00:34:26.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.045+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.4 2024-09-12T00:34:26.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.049+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.5 2024-09-12T00:34:26.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.049+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.6 2024-09-12T00:34:26.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.049+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.7 2024-09-12T00:34:26.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.049+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.8 2024-09-12T00:34:26.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.053+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.9 2024-09-12T00:34:26.050 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.053+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.10 2024-09-12T00:34:26.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.057+0000 7f9da90009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:26.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.057+0000 7f9da90009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 2024-09-12T00:34:26.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:34:26.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:34:26.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:26.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39, ofs0, ns] 2024-09-12T00:34:26.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9c89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398881 cookie 94210093576640 notifier 7562 bl.length()=931 2024-09-12T00:34:26.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9c89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:34:26.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9c89ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:34:26.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9c89ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:26.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_sources= new_sources= 2024-09-12T00:34:26.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential sources added=[] removed=[] 2024-09-12T00:34:26.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_dests= new_dests= 2024-09-12T00:34:26.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.061+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential dests added=[] removed=[] 2024-09-12T00:34:26.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.069+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.0 2024-09-12T00:34:26.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.069+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.1 2024-09-12T00:34:26.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.069+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.2 2024-09-12T00:34:26.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.069+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.3 2024-09-12T00:34:26.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.069+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.4 2024-09-12T00:34:26.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.073+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.5 2024-09-12T00:34:26.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.073+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.6 2024-09-12T00:34:26.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.073+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.7 2024-09-12T00:34:26.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.073+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.8 2024-09-12T00:34:26.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.073+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.9 2024-09-12T00:34:26.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.073+0000 7f9da90009c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39.10 2024-09-12T00:34:26.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9da90009c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 : hit (requested=0x17, cached=0x17) 2024-09-12T00:34:26.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9da90009c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 2024-09-12T00:34:26.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9da90009c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:34:26.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9da90009c0 10 moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:34:26.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9da90009c0 10 updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:26.076 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9da90009c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39, ofs0, ns] 2024-09-12T00:34:26.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9c89ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398882 cookie 94210093576640 notifier 7562 bl.length()=899 2024-09-12T00:34:26.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9c89ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 info.flags=0x17 2024-09-12T00:34:26.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9c89ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.abort-at-change-reshard-state:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 to cache LRU end 2024-09-12T00:34:26.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.077+0000 7f9c89ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=205 2024-09-12T00:34:26.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.081+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_sources= new_sources= 2024-09-12T00:34:26.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.081+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential sources added=[] removed=[] 2024-09-12T00:34:26.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.081+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): orig_dests= new_dests= 2024-09-12T00:34:26.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.081+0000 7f9da90009c0 20 handle_bi_update(): bucket=:abort-at-change-reshard-state[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39]): potential dests added=[] removed=[] 2024-09-12T00:34:26.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.085+0000 7f9da90009c0 1 execute INFO: reshard of bucket "abort-at-change-reshard-state" from 11 shards to 12 shards completed successfully 2024-09-12T00:34:26.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.089+0000 7f9c5dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.093+0000 7f9da90009c0 20 remove_watcher() i=0 2024-09-12T00:34:26.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.093+0000 7f9da90009c0 2 removed watcher, disabling cache 2024-09-12T00:34:26.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.093+0000 7f9da90009c0 20 remove_watcher() i=1 2024-09-12T00:34:26.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.097+0000 7f9da90009c0 20 remove_watcher() i=2 2024-09-12T00:34:26.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.101+0000 7f9da90009c0 20 remove_watcher() i=3 2024-09-12T00:34:26.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.101+0000 7f9da90009c0 20 remove_watcher() i=4 2024-09-12T00:34:26.101 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.105+0000 7f9da90009c0 20 remove_watcher() i=5 2024-09-12T00:34:26.104 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.105+0000 7f9da90009c0 20 remove_watcher() i=6 2024-09-12T00:34:26.107 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.109+0000 7f9da90009c0 20 remove_watcher() i=7 2024-09-12T00:34:26.123 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket abort-at-change-reshard-state 2024-09-12T00:34:26.152 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:26.152 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:26.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.197+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 realm 2024-09-12T00:34:26.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:26.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:26.200 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.201+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.205+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:26.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.205+0000 7fa81c1e79c0 20 searching for the correct realm 2024-09-12T00:34:26.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.205+0000 7fa8194ec640 0 -- 172.21.15.78:0/3211620342 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fa80c0ea120 msgr2=0x7fa80c119420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:26.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.421+0000 7fa819ced640 0 -- 172.21.15.78:0/3211620342 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fa81001d040 msgr2=0x7fa810042990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:26.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:26.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:26.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:26.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:26.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:26.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:26.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.641+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:26.641 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 zone default found 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 4 Realm: () 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 zonegroup default 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.645+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.649+0000 7fa81c1e79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.649+0000 7fa81c1e79c0 20 started sync module instance, tier type = 2024-09-12T00:34:26.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.649+0000 7fa81c1e79c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.669+0000 7fa81c1e79c0 20 add_watcher() i=0 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.669+0000 7fa81c1e79c0 20 add_watcher() i=1 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.669+0000 7fa81c1e79c0 20 add_watcher() i=2 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.669+0000 7fa81c1e79c0 20 add_watcher() i=3 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.669+0000 7fa81c1e79c0 20 add_watcher() i=4 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.669+0000 7fa81c1e79c0 20 add_watcher() i=5 2024-09-12T00:34:26.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.673+0000 7fa81c1e79c0 20 add_watcher() i=6 2024-09-12T00:34:26.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.673+0000 7fa81c1e79c0 20 add_watcher() i=7 2024-09-12T00:34:26.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.673+0000 7fa81c1e79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:26.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.677+0000 7fa6cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.677+0000 7fa81c1e79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:26.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.677+0000 7fa81c1e79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:26.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.677+0000 7fa81c1e79c0 5 note: GC not initialized 2024-09-12T00:34:26.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa6ca7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:26.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:26.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 Filter name: none 2024-09-12T00:34:26.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa63bfff640 20 reqs_thread_entry: start 2024-09-12T00:34:26.678 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:34:26.679 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:34:26.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:26.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.681+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.685+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=197 2024-09-12T00:34:26.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.685+0000 7fa81c1e79c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.685+0000 7fa81c1e79c0 20 rados_obj.operate() r=0 bl.length=419 2024-09-12T00:34:26.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.685+0000 7fa81c1e79c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:26.685 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.689+0000 7fa6cb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.693+0000 7fa81c1e79c0 20 remove_watcher() i=0 2024-09-12T00:34:26.689 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.693+0000 7fa81c1e79c0 2 removed watcher, disabling cache 2024-09-12T00:34:26.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.693+0000 7fa81c1e79c0 20 remove_watcher() i=1 2024-09-12T00:34:26.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.697+0000 7fa81c1e79c0 20 remove_watcher() i=2 2024-09-12T00:34:26.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.697+0000 7fa81c1e79c0 20 remove_watcher() i=3 2024-09-12T00:34:26.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.701+0000 7fa81c1e79c0 20 remove_watcher() i=4 2024-09-12T00:34:26.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.701+0000 7fa81c1e79c0 20 remove_watcher() i=5 2024-09-12T00:34:26.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.705+0000 7fa81c1e79c0 20 remove_watcher() i=6 2024-09-12T00:34:26.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.705+0000 7fa81c1e79c0 20 remove_watcher() i=7 2024-09-12T00:34:26.719 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:26.719 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:34:26.719 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: abort-at-change-reshard-state id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.39 num_objects: 19 size_kb: 1 num_shards: 12 2024-09-12T00:34:26.719 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:26.818 INFO:tasks.workunit.client.0.smithi078.stderr: test: logrecord could be stopped after reshard failed 2024-09-12T00:34:26.818 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:34:26.845 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:26.846 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:26.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.893+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.893+0000 7fbfaf3529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.893+0000 7fbfaf3529c0 20 realm 2024-09-12T00:34:26.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.893+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.893+0000 7fbfaf3529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.893+0000 7fbfaf3529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:26.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.893+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.897+0000 7fbfaf3529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.897+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.897+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:26.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.897+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.897+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:26.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.897+0000 7fbfaf3529c0 20 searching for the correct realm 2024-09-12T00:34:26.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.905+0000 7fbfad659640 0 -- 172.21.15.78:0/3613029887 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fbf9c037930 msgr2=0x7fbf9c016460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:26.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.909+0000 7fbface58640 0 -- 172.21.15.78:0/3613029887 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55cb48dcaf60 msgr2=0x55cb48dcd390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:26.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:26.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 zone default found 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 4 Realm: () 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 zonegroup default 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.917+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.921+0000 7fbfaf3529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.921+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.921+0000 7fbfaf3529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:26.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.921+0000 7fbfaf3529c0 20 started sync module instance, tier type = 2024-09-12T00:34:26.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.921+0000 7fbfaf3529c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:26.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.937+0000 7fbfaf3529c0 20 add_watcher() i=0 2024-09-12T00:34:26.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.937+0000 7fbfaf3529c0 20 add_watcher() i=1 2024-09-12T00:34:26.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.937+0000 7fbfaf3529c0 20 add_watcher() i=2 2024-09-12T00:34:26.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.937+0000 7fbfaf3529c0 20 add_watcher() i=3 2024-09-12T00:34:26.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.937+0000 7fbfaf3529c0 20 add_watcher() i=4 2024-09-12T00:34:26.937 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.937+0000 7fbfaf3529c0 20 add_watcher() i=5 2024-09-12T00:34:26.938 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.937+0000 7fbfaf3529c0 20 add_watcher() i=6 2024-09-12T00:34:26.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.941+0000 7fbfaf3529c0 20 add_watcher() i=7 2024-09-12T00:34:26.940 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.941+0000 7fbfaf3529c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:26.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbe62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:26.943 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:26.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 5 note: GC not initialized 2024-09-12T00:34:26.944 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbe61fe3640 20 reqs_thread_entry: start 2024-09-12T00:34:26.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:26.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 Filter name: none 2024-09-12T00:34:26.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbdd37fe640 20 reqs_thread_entry: start 2024-09-12T00:34:26.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:26.945 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.945+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.949+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.949+0000 7fbfaf3529c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.949+0000 7fbfaf3529c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:26.946 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.949+0000 7fbfaf3529c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:26.949 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.949+0000 7fbe62fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:26.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.953+0000 7fbfaf3529c0 20 remove_watcher() i=0 2024-09-12T00:34:26.953 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.953+0000 7fbfaf3529c0 2 removed watcher, disabling cache 2024-09-12T00:34:26.955 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.957+0000 7fbfaf3529c0 20 remove_watcher() i=1 2024-09-12T00:34:26.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.957+0000 7fbfaf3529c0 20 remove_watcher() i=2 2024-09-12T00:34:26.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.961+0000 7fbfaf3529c0 20 remove_watcher() i=3 2024-09-12T00:34:26.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.961+0000 7fbfaf3529c0 20 remove_watcher() i=4 2024-09-12T00:34:26.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.965+0000 7fbfaf3529c0 20 remove_watcher() i=5 2024-09-12T00:34:26.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.969+0000 7fbfaf3529c0 20 remove_watcher() i=6 2024-09-12T00:34:26.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:26.969+0000 7fbfaf3529c0 20 remove_watcher() i=7 2024-09-12T00:34:26.982 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:26.982 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:34:26.982 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 8 size_kb: 1 num_shards: 13 2024-09-12T00:34:26.982 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:26.983 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:34:27.010 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:27.010 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:27.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.057+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.057+0000 7f6e8249d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.057+0000 7f6e8249d9c0 20 realm 2024-09-12T00:34:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.057+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.057 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:27.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.061+0000 7f6e8249d9c0 20 searching for the correct realm 2024-09-12T00:34:27.064 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.065+0000 7f6e807a4640 0 -- 172.21.15.78:0/3408328954 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f6e700810c0 msgr2=0x7f6e7008f210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.281+0000 7f6e7ffa3640 0 -- 172.21.15.78:0/3408328954 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x561db4bd1ae0 msgr2=0x561db4bd3fa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:27.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:27.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:27.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:27.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:27.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:27.290 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 zone default found 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 4 Realm: () 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 zonegroup default 2024-09-12T00:34:27.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.293+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.297+0000 7f6e8249d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.297+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.297+0000 7f6e8249d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.297+0000 7f6e8249d9c0 20 started sync module instance, tier type = 2024-09-12T00:34:27.294 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.297+0000 7f6e8249d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=0 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=1 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=2 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=3 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=4 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=5 2024-09-12T00:34:27.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=6 2024-09-12T00:34:27.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 20 add_watcher() i=7 2024-09-12T00:34:27.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.321+0000 7f6e8249d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:27.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.325+0000 7f6d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:27.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:27.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 5 note: GC not initialized 2024-09-12T00:34:27.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6d34fe1640 20 reqs_thread_entry: start 2024-09-12T00:34:27.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:27.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 Filter name: none 2024-09-12T00:34:27.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6cae7fc640 20 reqs_thread_entry: start 2024-09-12T00:34:27.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:27.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:27.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:27.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.329+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.333+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:27.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.333+0000 7f6e8249d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.333+0000 7f6e8249d9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:27.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.333+0000 7f6e8249d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:27.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.337+0000 7f6d35fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.341+0000 7f6e8249d9c0 20 remove_watcher() i=0 2024-09-12T00:34:27.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.341+0000 7f6e8249d9c0 2 removed watcher, disabling cache 2024-09-12T00:34:27.340 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.341+0000 7f6e8249d9c0 20 remove_watcher() i=1 2024-09-12T00:34:27.342 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.345+0000 7f6e8249d9c0 20 remove_watcher() i=2 2024-09-12T00:34:27.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.345+0000 7f6e8249d9c0 20 remove_watcher() i=3 2024-09-12T00:34:27.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.349+0000 7f6e8249d9c0 20 remove_watcher() i=4 2024-09-12T00:34:27.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.353+0000 7f6e8249d9c0 20 remove_watcher() i=5 2024-09-12T00:34:27.351 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.353+0000 7f6e8249d9c0 20 remove_watcher() i=6 2024-09-12T00:34:27.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.357+0000 7f6e8249d9c0 20 remove_watcher() i=7 2024-09-12T00:34:27.372 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at change_reshard_state 2024-09-12T00:34:27.406 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:27.406 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:27.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 realm 2024-09-12T00:34:27.452 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.453+0000 7fc4c849e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:27.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:27.455 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 searching for the correct realm 2024-09-12T00:34:27.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.465+0000 7fc4c57a3640 0 -- 172.21.15.78:0/2911200628 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fc4b80168f0 msgr2=0x7fc4b8029410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.469+0000 7fc4c57a3640 0 -- 172.21.15.78:0/2911200628 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fc4b8045a80 msgr2=0x7fc4b8044390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:27.474 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 zone default found 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 Realm: () 2024-09-12T00:34:27.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:27.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:27.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:27.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 zonegroup default 2024-09-12T00:34:27.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 started sync module instance, tier type = 2024-09-12T00:34:27.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:27.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=0 2024-09-12T00:34:27.495 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=1 2024-09-12T00:34:27.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=2 2024-09-12T00:34:27.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=3 2024-09-12T00:34:27.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=4 2024-09-12T00:34:27.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=5 2024-09-12T00:34:27.496 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=6 2024-09-12T00:34:27.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.501+0000 7fc4c849e9c0 20 add_watcher() i=7 2024-09-12T00:34:27.499 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.501+0000 7fc4c849e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:27.501 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.501+0000 7fc3777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 note: GC not initialized 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc3767fc640 20 reqs_thread_entry: start 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 Filter name: none 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc2e7fff640 20 reqs_thread_entry: start 2024-09-12T00:34:27.502 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:27.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:34:27.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:34:27.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:34:27.503 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:27.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:27.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.504 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:34:27.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.512 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:34:27.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399017 cookie 94705991440736 notifier 7628 bl.length()=827 2024-09-12T00:34:27.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:34:27.513 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:34:27.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:34:27.514 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.1 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.1 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.2 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.2 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.3 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.3 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.4 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.4 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.5 2024-09-12T00:34:27.527 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.5 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.6 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.6 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.7 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.7 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.8 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.8 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.9 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.9 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.10 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.10 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.11 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.11 2024-09-12T00:34:27.528 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.12 2024-09-12T00:34:27.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.12 2024-09-12T00:34:27.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.13 2024-09-12T00:34:27.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.13 2024-09-12T00:34:27.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:27.529 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:27.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:27.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:27.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:27.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:27.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:27.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:27.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:27.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:27.534 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:27.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:27.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:27.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:27.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:27.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.541+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:27.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.541+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:27.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.541+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:27.539 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.541+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:27.542 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4c849e9c0 time 2024-09-12T00:34:27.547532+0000 2024-09-12T00:34:27.542 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4cbd782eb] 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:34:27.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.545+0000 7fc4c849e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4c849e9c0 time 2024-09-12T00:34:27.547532+0000 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4cbd782eb] 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:34:27.545 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.546 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:34:27.546 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fc4c849e9c0 thread_name:radosgw-admin 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4cabf7520] 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4cbd78345] 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.565 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.545+0000 7fc4c849e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fc4c849e9c0 thread_name:radosgw-admin 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4cabf7520] 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:34:27.566 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4cbd78345] 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:34:27.567 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key hook 0x562274ea5968 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.568 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274d31940 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274df1360 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274ed5000 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.769683s 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request con 0x562274df1360 auth_method 0 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.569 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request con 0x562274ed5000 auth_method 0 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_done global_id 7619 payload 824 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 1 monclient: found mon.noname-c 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.570 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: dump: 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.571 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: dump: 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.572 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 7619 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:34:27.433+0000 7fc3b3e07640 4 set_mon_vals no callback set 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.573 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 1 librados: init done 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:34:27.437+0000 7fc3b2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:34:27.437+0000 7fc3b2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:34:27.437+0000 7fc3b2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:34:27.437+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x7fc3ac070b10 auth_method 0 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:34:27.437+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274ecd1e0 auth_method 0 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:34:27.437+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x562274ef02f0 auth_method 0 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:34:27.437+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x562274ef44e0 auth_method 0 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:34:27.441+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274ef87e0 auth_method 0 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: monmap: 2024-09-12T00:34:27.574 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding auth protocol: cephx 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding auth protocol: cephx 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding auth protocol: cephx 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.575 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command objecter_requests cmddesc objecter_requests hook 0x562274efff20 EEXIST 2024-09-12T00:34:27.576 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: init 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding auth protocol: cephx 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding auth protocol: cephx 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding auth protocol: cephx 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.577 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key cmddesc rotate-key hook 0x562274efb670 EEXIST 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274f240d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274f23a00 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274f223e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.578 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.779311s 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request con 0x562274f240d0 auth_method 0 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request con 0x562274f223e0 auth_method 0 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.579 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_done global_id 7622 payload 824 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 1 monclient: found mon.noname-c 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:34:27.441+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274f23a00 auth_method 0 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: dump: 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.580 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.581 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: dump: 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 7622 2024-09-12T00:34:27.582 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:34:27.445+0000 7fc4c6fa6640 4 set_mon_vals no callback set 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x7fc3a0070a20 auth_method 0 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: monmap: 2024-09-12T00:34:27.583 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding auth protocol: cephx 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding auth protocol: cephx 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding auth protocol: cephx 2024-09-12T00:34:27.584 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: init 2024-09-12T00:34:27.585 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding auth protocol: cephx 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding auth protocol: cephx 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding auth protocol: cephx 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.586 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key cmddesc rotate-key hook 0x7fff35a77de8 EEXIST 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274f776c0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274f77aa0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.587 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274f73280 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.783268s 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request con 0x562274f776c0 auth_method 0 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request con 0x562274f77aa0 auth_method 0 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.588 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_done global_id 8169 payload 274 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 1 monclient: found mon.noname-a 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: dump: 2024-09-12T00:34:27.589 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 8169 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.590 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: dump: 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.591 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 4 set_mon_vals no callback set 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: shutdown 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: monmap: 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:34:27.592 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding auth protocol: cephx 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding auth protocol: cephx 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding auth protocol: cephx 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.593 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: starting msgr at 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: starting objecter 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command objecter_requests cmddesc objecter_requests hook 0x562274f467b0 EEXIST 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: setting wanted keys 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: calling monclient init 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: init 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding auth protocol: cephx 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding auth protocol: cephx 2024-09-12T00:34:27.594 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding auth protocol: cephx 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.595 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key cmddesc rotate-key hook 0x562274f26038 EEXIST 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274f73280 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274f776c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274f6d4f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.786046s 2024-09-12T00:34:27.596 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request con 0x562274f776c0 auth_method 0 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request con 0x562274f6d4f0 auth_method 0 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.597 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_done global_id 7628 payload 824 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 1 monclient: found mon.noname-c 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: dump: 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.598 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: dump: 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.599 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 7628 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 4 set_mon_vals no callback set 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: init done 2024-09-12T00:34:27.600 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cr dump hook 0x7fc4bc0f79b8 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:34:27.453+0000 7fc3977fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:34:27.453+0000 7fc3977fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:34:27.453+0000 7fc3977fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:34:27.453+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc390070b10 auth_method 0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:34:27.453+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x562274f915a0 auth_method 0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 realm 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.601 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:34:27.457+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x562274f95700 auth_method 0 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:34:27.457+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274f98f40 auth_method 0 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 searching for the correct realm 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:34:27.457+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x562274f9dc90 auth_method 0 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:34:27.457+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc4b80168f0 auth_method 0 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:34:27.461+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x7fc4b8037400 auth_method 0 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:34:27.465+0000 7fc4c57a3640 0 -- 172.21.15.78:0/2911200628 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fc4b80168f0 msgr2=0x7fc4b8029410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:34:27.465+0000 7fc3977fe640 1 client.7628.objecter ms_handle_reset 0x7fc4b80168f0 session 0x7fc4b8018e90 osd.2 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:34:27.465+0000 7fc3977fe640 10 monclient: _renew_subs 2024-09-12T00:34:27.602 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:34:27.465+0000 7fc3977fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:34:27.465+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc390080dc0 auth_method 0 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:34:27.465+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x7fc4bc12b050 auth_method 0 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:34:27.469+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc4b8045a80 auth_method 0 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:34:27.469+0000 7fc4c57a3640 0 -- 172.21.15.78:0/2911200628 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fc4b8045a80 msgr2=0x7fc4b8044390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:34:27.469+0000 7fc3977fe640 1 client.7628.objecter ms_handle_reset 0x7fc4b8045a80 session 0x7fc4b8045400 osd.3 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:34:27.469+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc4b80168f0 auth_method 0 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.603 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 zone default found 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 Realm: () 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 zonegroup default 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.604 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 started sync module instance, tier type = 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=0 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=1 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=2 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=3 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=4 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=5 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=6 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 20 add_watcher() i=7 2024-09-12T00:34:27.605 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding auth protocol: cephx 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding auth protocol: cephx 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding auth protocol: cephx 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:34:27.501+0000 7fc3777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.606 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache list hook 0x562274f6d910 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache inspect hook 0x562274f6d910 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache erase hook 0x562274f6d910 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache zap hook 0x562274f6d910 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 note: GC not initialized 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:34:27.505+0000 7fc3767fc640 20 reqs_thread_entry: start 2024-09-12T00:34:27.607 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace show hook 0x7fc4b800d470 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace history hook 0x7fc4b800d470 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace active hook 0x7fc4b800d470 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace active_short hook 0x7fc4b800d470 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 Filter name: none 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:34:27.505+0000 7fc2e7fff640 20 reqs_thread_entry: start 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.608 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399017 cookie 94705991440736 notifier 7628 bl.length()=827 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.609 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.1 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.1 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.2 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.2 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.3 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.3 2024-09-12T00:34:27.610 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.4 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.4 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.5 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.5 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.6 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.6 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.7 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.7 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.8 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.8 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.9 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.9 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.10 2024-09-12T00:34:27.611 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.10 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.11 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.11 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.12 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.12 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.13 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.13 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:27.612 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:27.613 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:34:27.545+0000 7fc4c849e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4c849e9c0 time 2024-09-12T00:34:27.547532+0000 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4cbd782eb] 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.614 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:34:27.545+0000 7fc4c849e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fc4c849e9c0 thread_name:radosgw-admin 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4cabf7520] 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:34:27.615 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4cbd78345] 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:27.616 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:27.617 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:34:27.618 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:34:27.619 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:34:27.620 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:34:27.621 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:27.622 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:27.623 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc2e7fff640 / http_manager 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3767fc640 / http_manager 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3777fe640 / rgw_dt_lg_renew 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3977fe640 / ms_dispatch 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3a8ff9640 / io_context_pool 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3a97fa640 / io_context_pool 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3ab7fe640 / ms_dispatch 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3b2604640 / ms_dispatch 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3b3e07640 / io_context_pool 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c57a3640 / msgr-worker-2 2024-09-12T00:34:27.624 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c5fa4640 / msgr-worker-1 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c67a5640 / msgr-worker-0 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c6fa6640 / io_context_pool 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c849e9c0 / radosgw-admin 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.137668.log 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.625 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: crc 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 AuthRegistry(0x562274ea5820) adding con mode: secure 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key hook 0x562274ea5968 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274d31940 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274df1360 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274ed5000 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.626 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.769683s 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request con 0x562274df1360 auth_method 0 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request con 0x562274ed5000 auth_method 0 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.627 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:34:27.433+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_done global_id 7619 payload 824 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 1 monclient: found mon.noname-c 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:34:27.433+0000 7fc4c57a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: dump: 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.628 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:27.629 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:34:27.433+0000 7fc3b2604640 10 monclient: dump: 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 7619 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.630 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:34:27.433+0000 7fc3b3e07640 4 set_mon_vals no callback set 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:34:27.433+0000 7fc4c849e9c0 1 librados: init done 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:34:27.437+0000 7fc3b2604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:34:27.437+0000 7fc3b2604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:34:27.437+0000 7fc3b2604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:34:27.437+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x7fc3ac070b10 auth_method 0 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:34:27.437+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274ecd1e0 auth_method 0 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:34:27.437+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x562274ef02f0 auth_method 0 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:34:27.437+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x562274ef44e0 auth_method 0 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:34:27.441+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274ef87e0 auth_method 0 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:27.631 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: monmap: 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding auth protocol: cephx 2024-09-12T00:34:27.632 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding auth protocol: cephx 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding auth protocol: cephx 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: crc 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efc570) adding con mode: secure 2024-09-12T00:34:27.633 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command objecter_requests cmddesc objecter_requests hook 0x562274efff20 EEXIST 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: init 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding auth protocol: cephx 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding auth protocol: cephx 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding auth protocol: cephx 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.634 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: crc 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 AuthRegistry(0x562274efb528) adding con mode: secure 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key cmddesc rotate-key hook 0x562274efb670 EEXIST 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274f240d0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274f23a00 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274f223e0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.635 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:34:27.441+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.779311s 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request con 0x562274f240d0 auth_method 0 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request con 0x562274f223e0 auth_method 0 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.636 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:34:27.441+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_done global_id 7622 payload 824 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 1 monclient: found mon.noname-c 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:34:27.441+0000 7fc4c57a3640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:34:27.441+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274f23a00 auth_method 0 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: dump: 2024-09-12T00:34:27.637 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.638 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 10 monclient: dump: 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 7622 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:34:27.445+0000 7fc4c6fa6640 4 set_mon_vals no callback set 2024-09-12T00:34:27.639 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:34:27.445+0000 7fc3ab7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x7fc3a0070a20 auth_method 0 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: get_monmap_and_config 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: monmap: 2024-09-12T00:34:27.640 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding auth protocol: cephx 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding auth protocol: cephx 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding auth protocol: cephx 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.641 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: crc 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f43350) adding con mode: secure 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: init 2024-09-12T00:34:27.642 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding auth protocol: cephx 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding auth protocol: cephx 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding auth protocol: cephx 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.643 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: crc 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a77ca0) adding con mode: secure 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key cmddesc rotate-key hook 0x7fff35a77de8 EEXIST 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274f776c0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274f77aa0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274f73280 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.644 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:34:27.445+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.783268s 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request con 0x562274f776c0 auth_method 0 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request con 0x562274f77aa0 auth_method 0 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.645 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:34:27.445+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient(hunting): handle_auth_done global_id 8169 payload 274 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 1 monclient: found mon.noname-a 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:34:27.445+0000 7fc4c57a3640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: dump: 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.646 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 8169 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 10 monclient: dump: 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.647 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 4 set_mon_vals no callback set 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: shutdown 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: build_initial_monmap 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 build_initial for_mkfs: 0 2024-09-12T00:34:27.648 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: monmap: 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding auth protocol: cephx 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding auth protocol: cephx 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding auth protocol: cephx 2024-09-12T00:34:27.649 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: crc 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f67f00) adding con mode: secure 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: starting msgr at 2024-09-12T00:34:27.650 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: starting objecter 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command objecter_requests cmddesc objecter_requests hook 0x562274f467b0 EEXIST 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: setting wanted keys 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: calling monclient init 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: init 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding auth protocol: cephx 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding auth protocol: cephx 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding auth protocol: cephx 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.651 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: crc 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 AuthRegistry(0x562274f25ef0) adding con mode: secure 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command rotate-key cmddesc rotate-key hook 0x562274f26038 EEXIST 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-b con 0x562274f73280 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-c con 0x562274f776c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:34:27.652 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): picked mon.noname-a con 0x562274f6d4f0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient(hunting): authenticate will time out at 2391.786046s 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request con 0x562274f776c0 auth_method 0 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request con 0x562274f6d4f0 auth_method 0 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:34:27.653 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:34:27.449+0000 7fc4c5fa4640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient(hunting): handle_auth_done global_id 7628 payload 824 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient: _finish_hunting 0 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 1 monclient: found mon.noname-c 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:34:27.449+0000 7fc4c67a5640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: dump: 2024-09-12T00:34:27.654 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: _finish_auth 0 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: _check_auth_tickets 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:34:27.655 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:34:27.449+0000 7fc3977fe640 10 monclient: dump: 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:34:27.656 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 monclient: authenticate success, global_id 7628 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:34:27.449+0000 7fc3a97fa640 4 set_mon_vals no callback set 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _renew_subs 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 1 librados: init done 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:34:27.449+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cr dump hook 0x7fc4bc0f79b8 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:34:27.453+0000 7fc3977fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:34:27.453+0000 7fc3977fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:34:27.453+0000 7fc3977fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:34:27.657 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:34:27.453+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc390070b10 auth_method 0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:34:27.453+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x562274f915a0 auth_method 0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 realm 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:34:27.453+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:34:27.457+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x562274f95700 auth_method 0 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.658 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:34:27.457+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x562274f98f40 auth_method 0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:34:27.457+0000 7fc4c849e9c0 20 searching for the correct realm 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:34:27.457+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x562274f9dc90 auth_method 0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:34:27.457+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc4b80168f0 auth_method 0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:34:27.461+0000 7fc4c67a5640 10 monclient: get_auth_request con 0x7fc4b8037400 auth_method 0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:34:27.465+0000 7fc4c57a3640 0 -- 172.21.15.78:0/2911200628 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fc4b80168f0 msgr2=0x7fc4b8029410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:34:27.465+0000 7fc3977fe640 1 client.7628.objecter ms_handle_reset 0x7fc4b80168f0 session 0x7fc4b8018e90 osd.2 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:34:27.465+0000 7fc3977fe640 10 monclient: _renew_subs 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:34:27.465+0000 7fc3977fe640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:34:27.465+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc390080dc0 auth_method 0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:34:27.465+0000 7fc4c5fa4640 10 monclient: get_auth_request con 0x7fc4bc12b050 auth_method 0 2024-09-12T00:34:27.659 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:34:27.469+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc4b8045a80 auth_method 0 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:34:27.469+0000 7fc4c57a3640 0 -- 172.21.15.78:0/2911200628 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fc4b8045a80 msgr2=0x7fc4b8044390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:34:27.469+0000 7fc3977fe640 1 client.7628.objecter ms_handle_reset 0x7fc4b8045a80 session 0x7fc4b8045400 osd.3 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:34:27.469+0000 7fc4c57a3640 10 monclient: get_auth_request con 0x7fc4b80168f0 auth_method 0 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.660 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 zone default found 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 Realm: () 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 zonegroup default 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:34:27.477+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.661 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 started sync module instance, tier type = 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:34:27.481+0000 7fc4c849e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=0 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=1 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=2 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=3 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=4 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=5 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:34:27.497+0000 7fc4c849e9c0 20 add_watcher() i=6 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 20 add_watcher() i=7 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:27.662 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding auth protocol: cephx 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding auth protocol: cephx 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding auth protocol: cephx 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:34:27.501+0000 7fc3777fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: crc 2024-09-12T00:34:27.663 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:34:27.501+0000 7fc4c849e9c0 5 AuthRegistry(0x7fff35a78180) adding con mode: secure 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache list hook 0x562274f6d910 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache inspect hook 0x562274f6d910 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache erase hook 0x562274f6d910 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command cache zap hook 0x562274f6d910 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 note: GC not initialized 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:34:27.505+0000 7fc3767fc640 20 reqs_thread_entry: start 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace show hook 0x7fc4b800d470 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace history hook 0x7fc4b800d470 2024-09-12T00:34:27.664 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace active hook 0x7fc4b800d470 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 5 asok(0x562274c982b0) register_command sync trace active_short hook 0x7fc4b800d470 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 Filter name: none 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:34:27.505+0000 7fc2e7fff640 20 reqs_thread_entry: start 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:27.665 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:34:27.505+0000 7fc4c849e9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:34:27.513+0000 7fc4c849e9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399017 cookie 94705991440736 notifier 7628 bl.length()=827 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:34:27.513+0000 7fc3a8ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:27.666 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:34:27.517+0000 7fc4c849e9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.1 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.1 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.2 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.2 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.3 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.3 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.4 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.4 2024-09-12T00:34:27.667 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.5 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.5 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.6 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.6 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.7 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.7 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.8 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.8 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.9 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.9 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.10 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.10 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.11 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.11 2024-09-12T00:34:27.668 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.12 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.12 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.13 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.13 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:34:27.529+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:27.669 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:34:27.533+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:34:27.537+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:27.670 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:34:27.541+0000 7fc4c849e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:34:27.545+0000 7fc4c849e9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7fc4c849e9c0 time 2024-09-12T00:34:27.547532+0000 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7fc4cbd782eb] 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.671 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:34:27.545+0000 7fc4c849e9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7fc4c849e9c0 thread_name:radosgw-admin 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7fc4cabf7520] 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7fc4cbd78345] 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7fc4cbd7849f] 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x562272bf9cc1] 2024-09-12T00:34:27.672 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::do_reshard(rgw::bucket_index_layout_generation const&, rgw::bucket_index_layout_generation const&, int, bool, bool, std::ostream*, ceph::Formatter*, FaultInjector > >&, DoutPrefixProvider const*, optional_yield)+0x198c) [0x562272c0e01c] 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0xac4) [0x562272c0f6a4] 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7fc4cabded90] 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:34:27.673 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:34:27.674 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:34:27.675 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:34:27.676 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:34:27.677 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:34:27.678 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:34:27.679 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc2e7fff640 / http_manager 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3767fc640 / http_manager 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3777fe640 / rgw_dt_lg_renew 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3977fe640 / ms_dispatch 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3a8ff9640 / io_context_pool 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3a97fa640 / io_context_pool 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3ab7fe640 / ms_dispatch 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3b2604640 / ms_dispatch 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc3b3e07640 / io_context_pool 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c57a3640 / msgr-worker-2 2024-09-12T00:34:27.680 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c5fa4640 / msgr-worker-1 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c67a5640 / msgr-worker-0 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c6fa6640 / io_context_pool 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr: 7fc4c849e9c0 / radosgw-admin 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:34:27.549929Z_c5d7b976-cc33-4e47-84d5-11fa8f0699e1/log 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:34:27.681 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.629+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 realm 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.633+0000 7f296cacc9c0 20 searching for the correct realm 2024-09-12T00:34:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.637+0000 7f2969dd1640 0 -- 172.21.15.78:0/4139592524 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x559839b0b580 msgr2=0x559839b0da40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.645+0000 7f2969dd1640 0 -- 172.21.15.78:0/4139592524 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f295c0243e0 msgr2=0x7f295c024860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:27.864 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.865+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.865 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 zone default found 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 4 Realm: () 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 zonegroup default 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.867 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:27.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 started sync module instance, tier type = 2024-09-12T00:34:27.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.869+0000 7f296cacc9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:27.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.897+0000 7f296cacc9c0 20 add_watcher() i=0 2024-09-12T00:34:27.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.897+0000 7f296cacc9c0 20 add_watcher() i=1 2024-09-12T00:34:27.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.897+0000 7f296cacc9c0 20 add_watcher() i=2 2024-09-12T00:34:27.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.897+0000 7f296cacc9c0 20 add_watcher() i=3 2024-09-12T00:34:27.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.897+0000 7f296cacc9c0 20 add_watcher() i=4 2024-09-12T00:34:27.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.897+0000 7f296cacc9c0 20 add_watcher() i=5 2024-09-12T00:34:27.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.897+0000 7f296cacc9c0 20 add_watcher() i=6 2024-09-12T00:34:27.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.901+0000 7f296cacc9c0 20 add_watcher() i=7 2024-09-12T00:34:27.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.901+0000 7f296cacc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:27.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.905+0000 7f2820fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.905+0000 7f296cacc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:27.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:27.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 5 note: GC not initialized 2024-09-12T00:34:27.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f279b7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:27.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:27.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 Filter name: none 2024-09-12T00:34:27.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f27997fa640 20 reqs_thread_entry: start 2024-09-12T00:34:27.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:27.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:34:27.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:27.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:27.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:27.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:34:27.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.909+0000 7f296cacc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:27.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.913+0000 7f2820fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:27.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.917+0000 7f296cacc9c0 20 remove_watcher() i=0 2024-09-12T00:34:27.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.917+0000 7f296cacc9c0 2 removed watcher, disabling cache 2024-09-12T00:34:27.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.921+0000 7f296cacc9c0 20 remove_watcher() i=1 2024-09-12T00:34:27.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.921+0000 7f296cacc9c0 20 remove_watcher() i=2 2024-09-12T00:34:27.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.925+0000 7f296cacc9c0 20 remove_watcher() i=3 2024-09-12T00:34:27.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.925+0000 7f296cacc9c0 20 remove_watcher() i=4 2024-09-12T00:34:27.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.933+0000 7f296cacc9c0 20 remove_watcher() i=5 2024-09-12T00:34:27.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.933+0000 7f296cacc9c0 20 remove_watcher() i=6 2024-09-12T00:34:27.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:27.937+0000 7f296cacc9c0 20 remove_watcher() i=7 2024-09-12T00:34:27.965 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:34:27.999 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:27.999 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:28.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.045+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 realm 2024-09-12T00:34:28.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:28.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:28.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.049+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.053+0000 7f6d754fe9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:28.049 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.053+0000 7f6d754fe9c0 20 searching for the correct realm 2024-09-12T00:34:28.054 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.057+0000 7f6d73805640 0 -- 172.21.15.78:0/2361435616 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f6d64034020 msgr2=0x7f6d6402c7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:28.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.269+0000 7f6d73805640 0 -- 172.21.15.78:0/2361435616 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5592dc660970 msgr2=0x5592dc662e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:28.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.281+0000 7f6d754fe9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.281+0000 7f6d754fe9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.281+0000 7f6d754fe9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.281+0000 7f6d754fe9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.281+0000 7f6d754fe9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.281+0000 7f6d754fe9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.281+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:28.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:28.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 zone default found 2024-09-12T00:34:28.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 4 Realm: () 2024-09-12T00:34:28.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:28.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:28.283 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:28.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 zonegroup default 2024-09-12T00:34:28.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.284 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.285+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.285 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.289+0000 7f6d754fe9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:28.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.289+0000 7f6d754fe9c0 20 started sync module instance, tier type = 2024-09-12T00:34:28.286 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.289+0000 7f6d754fe9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:28.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.313+0000 7f6d754fe9c0 20 add_watcher() i=0 2024-09-12T00:34:28.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.313+0000 7f6d754fe9c0 20 add_watcher() i=1 2024-09-12T00:34:28.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.313+0000 7f6d754fe9c0 20 add_watcher() i=2 2024-09-12T00:34:28.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.313+0000 7f6d754fe9c0 20 add_watcher() i=3 2024-09-12T00:34:28.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.313+0000 7f6d754fe9c0 20 add_watcher() i=4 2024-09-12T00:34:28.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.313+0000 7f6d754fe9c0 20 add_watcher() i=5 2024-09-12T00:34:28.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.313+0000 7f6d754fe9c0 20 add_watcher() i=6 2024-09-12T00:34:28.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.317+0000 7f6d754fe9c0 20 add_watcher() i=7 2024-09-12T00:34:28.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.317+0000 7f6d754fe9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:28.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.321+0000 7f6c297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:28.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.321+0000 7f6d754fe9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:28.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.321+0000 7f6d754fe9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:28.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 5 note: GC not initialized 2024-09-12T00:34:28.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6ba3fff640 20 reqs_thread_entry: start 2024-09-12T00:34:28.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:28.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 Filter name: none 2024-09-12T00:34:28.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6ba1ffb640 20 reqs_thread_entry: start 2024-09-12T00:34:28.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:34:28.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:28.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:34:28.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:28.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:28.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:28.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.325+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:28.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:28.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:28.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:28.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:28.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:28.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:28.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:28.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.329+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:28.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:28.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:28.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:28.330 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:28.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:28.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.333+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.337+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:28.333 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.337+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:28.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.337+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:28.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.337+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:28.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.337+0000 7f6d754fe9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:28.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.337+0000 7f6d754fe9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:28.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.341+0000 7f6c297e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:28.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.345+0000 7f6d754fe9c0 20 remove_watcher() i=0 2024-09-12T00:34:28.343 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.345+0000 7f6d754fe9c0 2 removed watcher, disabling cache 2024-09-12T00:34:28.345 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.349+0000 7f6d754fe9c0 20 remove_watcher() i=1 2024-09-12T00:34:28.347 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.349+0000 7f6d754fe9c0 20 remove_watcher() i=2 2024-09-12T00:34:28.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.353+0000 7f6d754fe9c0 20 remove_watcher() i=3 2024-09-12T00:34:28.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.357+0000 7f6d754fe9c0 20 remove_watcher() i=4 2024-09-12T00:34:28.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.357+0000 7f6d754fe9c0 20 remove_watcher() i=5 2024-09-12T00:34:28.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.361+0000 7f6d754fe9c0 20 remove_watcher() i=6 2024-09-12T00:34:28.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:28.365+0000 7f6d754fe9c0 20 remove_watcher() i=7 2024-09-12T00:34:58.396 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:34:58.428 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:58.428 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:58.473 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.472+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 realm 2024-09-12T00:34:58.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:58.476 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.476+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:58.477 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.480+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.480+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:58.478 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.480+0000 7f946c5609c0 20 searching for the correct realm 2024-09-12T00:34:58.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.484+0000 7f946a867640 0 -- 172.21.15.78:0/1173471181 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f945c0b6070 msgr2=0x7f945c0c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:58.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.696+0000 7f946a066640 0 -- 172.21.15.78:0/1173471181 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5646f3368230 msgr2=0x5646f336a6b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:58.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:58.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:58.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:58.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:58.709 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:58.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:58.710 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.708+0000 7f946c5609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 zone default found 2024-09-12T00:34:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 4 Realm: () 2024-09-12T00:34:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:58.713 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:58.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:58.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 zonegroup default 2024-09-12T00:34:58.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.715 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 started sync module instance, tier type = 2024-09-12T00:34:58.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.712+0000 7f946c5609c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:58.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.736+0000 7f946c5609c0 20 add_watcher() i=0 2024-09-12T00:34:58.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.736+0000 7f946c5609c0 20 add_watcher() i=1 2024-09-12T00:34:58.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.736+0000 7f946c5609c0 20 add_watcher() i=2 2024-09-12T00:34:58.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.736+0000 7f946c5609c0 20 add_watcher() i=3 2024-09-12T00:34:58.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.736+0000 7f946c5609c0 20 add_watcher() i=4 2024-09-12T00:34:58.736 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.736+0000 7f946c5609c0 20 add_watcher() i=5 2024-09-12T00:34:58.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.736+0000 7f946c5609c0 20 add_watcher() i=6 2024-09-12T00:34:58.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.740+0000 7f946c5609c0 20 add_watcher() i=7 2024-09-12T00:34:58.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.740+0000 7f946c5609c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:58.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f9320fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:58.743 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f946c5609c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:58.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f946c5609c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:58.744 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f946c5609c0 5 note: GC not initialized 2024-09-12T00:34:58.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f929b7fe640 20 reqs_thread_entry: start 2024-09-12T00:34:58.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f946c5609c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:58.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f946c5609c0 20 Filter name: none 2024-09-12T00:34:58.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f92997fa640 20 reqs_thread_entry: start 2024-09-12T00:34:58.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.744+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:58.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:34:58.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:58.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:58.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:34:58.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.748+0000 7f946c5609c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:34:58.750 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.752+0000 7f9320fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:58.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.756+0000 7f946c5609c0 20 remove_watcher() i=0 2024-09-12T00:34:58.755 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.756+0000 7f946c5609c0 2 removed watcher, disabling cache 2024-09-12T00:34:58.757 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.756+0000 7f946c5609c0 20 remove_watcher() i=1 2024-09-12T00:34:58.759 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.760+0000 7f946c5609c0 20 remove_watcher() i=2 2024-09-12T00:34:58.760 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.760+0000 7f946c5609c0 20 remove_watcher() i=3 2024-09-12T00:34:58.762 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.764+0000 7f946c5609c0 20 remove_watcher() i=4 2024-09-12T00:34:58.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.764+0000 7f946c5609c0 20 remove_watcher() i=5 2024-09-12T00:34:58.767 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.768+0000 7f946c5609c0 20 remove_watcher() i=6 2024-09-12T00:34:58.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.772+0000 7f946c5609c0 20 remove_watcher() i=7 2024-09-12T00:34:58.835 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:34:58.866 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:58.866 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:58.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.912+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 realm 2024-09-12T00:34:58.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:58.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:58.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:58.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:58.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:58.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.916+0000 7fd530f3a9c0 20 searching for the correct realm 2024-09-12T00:34:58.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:58.920+0000 7fd52e23f640 0 -- 172.21.15.78:0/3681010482 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fd52003f030 msgr2=0x7fd520064a50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:59.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.136+0000 7fd52ea40640 0 -- 172.21.15.78:0/3681010482 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fd524062040 msgr2=0x7fd524073150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:34:59.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:59.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:59.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:59.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:59.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:59.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:59.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.356+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:59.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 zone default found 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 4 Realm: () 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 zonegroup default 2024-09-12T00:34:59.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.360+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.364+0000 7fd530f3a9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.364+0000 7fd530f3a9c0 20 started sync module instance, tier type = 2024-09-12T00:34:59.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.364+0000 7fd530f3a9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.384+0000 7fd530f3a9c0 20 add_watcher() i=0 2024-09-12T00:34:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.384+0000 7fd530f3a9c0 20 add_watcher() i=1 2024-09-12T00:34:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.384+0000 7fd530f3a9c0 20 add_watcher() i=2 2024-09-12T00:34:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.384+0000 7fd530f3a9c0 20 add_watcher() i=3 2024-09-12T00:34:59.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.384+0000 7fd530f3a9c0 20 add_watcher() i=4 2024-09-12T00:34:59.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.384+0000 7fd530f3a9c0 20 add_watcher() i=5 2024-09-12T00:34:59.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.384+0000 7fd530f3a9c0 20 add_watcher() i=6 2024-09-12T00:34:59.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.388+0000 7fd530f3a9c0 20 add_watcher() i=7 2024-09-12T00:34:59.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.388+0000 7fd530f3a9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:34:59.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd3e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:59.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd530f3a9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:34:59.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd530f3a9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:34:59.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd530f3a9c0 5 note: GC not initialized 2024-09-12T00:34:59.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd35ffff640 20 reqs_thread_entry: start 2024-09-12T00:34:59.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd530f3a9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:34:59.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd530f3a9c0 20 Filter name: none 2024-09-12T00:34:59.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd35dffb640 20 reqs_thread_entry: start 2024-09-12T00:34:59.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd530f3a9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:34:59.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.392+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:34:59.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:34:59.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:34:59.394 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:34:59.395 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:59.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:34:59.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:59.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:34:59.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:59.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.396+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:34:59.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:59.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:34:59.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:59.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:34:59.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:59.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:34:59.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:59.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:34:59.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:59.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.400+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:34:59.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:59.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:34:59.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:59.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:34:59.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:59.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:34:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:59.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.404+0000 7fd530f3a9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:34:59.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.408+0000 7fd3e57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:34:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.412+0000 7fd530f3a9c0 20 remove_watcher() i=0 2024-09-12T00:34:59.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.412+0000 7fd530f3a9c0 2 removed watcher, disabling cache 2024-09-12T00:34:59.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.412+0000 7fd530f3a9c0 20 remove_watcher() i=1 2024-09-12T00:34:59.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.416+0000 7fd530f3a9c0 20 remove_watcher() i=2 2024-09-12T00:34:59.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.420+0000 7fd530f3a9c0 20 remove_watcher() i=3 2024-09-12T00:34:59.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.420+0000 7fd530f3a9c0 20 remove_watcher() i=4 2024-09-12T00:34:59.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.424+0000 7fd530f3a9c0 20 remove_watcher() i=5 2024-09-12T00:34:59.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.424+0000 7fd530f3a9c0 20 remove_watcher() i=6 2024-09-12T00:34:59.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.428+0000 7fd530f3a9c0 20 remove_watcher() i=7 2024-09-12T00:34:59.447 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:34:59.475 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:34:59.475 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:34:59.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.524+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.524+0000 7f7d5293e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.524+0000 7f7d5293e9c0 20 realm 2024-09-12T00:34:59.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.524+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.528+0000 7f7d5293e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.528+0000 7f7d5293e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:34:59.525 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.528+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.528+0000 7f7d5293e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.528+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.528+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:59.526 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.528+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.731 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.732+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:34:59.732 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.732+0000 7f7d5293e9c0 20 searching for the correct realm 2024-09-12T00:34:59.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.740+0000 7f7d50c45640 0 -- 172.21.15.78:0/873880015 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x5608e159af40 msgr2=0x5608e159d330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:59.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.748+0000 7f7d4fc43640 0 -- 172.21.15.78:0/873880015 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f7d40121380 msgr2=0x7f7d40124950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:34:59.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:34:59.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 zone default found 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 4 Realm: () 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 zonegroup default 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.968+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.972+0000 7f7d5293e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.972+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.972+0000 7f7d5293e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.972+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:34:59.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.972+0000 7f7d5293e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:34:59.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.972+0000 7f7d5293e9c0 20 started sync module instance, tier type = 2024-09-12T00:34:59.971 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.972+0000 7f7d5293e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:34:59.996 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.996+0000 7f7d5293e9c0 20 add_watcher() i=0 2024-09-12T00:34:59.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.996+0000 7f7d5293e9c0 20 add_watcher() i=1 2024-09-12T00:34:59.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.996+0000 7f7d5293e9c0 20 add_watcher() i=2 2024-09-12T00:34:59.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.996+0000 7f7d5293e9c0 20 add_watcher() i=3 2024-09-12T00:34:59.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.996+0000 7f7d5293e9c0 20 add_watcher() i=4 2024-09-12T00:34:59.997 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.996+0000 7f7d5293e9c0 20 add_watcher() i=5 2024-09-12T00:34:59.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:34:59.996+0000 7f7d5293e9c0 20 add_watcher() i=6 2024-09-12T00:35:00.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.000+0000 7f7d5293e9c0 20 add_watcher() i=7 2024-09-12T00:35:00.001 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.000+0000 7f7d5293e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:00.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7c06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:00.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:00.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 5 note: GC not initialized 2024-09-12T00:35:00.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7c05fdb640 20 reqs_thread_entry: start 2024-09-12T00:35:00.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:00.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 Filter name: none 2024-09-12T00:35:00.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7b777fe640 20 reqs_thread_entry: start 2024-09-12T00:35:00.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:00.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:35:00.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:00.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.008+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.012+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:00.009 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.012+0000 7f7d5293e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.012+0000 7f7d5293e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:35:00.010 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.012+0000 7f7d5293e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:00.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.016+0000 7f7c06fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.020+0000 7f7d5293e9c0 20 remove_watcher() i=0 2024-09-12T00:35:00.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.020+0000 7f7d5293e9c0 2 removed watcher, disabling cache 2024-09-12T00:35:00.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.024+0000 7f7d5293e9c0 20 remove_watcher() i=1 2024-09-12T00:35:00.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.024+0000 7f7d5293e9c0 20 remove_watcher() i=2 2024-09-12T00:35:00.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.028+0000 7f7d5293e9c0 20 remove_watcher() i=3 2024-09-12T00:35:00.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.028+0000 7f7d5293e9c0 20 remove_watcher() i=4 2024-09-12T00:35:00.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.032+0000 7f7d5293e9c0 20 remove_watcher() i=5 2024-09-12T00:35:00.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.032+0000 7f7d5293e9c0 20 remove_watcher() i=6 2024-09-12T00:35:00.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.036+0000 7f7d5293e9c0 20 remove_watcher() i=7 2024-09-12T00:35:00.052 INFO:tasks.workunit.client.0.smithi078.stderr: test: duplicated entries should be purged before reshard 2024-09-12T00:35:00.053 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:35:00.080 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:00.080 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:00.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 realm 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.128+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.132+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:00.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.132+0000 7efdbceb39c0 20 searching for the correct realm 2024-09-12T00:35:00.134 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.136+0000 7efdba9b9640 0 -- 172.21.15.78:0/244840019 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55fb6eed5420 msgr2=0x55fb6eed78e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.140+0000 7efdb3fff640 0 -- 172.21.15.78:0/244840019 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7efdac008b70 msgr2=0x7efdac026400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:00.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.360+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 zone default found 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 4 Realm: () 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 zonegroup default 2024-09-12T00:35:00.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.364+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.368+0000 7efdbceb39c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.368+0000 7efdbceb39c0 20 started sync module instance, tier type = 2024-09-12T00:35:00.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.368+0000 7efdbceb39c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:00.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.388+0000 7efdbceb39c0 20 add_watcher() i=0 2024-09-12T00:35:00.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.388+0000 7efdbceb39c0 20 add_watcher() i=1 2024-09-12T00:35:00.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.388+0000 7efdbceb39c0 20 add_watcher() i=2 2024-09-12T00:35:00.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.388+0000 7efdbceb39c0 20 add_watcher() i=3 2024-09-12T00:35:00.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.388+0000 7efdbceb39c0 20 add_watcher() i=4 2024-09-12T00:35:00.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.388+0000 7efdbceb39c0 20 add_watcher() i=5 2024-09-12T00:35:00.389 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.388+0000 7efdbceb39c0 20 add_watcher() i=6 2024-09-12T00:35:00.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.392+0000 7efdbceb39c0 20 add_watcher() i=7 2024-09-12T00:35:00.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.392+0000 7efdbceb39c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:00.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.396+0000 7efc717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.396+0000 7efdbceb39c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:00.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.396+0000 7efdbceb39c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:00.397 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.396+0000 7efdbceb39c0 5 note: GC not initialized 2024-09-12T00:35:00.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efbebfff640 20 reqs_thread_entry: start 2024-09-12T00:35:00.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 Filter name: none 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efbe9ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:00.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:00.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:35:00.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.400+0000 7efdbceb39c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:00.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.408+0000 7efc717e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.412+0000 7efdbceb39c0 20 remove_watcher() i=0 2024-09-12T00:35:00.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.412+0000 7efdbceb39c0 2 removed watcher, disabling cache 2024-09-12T00:35:00.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.412+0000 7efdbceb39c0 20 remove_watcher() i=1 2024-09-12T00:35:00.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.412+0000 7efdbceb39c0 20 remove_watcher() i=2 2024-09-12T00:35:00.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.416+0000 7efdbceb39c0 20 remove_watcher() i=3 2024-09-12T00:35:00.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.420+0000 7efdbceb39c0 20 remove_watcher() i=4 2024-09-12T00:35:00.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.420+0000 7efdbceb39c0 20 remove_watcher() i=5 2024-09-12T00:35:00.422 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.424+0000 7efdbceb39c0 20 remove_watcher() i=6 2024-09-12T00:35:00.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.424+0000 7efdbceb39c0 20 remove_watcher() i=7 2024-09-12T00:35:00.448 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 10 size_kb: 1 num_shards: 13 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.449 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:35:00.488 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:00.488 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:00.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.532+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 realm 2024-09-12T00:35:00.535 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:00.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.536 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:00.538 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 searching for the correct realm 2024-09-12T00:35:00.540 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.540+0000 7f1039071640 0 -- 172.21.15.78:0/2082566518 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f1024002300 msgr2=0x7f102c06cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.548+0000 7f1039872640 0 -- 172.21.15.78:0/2082566518 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f10300017c0 msgr2=0x7f1030136130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:00.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:00.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:00.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:00.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:00.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:00.768 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:00.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.769 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 zone default found 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 Realm: () 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 zonegroup default 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 started sync module instance, tier type = 2024-09-12T00:35:00.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:00.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=0 2024-09-12T00:35:00.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=1 2024-09-12T00:35:00.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=2 2024-09-12T00:35:00.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=3 2024-09-12T00:35:00.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=4 2024-09-12T00:35:00.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=5 2024-09-12T00:35:00.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=6 2024-09-12T00:35:00.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.800+0000 7f103bd6c9c0 20 add_watcher() i=7 2024-09-12T00:35:00.798 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.800+0000 7f103bd6c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:00.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f0eeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:00.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:00.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 note: GC not initialized 2024-09-12T00:35:00.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f0eea7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:00.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:00.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 Filter name: none 2024-09-12T00:35:00.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f0e5bfff640 20 reqs_thread_entry: start 2024-09-12T00:35:00.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:00.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:00.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:00.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:00.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:00.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.808+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:35:00.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:00.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:00.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.816 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399019 cookie 94779549160304 notifier 8301 bl.length()=827 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:35:00.817 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:35:00.830 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f103bd6c9c0 time 2024-09-12T00:35:00.835607+0000 2024-09-12T00:35:00.831 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:00.831 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f103f6462eb] 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.832+0000 7f103bd6c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f103bd6c9c0 time 2024-09-12T00:35:00.835607+0000 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.832 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f103f6462eb] 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:35:00.833 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f103bd6c9c0 thread_name:radosgw-admin 2024-09-12T00:35:00.849 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f103e4c5520] 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f103f646345] 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:35:00.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.832+0000 7f103bd6c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f103bd6c9c0 thread_name:radosgw-admin 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f103e4c5520] 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f103f646345] 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.851 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:35:00.512+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:35:00.512+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:35:00.512+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:35:00.512+0000 7f103a073640 10 monclient(hunting): handle_auth_done global_id 7736 payload 274 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:35:00.512+0000 7f103a073640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:35:00.512+0000 7f103a073640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.852 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:35:00.512+0000 7f103a073640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: dump: 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.853 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: dump: 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.854 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7736 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 4 set_mon_vals no callback set 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: shutdown 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) unregister_commands rotate-key 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.855 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding auth protocol: cephx 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding auth protocol: cephx 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding auth protocol: cephx 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.856 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: starting msgr at 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: starting objecter 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command objecter_requests hook 0x563395292430 2024-09-12T00:35:00.857 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: setting wanted keys 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: calling monclient init 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding auth protocol: cephx 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding auth protocol: cephx 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding auth protocol: cephx 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.858 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key hook 0x5633954c0ed8 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x5633954f5300 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x5633954f9d20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x7f1024003100 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.859 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.852107s 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): get_auth_request con 0x5633954f5300 auth_method 0 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): get_auth_request con 0x7f1024003100 auth_method 0 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.860 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:35:00.516+0000 7f1039872640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: dump: 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.861 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: dump: 2024-09-12T00:35:00.862 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7739 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:35:00.516+0000 7f0f27e07640 4 set_mon_vals no callback set 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.863 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 1 librados: init done 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:35:00.516+0000 7f0f26604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:35:00.516+0000 7f0f26604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:35:00.516+0000 7f0f26604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:35:00.516+0000 7f1039071640 10 monclient: get_auth_request con 0x7f0f20070b10 auth_method 0 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient: get_auth_request con 0x5633954febb0 auth_method 0 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:35:00.520+0000 7f1039872640 10 monclient: get_auth_request con 0x56339550ba10 auth_method 0 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:35:00.520+0000 7f1039071640 10 monclient: get_auth_request con 0x56339550fe30 auth_method 0 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:35:00.520+0000 7f103a073640 10 monclient: get_auth_request con 0x56339550f2c0 auth_method 0 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.864 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding auth protocol: cephx 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding auth protocol: cephx 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding auth protocol: cephx 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.865 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command objecter_requests cmddesc objecter_requests hook 0x56339551b9a0 EEXIST 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.866 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding auth protocol: cephx 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding auth protocol: cephx 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding auth protocol: cephx 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.867 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key cmddesc rotate-key hook 0x563395517010 EEXIST 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x56339553fb50 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x56339553f480 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x56339553de60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.868 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.862357s 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): get_auth_request con 0x56339553fb50 auth_method 0 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): get_auth_request con 0x56339553de60 auth_method 0 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.869 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): get_auth_request con 0x56339553f480 auth_method 0 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:35:00.524+0000 7f1039872640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: dump: 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.870 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: dump: 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.871 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7742 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:35:00.524+0000 7f103a874640 4 set_mon_vals no callback set 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.872 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:35:00.528+0000 7f0f1f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:35:00.528+0000 7f0f1f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:35:00.528+0000 7f0f1f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient: get_auth_request con 0x7f0f14070a20 auth_method 0 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.873 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding auth protocol: cephx 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding auth protocol: cephx 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding auth protocol: cephx 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.874 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding auth protocol: cephx 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding auth protocol: cephx 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding auth protocol: cephx 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.875 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd42ddea18 EEXIST 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:00.876 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x5633955937e0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x56339558ebd0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x56339558f550 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.866593s 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): get_auth_request con 0x5633955937e0 auth_method 0 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): get_auth_request con 0x56339558f550 auth_method 0 2024-09-12T00:35:00.877 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_done global_id 7745 payload 274 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:35:00.528+0000 7f1039071640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.878 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: dump: 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.879 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: dump: 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.880 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7745 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 4 set_mon_vals no callback set 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: shutdown 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.881 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding auth protocol: cephx 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding auth protocol: cephx 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding auth protocol: cephx 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.882 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: starting msgr at 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: starting objecter 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command objecter_requests cmddesc objecter_requests hook 0x56339555efd0 EEXIST 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: setting wanted keys 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: calling monclient init 2024-09-12T00:35:00.883 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding auth protocol: cephx 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding auth protocol: cephx 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding auth protocol: cephx 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.884 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key cmddesc rotate-key hook 0x563395541ab8 EEXIST 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x56339558ebd0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x56339558f550 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x5633955937e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.885 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.869336s 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): get_auth_request con 0x56339558ebd0 auth_method 0 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): get_auth_request con 0x56339558f550 auth_method 0 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.886 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_done global_id 8301 payload 824 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:35:00.532+0000 7f1039071640 1 monclient: found mon.noname-a 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: dump: 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.887 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: dump: 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.888 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 8301 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:35:00.532+0000 7f0f1d7fa640 4 set_mon_vals no callback set 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: init done 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cr dump hook 0x56339558abf8 2024-09-12T00:35:00.889 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:35:00.536+0000 7f0f0b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:35:00.536+0000 7f0f0b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:35:00.536+0000 7f0f0b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:35:00.536+0000 7f103a073640 10 monclient: get_auth_request con 0x7f0f04070b10 auth_method 0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:35:00.536+0000 7f1039872640 10 monclient: get_auth_request con 0x5633955ad060 auth_method 0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 realm 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:35:00.536+0000 7f1039071640 10 monclient: get_auth_request con 0x5633955b13a0 auth_method 0 2024-09-12T00:35:00.890 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:35:00.540+0000 7f103a073640 10 monclient: get_auth_request con 0x5633955b4ac0 auth_method 0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 searching for the correct realm 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:35:00.540+0000 7f1039872640 10 monclient: get_auth_request con 0x5633955b9880 auth_method 0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:35:00.540+0000 7f1039071640 10 monclient: get_auth_request con 0x7f1024002300 auth_method 0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:35:00.540+0000 7f1039071640 0 -- 172.21.15.78:0/2082566518 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f1024002300 msgr2=0x7f102c06cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:35:00.540+0000 7f0f0b7fe640 1 client.8301.objecter ms_handle_reset 0x7f1024002300 session 0x7f102c076070 osd.2 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:35:00.540+0000 7f0f0b7fe640 10 monclient: _renew_subs 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:35:00.540+0000 7f0f0b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:35:00.540+0000 7f1039071640 10 monclient: get_auth_request con 0x7f0f04080d40 auth_method 0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:35:00.544+0000 7f103a073640 10 monclient: get_auth_request con 0x7f102c07cf30 auth_method 0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:35:00.548+0000 7f1039872640 10 monclient: get_auth_request con 0x7f10300017c0 auth_method 0 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:35:00.548+0000 7f1039872640 0 -- 172.21.15.78:0/2082566518 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f10300017c0 msgr2=0x7f1030136130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:00.891 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:35:00.752+0000 7f1039872640 10 monclient: get_auth_request con 0x7f10300017c0 auth_method 0 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:35:00.752+0000 7f1039071640 10 monclient: get_auth_request con 0x7f102c06dd50 auth_method 0 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.892 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 zone default found 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 Realm: () 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 zonegroup default 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.893 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 started sync module instance, tier type = 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=0 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=1 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=2 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=3 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=4 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=5 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=6 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:35:00.800+0000 7f103bd6c9c0 20 add_watcher() i=7 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:35:00.800+0000 7f103bd6c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding auth protocol: cephx 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding auth protocol: cephx 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding auth protocol: cephx 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.894 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:35:00.804+0000 7f0eeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:00.895 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache list hook 0x5633955844e0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache inspect hook 0x5633955844e0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache erase hook 0x5633955844e0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache zap hook 0x5633955844e0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 note: GC not initialized 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:35:00.804+0000 7f0eea7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace show hook 0x7f10340048d0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace history hook 0x7f10340048d0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace active hook 0x7f10340048d0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace active_short hook 0x7f10340048d0 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 Filter name: none 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:35:00.804+0000 7f0e5bfff640 20 reqs_thread_entry: start 2024-09-12T00:35:00.896 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.897 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399019 cookie 94779549160304 notifier 8301 bl.length()=827 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:35:00.832+0000 7f103bd6c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f103bd6c9c0 time 2024-09-12T00:35:00.835607+0000 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.898 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f103f6462eb] 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:35:00.832+0000 7f103bd6c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f103bd6c9c0 thread_name:radosgw-admin 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f103e4c5520] 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:00.899 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f103f646345] 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:35:00.900 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:35:00.901 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:35:00.902 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:00.903 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:35:00.904 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:00.905 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:35:00.906 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0e5bfff640 / http_manager 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0eea7fc640 / http_manager 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0eeb7fe640 / rgw_dt_lg_renew 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f0b7fe640 / ms_dispatch 2024-09-12T00:35:00.907 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f1cff9640 / io_context_pool 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f1d7fa640 / io_context_pool 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f1f7fe640 / ms_dispatch 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f26604640 / ms_dispatch 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f27e07640 / io_context_pool 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1039071640 / msgr-worker-2 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1039872640 / msgr-worker-1 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f103a073640 / msgr-worker-0 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f103a874640 / io_context_pool 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: 7f103bd6c9c0 / radosgw-admin 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.141798.log 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:35:00.908 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:35:00.512+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:35:00.512+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:35:00.512+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:35:00.512+0000 7f103a073640 10 monclient(hunting): handle_auth_done global_id 7736 payload 274 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:35:00.512+0000 7f103a073640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:35:00.512+0000 7f103a073640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:35:00.512+0000 7f103a073640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: dump: 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.909 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.910 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:35:00.512+0000 7f0f27e07640 10 monclient: dump: 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7736 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:00.911 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 4 set_mon_vals no callback set 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: shutdown 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) unregister_commands rotate-key 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.912 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding auth protocol: cephx 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding auth protocol: cephx 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding auth protocol: cephx 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.913 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: crc 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c3c00) adding con mode: secure 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: starting msgr at 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: starting objecter 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command objecter_requests hook 0x563395292430 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: setting wanted keys 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 1 librados: calling monclient init 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding auth protocol: cephx 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding auth protocol: cephx 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding auth protocol: cephx 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.914 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: crc 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 5 AuthRegistry(0x5633954c0d90) adding con mode: secure 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:35:00.512+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key hook 0x5633954c0ed8 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.915 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x5633954f5300 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x5633954f9d20 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x7f1024003100 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.852107s 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): get_auth_request con 0x5633954f5300 auth_method 0 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.916 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): get_auth_request con 0x7f1024003100 auth_method 0 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient(hunting): handle_auth_done global_id 7739 payload 824 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:35:00.516+0000 7f1039872640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:35:00.516+0000 7f1039872640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.917 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: dump: 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.918 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:35:00.516+0000 7f0f26604640 10 monclient: dump: 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.919 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7739 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:35:00.516+0000 7f0f27e07640 4 set_mon_vals no callback set 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:35:00.516+0000 7f103bd6c9c0 1 librados: init done 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:35:00.516+0000 7f0f26604640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:35:00.516+0000 7f0f26604640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:35:00.516+0000 7f0f26604640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:35:00.516+0000 7f1039071640 10 monclient: get_auth_request con 0x7f0f20070b10 auth_method 0 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:35:00.516+0000 7f103a073640 10 monclient: get_auth_request con 0x5633954febb0 auth_method 0 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:35:00.520+0000 7f1039872640 10 monclient: get_auth_request con 0x56339550ba10 auth_method 0 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:35:00.520+0000 7f1039071640 10 monclient: get_auth_request con 0x56339550fe30 auth_method 0 2024-09-12T00:35:00.920 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:35:00.520+0000 7f103a073640 10 monclient: get_auth_request con 0x56339550f2c0 auth_method 0 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.921 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding auth protocol: cephx 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding auth protocol: cephx 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding auth protocol: cephx 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: crc 2024-09-12T00:35:00.922 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395517fd0) adding con mode: secure 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command objecter_requests cmddesc objecter_requests hook 0x56339551b9a0 EEXIST 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding auth protocol: cephx 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding auth protocol: cephx 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding auth protocol: cephx 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.923 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: crc 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 AuthRegistry(0x563395516ec8) adding con mode: secure 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key cmddesc rotate-key hook 0x563395517010 EEXIST 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[0,1,2] 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x56339553fb50 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x56339553f480 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.924 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x56339553de60 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.862357s 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): get_auth_request con 0x56339553fb50 auth_method 0 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): get_auth_request con 0x56339553de60 auth_method 0 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.925 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:35:00.524+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): get_auth_request con 0x56339553f480 auth_method 0 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:35:00.524+0000 7f103a073640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient(hunting): handle_auth_done global_id 7742 payload 824 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:35:00.524+0000 7f1039872640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:35:00.524+0000 7f1039872640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.926 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: dump: 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.927 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:35:00.524+0000 7f0f1f7fe640 10 monclient: dump: 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.928 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7742 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:35:00.524+0000 7f103a874640 4 set_mon_vals no callback set 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:35:00.524+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:35:00.528+0000 7f0f1f7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:35:00.528+0000 7f0f1f7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:35:00.528+0000 7f0f1f7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient: get_auth_request con 0x7f0f14070a20 auth_method 0 2024-09-12T00:35:00.929 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.930 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding auth protocol: cephx 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding auth protocol: cephx 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding auth protocol: cephx 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.931 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: crc 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x56339555f2e0) adding con mode: secure 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding auth protocol: cephx 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding auth protocol: cephx 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding auth protocol: cephx 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.932 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: crc 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42dde8d0) adding con mode: secure 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key cmddesc rotate-key hook 0x7ffd42ddea18 EEXIST 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x5633955937e0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x56339558ebd0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x56339558f550 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.933 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.866593s 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): get_auth_request con 0x5633955937e0 auth_method 0 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): get_auth_request con 0x56339558f550 auth_method 0 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.934 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:35:00.528+0000 7f1039872640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient(hunting): handle_auth_done global_id 7745 payload 274 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:35:00.528+0000 7f1039071640 1 monclient: found mon.noname-c 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:35:00.528+0000 7f1039071640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: dump: 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.935 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:00.936 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:35:00.528+0000 7f0f1d7fa640 10 monclient: dump: 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 7745 2024-09-12T00:35:00.937 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:35:00.528+0000 7f103bd6c9c0 4 set_mon_vals no callback set 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: shutdown 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: build_initial_monmap 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: monmap: 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:00.938 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding auth protocol: cephx 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding auth protocol: cephx 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding auth protocol: cephx 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.939 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: crc 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395585b30) adding con mode: secure 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: starting msgr at 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: starting objecter 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command objecter_requests cmddesc objecter_requests hook 0x56339555efd0 EEXIST 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: setting wanted keys 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: calling monclient init 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: init 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding auth protocol: cephx 2024-09-12T00:35:00.940 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding auth protocol: cephx 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding auth protocol: cephx 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: crc 2024-09-12T00:35:00.941 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 AuthRegistry(0x563395541970) adding con mode: secure 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command rotate-key cmddesc rotate-key hook 0x563395541ab8 EEXIST 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _add_conns ranks=[0,2,1] 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-a con 0x56339558ebd0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-c con 0x56339558f550 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): picked mon.noname-b con 0x5633955937e0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:00.942 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient(hunting): authenticate will time out at 2424.869336s 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): get_auth_request con 0x56339558ebd0 auth_method 0 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): get_auth_request con 0x56339558f550 auth_method 0 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:35:00.532+0000 7f103a073640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:00.943 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient(hunting): handle_auth_done global_id 8301 payload 824 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient: _finish_hunting 0 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:35:00.532+0000 7f1039071640 1 monclient: found mon.noname-a 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:35:00.532+0000 7f1039071640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: dump: 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.944 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: _finish_auth 0 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: _check_auth_tickets 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:35:00.532+0000 7f0f0b7fe640 10 monclient: dump: 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:00.945 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 monclient: authenticate success, global_id 8301 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:35:00.532+0000 7f0f1d7fa640 4 set_mon_vals no callback set 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _renew_subs 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 1 librados: init done 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cr dump hook 0x56339558abf8 2024-09-12T00:35:00.946 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:35:00.532+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:35:00.536+0000 7f0f0b7fe640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:35:00.536+0000 7f0f0b7fe640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:35:00.536+0000 7f0f0b7fe640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:35:00.536+0000 7f103a073640 10 monclient: get_auth_request con 0x7f0f04070b10 auth_method 0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:35:00.536+0000 7f1039872640 10 monclient: get_auth_request con 0x5633955ad060 auth_method 0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 realm 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.947 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:35:00.536+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:35:00.536+0000 7f1039071640 10 monclient: get_auth_request con 0x5633955b13a0 auth_method 0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:35:00.540+0000 7f103a073640 10 monclient: get_auth_request con 0x5633955b4ac0 auth_method 0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:35:00.540+0000 7f103bd6c9c0 20 searching for the correct realm 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:35:00.540+0000 7f1039872640 10 monclient: get_auth_request con 0x5633955b9880 auth_method 0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:35:00.540+0000 7f1039071640 10 monclient: get_auth_request con 0x7f1024002300 auth_method 0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:35:00.540+0000 7f1039071640 0 -- 172.21.15.78:0/2082566518 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f1024002300 msgr2=0x7f102c06cab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:35:00.540+0000 7f0f0b7fe640 1 client.8301.objecter ms_handle_reset 0x7f1024002300 session 0x7f102c076070 osd.2 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:35:00.540+0000 7f0f0b7fe640 10 monclient: _renew_subs 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:35:00.540+0000 7f0f0b7fe640 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:35:00.540+0000 7f1039071640 10 monclient: get_auth_request con 0x7f0f04080d40 auth_method 0 2024-09-12T00:35:00.948 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:35:00.544+0000 7f103a073640 10 monclient: get_auth_request con 0x7f102c07cf30 auth_method 0 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:35:00.548+0000 7f1039872640 10 monclient: get_auth_request con 0x7f10300017c0 auth_method 0 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:35:00.548+0000 7f1039872640 0 -- 172.21.15.78:0/2082566518 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f10300017c0 msgr2=0x7f1030136130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:35:00.752+0000 7f1039872640 10 monclient: get_auth_request con 0x7f10300017c0 auth_method 0 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:35:00.752+0000 7f1039071640 10 monclient: get_auth_request con 0x7f102c06dd50 auth_method 0 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.949 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:35:00.768+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 zone default found 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 Realm: () 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 zonegroup default 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.950 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:35:00.772+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 started sync module instance, tier type = 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:35:00.776+0000 7f103bd6c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=0 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=1 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=2 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=3 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=4 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=5 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:35:00.796+0000 7f103bd6c9c0 20 add_watcher() i=6 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:35:00.800+0000 7f103bd6c9c0 20 add_watcher() i=7 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:35:00.800+0000 7f103bd6c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:00.951 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding auth protocol: cephx 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding auth protocol: cephx 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding auth protocol: cephx 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:35:00.804+0000 7f0eeb7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.952 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: crc 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 AuthRegistry(0x7ffd42ddedb0) adding con mode: secure 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache list hook 0x5633955844e0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache inspect hook 0x5633955844e0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache erase hook 0x5633955844e0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command cache zap hook 0x5633955844e0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 note: GC not initialized 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:35:00.804+0000 7f0eea7fc640 20 reqs_thread_entry: start 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace show hook 0x7f10340048d0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace history hook 0x7f10340048d0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace active hook 0x7f10340048d0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 5 asok(0x5633952b72b0) register_command sync trace active_short hook 0x7f10340048d0 2024-09-12T00:35:00.953 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 Filter name: none 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:35:00.804+0000 7f0e5bfff640 20 reqs_thread_entry: start 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:35:00.804+0000 7f103bd6c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.954 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:35:00.808+0000 7f103bd6c9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:35:00.816+0000 7f103bd6c9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399019 cookie 94779549160304 notifier 8301 bl.length()=827 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:35:00.816+0000 7f0f1cff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:35:00.955 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:35:00.820+0000 7f103bd6c9c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:35:00.832+0000 7f103bd6c9c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f103bd6c9c0 time 2024-09-12T00:35:00.835607+0000 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f103f6462eb] 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:35:00.956 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:35:00.832+0000 7f103bd6c9c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f103bd6c9c0 thread_name:radosgw-admin 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f103e4c5520] 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f103f646345] 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f103f64649f] 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x5633928eecc1] 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x563392903d5a] 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:35:00.957 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f103e4acd90] 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:35:00.958 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:00.959 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:35:00.960 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:00.961 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:35:00.962 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:00.963 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:00.964 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0e5bfff640 / http_manager 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0eea7fc640 / http_manager 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0eeb7fe640 / rgw_dt_lg_renew 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f0b7fe640 / ms_dispatch 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f1cff9640 / io_context_pool 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f1d7fa640 / io_context_pool 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f1f7fe640 / ms_dispatch 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f26604640 / ms_dispatch 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0f27e07640 / io_context_pool 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1039071640 / msgr-worker-2 2024-09-12T00:35:00.965 INFO:tasks.workunit.client.0.smithi078.stderr: 7f1039872640 / msgr-worker-1 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr: 7f103a073640 / msgr-worker-0 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr: 7f103a874640 / io_context_pool 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr: 7f103bd6c9c0 / radosgw-admin 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:35:00.837746Z_8de8d82d-bab0-4b15-98f5-035b7d7cec66/log 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:35:00.966 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.916+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 realm 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:00.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.920+0000 7fef45a7f9c0 20 searching for the correct realm 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.924+0000 7fef43585640 0 -- 172.21.15.78:0/1786196005 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55c9fb642e70 msgr2=0x55c9fb645310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:00.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:00.932+0000 7fef42d84640 0 -- 172.21.15.78:0/1786196005 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fef3c107810 msgr2=0x7fef3c0098c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:01.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.148+0000 7fef45a7f9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:01.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.148+0000 7fef45a7f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:01.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.148+0000 7fef45a7f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:01.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.148+0000 7fef45a7f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:01.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.148+0000 7fef45a7f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:01.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.148+0000 7fef45a7f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:01.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.148+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:01.150 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:01.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 zone default found 2024-09-12T00:35:01.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 4 Realm: () 2024-09-12T00:35:01.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:01.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:01.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:01.151 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 zonegroup default 2024-09-12T00:35:01.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.152 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.152+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.156+0000 7fef45a7f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.156+0000 7fef45a7f9c0 20 started sync module instance, tier type = 2024-09-12T00:35:01.155 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.156+0000 7fef45a7f9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:01.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=0 2024-09-12T00:35:01.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=1 2024-09-12T00:35:01.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=2 2024-09-12T00:35:01.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=3 2024-09-12T00:35:01.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=4 2024-09-12T00:35:01.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=5 2024-09-12T00:35:01.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=6 2024-09-12T00:35:01.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 20 add_watcher() i=7 2024-09-12T00:35:01.180 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.180+0000 7fef45a7f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:01.185 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.184+0000 7fedf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:01.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:01.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:01.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 5 note: GC not initialized 2024-09-12T00:35:01.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fedf8fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:01.186 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:01.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 Filter name: none 2024-09-12T00:35:01.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fed727fc640 20 reqs_thread_entry: start 2024-09-12T00:35:01.187 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:01.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:35:01.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:01.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:01.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.188+0000 7fef45a7f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.192+0000 7fef45a7f9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:35:01.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.192+0000 7fef45a7f9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:35:01.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.192+0000 7fedf9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:01.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.200+0000 7fef45a7f9c0 20 remove_watcher() i=0 2024-09-12T00:35:01.197 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.200+0000 7fef45a7f9c0 2 removed watcher, disabling cache 2024-09-12T00:35:01.199 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.200+0000 7fef45a7f9c0 20 remove_watcher() i=1 2024-09-12T00:35:01.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.204+0000 7fef45a7f9c0 20 remove_watcher() i=2 2024-09-12T00:35:01.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.204+0000 7fef45a7f9c0 20 remove_watcher() i=3 2024-09-12T00:35:01.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.208+0000 7fef45a7f9c0 20 remove_watcher() i=4 2024-09-12T00:35:01.208 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.208+0000 7fef45a7f9c0 20 remove_watcher() i=5 2024-09-12T00:35:01.210 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.212+0000 7fef45a7f9c0 20 remove_watcher() i=6 2024-09-12T00:35:01.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.216+0000 7fef45a7f9c0 20 remove_watcher() i=7 2024-09-12T00:35:01.242 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:35:01.269 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:01.269 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:01.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 realm 2024-09-12T00:35:01.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:01.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.316+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.320+0000 7f5ea09659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:01.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.320+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.320+0000 7f5ea09659c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:01.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.320+0000 7f5ea09659c0 20 searching for the correct realm 2024-09-12T00:35:01.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.324+0000 7f5e9ec6c640 0 -- 172.21.15.78:0/3415582881 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f5e900fe1f0 msgr2=0x7f5e901189d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:01.537 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.540+0000 7f5e9e46b640 0 -- 172.21.15.78:0/3415582881 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x562ec09a1ec0 msgr2=0x562ec09a4300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:01.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.548+0000 7f5ea09659c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:01.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.548+0000 7f5ea09659c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:01.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.548+0000 7f5ea09659c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:01.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.548+0000 7f5ea09659c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:01.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.548+0000 7f5ea09659c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:01.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.548+0000 7f5ea09659c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:01.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.548+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:01.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:01.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 zone default found 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 4 Realm: () 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 zonegroup default 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.552+0000 7f5ea09659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.556+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.556+0000 7f5ea09659c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:01.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.556+0000 7f5ea09659c0 20 started sync module instance, tier type = 2024-09-12T00:35:01.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.556+0000 7f5ea09659c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:01.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=0 2024-09-12T00:35:01.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=1 2024-09-12T00:35:01.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=2 2024-09-12T00:35:01.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=3 2024-09-12T00:35:01.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=4 2024-09-12T00:35:01.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=5 2024-09-12T00:35:01.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=6 2024-09-12T00:35:01.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 20 add_watcher() i=7 2024-09-12T00:35:01.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.580+0000 7f5ea09659c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:01.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5d557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:01.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:01.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:01.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 5 note: GC not initialized 2024-09-12T00:35:01.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5d4f7fe640 20 reqs_thread_entry: start 2024-09-12T00:35:01.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:01.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 20 Filter name: none 2024-09-12T00:35:01.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5d4d7fa640 20 reqs_thread_entry: start 2024-09-12T00:35:01.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:01.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:01.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:01.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:01.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:01.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.588+0000 7f5ea09659c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:01.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:35:01.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:35:01.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:35:01.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:35:01.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:35:01.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:35:01.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:35:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:35:01.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.592+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:35:01.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:35:01.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:35:01.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:35:01.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:35:01.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:35:01.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:35:01.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:35:01.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:35:01.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:35:01.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:35:01.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:35:01.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.596+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:35:01.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.600+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:35:01.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.600+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:35:01.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.600+0000 7f5ea09659c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:35:01.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.600+0000 7f5ea09659c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:35:01.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.600+0000 7f5d557e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:01.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.608+0000 7f5ea09659c0 20 remove_watcher() i=0 2024-09-12T00:35:01.605 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.608+0000 7f5ea09659c0 2 removed watcher, disabling cache 2024-09-12T00:35:01.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.608+0000 7f5ea09659c0 20 remove_watcher() i=1 2024-09-12T00:35:01.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.612+0000 7f5ea09659c0 20 remove_watcher() i=2 2024-09-12T00:35:01.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.612+0000 7f5ea09659c0 20 remove_watcher() i=3 2024-09-12T00:35:01.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.616+0000 7f5ea09659c0 20 remove_watcher() i=4 2024-09-12T00:35:01.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.616+0000 7f5ea09659c0 20 remove_watcher() i=5 2024-09-12T00:35:01.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.620+0000 7f5ea09659c0 20 remove_watcher() i=6 2024-09-12T00:35:01.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:01.624+0000 7f5ea09659c0 20 remove_watcher() i=7 2024-09-12T00:35:31.664 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at logrecord_writes 2024-09-12T00:35:31.704 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:31.704 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:31.749 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.748+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:31.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:31.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 realm 2024-09-12T00:35:31.751 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:31.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:31.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:31.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:31.752 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:31.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:31.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:31.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:31.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:31.754 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 searching for the correct realm 2024-09-12T00:35:31.756 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.756+0000 7f35f29ba640 0 -- 172.21.15.78:0/3104580371 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f35e40dd040 msgr2=0x7f35e40b0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:31.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:31.972+0000 7f35f31bb640 0 -- 172.21.15.78:0/3104580371 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f35e806a0e0 msgr2=0x7f35e807c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:32.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:32.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:32.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:32.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:32.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:32.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:32.192 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:32.193 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 zone default found 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 Realm: () 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 zonegroup default 2024-09-12T00:35:32.194 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.195 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 started sync module instance, tier type = 2024-09-12T00:35:32.196 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:32.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=0 2024-09-12T00:35:32.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=1 2024-09-12T00:35:32.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=2 2024-09-12T00:35:32.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=3 2024-09-12T00:35:32.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=4 2024-09-12T00:35:32.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=5 2024-09-12T00:35:32.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.220+0000 7f35f56b59c0 20 add_watcher() i=6 2024-09-12T00:35:32.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.220+0000 7f35f56b59c0 20 add_watcher() i=7 2024-09-12T00:35:32.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.220+0000 7f35f56b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:32.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f34a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:32.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 note: GC not initialized 2024-09-12T00:35:32.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f34a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:32.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:32.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 Filter name: none 2024-09-12T00:35:32.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f34227fc640 20 reqs_thread_entry: start 2024-09-12T00:35:32.225 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f35f56b59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:32.226 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:35:32.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:32.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.227 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:32.228 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:35:32.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:35:32.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399020 cookie 94247702444272 notifier 7796 bl.length()=827 2024-09-12T00:35:32.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:35:32.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:35:32.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:35:32.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:35:32.251 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35f56b59c0 time 2024-09-12T00:35:32.256798+0000 2024-09-12T00:35:32.252 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:32.253 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.253 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35f8f8f2eb] 2024-09-12T00:35:32.253 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.253 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f35f56b59c0 thread_name:radosgw-admin 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.256+0000 7f35f56b59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35f56b59c0 time 2024-09-12T00:35:32.256798+0000 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35f8f8f2eb] 2024-09-12T00:35:32.254 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:35:32.255 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.278 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35f7e0e520] 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35f8f8f345] 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.279 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.256+0000 7f35f56b59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f35f56b59c0 thread_name:radosgw-admin 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35f7e0e520] 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:32.280 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35f8f8f345] 2024-09-12T00:35:32.281 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.281 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.281 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.281 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.281 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:35:32.281 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:35:31.728+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:35:31.728+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:35:31.728+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-12T00:35:32.282 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:35:31.728+0000 7f35f31bb640 1 monclient: found mon.noname-a 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: dump: 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.283 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 8346 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: dump: 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.284 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 4 set_mon_vals no callback set 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: shutdown 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) unregister_commands rotate-key 2024-09-12T00:35:32.285 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.286 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.286 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.286 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.286 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.286 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.286 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.286 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding auth protocol: cephx 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding auth protocol: cephx 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding auth protocol: cephx 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.287 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: starting msgr at 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: starting objecter 2024-09-12T00:35:32.288 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command objecter_requests hook 0x55b7c0aeee60 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: setting wanted keys 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: calling monclient init 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding auth protocol: cephx 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding auth protocol: cephx 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding auth protocol: cephx 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.289 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key hook 0x55b7c0c32048 2024-09-12T00:35:32.290 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.291 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:32.291 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0c37eb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.291 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0c5e490 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.291 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x7f35dc002350 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.291 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.291 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.067968s 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): get_auth_request con 0x7f35dc002350 auth_method 0 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): get_auth_request con 0x55b7c0c5e490 auth_method 0 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.292 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0c37eb0 auth_method 0 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_done global_id 8349 payload 824 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.293 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:35:31.732+0000 7f35f29ba640 1 monclient: found mon.noname-a 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: dump: 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.294 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: dump: 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.295 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.296 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:35:31.732+0000 7f34e160a640 4 set_mon_vals no callback set 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 8349 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 1 librados: init done 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:35:31.732+0000 7f34dfe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:35:31.732+0000 7f34dfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:35:31.732+0000 7f34dfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient: get_auth_request con 0x7f34d8070b10 auth_method 0 2024-09-12T00:35:32.297 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:35:31.736+0000 7f35f39bc640 10 monclient: get_auth_request con 0x55b7c0c7a170 auth_method 0 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:35:31.736+0000 7f35f31bb640 10 monclient: get_auth_request con 0x55b7c0c7cfb0 auth_method 0 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:35:31.736+0000 7f35f29ba640 10 monclient: get_auth_request con 0x55b7c0c81650 auth_method 0 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:35:31.736+0000 7f35f39bc640 10 monclient: get_auth_request con 0x55b7c0c80cb0 auth_method 0 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.298 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding auth protocol: cephx 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding auth protocol: cephx 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding auth protocol: cephx 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.299 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.300 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.301 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b7c0c8cfe0 EEXIST 2024-09-12T00:35:32.301 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.301 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding auth protocol: cephx 2024-09-12T00:35:32.301 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding auth protocol: cephx 2024-09-12T00:35:32.301 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding auth protocol: cephx 2024-09-12T00:35:32.301 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.302 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key cmddesc rotate-key hook 0x55b7c0c88670 EEXIST 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x55b7c0cb1190 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0cb0ac0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.303 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0caf4a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.078490s 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): get_auth_request con 0x55b7c0cb1190 auth_method 0 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0caf4a0 auth_method 0 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.304 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:35:31.740+0000 7f35f29ba640 1 monclient: found mon.noname-c 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:32.305 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: dump: 2024-09-12T00:35:32.306 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.306 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.306 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.306 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.306 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.306 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: dump: 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.307 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 7790 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.308 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:35:31.740+0000 7f35f41bd640 4 set_mon_vals no callback set 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:35:31.744+0000 7f34dd602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:35:31.744+0000 7f34dd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:35:31.744+0000 7f34dd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient: get_auth_request con 0x7f34cc070a20 auth_method 0 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.309 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.310 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding auth protocol: cephx 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding auth protocol: cephx 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding auth protocol: cephx 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.311 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding auth protocol: cephx 2024-09-12T00:35:32.312 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding auth protocol: cephx 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding auth protocol: cephx 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.313 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5a0b5238 EEXIST 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0cfef90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x55b7c0cff370 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0d00830 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.082578s 2024-09-12T00:35:32.314 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): get_auth_request con 0x55b7c0cff370 auth_method 0 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0d00830 auth_method 0 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.315 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:35:31.744+0000 7f35f39bc640 1 monclient: found mon.noname-c 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: dump: 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.316 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.317 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.317 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.317 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.317 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.320 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.320 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.320 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 7793 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 4 set_mon_vals no callback set 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: dump: 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.321 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: shutdown 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.322 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding auth protocol: cephx 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding auth protocol: cephx 2024-09-12T00:35:32.323 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding auth protocol: cephx 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.324 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: starting msgr at 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: starting objecter 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b7c0cd4e10 EEXIST 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: setting wanted keys 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: calling monclient init 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding auth protocol: cephx 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding auth protocol: cephx 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding auth protocol: cephx 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.325 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key cmddesc rotate-key hook 0x55b7c0cb30f8 EEXIST 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0cfef90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x55b7c0d00830 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.326 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0cfc050 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.085309s 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): get_auth_request con 0x55b7c0d00830 auth_method 0 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0cfc050 auth_method 0 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.327 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.328 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.328 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.328 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.328 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.328 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.328 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.328 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:35:31.748+0000 7f35f39bc640 1 monclient: found mon.noname-c 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:35:31.748+0000 7f35f29ba640 10 monclient: get_auth_request con 0x55b7c0cfef90 auth_method 0 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: dump: 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.329 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: dump: 2024-09-12T00:35:32.330 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:35:31.748+0000 7f34d6ffd640 4 set_mon_vals no callback set 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 7796 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.331 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: init done 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cr dump hook 0x55b7c0cfdd48 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:35:31.752+0000 7f34d57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:35:31.752+0000 7f34d57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:35:31.752+0000 7f34d57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.332 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:35:31.752+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f34bc070b10 auth_method 0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:35:31.752+0000 7f35f31bb640 10 monclient: get_auth_request con 0x55b7c0d1ef50 auth_method 0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 realm 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.333 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:35:31.752+0000 7f35f29ba640 10 monclient: get_auth_request con 0x55b7c0d23170 auth_method 0 2024-09-12T00:35:32.334 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:32.334 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.334 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:35:31.756+0000 7f35f39bc640 10 monclient: get_auth_request con 0x55b7c0d269d0 auth_method 0 2024-09-12T00:35:32.334 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:32.334 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 searching for the correct realm 2024-09-12T00:35:32.334 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:35:31.756+0000 7f35f31bb640 10 monclient: get_auth_request con 0x55b7c0d2b790 auth_method 0 2024-09-12T00:35:32.334 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:35:31.756+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f35e40dd040 auth_method 0 2024-09-12T00:35:32.335 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:35:31.756+0000 7f35f29ba640 0 -- 172.21.15.78:0/3104580371 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f35e40dd040 msgr2=0x7f35e40b0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:32.335 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:35:31.960+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f35e40dd040 auth_method 0 2024-09-12T00:35:32.335 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:35:31.964+0000 7f35f39bc640 10 monclient: get_auth_request con 0x7f35e40ca040 auth_method 0 2024-09-12T00:35:32.335 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:35:31.972+0000 7f35f31bb640 10 monclient: get_auth_request con 0x7f35e806a0e0 auth_method 0 2024-09-12T00:35:32.335 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:35:31.972+0000 7f35f31bb640 0 -- 172.21.15.78:0/3104580371 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f35e806a0e0 msgr2=0x7f35e807c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:32.335 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:35:32.176+0000 7f35f31bb640 10 monclient: get_auth_request con 0x7f35e806a0e0 auth_method 0 2024-09-12T00:35:32.335 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:35:32.176+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f35e40dd930 auth_method 0 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:32.336 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 zone default found 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 Realm: () 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 zonegroup default 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 started sync module instance, tier type = 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:32.337 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=0 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=1 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=2 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=3 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=4 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=5 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:35:32.220+0000 7f35f56b59c0 20 add_watcher() i=6 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:35:32.220+0000 7f35f56b59c0 20 add_watcher() i=7 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:35:32.220+0000 7f35f56b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding auth protocol: cephx 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding auth protocol: cephx 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding auth protocol: cephx 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.338 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.339 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.339 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.339 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.339 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.339 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.339 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.339 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.340 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.340 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.340 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.340 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:35:32.224+0000 7f34a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:32.340 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.340 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:32.340 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:32.341 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache list hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.341 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache inspect hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.341 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache erase hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.341 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache zap hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.341 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 note: GC not initialized 2024-09-12T00:35:32.341 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:35:32.224+0000 7f34a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:32.341 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace show hook 0x7f35dc001d40 2024-09-12T00:35:32.342 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace history hook 0x7f35dc001d40 2024-09-12T00:35:32.342 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace active hook 0x7f35dc001d40 2024-09-12T00:35:32.342 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace active_short hook 0x7f35dc001d40 2024-09-12T00:35:32.342 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:32.342 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 Filter name: none 2024-09-12T00:35:32.342 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:35:32.224+0000 7f34227fc640 20 reqs_thread_entry: start 2024-09-12T00:35:32.342 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.343 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.344 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:32.344 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.344 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:32.344 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:35:32.344 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.344 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.344 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399020 cookie 94247702444272 notifier 7796 bl.length()=827 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:35:32.345 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:35:32.346 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:35:32.346 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:35:32.256+0000 7f35f56b59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35f56b59c0 time 2024-09-12T00:35:32.256798+0000 2024-09-12T00:35:32.346 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:32.346 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.346 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.346 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35f8f8f2eb] 2024-09-12T00:35:32.346 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.347 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.347 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.347 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.347 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:35:32.347 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.347 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:35:32.347 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:35:32.256+0000 7f35f56b59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f35f56b59c0 thread_name:radosgw-admin 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35f7e0e520] 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:32.348 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:32.349 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:32.349 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35f8f8f345] 2024-09-12T00:35:32.349 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.349 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.349 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.349 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.349 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:35:32.350 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:32.351 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:35:32.352 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:32.353 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:32.353 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:32.353 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:35:32.353 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:35:32.353 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:32.353 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:35:32.353 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:35:32.354 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:35:32.355 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:35:32.356 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:32.356 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:32.356 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:35:32.356 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:32.356 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:32.356 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:32.356 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:35:32.357 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:35:32.357 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:35:32.357 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:35:32.357 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:35:32.357 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:35:32.357 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:35:32.357 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:35:32.358 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:35:32.358 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:35:32.358 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:35:32.358 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:35:32.358 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:35:32.358 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:35:32.358 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:32.359 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:35:32.360 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34227fc640 / http_manager 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34a8fe1640 / http_manager 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34a9fe3640 / rgw_dt_lg_renew 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34d57fa640 / ms_dispatch 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34d67fc640 / io_context_pool 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34d6ffd640 / io_context_pool 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34dd602640 / ms_dispatch 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34dfe07640 / ms_dispatch 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34e160a640 / io_context_pool 2024-09-12T00:35:32.361 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f29ba640 / msgr-worker-2 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f31bb640 / msgr-worker-1 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f39bc640 / msgr-worker-0 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f41bd640 / io_context_pool 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f56b59c0 / radosgw-admin 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.143571.log 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:35:31.728+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:35:31.728+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:35:31.728+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.362 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient(hunting): handle_auth_done global_id 8346 payload 274 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:35:31.728+0000 7f35f31bb640 1 monclient: found mon.noname-a 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:35:31.728+0000 7f35f31bb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: dump: 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.363 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 8346 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:35:31.728+0000 7f34e160a640 10 monclient: dump: 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.364 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 4 set_mon_vals no callback set 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: shutdown 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) unregister_commands rotate-key 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.365 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding auth protocol: cephx 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding auth protocol: cephx 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding auth protocol: cephx 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.366 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: crc 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c37250) adding con mode: secure 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: starting msgr at 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: starting objecter 2024-09-12T00:35:32.367 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command objecter_requests hook 0x55b7c0aeee60 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: setting wanted keys 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 1 librados: calling monclient init 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding auth protocol: cephx 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding auth protocol: cephx 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding auth protocol: cephx 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.368 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: crc 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c31f00) adding con mode: secure 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key hook 0x55b7c0c32048 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0c37eb0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.369 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0c5e490 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x7f35dc002350 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:35:31.728+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.067968s 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): get_auth_request con 0x7f35dc002350 auth_method 0 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): get_auth_request con 0x55b7c0c5e490 auth_method 0 2024-09-12T00:35:32.370 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:35:31.732+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0c37eb0 auth_method 0 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient(hunting): handle_auth_done global_id 8349 payload 824 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.371 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:35:31.732+0000 7f35f29ba640 1 monclient: found mon.noname-a 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:35:31.732+0000 7f35f29ba640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: dump: 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.372 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:35:31.732+0000 7f34dfe07640 10 monclient: dump: 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.373 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:35:31.732+0000 7f34e160a640 4 set_mon_vals no callback set 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 8349 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:35:31.732+0000 7f35f56b59c0 1 librados: init done 2024-09-12T00:35:32.374 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:35:31.732+0000 7f34dfe07640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:35:31.732+0000 7f34dfe07640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:35:31.732+0000 7f34dfe07640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:35:31.732+0000 7f35f31bb640 10 monclient: get_auth_request con 0x7f34d8070b10 auth_method 0 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:35:31.736+0000 7f35f39bc640 10 monclient: get_auth_request con 0x55b7c0c7a170 auth_method 0 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:35:31.736+0000 7f35f31bb640 10 monclient: get_auth_request con 0x55b7c0c7cfb0 auth_method 0 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:35:31.736+0000 7f35f29ba640 10 monclient: get_auth_request con 0x55b7c0c81650 auth_method 0 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:35:31.736+0000 7f35f39bc640 10 monclient: get_auth_request con 0x55b7c0c80cb0 auth_method 0 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.375 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding auth protocol: cephx 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding auth protocol: cephx 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding auth protocol: cephx 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.376 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: crc 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c89630) adding con mode: secure 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b7c0c8cfe0 EEXIST 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding auth protocol: cephx 2024-09-12T00:35:32.377 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding auth protocol: cephx 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding auth protocol: cephx 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: crc 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0c88528) adding con mode: secure 2024-09-12T00:35:32.378 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key cmddesc rotate-key hook 0x55b7c0c88670 EEXIST 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x55b7c0cb1190 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0cb0ac0 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0caf4a0 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.078490s 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): get_auth_request con 0x55b7c0cb1190 auth_method 0 2024-09-12T00:35:32.379 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0caf4a0 auth_method 0 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.380 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:35:31.740+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient(hunting): handle_auth_done global_id 7790 payload 824 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:35:31.740+0000 7f35f29ba640 1 monclient: found mon.noname-c 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:35:31.740+0000 7f35f29ba640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: dump: 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.381 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:35:31.740+0000 7f34dd602640 10 monclient: dump: 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.382 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 7790 2024-09-12T00:35:32.383 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:35:31.740+0000 7f35f41bd640 4 set_mon_vals no callback set 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:35:31.740+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:35:31.744+0000 7f34dd602640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:35:31.744+0000 7f34dd602640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:35:31.744+0000 7f34dd602640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient: get_auth_request con 0x7f34cc070a20 auth_method 0 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: get_monmap_and_config 2024-09-12T00:35:32.384 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.385 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding auth protocol: cephx 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding auth protocol: cephx 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding auth protocol: cephx 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: crc 2024-09-12T00:35:32.386 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cd0960) adding con mode: secure 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding auth protocol: cephx 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding auth protocol: cephx 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding auth protocol: cephx 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.387 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: crc 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b50f0) adding con mode: secure 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key cmddesc rotate-key hook 0x7ffc5a0b5238 EEXIST 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0cfef90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x55b7c0cff370 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0d00830 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.388 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.082578s 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): get_auth_request con 0x55b7c0cff370 auth_method 0 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0d00830 auth_method 0 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.389 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:35:31.744+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient(hunting): handle_auth_done global_id 7793 payload 274 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:35:31.744+0000 7f35f39bc640 1 monclient: found mon.noname-c 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:35:31.744+0000 7f35f39bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.390 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: dump: 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.391 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 7793 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 10 monclient: get_monmap_and_config success 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:35:31.744+0000 7f35f56b59c0 4 set_mon_vals no callback set 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:35:31.744+0000 7f34d6ffd640 10 monclient: dump: 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.392 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: shutdown 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: build_initial_monmap 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 build_initial for_mkfs: 0 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: monmap: 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:35:32.393 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.394 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding auth protocol: cephx 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding auth protocol: cephx 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding auth protocol: cephx 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.395 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: crc 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cf7510) adding con mode: secure 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: starting msgr at 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: starting objecter 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command objecter_requests cmddesc objecter_requests hook 0x55b7c0cd4e10 EEXIST 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: setting wanted keys 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: calling monclient init 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: init 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding auth protocol: cephx 2024-09-12T00:35:32.396 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding auth protocol: cephx 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding auth protocol: cephx 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: crc 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 AuthRegistry(0x55b7c0cb2fb0) adding con mode: secure 2024-09-12T00:35:32.397 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command rotate-key cmddesc rotate-key hook 0x55b7c0cb30f8 EEXIST 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _reopen_session rank -1 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-b con 0x55b7c0cfef90 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-c con 0x55b7c0d00830 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): picked mon.noname-a con 0x55b7c0cfc050 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): _renew_subs 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient(hunting): authenticate will time out at 2456.085309s 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): get_auth_request con 0x55b7c0d00830 auth_method 0 2024-09-12T00:35:32.398 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): get_auth_request con 0x55b7c0cfc050 auth_method 0 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:35:31.748+0000 7f35f31bb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient(hunting): handle_auth_done global_id 7796 payload 824 2024-09-12T00:35:32.399 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient: _finish_hunting 0 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:35:31.748+0000 7f35f39bc640 1 monclient: found mon.noname-c 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:35:31.748+0000 7f35f39bc640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:35:31.748+0000 7f35f29ba640 10 monclient: get_auth_request con 0x55b7c0cfef90 auth_method 0 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: dump: 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.400 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: _finish_auth 0 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: _check_auth_tickets 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: handle_config config(0 keys) 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:35:31.748+0000 7f34d57fa640 10 monclient: dump: 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:35:32.401 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:35:31.748+0000 7f34d6ffd640 4 set_mon_vals no callback set 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 monclient: authenticate success, global_id 7796 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _renew_subs 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:35:32.402 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 1 librados: init done 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cr dump hook 0x55b7c0cfdd48 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:35:31.748+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:35:31.752+0000 7f34d57fa640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:35:31.752+0000 7f34d57fa640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:35:31.752+0000 7f34d57fa640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:35:31.752+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f34bc070b10 auth_method 0 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:35:31.752+0000 7f35f31bb640 10 monclient: get_auth_request con 0x55b7c0d1ef50 auth_method 0 2024-09-12T00:35:32.403 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 realm 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:35:31.752+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.404 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:35:31.752+0000 7f35f29ba640 10 monclient: get_auth_request con 0x55b7c0d23170 auth_method 0 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:35:31.756+0000 7f35f39bc640 10 monclient: get_auth_request con 0x55b7c0d269d0 auth_method 0 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:35:31.756+0000 7f35f56b59c0 20 searching for the correct realm 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:35:31.756+0000 7f35f31bb640 10 monclient: get_auth_request con 0x55b7c0d2b790 auth_method 0 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:35:31.756+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f35e40dd040 auth_method 0 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:35:31.756+0000 7f35f29ba640 0 -- 172.21.15.78:0/3104580371 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f35e40dd040 msgr2=0x7f35e40b0420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:35:31.960+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f35e40dd040 auth_method 0 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:35:31.964+0000 7f35f39bc640 10 monclient: get_auth_request con 0x7f35e40ca040 auth_method 0 2024-09-12T00:35:32.405 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:35:31.972+0000 7f35f31bb640 10 monclient: get_auth_request con 0x7f35e806a0e0 auth_method 0 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:35:31.972+0000 7f35f31bb640 0 -- 172.21.15.78:0/3104580371 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f35e806a0e0 msgr2=0x7f35e807c640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:35:32.176+0000 7f35f31bb640 10 monclient: get_auth_request con 0x7f35e806a0e0 auth_method 0 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:35:32.176+0000 7f35f29ba640 10 monclient: get_auth_request con 0x7f35e40dd930 auth_method 0 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.406 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:35:32.192+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 zone default found 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 Realm: () 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 zonegroup default 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.407 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 started sync module instance, tier type = 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:35:32.196+0000 7f35f56b59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=0 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=1 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=2 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=3 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=4 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:35:32.216+0000 7f35f56b59c0 20 add_watcher() i=5 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:35:32.220+0000 7f35f56b59c0 20 add_watcher() i=6 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:35:32.220+0000 7f35f56b59c0 20 add_watcher() i=7 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:35:32.220+0000 7f35f56b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding auth protocol: cephx 2024-09-12T00:35:32.408 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding auth protocol: cephx 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding auth protocol: cephx 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.409 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: crc 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 AuthRegistry(0x7ffc5a0b55d0) adding con mode: secure 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:35:32.224+0000 7f34a9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache list hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache inspect hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache erase hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command cache zap hook 0x55b7c0cfa0a0 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 note: GC not initialized 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:35:32.224+0000 7f34a8fe1640 20 reqs_thread_entry: start 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace show hook 0x7f35dc001d40 2024-09-12T00:35:32.410 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace history hook 0x7f35dc001d40 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace active hook 0x7f35dc001d40 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 5 asok(0x55b7c0a282b0) register_command sync trace active_short hook 0x7f35dc001d40 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 Filter name: none 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:35:32.224+0000 7f34227fc640 20 reqs_thread_entry: start 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:35:32.224+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:32.411 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:35:32.228+0000 7f35f56b59c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.412 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:35:32.244+0000 7f35f56b59c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399020 cookie 94247702444272 notifier 7796 bl.length()=827 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:35:32.248+0000 7f34d67fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:35:32.248+0000 7f35f56b59c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:35:32.256+0000 7f35f56b59c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f35f56b59c0 time 2024-09-12T00:35:32.256798+0000 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:35:32.413 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f35f8f8f2eb] 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 4: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 6: main() 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 7: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 8: __libc_start_main() 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 9: _start() 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:35:32.256+0000 7f35f56b59c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f35f56b59c0 thread_name:radosgw-admin 2024-09-12T00:35:32.414 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f35f7e0e520] 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f35f8f8f345] 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f35f8f8f49f] 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x55b7be59acc1] 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 8: radosgw-admin(+0x1422aac) [0x55b7beff8aac] 2024-09-12T00:35:32.415 INFO:tasks.workunit.client.0.smithi078.stderr: 9: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x10d) [0x55b7be5afced] 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 10: main() 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 11: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f35f7df5d90] 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 12: __libc_start_main() 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 13: _start() 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:35:32.416 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:35:32.417 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:35:32.418 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:35:32.419 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:35:32.420 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:35:32.421 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:35:32.422 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34227fc640 / http_manager 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34a8fe1640 / http_manager 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34a9fe3640 / rgw_dt_lg_renew 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34d57fa640 / ms_dispatch 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34d67fc640 / io_context_pool 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34d6ffd640 / io_context_pool 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34dd602640 / ms_dispatch 2024-09-12T00:35:32.423 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34dfe07640 / ms_dispatch 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: 7f34e160a640 / io_context_pool 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f29ba640 / msgr-worker-2 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f31bb640 / msgr-worker-1 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f39bc640 / msgr-worker-0 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f41bd640 / io_context_pool 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: 7f35f56b59c0 / radosgw-admin 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:35:32.260207Z_348d72f8-df99-4176-9016-e2e08d44264a/log 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:35:32.424 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:35:32.426 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:35:32.426 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:35:32.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.340+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 realm 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.344+0000 7fe1e934b9c0 20 searching for the correct realm 2024-09-12T00:35:32.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.352+0000 7fe1e7652640 0 -- 172.21.15.78:0/2564337696 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fe1d80652f0 msgr2=0x7fe1d807a910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:32.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.568+0000 7fe1e6e51640 0 -- 172.21.15.78:0/2564337696 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x562732809f30 msgr2=0x56273280c3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:35:32.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:35:32.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:35:32.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:35:32.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:35:32.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:35:32.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:35:32.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:35:32.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 zone default found 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 4 Realm: () 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 zonegroup default 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.580+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.584+0000 7fe1e934b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.584+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.584+0000 7fe1e934b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.584+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.584+0000 7fe1e934b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:35:32.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.584+0000 7fe1e934b9c0 20 started sync module instance, tier type = 2024-09-12T00:35:32.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.584+0000 7fe1e934b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:35:32.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=0 2024-09-12T00:35:32.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=1 2024-09-12T00:35:32.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=2 2024-09-12T00:35:32.606 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=3 2024-09-12T00:35:32.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=4 2024-09-12T00:35:32.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=5 2024-09-12T00:35:32.607 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=6 2024-09-12T00:35:32.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 20 add_watcher() i=7 2024-09-12T00:35:32.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.608+0000 7fe1e934b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:35:32.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:32.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:35:32.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:35:32.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 5 note: GC not initialized 2024-09-12T00:35:32.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe09cfe1640 20 reqs_thread_entry: start 2024-09-12T00:35:32.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:35:32.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 Filter name: none 2024-09-12T00:35:32.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe095ffb640 20 reqs_thread_entry: start 2024-09-12T00:35:32.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:35:32.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:35:32.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:35:32.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:35:32.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:35:32.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:35:32.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:35:32.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:35:32.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:35:32.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:35:32.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:35:32.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:35:32.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:35:32.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.616+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:35:32.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:35:32.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:35:32.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:35:32.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:35:32.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:35:32.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:35:32.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:35:32.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:35:32.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:35:32.621 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.620+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:35:32.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:35:32.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:35:32.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:35:32.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:35:32.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:35:32.623 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:35:32.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:35:32.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.624+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:35:32.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.628+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:35:32.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.628+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:35:32.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.628+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:35:32.626 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.628+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:35:32.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.628+0000 7fe1e934b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:35:32.627 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.628+0000 7fe1e934b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:35:32.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.632+0000 7fe09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:35:32.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.636+0000 7fe1e934b9c0 20 remove_watcher() i=0 2024-09-12T00:35:32.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.636+0000 7fe1e934b9c0 2 removed watcher, disabling cache 2024-09-12T00:35:32.635 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.636+0000 7fe1e934b9c0 20 remove_watcher() i=1 2024-09-12T00:35:32.638 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.640+0000 7fe1e934b9c0 20 remove_watcher() i=2 2024-09-12T00:35:32.640 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.640+0000 7fe1e934b9c0 20 remove_watcher() i=3 2024-09-12T00:35:32.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.644+0000 7fe1e934b9c0 20 remove_watcher() i=4 2024-09-12T00:35:32.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.644+0000 7fe1e934b9c0 20 remove_watcher() i=5 2024-09-12T00:35:32.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.648+0000 7fe1e934b9c0 20 remove_watcher() i=6 2024-09-12T00:35:32.650 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:35:32.652+0000 7fe1e934b9c0 20 remove_watcher() i=7 2024-09-12T00:35:32.665 INFO:tasks.workunit.client.0.smithi078.stderr: test: duplicated entries can be purged manually 2024-09-12T00:36:02.697 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:02.730 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:02.730 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:02.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.983+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:02.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.983+0000 7fa3af5639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:02.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.983+0000 7fa3af5639c0 20 realm 2024-09-12T00:36:02.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.983+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:02.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.983+0000 7fa3af5639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:02.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.983+0000 7fa3af5639c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:02.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.983+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:02.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.987+0000 7fa3af5639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:02.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.987+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:02.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.987+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:02.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.987+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:02.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.987+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:02.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.987+0000 7fa3af5639c0 20 searching for the correct realm 2024-09-12T00:36:02.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.991+0000 7fa3ac868640 0 -- 172.21.15.78:0/195264535 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x561e56dd5de0 msgr2=0x561e56dd81d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:02.998 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:02.999+0000 7fa3ac868640 0 -- 172.21.15.78:0/195264535 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fa3a00253e0 msgr2=0x7fa3a0025860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:03.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:03.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.219 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.220 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.219+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 zone default found 2024-09-12T00:36:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 4 Realm: () 2024-09-12T00:36:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:03.221 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 zonegroup default 2024-09-12T00:36:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.222 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.223 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 started sync module instance, tier type = 2024-09-12T00:36:03.224 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.223+0000 7fa3af5639c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=0 2024-09-12T00:36:03.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=1 2024-09-12T00:36:03.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=2 2024-09-12T00:36:03.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=3 2024-09-12T00:36:03.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=4 2024-09-12T00:36:03.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=5 2024-09-12T00:36:03.247 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=6 2024-09-12T00:36:03.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 20 add_watcher() i=7 2024-09-12T00:36:03.249 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.247+0000 7fa3af5639c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.251+0000 7fa2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:03.253 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 5 note: GC not initialized 2024-09-12T00:36:03.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa2627e4640 20 reqs_thread_entry: start 2024-09-12T00:36:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 Filter name: none 2024-09-12T00:36:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa1d3fff640 20 reqs_thread_entry: start 2024-09-12T00:36:03.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:03.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:03.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:03.256 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:03.257 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.255+0000 7fa3af5639c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:03.259 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.259+0000 7fa2637e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.263+0000 7fa3af5639c0 20 remove_watcher() i=0 2024-09-12T00:36:03.264 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.263+0000 7fa3af5639c0 2 removed watcher, disabling cache 2024-09-12T00:36:03.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.267+0000 7fa3af5639c0 20 remove_watcher() i=1 2024-09-12T00:36:03.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.267+0000 7fa3af5639c0 20 remove_watcher() i=2 2024-09-12T00:36:03.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.271+0000 7fa3af5639c0 20 remove_watcher() i=3 2024-09-12T00:36:03.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.271+0000 7fa3af5639c0 20 remove_watcher() i=4 2024-09-12T00:36:03.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.275+0000 7fa3af5639c0 20 remove_watcher() i=5 2024-09-12T00:36:03.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.275+0000 7fa3af5639c0 20 remove_watcher() i=6 2024-09-12T00:36:03.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.279+0000 7fa3af5639c0 20 remove_watcher() i=7 2024-09-12T00:36:03.293 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.293 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:36:03.293 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 11 size_kb: 1 num_shards: 13 2024-09-12T00:36:03.293 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.293 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 14 --rgw-reshard-bucket-lock-duration 30 --inject-abort-at do_reshard 2024-09-12T00:36:03.326 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:03.327 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:03.372 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.371+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 realm 2024-09-12T00:36:03.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:03.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.375 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:03.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 searching for the correct realm 2024-09-12T00:36:03.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.383+0000 7f0dd74cb640 0 -- 172.21.15.78:0/2375472453 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0dc80b6900 msgr2=0x7f0dc80df420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.595+0000 7f0dd6cca640 0 -- 172.21.15.78:0/2375472453 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560ed60d7c70 msgr2=0x560ed60da130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 zone default found 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 Realm: () 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 zonegroup default 2024-09-12T00:36:03.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 started sync module instance, tier type = 2024-09-12T00:36:03.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:03.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=0 2024-09-12T00:36:03.636 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=1 2024-09-12T00:36:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=2 2024-09-12T00:36:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=3 2024-09-12T00:36:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=4 2024-09-12T00:36:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=5 2024-09-12T00:36:03.637 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=6 2024-09-12T00:36:03.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.639+0000 7f0dd91c49c0 20 add_watcher() i=7 2024-09-12T00:36:03.639 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.639+0000 7f0dd91c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:03.643 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.643+0000 7f0c8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:03.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:03.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:03.644 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 note: GC not initialized 2024-09-12T00:36:03.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.643+0000 7f0c07fff640 20 reqs_thread_entry: start 2024-09-12T00:36:03.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:03.645 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 Filter name: none 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0c05ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:36:03.646 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:03.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:03.647 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.648 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:03.649 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.651+0000 7f0dd91c49c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:36:03.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399021 cookie 94621720808544 notifier 7850 bl.length()=827 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:36:03.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:36:03.679 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dd91c49c0 time 2024-09-12T00:36:03.684086+0000 2024-09-12T00:36:03.679 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:03.680 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.680 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ddca9e2eb] 2024-09-12T00:36:03.680 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.680 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr:*** Caught signal (Aborted) ** 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f0dd91c49c0 thread_name:radosgw-admin 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.679+0000 7f0dd91c49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dd91c49c0 time 2024-09-12T00:36:03.684086+0000 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.681 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ddca9e2eb] 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:36:03.682 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.699 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.699 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ddb91d520] 2024-09-12T00:36:03.699 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:36:03.699 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:36:03.699 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ddca9e345] 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.683+0000 7f0dd91c49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f0dd91c49c0 thread_name:radosgw-admin 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.700 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ddb91d520] 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ddca9e345] 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:36:03.701 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 8397 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 4 set_mon_vals no callback set 2024-09-12T00:36:03.702 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: dump: 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: shutdown 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) unregister_commands rotate-key 2024-09-12T00:36:03.703 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.704 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding auth protocol: cephx 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding auth protocol: cephx 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding auth protocol: cephx 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.705 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: starting msgr at 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: starting objecter 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command objecter_requests hook 0x560ed5e7ae20 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: setting wanted keys 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: calling monclient init 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding auth protocol: cephx 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding auth protocol: cephx 2024-09-12T00:36:03.706 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding auth protocol: cephx 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.707 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key hook 0x560ed5fea1e8 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed5e9a040 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed5f2f7c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed5f33390 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.708 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.690885s 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request con 0x560ed5f33390 auth_method 0 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed5f2f7c0 auth_method 0 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.709 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed5e9a040 auth_method 0 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_done global_id 8400 payload 824 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 1 monclient: found mon.noname-a 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.710 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: dump: 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.711 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: dump: 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.712 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 8400 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 4 set_mon_vals no callback set 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: init done 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:36:03.355+0000 7f0cc3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:36:03.355+0000 7f0cc3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:36:03.355+0000 7f0cc3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.713 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:36:03.355+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x7f0cbc070ae0 auth_method 0 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:36:03.355+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x560ed602b710 auth_method 0 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:36:03.359+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x560ed60349a0 auth_method 0 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:36:03.359+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x560ed6039070 auth_method 0 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:36:03.359+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x560ed60386f0 auth_method 0 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.714 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding auth protocol: cephx 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding auth protocol: cephx 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding auth protocol: cephx 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.715 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ed6044a40 EEXIST 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.716 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding auth protocol: cephx 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding auth protocol: cephx 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding auth protocol: cephx 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.717 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key cmddesc rotate-key hook 0x560ed6040090 EEXIST 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed6068bf0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed6068520 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed6066f00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.718 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.701098s 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed6068bf0 auth_method 0 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed6066f00 auth_method 0 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.719 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request con 0x560ed6068520 auth_method 0 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 1 monclient: found mon.noname-c 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:03.720 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: dump: 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.721 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: dump: 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.722 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:36:03.363+0000 7f0dd7ccc640 4 set_mon_vals no callback set 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 7844 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:36:03.367+0000 7f0cc0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:36:03.367+0000 7f0cc0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:36:03.367+0000 7f0cc0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0cb0070a20 auth_method 0 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.723 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.724 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding auth protocol: cephx 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding auth protocol: cephx 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding auth protocol: cephx 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.725 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding auth protocol: cephx 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding auth protocol: cephx 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding auth protocol: cephx 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.726 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffeb74c4c78 EEXIST 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed608d730 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.727 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed60b7d10 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed60b9460 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.706129s 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request con 0x560ed60b7d10 auth_method 0 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed60b9460 auth_method 0 2024-09-12T00:36:03.728 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed608d730 auth_method 0 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.729 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_done global_id 8406 payload 274 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 1 monclient: found mon.noname-a 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: dump: 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.730 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: dump: 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.731 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 8406 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 4 set_mon_vals no callback set 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: shutdown 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.732 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding auth protocol: cephx 2024-09-12T00:36:03.733 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding auth protocol: cephx 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding auth protocol: cephx 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.734 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: starting msgr at 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: starting objecter 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ed606dbf0 EEXIST 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: setting wanted keys 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: calling monclient init 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding auth protocol: cephx 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding auth protocol: cephx 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding auth protocol: cephx 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.735 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key cmddesc rotate-key hook 0x560ed606ab58 EEXIST 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:03.736 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed608d730 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed60b7d10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed60b9460 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.708868s 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed608d730 auth_method 0 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed60b9460 auth_method 0 2024-09-12T00:36:03.737 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_done global_id 7850 payload 824 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 1 monclient: found mon.noname-c 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:36:03.371+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x560ed60b7d10 auth_method 0 2024-09-12T00:36:03.738 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: dump: 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.739 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: dump: 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.740 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:36:03.371+0000 7f0cba7fc640 4 set_mon_vals no callback set 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 7850 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: init done 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cr dump hook 0x560ed60c8628 2024-09-12T00:36:03.741 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:36:03.371+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0ca0070b10 auth_method 0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:36:03.375+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x560ed60d7c70 auth_method 0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 realm 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.742 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:36:03.375+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x560ed60dbef0 auth_method 0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:36:03.375+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x560ed60df770 auth_method 0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 searching for the correct realm 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:36:03.379+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x560ed60e4510 auth_method 0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:36:03.379+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x7f0dc80df040 auth_method 0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:36:03.383+0000 7f0dd74cb640 0 -- 172.21.15.78:0/2375472453 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0dc80b6900 msgr2=0x7f0dc80df420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:36:03.383+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0dc80b6900 auth_method 0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:36:03.587+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0dc80b6900 auth_method 0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:36:03.591+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x7f0dcc008040 auth_method 0 2024-09-12T00:36:03.743 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:36:03.595+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x7f0dc80f8940 auth_method 0 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:36:03.595+0000 7f0dd6cca640 0 -- 172.21.15.78:0/2375472453 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560ed60d7c70 msgr2=0x560ed60da130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:36:03.595+0000 7f0cb8ff9640 1 client.7850.objecter ms_handle_reset 0x560ed60d7c70 session 0x560ed60d75a0 osd.6 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:36:03.599+0000 7f0cb8ff9640 10 monclient: _renew_subs 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:36:03.599+0000 7f0cb8ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:36:03.599+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x7f0ca0080dc0 auth_method 0 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:03.744 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 zone default found 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 Realm: () 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 zonegroup default 2024-09-12T00:36:03.745 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 started sync module instance, tier type = 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=0 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=1 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=2 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=3 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=4 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=5 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=6 2024-09-12T00:36:03.746 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:36:03.639+0000 7f0dd91c49c0 20 add_watcher() i=7 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:36:03.639+0000 7f0dd91c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding auth protocol: cephx 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding auth protocol: cephx 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding auth protocol: cephx 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.747 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:36:03.643+0000 7f0c8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache list hook 0x560ed60b0b40 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache inspect hook 0x560ed60b0b40 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache erase hook 0x560ed60b0b40 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache zap hook 0x560ed60b0b40 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 note: GC not initialized 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:36:03.643+0000 7f0c07fff640 20 reqs_thread_entry: start 2024-09-12T00:36:03.748 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace show hook 0x7f0dd0005480 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace history hook 0x7f0dd0005480 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace active hook 0x7f0dd0005480 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace active_short hook 0x7f0dd0005480 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 Filter name: none 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:36:03.647+0000 7f0c05ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.749 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:36:03.651+0000 7f0dd91c49c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:36:03.750 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399021 cookie 94621720808544 notifier 7850 bl.length()=827 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:36:03.679+0000 7f0dd91c49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dd91c49c0 time 2024-09-12T00:36:03.684086+0000 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.751 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ddca9e2eb] 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:36:03.683+0000 7f0dd91c49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f0dd91c49c0 thread_name:radosgw-admin 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.752 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ddb91d520] 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ddca9e345] 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.753 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:36:03.754 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:03.755 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:36:03.756 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:36:03.757 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:36:03.758 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:36:03.759 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:36:03.760 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0c05ffb640 / http_manager 2024-09-12T00:36:03.761 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0c07fff640 / http_manager 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0c8d7e2640 / rgw_dt_lg_renew 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cb8ff9640 / ms_dispatch 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cb9ffb640 / io_context_pool 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cba7fc640 / io_context_pool 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cc0e01640 / ms_dispatch 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cc3606640 / ms_dispatch 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cc4e09640 / io_context_pool 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd64c9640 / msgr-worker-2 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd6cca640 / msgr-worker-1 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd74cb640 / msgr-worker-0 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd7ccc640 / io_context_pool 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd91c49c0 / radosgw-admin 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:36:03.762 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/log/ceph/ceph-client.admin.145341.log 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr:--- begin dump of recent events --- 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -499> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -498> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -497> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -496> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 8397 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -495> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -494> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 4 set_mon_vals no callback set 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -493> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -492> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:03.763 INFO:tasks.workunit.client.0.smithi078.stderr: -491> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 10 monclient: dump: 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr: -490> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: shutdown 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr: -489> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) unregister_commands rotate-key 2024-09-12T00:36:03.764 INFO:tasks.workunit.client.0.smithi078.stderr: -488> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr: -487> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr: -486> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.765 INFO:tasks.workunit.client.0.smithi078.stderr: -485> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding auth protocol: cephx 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -484> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding auth protocol: cephx 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -483> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding auth protocol: cephx 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -482> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -481> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -480> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -479> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -478> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -477> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -476> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -475> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -474> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -473> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.766 INFO:tasks.workunit.client.0.smithi078.stderr: -472> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: crc 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -471> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5ff0010) adding con mode: secure 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -470> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -469> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: starting msgr at 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -468> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: starting objecter 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -467> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command objecter_requests hook 0x560ed5e7ae20 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -466> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: setting wanted keys 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -465> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: calling monclient init 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -464> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -463> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding auth protocol: cephx 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -462> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding auth protocol: cephx 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -461> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding auth protocol: cephx 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -460> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.767 INFO:tasks.workunit.client.0.smithi078.stderr: -459> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -458> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -457> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -456> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -455> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -454> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -453> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -452> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -451> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -450> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: crc 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -449> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed5fea0a0) adding con mode: secure 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -448> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -447> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.768 INFO:tasks.workunit.client.0.smithi078.stderr: -446> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key hook 0x560ed5fea1e8 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -445> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -444> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[1,2,0] 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -443> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed5e9a040 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -442> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed5f2f7c0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -441> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed5f33390 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -440> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -439> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -438> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -437> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -436> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.690885s 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -435> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request con 0x560ed5f33390 auth_method 0 2024-09-12T00:36:03.769 INFO:tasks.workunit.client.0.smithi078.stderr: -434> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -433> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -432> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -431> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed5f2f7c0 auth_method 0 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -430> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -429> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -428> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -427> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -426> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -425> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -424> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.770 INFO:tasks.workunit.client.0.smithi078.stderr: -423> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -422> 2024-09-12T00:36:03.351+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -421> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed5e9a040 auth_method 0 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -420> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -419> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -418> 2024-09-12T00:36:03.351+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -417> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_done global_id 8400 payload 824 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -416> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -415> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 1 monclient: found mon.noname-a 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -414> 2024-09-12T00:36:03.351+0000 7f0dd74cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -413> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -412> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr: -411> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: dump: 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.771 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr: -410> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr: -409> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr: -408> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.772 INFO:tasks.workunit.client.0.smithi078.stderr: -407> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr: -406> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr: -405> 2024-09-12T00:36:03.351+0000 7f0cc3606640 10 monclient: dump: 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.773 INFO:tasks.workunit.client.0.smithi078.stderr: -404> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 8400 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -403> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -402> 2024-09-12T00:36:03.351+0000 7f0cc4e09640 4 set_mon_vals no callback set 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -401> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -400> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -399> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -398> 2024-09-12T00:36:03.351+0000 7f0dd91c49c0 1 librados: init done 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -397> 2024-09-12T00:36:03.355+0000 7f0cc3606640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -396> 2024-09-12T00:36:03.355+0000 7f0cc3606640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -395> 2024-09-12T00:36:03.355+0000 7f0cc3606640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -394> 2024-09-12T00:36:03.355+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x7f0cbc070ae0 auth_method 0 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -393> 2024-09-12T00:36:03.355+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x560ed602b710 auth_method 0 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -392> 2024-09-12T00:36:03.359+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x560ed60349a0 auth_method 0 2024-09-12T00:36:03.774 INFO:tasks.workunit.client.0.smithi078.stderr: -391> 2024-09-12T00:36:03.359+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x560ed6039070 auth_method 0 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr: -390> 2024-09-12T00:36:03.359+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x560ed60386f0 auth_method 0 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr: -389> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr: -388> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr: -387> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.775 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -386> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding auth protocol: cephx 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -385> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding auth protocol: cephx 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -384> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding auth protocol: cephx 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -383> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -382> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -381> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -380> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -379> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -378> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -377> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -376> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.776 INFO:tasks.workunit.client.0.smithi078.stderr: -375> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -374> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -373> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: crc 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -372> 2024-09-12T00:36:03.359+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6041050) adding con mode: secure 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -371> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -370> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ed6044a40 EEXIST 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -369> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -368> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding auth protocol: cephx 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -367> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding auth protocol: cephx 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -366> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding auth protocol: cephx 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -365> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -364> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -363> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -362> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.777 INFO:tasks.workunit.client.0.smithi078.stderr: -361> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -360> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -359> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -358> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -357> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -356> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -355> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: crc 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -354> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed603ff48) adding con mode: secure 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -353> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -352> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -351> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key cmddesc rotate-key hook 0x560ed6040090 EEXIST 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -350> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -349> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:03.778 INFO:tasks.workunit.client.0.smithi078.stderr: -348> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed6068bf0 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -347> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed6068520 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -346> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed6066f00 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -345> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -344> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -343> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -342> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -341> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.701098s 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -340> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed6068bf0 auth_method 0 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -339> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -338> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -337> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -336> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed6066f00 auth_method 0 2024-09-12T00:36:03.779 INFO:tasks.workunit.client.0.smithi078.stderr: -335> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -334> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -333> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -332> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -331> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -330> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -329> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -328> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -327> 2024-09-12T00:36:03.363+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -326> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request con 0x560ed6068520 auth_method 0 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -325> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -324> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -323> 2024-09-12T00:36:03.363+0000 7f0dd74cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.780 INFO:tasks.workunit.client.0.smithi078.stderr: -322> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_done global_id 7844 payload 824 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr: -321> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr: -320> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 1 monclient: found mon.noname-c 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr: -319> 2024-09-12T00:36:03.363+0000 7f0dd64c9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr: -318> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr: -317> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr: -316> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: dump: 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.781 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr: -315> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr: -314> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr: -313> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr: -312> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr: -311> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr: -310> 2024-09-12T00:36:03.363+0000 7f0cc0e01640 10 monclient: dump: 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.782 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -309> 2024-09-12T00:36:03.363+0000 7f0dd7ccc640 4 set_mon_vals no callback set 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -308> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 7844 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -307> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -306> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -305> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -304> 2024-09-12T00:36:03.363+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -303> 2024-09-12T00:36:03.367+0000 7f0cc0e01640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:03.783 INFO:tasks.workunit.client.0.smithi078.stderr: -302> 2024-09-12T00:36:03.367+0000 7f0cc0e01640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr: -301> 2024-09-12T00:36:03.367+0000 7f0cc0e01640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr: -300> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0cb0070a20 auth_method 0 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr: -299> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: get_monmap_and_config 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr: -298> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr: -297> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr: -296> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.784 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -295> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding auth protocol: cephx 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -294> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding auth protocol: cephx 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -293> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding auth protocol: cephx 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -292> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -291> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -290> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -289> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -288> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.785 INFO:tasks.workunit.client.0.smithi078.stderr: -287> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -286> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -285> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -284> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -283> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -282> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: crc 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -281> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed6088580) adding con mode: secure 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -280> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -279> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -278> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding auth protocol: cephx 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -277> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding auth protocol: cephx 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -276> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding auth protocol: cephx 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -275> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.786 INFO:tasks.workunit.client.0.smithi078.stderr: -274> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -273> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -272> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -271> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -270> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -269> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -268> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -267> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -266> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -265> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: crc 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -264> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c4b30) adding con mode: secure 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -263> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -262> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.787 INFO:tasks.workunit.client.0.smithi078.stderr: -261> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key cmddesc rotate-key hook 0x7ffeb74c4c78 EEXIST 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -260> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -259> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[1,0,2] 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -258> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed608d730 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -257> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed60b7d10 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -256> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed60b9460 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -255> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -254> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -253> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -252> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -251> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.706129s 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -250> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request con 0x560ed60b7d10 auth_method 0 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -249> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.788 INFO:tasks.workunit.client.0.smithi078.stderr: -248> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -247> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -246> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed60b9460 auth_method 0 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -245> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -244> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -243> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -242> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -241> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.789 INFO:tasks.workunit.client.0.smithi078.stderr: -240> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -239> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -238> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -237> 2024-09-12T00:36:03.367+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -236> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed608d730 auth_method 0 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -235> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -234> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -233> 2024-09-12T00:36:03.367+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -232> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient(hunting): handle_auth_done global_id 8406 payload 274 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -231> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -230> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 1 monclient: found mon.noname-a 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -229> 2024-09-12T00:36:03.367+0000 7f0dd74cb640 10 monclient: _send_mon_message to mon.noname-a at v2:172.21.15.78:3300/0 2024-09-12T00:36:03.790 INFO:tasks.workunit.client.0.smithi078.stderr: -228> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr: -227> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: got monmap 1 from mon.noname-a (according to old e1) 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr: -226> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: dump: 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.791 INFO:tasks.workunit.client.0.smithi078.stderr: -225> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr: -224> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr: -223> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr: -222> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr: -221> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: got monmap 1 from mon.a (according to old e1) 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr: -220> 2024-09-12T00:36:03.367+0000 7f0cba7fc640 10 monclient: dump: 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.792 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: -219> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 8406 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: -218> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: get_monmap_and_config success 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: -217> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 4 set_mon_vals no callback set 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: -216> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: shutdown 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: -215> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: build_initial_monmap 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: -214> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 1 build_initial for_mkfs: 0 2024-09-12T00:36:03.793 INFO:tasks.workunit.client.0.smithi078.stderr: -213> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 10 monclient: monmap: 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 0 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 00000000-0000-0000-0000-000000000000 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 0.000000 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:created 0.000000 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 0 (unknown) 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.noname-a 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.noname-b 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.noname-c 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr: -212> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding auth protocol: cephx 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr: -211> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding auth protocol: cephx 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr: -210> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding auth protocol: cephx 2024-09-12T00:36:03.794 INFO:tasks.workunit.client.0.smithi078.stderr: -209> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -208> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -207> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -206> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -205> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -204> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -203> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -202> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -201> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -200> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -199> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: crc 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -198> 2024-09-12T00:36:03.367+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed60ae350) adding con mode: secure 2024-09-12T00:36:03.795 INFO:tasks.workunit.client.0.smithi078.stderr: -197> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -196> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: starting msgr at 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -195> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: starting objecter 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -194> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command objecter_requests cmddesc objecter_requests hook 0x560ed606dbf0 EEXIST 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -193> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: setting wanted keys 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -192> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: calling monclient init 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -191> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: init 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -190> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding auth protocol: cephx 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -189> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding auth protocol: cephx 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -188> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding auth protocol: cephx 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -187> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -186> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -185> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.796 INFO:tasks.workunit.client.0.smithi078.stderr: -184> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -183> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -182> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -181> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -180> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -179> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -178> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -177> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: crc 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -176> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 AuthRegistry(0x560ed606aa10) adding con mode: secure 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -175> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -174> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -173> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command rotate-key cmddesc rotate-key hook 0x560ed606ab58 EEXIST 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -172> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _reopen_session rank -1 2024-09-12T00:36:03.797 INFO:tasks.workunit.client.0.smithi078.stderr: -171> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _add_conns ranks=[2,1,0] 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -170> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-c con 0x560ed608d730 addr [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -169> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-b con 0x560ed60b7d10 addr [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -168> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): picked mon.noname-a con 0x560ed60b9460 addr [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -167> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -166> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -165> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): start opening mon connection 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -164> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): _renew_subs 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -163> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient(hunting): authenticate will time out at 2487.708868s 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -162> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request con 0x560ed608d730 auth_method 0 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -161> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -160> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -159> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -158> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request con 0x560ed60b9460 auth_method 0 2024-09-12T00:36:03.798 INFO:tasks.workunit.client.0.smithi078.stderr: -157> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): get_auth_request method 2 preferred_modes [2,1] 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -156> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): _init_auth method 2 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -155> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): _init_auth creating new auth 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -154> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -153> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -152> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -151> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload 9 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -150> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more payload_len 9 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -149> 2024-09-12T00:36:03.371+0000 7f0dd6cca640 10 monclient(hunting): handle_auth_reply_more responding with 36 bytes 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -148> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient(hunting): handle_auth_done global_id 7850 payload 824 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -147> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient: _finish_hunting 0 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -146> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 1 monclient: found mon.noname-c 2024-09-12T00:36:03.799 INFO:tasks.workunit.client.0.smithi078.stderr: -145> 2024-09-12T00:36:03.371+0000 7f0dd64c9640 10 monclient: _send_mon_message to mon.noname-c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr: -144> 2024-09-12T00:36:03.371+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x560ed60b7d10 auth_method 0 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr: -143> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr: -142> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: got monmap 1 from mon.noname-c (according to old e1) 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr: -141> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: dump: 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.800 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr: -140> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: _finish_auth 0 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr: -139> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: _check_auth_tickets 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr: -138> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: handle_config config(0 keys) 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr: -137> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: handle_monmap mon_map magic: 0 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr: -136> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: got monmap 1 from mon.c (according to old e1) 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr: -135> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 10 monclient: dump: 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr:epoch 1 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr:fsid 78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr:last_changed 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr:created 2024-09-12T00:10:32.898116+0000 2024-09-12T00:36:03.801 INFO:tasks.workunit.client.0.smithi078.stderr:min_mon_release 19 (squid) 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr:election_strategy: 1 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr:0: [v2:172.21.15.78:3300/0,v1:172.21.15.78:6789/0] mon.a 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr:1: [v2:172.21.15.171:3300/0,v1:172.21.15.171:6789/0] mon.b 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr:2: [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] mon.c 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -134> 2024-09-12T00:36:03.371+0000 7f0cba7fc640 4 set_mon_vals no callback set 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -133> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 monclient: authenticate success, global_id 7850 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -132> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -131> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -130> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _renew_subs 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -129> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -128> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 1 librados: init done 2024-09-12T00:36:03.802 INFO:tasks.workunit.client.0.smithi078.stderr: -127> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cr dump hook 0x560ed60c8628 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -126> 2024-09-12T00:36:03.371+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -125> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 4 mgrc handle_mgr_map Got map version 5 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -124> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 4 mgrc handle_mgr_map Active mgr is now [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -123> 2024-09-12T00:36:03.371+0000 7f0cb8ff9640 4 mgrc reconnect Starting new session with [v2:172.21.15.78:6832/2754915500,v1:172.21.15.78:6833/2754915500] 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -122> 2024-09-12T00:36:03.371+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0ca0070b10 auth_method 0 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -121> 2024-09-12T00:36:03.375+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x560ed60d7c70 auth_method 0 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -120> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -119> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 realm 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -118> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -117> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -116> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -115> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.803 INFO:tasks.workunit.client.0.smithi078.stderr: -114> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -113> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -112> 2024-09-12T00:36:03.375+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x560ed60dbef0 auth_method 0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -111> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -110> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -109> 2024-09-12T00:36:03.375+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x560ed60df770 auth_method 0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -108> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -107> 2024-09-12T00:36:03.375+0000 7f0dd91c49c0 20 searching for the correct realm 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -106> 2024-09-12T00:36:03.379+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x560ed60e4510 auth_method 0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -105> 2024-09-12T00:36:03.379+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x7f0dc80df040 auth_method 0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -104> 2024-09-12T00:36:03.383+0000 7f0dd74cb640 0 -- 172.21.15.78:0/2375472453 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0dc80b6900 msgr2=0x7f0dc80df420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -103> 2024-09-12T00:36:03.383+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0dc80b6900 auth_method 0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -102> 2024-09-12T00:36:03.587+0000 7f0dd74cb640 10 monclient: get_auth_request con 0x7f0dc80b6900 auth_method 0 2024-09-12T00:36:03.804 INFO:tasks.workunit.client.0.smithi078.stderr: -101> 2024-09-12T00:36:03.591+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x7f0dcc008040 auth_method 0 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -100> 2024-09-12T00:36:03.595+0000 7f0dd64c9640 10 monclient: get_auth_request con 0x7f0dc80f8940 auth_method 0 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -99> 2024-09-12T00:36:03.595+0000 7f0dd6cca640 0 -- 172.21.15.78:0/2375472453 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560ed60d7c70 msgr2=0x560ed60da130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -98> 2024-09-12T00:36:03.595+0000 7f0cb8ff9640 1 client.7850.objecter ms_handle_reset 0x560ed60d7c70 session 0x560ed60d75a0 osd.6 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -97> 2024-09-12T00:36:03.599+0000 7f0cb8ff9640 10 monclient: _renew_subs 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -96> 2024-09-12T00:36:03.599+0000 7f0cb8ff9640 10 monclient: _send_mon_message to mon.c at v2:172.21.15.78:3301/0 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -95> 2024-09-12T00:36:03.599+0000 7f0dd6cca640 10 monclient: get_auth_request con 0x7f0ca0080dc0 auth_method 0 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -94> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -93> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -92> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -91> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -90> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -89> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:03.805 INFO:tasks.workunit.client.0.smithi078.stderr: -88> 2024-09-12T00:36:03.607+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -87> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -86> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -85> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -84> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -83> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -82> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 zone default found 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -81> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 Realm: () 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -80> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -79> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -78> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -77> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 zonegroup default 2024-09-12T00:36:03.806 INFO:tasks.workunit.client.0.smithi078.stderr: -76> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -75> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -74> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -73> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -72> 2024-09-12T00:36:03.611+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -71> 2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -70> 2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 started sync module instance, tier type = 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -69> 2024-09-12T00:36:03.615+0000 7f0dd91c49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -68> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=0 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -67> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=1 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -66> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=2 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -65> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=3 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -64> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=4 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -63> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=5 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -62> 2024-09-12T00:36:03.635+0000 7f0dd91c49c0 20 add_watcher() i=6 2024-09-12T00:36:03.807 INFO:tasks.workunit.client.0.smithi078.stderr: -61> 2024-09-12T00:36:03.639+0000 7f0dd91c49c0 20 add_watcher() i=7 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -60> 2024-09-12T00:36:03.639+0000 7f0dd91c49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -59> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding auth protocol: cephx 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -58> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding auth protocol: cephx 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -57> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding auth protocol: cephx 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -56> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -55> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -54> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -53> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -52> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -51> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -50> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -49> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.808 INFO:tasks.workunit.client.0.smithi078.stderr: -48> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -47> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -46> 2024-09-12T00:36:03.643+0000 7f0c8d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -45> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: crc 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -44> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 AuthRegistry(0x7ffeb74c5010) adding con mode: secure 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -43> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 2 auth: KeyRing::load: loaded key file /etc/ceph/ceph.keyring 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -42> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -41> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -40> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache list hook 0x560ed60b0b40 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -39> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache inspect hook 0x560ed60b0b40 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -38> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache erase hook 0x560ed60b0b40 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -37> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command cache zap hook 0x560ed60b0b40 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -36> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 note: GC not initialized 2024-09-12T00:36:03.809 INFO:tasks.workunit.client.0.smithi078.stderr: -35> 2024-09-12T00:36:03.643+0000 7f0c07fff640 20 reqs_thread_entry: start 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -34> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace show hook 0x7f0dd0005480 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -33> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace history hook 0x7f0dd0005480 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -32> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace active hook 0x7f0dd0005480 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -31> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 5 asok(0x560ed5de02b0) register_command sync trace active_short hook 0x7f0dd0005480 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -30> 2024-09-12T00:36:03.643+0000 7f0dd91c49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -29> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 Filter name: none 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -28> 2024-09-12T00:36:03.647+0000 7f0c05ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -27> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -26> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -25> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -24> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -23> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:03.810 INFO:tasks.workunit.client.0.smithi078.stderr: -22> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -21> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -20> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -19> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -18> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -17> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -16> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -15> 2024-09-12T00:36:03.647+0000 7f0dd91c49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -14> 2024-09-12T00:36:03.651+0000 7f0dd91c49c0 10 init_target_layout removing existing target index objects from a previous reshard attempt 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -13> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -12> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -11> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -10> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:36:03.811 INFO:tasks.workunit.client.0.smithi078.stderr: -9> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399021 cookie 94621720808544 notifier 7850 bl.length()=827 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -8> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -7> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -6> 2024-09-12T00:36:03.667+0000 7f0cb9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -5> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -4> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -3> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -2> 2024-09-12T00:36:03.667+0000 7f0dd91c49c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: -1> 2024-09-12T00:36:03.679+0000 7f0dd91c49c0 -1 ./src/common/fault_injector.h: In function 'int FaultInjector::check(const Key&) const::visitor::operator()(const InjectAbort&) const [with Key = std::basic_string_view]' thread 7f0dd91c49c0 time 2024-09-12T00:36:03.684086+0000 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr:./src/common/fault_injector.h: 120: FAILED ceph_assert(!"FaultInjector") 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x121) [0x7f0ddca9e2eb] 2024-09-12T00:36:03.812 INFO:tasks.workunit.client.0.smithi078.stderr: 2: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 3: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 4: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 5: main() 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 7: __libc_start_main() 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 8: _start() 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 0> 2024-09-12T00:36:03.683+0000 7f0dd91c49c0 -1 *** Caught signal (Aborted) ** 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: in thread 7f0dd91c49c0 thread_name:radosgw-admin 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: ceph version 19.3.0-4753-gd011c522 (d011c522bb171e70fc5782f1e7a71ce5f37e573f) squid (dev) 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 1: /lib/x86_64-linux-gnu/libc.so.6(+0x42520) [0x7f0ddb91d520] 2024-09-12T00:36:03.813 INFO:tasks.workunit.client.0.smithi078.stderr: 2: pthread_kill() 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 3: raise() 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 4: abort() 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 5: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x17b) [0x7f0ddca9e345] 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 6: /usr/lib/ceph/libceph-common.so.2(+0x18549f) [0x7f0ddca9e49f] 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 7: (std::__detail::__variant::__gen_vtable_impl (*)(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)>, std::integer_sequence >::__visit_invoke(FaultInjector > >::check(std::basic_string_view > const&) const::visitor&&, std::variant const&)+0x41) [0x560ed49eacc1] 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 8: (RGWBucketReshard::execute(int, FaultInjector > >&, int, cls_rgw_reshard_initiator, DoutPrefixProvider const*, optional_yield, bool, std::ostream*, ceph::Formatter*, RGWReshard*)+0x17a) [0x560ed49ffd5a] 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 9: main() 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 10: /lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f0ddb904d90] 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 11: __libc_start_main() 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 12: _start() 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr:--- logging levels --- 2024-09-12T00:36:03.814 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 none 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 lockdep 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 context 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 crush 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_balancer 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_locker 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_log_expire 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mds_migrator 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 3/ 5 mds_quiesce 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 buffer 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 timer 2024-09-12T00:36:03.815 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 filer 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 striper 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 1 objecter 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rados 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_mirror 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_replay 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 rbd_pwl 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 journaler 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objectcacher 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 immutable_obj_cache 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 client 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 osd 2024-09-12T00:36:03.816 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 optracker 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 objclass 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 filestore 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 journal 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 ms 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mon 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/10 monc 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 paxos 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 tp 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 auth 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 crypto 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 finisher 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 reserver 2024-09-12T00:36:03.817 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 heartbeatmap 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 perfcounter 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_sync 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_datacache 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_access 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_dbstore 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_flight 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 rgw_lifecycle 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 20/20 rgw_notification 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 javaclient 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 asok 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 1 throttle 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 0 refs 2024-09-12T00:36:03.818 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 compressor 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluestore 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 bluefs 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 3 bdev 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 kstore 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 4/ 5 rocksdb 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 fuse 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 2/ 5 mgr 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mgrc 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 dpdk 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 eventtrace 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 prioritycache 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 test 2024-09-12T00:36:03.819 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephfs_mirror 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cephsqlite 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 crimson_interrupt 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_onode 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_odata 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_omap 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_tm 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_t 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cleaner 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_epm 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_lba 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_fixedkv_tree 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_cache 2024-09-12T00:36:03.820 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_journal 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_device 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 seastore_backref 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 alienstore 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 mclock 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 cyanstore 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 ceph_exporter 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 memstore 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 1/ 5 trace 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 0/ 5 ceph_dedup 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: -2/-2 (syslog threshold) 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 99/99 (stderr threshold) 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr:--- pthread ID / name mapping for recent threads --- 2024-09-12T00:36:03.821 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0c05ffb640 / http_manager 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0c07fff640 / http_manager 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0c8d7e2640 / rgw_dt_lg_renew 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cb8ff9640 / ms_dispatch 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cb9ffb640 / io_context_pool 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cba7fc640 / io_context_pool 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cc0e01640 / ms_dispatch 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cc3606640 / ms_dispatch 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0cc4e09640 / io_context_pool 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd64c9640 / msgr-worker-2 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd6cca640 / msgr-worker-1 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd74cb640 / msgr-worker-0 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd7ccc640 / io_context_pool 2024-09-12T00:36:03.822 INFO:tasks.workunit.client.0.smithi078.stderr: 7f0dd91c49c0 / radosgw-admin 2024-09-12T00:36:03.823 INFO:tasks.workunit.client.0.smithi078.stderr: max_recent 500 2024-09-12T00:36:03.823 INFO:tasks.workunit.client.0.smithi078.stderr: max_new 1000 2024-09-12T00:36:03.823 INFO:tasks.workunit.client.0.smithi078.stderr: log_file /var/lib/ceph/crash/2024-09-12T00:36:03.686775Z_4c3a75c1-4539-439f-ac28-42b50090908e/log 2024-09-12T00:36:03.823 INFO:tasks.workunit.client.0.smithi078.stderr:--- end dump of recent events --- 2024-09-12T00:36:03.823 INFO:tasks.workunit.client.0.smithi078.stderr:Aborted 2024-09-12T00:36:03.823 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:03.824 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:03.824 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 realm 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.767+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.771+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:03.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.771+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:03.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.771+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:03.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.771+0000 7fdb80e209c0 20 searching for the correct realm 2024-09-12T00:36:03.826 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.775+0000 7fdb7f127640 0 -- 172.21.15.78:0/1959752905 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fdb700660b0 msgr2=0x7fdb7000b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:03.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:03.991+0000 7fdb7e926640 0 -- 172.21.15.78:0/1959752905 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55c1d94f3550 msgr2=0x55c1d94f59f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:04.004 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.003+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:04.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:04.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 zone default found 2024-09-12T00:36:04.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 4 Realm: () 2024-09-12T00:36:04.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:04.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:04.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:04.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 zonegroup default 2024-09-12T00:36:04.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.007 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 started sync module instance, tier type = 2024-09-12T00:36:04.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.007+0000 7fdb80e209c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:04.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.031+0000 7fdb80e209c0 20 add_watcher() i=0 2024-09-12T00:36:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.031+0000 7fdb80e209c0 20 add_watcher() i=1 2024-09-12T00:36:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.031+0000 7fdb80e209c0 20 add_watcher() i=2 2024-09-12T00:36:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.031+0000 7fdb80e209c0 20 add_watcher() i=3 2024-09-12T00:36:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.031+0000 7fdb80e209c0 20 add_watcher() i=4 2024-09-12T00:36:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.031+0000 7fdb80e209c0 20 add_watcher() i=5 2024-09-12T00:36:04.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.031+0000 7fdb80e209c0 20 add_watcher() i=6 2024-09-12T00:36:04.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.035+0000 7fdb80e209c0 20 add_watcher() i=7 2024-09-12T00:36:04.035 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.035+0000 7fdb80e209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:04.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.039+0000 7fda357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:04.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.039+0000 7fdb80e209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:04.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.039+0000 7fdb80e209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:04.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.039+0000 7fdb80e209c0 5 note: GC not initialized 2024-09-12T00:36:04.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.039+0000 7fd9affff640 20 reqs_thread_entry: start 2024-09-12T00:36:04.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:04.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 Filter name: none 2024-09-12T00:36:04.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fd9adffb640 20 reqs_thread_entry: start 2024-09-12T00:36:04.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:04.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:04.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:04.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:04.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:04.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.043+0000 7fdb80e209c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:04.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.047+0000 7fda357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:04.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.051+0000 7fdb80e209c0 20 remove_watcher() i=0 2024-09-12T00:36:04.053 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.051+0000 7fdb80e209c0 2 removed watcher, disabling cache 2024-09-12T00:36:04.055 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.055+0000 7fdb80e209c0 20 remove_watcher() i=1 2024-09-12T00:36:04.056 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.055+0000 7fdb80e209c0 20 remove_watcher() i=2 2024-09-12T00:36:04.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.059+0000 7fdb80e209c0 20 remove_watcher() i=3 2024-09-12T00:36:04.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.063+0000 7fdb80e209c0 20 remove_watcher() i=4 2024-09-12T00:36:04.063 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.063+0000 7fdb80e209c0 20 remove_watcher() i=5 2024-09-12T00:36:04.065 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.067+0000 7fdb80e209c0 20 remove_watcher() i=6 2024-09-12T00:36:04.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.067+0000 7fdb80e209c0 20 remove_watcher() i=7 2024-09-12T00:36:04.096 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:36:04.123 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:04.123 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:04.167 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.167+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 realm 2024-09-12T00:36:04.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:04.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:04.171 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:04.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.171+0000 7f51f11399c0 20 searching for the correct realm 2024-09-12T00:36:04.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.175+0000 7f51eec3f640 0 -- 172.21.15.78:0/3367939700 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x557b0dd48150 msgr2=0x557b0dd4a610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:04.183 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.183+0000 7f51ee43e640 0 -- 172.21.15.78:0/3367939700 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f51e0033c10 msgr2=0x7f51e0065080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:04.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:04.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:04.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:04.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:04.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:04.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:04.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:04.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:04.403 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 zone default found 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 4 Realm: () 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 zonegroup default 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.403+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.407+0000 7f51f11399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.407+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.407+0000 7f51f11399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:04.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.407+0000 7f51f11399c0 20 started sync module instance, tier type = 2024-09-12T00:36:04.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.407+0000 7f51f11399c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:04.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=0 2024-09-12T00:36:04.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=1 2024-09-12T00:36:04.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=2 2024-09-12T00:36:04.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=3 2024-09-12T00:36:04.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=4 2024-09-12T00:36:04.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=5 2024-09-12T00:36:04.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=6 2024-09-12T00:36:04.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 20 add_watcher() i=7 2024-09-12T00:36:04.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.431+0000 7f51f11399c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:04.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.435+0000 7f50a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:04.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:04.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:04.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 5 note: GC not initialized 2024-09-12T00:36:04.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f501ffff640 20 reqs_thread_entry: start 2024-09-12T00:36:04.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:04.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 Filter name: none 2024-09-12T00:36:04.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f501dffb640 20 reqs_thread_entry: start 2024-09-12T00:36:04.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:04.440 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:04.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.439+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:04.442 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:04.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:04.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:04.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:04.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:04.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:04.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:04.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:04.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.443+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:04.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:04.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:04.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:04.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:04.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:04.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:04.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:04.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:04.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:04.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.447+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:04.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.451+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:04.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.451+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:04.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.451+0000 7f51f11399c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:04.451 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.451+0000 7f51f11399c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:04.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.455+0000 7f50a57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:04.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.459+0000 7f51f11399c0 20 remove_watcher() i=0 2024-09-12T00:36:04.458 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.459+0000 7f51f11399c0 2 removed watcher, disabling cache 2024-09-12T00:36:04.460 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.459+0000 7f51f11399c0 20 remove_watcher() i=1 2024-09-12T00:36:04.462 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.463+0000 7f51f11399c0 20 remove_watcher() i=2 2024-09-12T00:36:04.465 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.467+0000 7f51f11399c0 20 remove_watcher() i=3 2024-09-12T00:36:04.467 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.467+0000 7f51f11399c0 20 remove_watcher() i=4 2024-09-12T00:36:04.469 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.471+0000 7f51f11399c0 20 remove_watcher() i=5 2024-09-12T00:36:04.472 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.471+0000 7f51f11399c0 20 remove_watcher() i=6 2024-09-12T00:36:04.475 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:04.475+0000 7f51f11399c0 20 remove_watcher() i=7 2024-09-12T00:36:34.530 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog purge --bucket a-bucket 2024-09-12T00:36:34.564 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:34.564 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:34.610 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.611+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.611+0000 7f0fd74ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:34.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.611+0000 7f0fd74ec9c0 20 realm 2024-09-12T00:36:34.612 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.611+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:34.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:34.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:34.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:34.614 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:34.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.615+0000 7f0fd74ec9c0 20 searching for the correct realm 2024-09-12T00:36:34.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.619+0000 7f0fd57f3640 0 -- 172.21.15.78:0/3215752496 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0fc406c350 msgr2=0x7f0fc40794f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:34.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.835+0000 7f0fd57f3640 0 -- 172.21.15.78:0/3215752496 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55b052622c70 msgr2=0x55b052625130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:34.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:34.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:34.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:34.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:34.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:34.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:34.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:34.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:34.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:34.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 zone default found 2024-09-12T00:36:34.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 4 Realm: () 2024-09-12T00:36:34.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:34.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:34.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:34.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 zonegroup default 2024-09-12T00:36:34.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:34.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.847+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.851+0000 7f0fd74ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:34.851 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.851+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.851+0000 7f0fd74ec9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:34.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.851+0000 7f0fd74ec9c0 20 started sync module instance, tier type = 2024-09-12T00:36:34.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.851+0000 7f0fd74ec9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:34.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=0 2024-09-12T00:36:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=1 2024-09-12T00:36:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=2 2024-09-12T00:36:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=3 2024-09-12T00:36:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=4 2024-09-12T00:36:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=5 2024-09-12T00:36:34.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=6 2024-09-12T00:36:34.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 20 add_watcher() i=7 2024-09-12T00:36:34.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.875+0000 7f0fd74ec9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:34.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.879+0000 7f0e8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:34.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:34.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:34.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 5 note: GC not initialized 2024-09-12T00:36:34.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0e89fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:34.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:34.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 Filter name: none 2024-09-12T00:36:34.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0dfb7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:34.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:34.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:34.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:34.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:34.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:36:34.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:34.883 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:34.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:34.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:34.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:34.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:34.884 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.883+0000 7f0fd74ec9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:34.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.891+0000 7f0e8afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:34.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.895+0000 7f0fd74ec9c0 20 remove_watcher() i=0 2024-09-12T00:36:34.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.895+0000 7f0fd74ec9c0 2 removed watcher, disabling cache 2024-09-12T00:36:34.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.899+0000 7f0fd74ec9c0 20 remove_watcher() i=1 2024-09-12T00:36:34.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.899+0000 7f0fd74ec9c0 20 remove_watcher() i=2 2024-09-12T00:36:34.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.903+0000 7f0fd74ec9c0 20 remove_watcher() i=3 2024-09-12T00:36:34.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.903+0000 7f0fd74ec9c0 20 remove_watcher() i=4 2024-09-12T00:36:34.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.907+0000 7f0fd74ec9c0 20 remove_watcher() i=5 2024-09-12T00:36:34.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.907+0000 7f0fd74ec9c0 20 remove_watcher() i=6 2024-09-12T00:36:34.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:34.911+0000 7f0fd74ec9c0 20 remove_watcher() i=7 2024-09-12T00:36:34.927 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin reshardlog list --bucket a-bucket 2024-09-12T00:36:34.958 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:34.958 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:35.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.183+0000 7ffb06f8d640 0 --2- 172.21.15.78:0/543012925 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x556e6c7c9970 0x556e6c940540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:36:35.212 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.211+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 realm 2024-09-12T00:36:35.213 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.214 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:35.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.215 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:35.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:35.217 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.215+0000 7ffb094879c0 20 searching for the correct realm 2024-09-12T00:36:35.218 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.219+0000 7ffb0678c640 0 -- 172.21.15.78:0/2083256581 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7ffaf8008050 msgr2=0x7ffaf8009d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:35.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.435+0000 7ffb06f8d640 0 -- 172.21.15.78:0/2083256581 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7ffaf00e4980 msgr2=0x7ffaf00f2430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:35.655 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.655+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:35.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:35.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 zone default found 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 4 Realm: () 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 zonegroup default 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.660 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.659+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.663+0000 7ffb094879c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.663+0000 7ffb094879c0 20 started sync module instance, tier type = 2024-09-12T00:36:35.661 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.663+0000 7ffb094879c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:35.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.683+0000 7ffb094879c0 20 add_watcher() i=0 2024-09-12T00:36:35.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.683+0000 7ffb094879c0 20 add_watcher() i=1 2024-09-12T00:36:35.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.683+0000 7ffb094879c0 20 add_watcher() i=2 2024-09-12T00:36:35.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.683+0000 7ffb094879c0 20 add_watcher() i=3 2024-09-12T00:36:35.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.683+0000 7ffb094879c0 20 add_watcher() i=4 2024-09-12T00:36:35.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.683+0000 7ffb094879c0 20 add_watcher() i=5 2024-09-12T00:36:35.684 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.683+0000 7ffb094879c0 20 add_watcher() i=6 2024-09-12T00:36:35.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.687+0000 7ffb094879c0 20 add_watcher() i=7 2024-09-12T00:36:35.687 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.687+0000 7ffb094879c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:35.691 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.691+0000 7ff9bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:35.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.691+0000 7ffb094879c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:35.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.691+0000 7ffb094879c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:35.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.691+0000 7ffb094879c0 5 note: GC not initialized 2024-09-12T00:36:35.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ff937fff640 20 reqs_thread_entry: start 2024-09-12T00:36:35.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:35.693 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 20 Filter name: none 2024-09-12T00:36:35.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ff935ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:35.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:35.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:35.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:35.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:35.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:36:35.695 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 20 rados_obj.operate() r=0 bl.length=430 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:35.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.695+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:35.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:35.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:35.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:35.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:35.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:35.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:35.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:35.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:35.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:35.700 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.699+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:35.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:35.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:35.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:35.701 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:35.702 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:35.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:35.703 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:35.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:35.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:35.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.703+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:35.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.707+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:35.705 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.707+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:35.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.707+0000 7ffb094879c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:35.706 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.707+0000 7ffb094879c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:35.708 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.707+0000 7ff9bd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:35.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.711+0000 7ffb094879c0 20 remove_watcher() i=0 2024-09-12T00:36:35.712 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.711+0000 7ffb094879c0 2 removed watcher, disabling cache 2024-09-12T00:36:35.714 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.715+0000 7ffb094879c0 20 remove_watcher() i=1 2024-09-12T00:36:35.716 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.715+0000 7ffb094879c0 20 remove_watcher() i=2 2024-09-12T00:36:35.718 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.719+0000 7ffb094879c0 20 remove_watcher() i=3 2024-09-12T00:36:35.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.719+0000 7ffb094879c0 20 remove_watcher() i=4 2024-09-12T00:36:35.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.723+0000 7ffb094879c0 20 remove_watcher() i=5 2024-09-12T00:36:35.725 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.727+0000 7ffb094879c0 20 remove_watcher() i=6 2024-09-12T00:36:35.728 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.727+0000 7ffb094879c0 20 remove_watcher() i=7 2024-09-12T00:36:35.743 INFO:tasks.workunit.client.0.smithi078.stderr:check reshard logrecord successfully 2024-09-12T00:36:35.743 INFO:tasks.workunit.client.0.smithi078.stderr: test: reshard versioned bucket 2024-09-12T00:36:35.743 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:36:35.774 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:35.774 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:35.818 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.819+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.819+0000 7fc268a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.819+0000 7fc268a019c0 20 realm 2024-09-12T00:36:35.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.819+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:35.821 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:35.822 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:35.823 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:35.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:35.824 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.823+0000 7fc268a019c0 20 searching for the correct realm 2024-09-12T00:36:35.825 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:35.827+0000 7fc265d06640 0 -- 172.21.15.78:0/836551353 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fc254002350 msgr2=0x7fc260015400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:36.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.043+0000 7fc266507640 0 -- 172.21.15.78:0/836551353 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fc2500ba040 msgr2=0x7fc2500c9420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:36.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:36.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:36.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:36.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:36.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:36.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:36.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:36.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:36.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:36.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 zone default found 2024-09-12T00:36:36.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 4 Realm: () 2024-09-12T00:36:36.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:36.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:36.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:36.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 zonegroup default 2024-09-12T00:36:36.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.871+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.875+0000 7fc268a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:36.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.875+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.875+0000 7fc268a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:36.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.875+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.875+0000 7fc268a019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:36.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.875+0000 7fc268a019c0 20 started sync module instance, tier type = 2024-09-12T00:36:36.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.875+0000 7fc268a019c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:36.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.899+0000 7fc268a019c0 20 add_watcher() i=0 2024-09-12T00:36:36.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.899+0000 7fc268a019c0 20 add_watcher() i=1 2024-09-12T00:36:36.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.899+0000 7fc268a019c0 20 add_watcher() i=2 2024-09-12T00:36:36.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.899+0000 7fc268a019c0 20 add_watcher() i=3 2024-09-12T00:36:36.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.899+0000 7fc268a019c0 20 add_watcher() i=4 2024-09-12T00:36:36.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.899+0000 7fc268a019c0 20 add_watcher() i=5 2024-09-12T00:36:36.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.899+0000 7fc268a019c0 20 add_watcher() i=6 2024-09-12T00:36:36.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.903+0000 7fc268a019c0 20 add_watcher() i=7 2024-09-12T00:36:36.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.903+0000 7fc268a019c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:36.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc11cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:36.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc268a019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:36.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc268a019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:36.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc268a019c0 5 note: GC not initialized 2024-09-12T00:36:36.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc0977fe640 20 reqs_thread_entry: start 2024-09-12T00:36:36.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc268a019c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:36.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc268a019c0 20 Filter name: none 2024-09-12T00:36:36.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc0957fa640 20 reqs_thread_entry: start 2024-09-12T00:36:36.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.907+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:36.910 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:36.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:36.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:36.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:36.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:36.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.911+0000 7fc268a019c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:36.915 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.915+0000 7fc11cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:36.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.919+0000 7fc268a019c0 20 remove_watcher() i=0 2024-09-12T00:36:36.920 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.919+0000 7fc268a019c0 2 removed watcher, disabling cache 2024-09-12T00:36:36.922 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.923+0000 7fc268a019c0 20 remove_watcher() i=1 2024-09-12T00:36:36.924 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.923+0000 7fc268a019c0 20 remove_watcher() i=2 2024-09-12T00:36:36.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.927+0000 7fc268a019c0 20 remove_watcher() i=3 2024-09-12T00:36:36.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.927+0000 7fc268a019c0 20 remove_watcher() i=4 2024-09-12T00:36:36.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.931+0000 7fc268a019c0 20 remove_watcher() i=5 2024-09-12T00:36:36.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.935+0000 7fc268a019c0 20 remove_watcher() i=6 2024-09-12T00:36:36.935 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:36.935+0000 7fc268a019c0 20 remove_watcher() i=7 2024-09-12T00:36:36.950 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:36.951 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:36:36.951 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: myver id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 num_objects: 0 size_kb: 0 num_shards: 11 2024-09-12T00:36:36.951 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:36.951 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 12 2024-09-12T00:36:36.984 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:36.985 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:37.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.239+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 realm 2024-09-12T00:36:37.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:37.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:37.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.245 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.243+0000 7ff7206299c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:37.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.247+0000 7ff7206299c0 20 searching for the correct realm 2024-09-12T00:36:37.246 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.247+0000 7ff71e12f640 0 -- 172.21.15.78:0/3202613743 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x561b3b919b30 msgr2=0x561b3b91bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:37.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.463+0000 7ff71e12f640 0 -- 172.21.15.78:0/3202613743 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x561b3b90d2a0 msgr2=0x561b3b90f6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.479+0000 7ff7206299c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.479+0000 7ff7206299c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.479+0000 7ff7206299c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.479+0000 7ff7206299c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.479+0000 7ff7206299c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.479+0000 7ff7206299c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.479+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.481 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:37.482 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.483 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 zone default found 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 4 Realm: () 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 zonegroup default 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.484 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.483+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.487+0000 7ff7206299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.485 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.487+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.487+0000 7ff7206299c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.487+0000 7ff7206299c0 20 started sync module instance, tier type = 2024-09-12T00:36:37.486 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.487+0000 7ff7206299c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:37.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.507+0000 7ff7206299c0 20 add_watcher() i=0 2024-09-12T00:36:37.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.507+0000 7ff7206299c0 20 add_watcher() i=1 2024-09-12T00:36:37.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.507+0000 7ff7206299c0 20 add_watcher() i=2 2024-09-12T00:36:37.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.507+0000 7ff7206299c0 20 add_watcher() i=3 2024-09-12T00:36:37.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.507+0000 7ff7206299c0 20 add_watcher() i=4 2024-09-12T00:36:37.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.507+0000 7ff7206299c0 20 add_watcher() i=5 2024-09-12T00:36:37.509 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.507+0000 7ff7206299c0 20 add_watcher() i=6 2024-09-12T00:36:37.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.511+0000 7ff7206299c0 20 add_watcher() i=7 2024-09-12T00:36:37.511 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.511+0000 7ff7206299c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:37.515 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.515+0000 7ff5d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:37.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.515+0000 7ff7206299c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:37.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.515+0000 7ff7206299c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:37.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.515+0000 7ff7206299c0 5 note: GC not initialized 2024-09-12T00:36:37.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff54f7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:37.517 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 20 Filter name: none 2024-09-12T00:36:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff54d7fa640 20 reqs_thread_entry: start 2024-09-12T00:36:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:36:37.518 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:36:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:36:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : miss 2024-09-12T00:36:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:37.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:37.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 adding default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:37.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:37.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:37.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.519+0000 7ff7206299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:37.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:37.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:37.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:37.530 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:37.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff6017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398969 cookie 94674963526736 notifier 8520 bl.length()=821 2024-09-12T00:36:37.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff6017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:37.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff6017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:37.531 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff6017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:37.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:37.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:37.532 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:37.533 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.531+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.0 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.0 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.1 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.1 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.2 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.2 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.3 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.3 2024-09-12T00:36:37.543 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.4 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.4 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.5 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.5 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.6 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.6 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.7 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.7 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.8 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.8 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.9 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.9 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.10 2024-09-12T00:36:37.544 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.10 2024-09-12T00:36:37.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.11 2024-09-12T00:36:37.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.11 2024-09-12T00:36:37.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.0 2024-09-12T00:36:37.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1 2024-09-12T00:36:37.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2 2024-09-12T00:36:37.545 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.543+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3 2024-09-12T00:36:37.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.547+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.4 2024-09-12T00:36:37.546 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.547+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.5 2024-09-12T00:36:37.547 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.547+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.6 2024-09-12T00:36:37.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.547+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.7 2024-09-12T00:36:37.549 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.551+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.8 2024-09-12T00:36:37.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.551+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.9 2024-09-12T00:36:37.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.551+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.10 2024-09-12T00:36:37.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.551+0000 7ff7206299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:37.552 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.551+0000 7ff7206299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:37.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff601ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398970 cookie 94674963526736 notifier 8520 bl.length()=821 2024-09-12T00:36:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff601ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff601ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:37.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff601ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:37.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:37.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:37.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:37.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.555+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:37.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.563+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.0 2024-09-12T00:36:37.562 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.563+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1 2024-09-12T00:36:37.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.563+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2 2024-09-12T00:36:37.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.563+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3 2024-09-12T00:36:37.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.563+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.4 2024-09-12T00:36:37.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.563+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.5 2024-09-12T00:36:37.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.567+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.6 2024-09-12T00:36:37.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.567+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.7 2024-09-12T00:36:37.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.567+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.8 2024-09-12T00:36:37.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.567+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.9 2024-09-12T00:36:37.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.567+0000 7ff7206299c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.10 2024-09-12T00:36:37.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:37.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff601ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398971 cookie 94674963526736 notifier 8520 bl.length()=789 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff601ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff601ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:37.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff601ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:37.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:37.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:37.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:37.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.571+0000 7ff7206299c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:37.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.579+0000 7ff7206299c0 1 execute INFO: reshard of bucket "myver" from 11 shards to 12 shards completed successfully 2024-09-12T00:36:37.580 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.579+0000 7ff5d4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:37.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.583+0000 7ff7206299c0 20 remove_watcher() i=0 2024-09-12T00:36:37.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.583+0000 7ff7206299c0 2 removed watcher, disabling cache 2024-09-12T00:36:37.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.587+0000 7ff7206299c0 20 remove_watcher() i=1 2024-09-12T00:36:37.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.587+0000 7ff7206299c0 20 remove_watcher() i=2 2024-09-12T00:36:37.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.591+0000 7ff7206299c0 20 remove_watcher() i=3 2024-09-12T00:36:37.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.591+0000 7ff7206299c0 20 remove_watcher() i=4 2024-09-12T00:36:37.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.595+0000 7ff7206299c0 20 remove_watcher() i=5 2024-09-12T00:36:37.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.599+0000 7ff7206299c0 20 remove_watcher() i=6 2024-09-12T00:36:37.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.599+0000 7ff7206299c0 20 remove_watcher() i=7 2024-09-12T00:36:37.615 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:36:37.645 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:37.646 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:37.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.695+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.695+0000 7efc6bc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.695+0000 7efc6bc0d9c0 20 realm 2024-09-12T00:36:37.696 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.695+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:37.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:37.698 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:37.699 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.699+0000 7efc6bc0d9c0 20 searching for the correct realm 2024-09-12T00:36:37.704 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.703+0000 7efc69f14640 0 -- 172.21.15.78:0/4142831330 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7efc5c103b70 msgr2=0x7efc5c131770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:37.917 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.915+0000 7efc69713640 0 -- 172.21.15.78:0/4142831330 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5651a1e551e0 msgr2=0x5651a1e576a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:37.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:37.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:37.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:37.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:37.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:37.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:37.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.927+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:37.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.930 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 zone default found 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 4 Realm: () 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 zonegroup default 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.931 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:37.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 started sync module instance, tier type = 2024-09-12T00:36:37.933 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.931+0000 7efc6bc0d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:37.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.955+0000 7efc6bc0d9c0 20 add_watcher() i=0 2024-09-12T00:36:37.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.955+0000 7efc6bc0d9c0 20 add_watcher() i=1 2024-09-12T00:36:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.955+0000 7efc6bc0d9c0 20 add_watcher() i=2 2024-09-12T00:36:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.955+0000 7efc6bc0d9c0 20 add_watcher() i=3 2024-09-12T00:36:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.955+0000 7efc6bc0d9c0 20 add_watcher() i=4 2024-09-12T00:36:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.955+0000 7efc6bc0d9c0 20 add_watcher() i=5 2024-09-12T00:36:37.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.955+0000 7efc6bc0d9c0 20 add_watcher() i=6 2024-09-12T00:36:37.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.959+0000 7efc6bc0d9c0 20 add_watcher() i=7 2024-09-12T00:36:37.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.959+0000 7efc6bc0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:37.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.963+0000 7efb1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:37.964 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.963+0000 7efc6bc0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:37.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.963+0000 7efc6bc0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:37.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.963+0000 7efc6bc0d9c0 5 note: GC not initialized 2024-09-12T00:36:37.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efb1e7e4640 20 reqs_thread_entry: start 2024-09-12T00:36:37.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:37.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 Filter name: none 2024-09-12T00:36:37.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efa8ffff640 20 reqs_thread_entry: start 2024-09-12T00:36:37.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:37.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:37.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:37.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.967+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.971+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:37.969 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.971+0000 7efc6bc0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:37.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.971+0000 7efc6bc0d9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:37.970 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.971+0000 7efc6bc0d9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:37.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.975+0000 7efb1f7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:37.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.979+0000 7efc6bc0d9c0 20 remove_watcher() i=0 2024-09-12T00:36:37.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.979+0000 7efc6bc0d9c0 2 removed watcher, disabling cache 2024-09-12T00:36:37.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.979+0000 7efc6bc0d9c0 20 remove_watcher() i=1 2024-09-12T00:36:37.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.983+0000 7efc6bc0d9c0 20 remove_watcher() i=2 2024-09-12T00:36:37.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.987+0000 7efc6bc0d9c0 20 remove_watcher() i=3 2024-09-12T00:36:37.987 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.987+0000 7efc6bc0d9c0 20 remove_watcher() i=4 2024-09-12T00:36:37.989 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.991+0000 7efc6bc0d9c0 20 remove_watcher() i=5 2024-09-12T00:36:37.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.991+0000 7efc6bc0d9c0 20 remove_watcher() i=6 2024-09-12T00:36:37.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:37.995+0000 7efc6bc0d9c0 20 remove_watcher() i=7 2024-09-12T00:36:38.013 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:38.013 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:36:38.013 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: myver id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:36:38.013 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:38.065 INFO:tasks.workunit.client.0.smithi078.stderr: test: reshard removes olh entries with empty name 2024-09-12T00:36:38.219 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket a-bucket 2024-09-12T00:36:38.251 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:38.252 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:38.296 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.295+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 realm 2024-09-12T00:36:38.298 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:38.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.299 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:38.300 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.299+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.303+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:38.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.303+0000 7f5c7c4cd9c0 20 searching for the correct realm 2024-09-12T00:36:38.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.303+0000 7f5c7a7d4640 0 -- 172.21.15.78:0/230803036 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x562707363f80 msgr2=0x562707366370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:38.516 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.515+0000 7f5c79fd3640 0 -- 172.21.15.78:0/230803036 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f5c70125070 msgr2=0x7f5c700b9a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.735 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:38.737 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.735+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 zone default found 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 4 Realm: () 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 zonegroup default 2024-09-12T00:36:38.738 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.739 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 started sync module instance, tier type = 2024-09-12T00:36:38.740 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.739+0000 7f5c7c4cd9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:38.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.763+0000 7f5c7c4cd9c0 20 add_watcher() i=0 2024-09-12T00:36:38.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.763+0000 7f5c7c4cd9c0 20 add_watcher() i=1 2024-09-12T00:36:38.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.763+0000 7f5c7c4cd9c0 20 add_watcher() i=2 2024-09-12T00:36:38.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.763+0000 7f5c7c4cd9c0 20 add_watcher() i=3 2024-09-12T00:36:38.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.763+0000 7f5c7c4cd9c0 20 add_watcher() i=4 2024-09-12T00:36:38.763 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.763+0000 7f5c7c4cd9c0 20 add_watcher() i=5 2024-09-12T00:36:38.764 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.763+0000 7f5c7c4cd9c0 20 add_watcher() i=6 2024-09-12T00:36:38.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.767+0000 7f5c7c4cd9c0 20 add_watcher() i=7 2024-09-12T00:36:38.765 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.767+0000 7f5c7c4cd9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:38.770 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5b2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:38.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:38.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:38.771 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 5 note: GC not initialized 2024-09-12T00:36:38.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5b2a7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:38.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:38.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 20 Filter name: none 2024-09-12T00:36:38.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5a9bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:38.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.772 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:38.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.771+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.775+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:38.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.775+0000 7f5c7c4cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:38.773 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.775+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.775+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:38.774 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.775+0000 7f5c7c4cd9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.775+0000 7f5c7c4cd9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:38.775 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.775+0000 7f5c7c4cd9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:38.778 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.779+0000 7f5b2b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:38.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.783+0000 7f5c7c4cd9c0 20 remove_watcher() i=0 2024-09-12T00:36:38.782 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.783+0000 7f5c7c4cd9c0 2 removed watcher, disabling cache 2024-09-12T00:36:38.784 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.783+0000 7f5c7c4cd9c0 20 remove_watcher() i=1 2024-09-12T00:36:38.786 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.787+0000 7f5c7c4cd9c0 20 remove_watcher() i=2 2024-09-12T00:36:38.788 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.787+0000 7f5c7c4cd9c0 20 remove_watcher() i=3 2024-09-12T00:36:38.790 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.791+0000 7f5c7c4cd9c0 20 remove_watcher() i=4 2024-09-12T00:36:38.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.795+0000 7f5c7c4cd9c0 20 remove_watcher() i=5 2024-09-12T00:36:38.796 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.795+0000 7f5c7c4cd9c0 20 remove_watcher() i=6 2024-09-12T00:36:38.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.799+0000 7f5c7c4cd9c0 20 remove_watcher() i=7 2024-09-12T00:36:38.815 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:38.815 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:36:38.815 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: a-bucket id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 num_objects: 0 size_kb: 0 num_shards: 13 2024-09-12T00:36:38.815 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:38.816 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket layout --bucket a-bucket 2024-09-12T00:36:38.846 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:38.846 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:38.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.891+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.891+0000 7fee5eb1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.891+0000 7fee5eb1e9c0 20 realm 2024-09-12T00:36:38.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.891+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:38.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:38.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:38.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:38.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:38.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.895+0000 7fee5eb1e9c0 20 searching for the correct realm 2024-09-12T00:36:38.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.899+0000 7fee5c624640 0 -- 172.21.15.78:0/4227404889 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x56051ada8680 msgr2=0x56051adaaad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:38.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:38.907+0000 7fee5be23640 0 -- 172.21.15.78:0/4227404889 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fee4c112540 msgr2=0x7fee4c12b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:39.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:39.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:39.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:39.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:39.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:39.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:39.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:39.126 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.127 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 zone default found 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 4 Realm: () 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 zonegroup default 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.128 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.127+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.131+0000 7fee5eb1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.131+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.131+0000 7fee5eb1e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.131+0000 7fee5eb1e9c0 20 started sync module instance, tier type = 2024-09-12T00:36:39.130 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.131+0000 7fee5eb1e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:39.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=0 2024-09-12T00:36:39.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=1 2024-09-12T00:36:39.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=2 2024-09-12T00:36:39.153 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=3 2024-09-12T00:36:39.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=4 2024-09-12T00:36:39.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=5 2024-09-12T00:36:39.154 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=6 2024-09-12T00:36:39.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 20 add_watcher() i=7 2024-09-12T00:36:39.156 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.155+0000 7fee5eb1e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:39.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.159+0000 7fed12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:39.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.159+0000 7fee5eb1e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:39.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.159+0000 7fee5eb1e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:39.160 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.159+0000 7fee5eb1e9c0 5 note: GC not initialized 2024-09-12T00:36:39.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.159+0000 7fed11fdb640 20 reqs_thread_entry: start 2024-09-12T00:36:39.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fee5eb1e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:39.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fee5eb1e9c0 20 Filter name: none 2024-09-12T00:36:39.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fec837fe640 20 reqs_thread_entry: start 2024-09-12T00:36:39.161 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fee5eb1e9c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:39.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fee5eb1e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fee5eb1e9c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:39.162 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fee5eb1e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:39.163 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.163+0000 7fed12fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:39.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.167+0000 7fee5eb1e9c0 20 remove_watcher() i=0 2024-09-12T00:36:39.168 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.167+0000 7fee5eb1e9c0 2 removed watcher, disabling cache 2024-09-12T00:36:39.170 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.171+0000 7fee5eb1e9c0 20 remove_watcher() i=1 2024-09-12T00:36:39.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.171+0000 7fee5eb1e9c0 20 remove_watcher() i=2 2024-09-12T00:36:39.174 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.175+0000 7fee5eb1e9c0 20 remove_watcher() i=3 2024-09-12T00:36:39.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.175+0000 7fee5eb1e9c0 20 remove_watcher() i=4 2024-09-12T00:36:39.179 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.179+0000 7fee5eb1e9c0 20 remove_watcher() i=5 2024-09-12T00:36:39.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.183+0000 7fee5eb1e9c0 20 remove_watcher() i=6 2024-09-12T00:36:39.184 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.183+0000 7fee5eb1e9c0 20 remove_watcher() i=7 2024-09-12T00:36:39.200 INFO:tasks.workunit.client.0.smithi078.stderr:rados -p default.rgw.buckets.index setomapval .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 --omap-key-file /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_key < /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/olh_noname_val 2024-09-12T00:36:39.226 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:39.226 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:39.246 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:36:39.272 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:39.272 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:39.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.315+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.315+0000 7f48996129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.315+0000 7f48996129c0 20 realm 2024-09-12T00:36:39.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.315+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:39.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:39.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:39.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.319+0000 7f48996129c0 20 searching for the correct realm 2024-09-12T00:36:39.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.323+0000 7f4896917640 0 -- 172.21.15.78:0/4002651482 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x55a0acc4a9e0 msgr2=0x55a0acc4cdd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:39.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.331+0000 7f4896917640 0 -- 172.21.15.78:0/4002651482 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f4888112040 msgr2=0x7f4888105740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:39.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:39.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:39.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:39.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:39.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:39.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:39.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:39.551 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 zone default found 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 4 Realm: () 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 zonegroup default 2024-09-12T00:36:39.553 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.551+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.555+0000 7f48996129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.555+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.555+0000 7f48996129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.554 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.555+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.555+0000 7f48996129c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.555+0000 7f48996129c0 20 started sync module instance, tier type = 2024-09-12T00:36:39.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.555+0000 7f48996129c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:39.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.579+0000 7f48996129c0 20 add_watcher() i=0 2024-09-12T00:36:39.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.579+0000 7f48996129c0 20 add_watcher() i=1 2024-09-12T00:36:39.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.579+0000 7f48996129c0 20 add_watcher() i=2 2024-09-12T00:36:39.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.579+0000 7f48996129c0 20 add_watcher() i=3 2024-09-12T00:36:39.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.579+0000 7f48996129c0 20 add_watcher() i=4 2024-09-12T00:36:39.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.579+0000 7f48996129c0 20 add_watcher() i=5 2024-09-12T00:36:39.579 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.579+0000 7f48996129c0 20 add_watcher() i=6 2024-09-12T00:36:39.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.583+0000 7f48996129c0 20 add_watcher() i=7 2024-09-12T00:36:39.581 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.583+0000 7f48996129c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:39.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f474dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:39.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:39.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:39.586 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 5 note: GC not initialized 2024-09-12T00:36:39.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f474cfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:39.587 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:39.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 20 Filter name: none 2024-09-12T00:36:39.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f46c67fc640 20 reqs_thread_entry: start 2024-09-12T00:36:39.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:39.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.587+0000 7f48996129c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:39.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:39.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:36:39.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: starting shard=0 2024-09-12T00:36:39.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:39.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:39.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:36:39.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: starting shard=1 2024-09-12T00:36:39.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:39.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:39.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: starting shard=2 2024-09-12T00:36:39.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:39.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:39.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 INFO: main: starting shard=3 2024-09-12T00:36:39.592 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:39.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.591+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:39.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: starting shard=4 2024-09-12T00:36:39.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:39.594 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:39.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: starting shard=5 2024-09-12T00:36:39.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:39.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:39.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: starting shard=6 2024-09-12T00:36:39.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:39.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:39.596 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 INFO: main: starting shard=7 2024-09-12T00:36:39.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:39.597 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.595+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:39.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 INFO: main: starting shard=8 2024-09-12T00:36:39.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:39.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:39.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 INFO: main: starting shard=9 2024-09-12T00:36:39.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:39.599 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:39.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 INFO: main: starting shard=10 2024-09-12T00:36:39.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:39.600 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.599+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:39.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 INFO: main: starting shard=11 2024-09-12T00:36:39.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:39.601 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:39.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 INFO: main: starting shard=12 2024-09-12T00:36:39.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:39.602 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:39.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:39.603 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f48996129c0 20 INFO: main: done 2024-09-12T00:36:39.604 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.603+0000 7f474dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:39.608 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.607+0000 7f48996129c0 20 remove_watcher() i=0 2024-09-12T00:36:39.609 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.607+0000 7f48996129c0 2 removed watcher, disabling cache 2024-09-12T00:36:39.611 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.611+0000 7f48996129c0 20 remove_watcher() i=1 2024-09-12T00:36:39.613 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.615+0000 7f48996129c0 20 remove_watcher() i=2 2024-09-12T00:36:39.616 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.615+0000 7f48996129c0 20 remove_watcher() i=3 2024-09-12T00:36:39.617 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.619+0000 7f48996129c0 20 remove_watcher() i=4 2024-09-12T00:36:39.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.619+0000 7f48996129c0 20 remove_watcher() i=5 2024-09-12T00:36:39.622 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.623+0000 7f48996129c0 20 remove_watcher() i=6 2024-09-12T00:36:39.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.627+0000 7f48996129c0 20 remove_watcher() i=7 2024-09-12T00:36:39.641 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket a-bucket --num-shards 1 --yes-i-really-mean-it 2024-09-12T00:36:39.674 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:39.674 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:39.720 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.719+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.721 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 realm 2024-09-12T00:36:39.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:39.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.722 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:39.723 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:39.724 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.723+0000 7f3b8a9109c0 20 searching for the correct realm 2024-09-12T00:36:39.726 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.727+0000 7f3b87c15640 0 -- 172.21.15.78:0/2496703254 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f3b780c4910 msgr2=0x7f3b780dc3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:39.734 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.735+0000 7f3b88416640 0 -- 172.21.15.78:0/2496703254 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f3b7c063ea0 msgr2=0x7f3b7c062910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:39.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:39.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:39.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:39.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:39.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:39.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:39.956 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.955+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:39.957 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:39.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 zone default found 2024-09-12T00:36:39.958 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 4 Realm: () 2024-09-12T00:36:39.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:39.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:39.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:39.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 zonegroup default 2024-09-12T00:36:39.959 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:39.960 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 started sync module instance, tier type = 2024-09-12T00:36:39.961 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.959+0000 7f3b8a9109c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:39.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.983+0000 7f3b8a9109c0 20 add_watcher() i=0 2024-09-12T00:36:39.984 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.983+0000 7f3b8a9109c0 20 add_watcher() i=1 2024-09-12T00:36:39.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.983+0000 7f3b8a9109c0 20 add_watcher() i=2 2024-09-12T00:36:39.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.983+0000 7f3b8a9109c0 20 add_watcher() i=3 2024-09-12T00:36:39.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.983+0000 7f3b8a9109c0 20 add_watcher() i=4 2024-09-12T00:36:39.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.983+0000 7f3b8a9109c0 20 add_watcher() i=5 2024-09-12T00:36:39.985 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.983+0000 7f3b8a9109c0 20 add_watcher() i=6 2024-09-12T00:36:39.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.987+0000 7f3b8a9109c0 20 add_watcher() i=7 2024-09-12T00:36:39.986 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.987+0000 7f3b8a9109c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:39.991 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.991+0000 7f3a3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:39.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.991+0000 7f3b8a9109c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:39.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.991+0000 7f3b8a9109c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:39.992 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.991+0000 7f3b8a9109c0 5 note: GC not initialized 2024-09-12T00:36:39.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.991+0000 7f3a3dfdb640 20 reqs_thread_entry: start 2024-09-12T00:36:39.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:39.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 20 Filter name: none 2024-09-12T00:36:39.993 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f39af7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:39.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 cache get: name=default.rgw.meta+root+a-bucket : miss 2024-09-12T00:36:39.994 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 cache put: name=default.rgw.meta+root+a-bucket info.flags=0x11 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 adding default.rgw.meta+root+a-bucket to cache LRU end 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : miss 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 adding default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:39.995 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:39.995+0000 7f3b8a9109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:40.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:40.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:40.002 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3a5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399023 cookie 94708970817904 notifier 8622 bl.length()=827 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3a5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3a5effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3a5effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:36:40.003 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.003+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:36:40.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.015+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:36:40.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.015+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:36:40.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.015+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:40.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.015+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:40.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 10 Dropping entry with empty name, idx=�1001_04/57/0457f727ec113e418d5b16d206b200ed068c0533554883ce811df7c932a3df68/2018_12_11/2889999/3386469/metadata.gz 2024-09-12T00:36:40.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:40.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:40.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:40.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:40.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:40.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:40.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:40.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.019+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:40.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:40.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:40.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:40.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:40.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:40.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:40.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:40.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.023+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:40.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.027+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:40.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.027+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:40.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.027+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:40.027 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.027+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:40.028 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.027+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:40.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.027+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:40.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:40.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:40.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:40.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:40.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:40.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:40.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:40.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.031+0000 7f3b8a9109c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:36:40.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3a5effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399024 cookie 94708970817904 notifier 8622 bl.length()=827 2024-09-12T00:36:40.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3a5effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:40.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3a5effd640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:40.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3a5effd640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:40.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:36:40.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:36:40.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:36:40.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.035+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:36:40.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.039+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:40.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.039+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.0 2024-09-12T00:36:40.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.039+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:40.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.039+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.1 2024-09-12T00:36:40.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:40.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.2 2024-09-12T00:36:40.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:40.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.3 2024-09-12T00:36:40.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:40.042 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.4 2024-09-12T00:36:40.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:40.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.5 2024-09-12T00:36:40.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:40.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.6 2024-09-12T00:36:40.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:40.044 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.043+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.7 2024-09-12T00:36:40.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:40.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.8 2024-09-12T00:36:40.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:40.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.9 2024-09-12T00:36:40.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:40.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.10 2024-09-12T00:36:40.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:40.047 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.11 2024-09-12T00:36:40.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:40.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.2.12 2024-09-12T00:36:40.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:40.048 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.047+0000 7f3b8a9109c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 2024-09-12T00:36:40.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:40.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 10 moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:40.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:40.051 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17, ofs0, ns] 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3a5f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399025 cookie 94708970817904 notifier 8622 bl.length()=795 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3a5f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 info.flags=0x17 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3a5f7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.a-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17 to cache LRU end 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3a5f7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_sources= new_sources= 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential sources added=[] removed=[] 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): orig_dests= new_dests= 2024-09-12T00:36:40.052 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.051+0000 7f3b8a9109c0 20 handle_bi_update(): bucket=:a-bucket[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17]): potential dests added=[] removed=[] 2024-09-12T00:36:40.058 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.059+0000 7f3b8a9109c0 1 execute INFO: reshard of bucket "a-bucket" from 13 shards to 1 shards completed successfully 2024-09-12T00:36:40.061 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.063+0000 7f3a3efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:40.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.067+0000 7f3b8a9109c0 20 remove_watcher() i=0 2024-09-12T00:36:40.066 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.067+0000 7f3b8a9109c0 2 removed watcher, disabling cache 2024-09-12T00:36:40.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.067+0000 7f3b8a9109c0 20 remove_watcher() i=1 2024-09-12T00:36:40.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.071+0000 7f3b8a9109c0 20 remove_watcher() i=2 2024-09-12T00:36:40.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.071+0000 7f3b8a9109c0 20 remove_watcher() i=3 2024-09-12T00:36:40.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.075+0000 7f3b8a9109c0 20 remove_watcher() i=4 2024-09-12T00:36:40.077 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.079+0000 7f3b8a9109c0 20 remove_watcher() i=5 2024-09-12T00:36:40.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.079+0000 7f3b8a9109c0 20 remove_watcher() i=6 2024-09-12T00:36:40.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.083+0000 7f3b8a9109c0 20 remove_watcher() i=7 2024-09-12T00:36:40.098 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket a-bucket 2024-09-12T00:36:40.129 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:40.129 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:40.172 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.171+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 20 realm 2024-09-12T00:36:40.175 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.176 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.175+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.179+0000 7f7466f959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:40.177 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.179+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.179+0000 7f7466f959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:40.178 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.179+0000 7f7466f959c0 20 searching for the correct realm 2024-09-12T00:36:40.182 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.183+0000 7f7464a9b640 0 -- 172.21.15.78:0/1585502021 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55e5e6356740 msgr2=0x55e5e6358be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:40.188 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.187+0000 7f746429a640 0 -- 172.21.15.78:0/1585502021 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f7454092a70 msgr2=0x7f745405e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:40.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:40.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:40.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:40.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:40.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:40.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:40.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.406 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:40.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 zone default found 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 4 Realm: () 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 zonegroup default 2024-09-12T00:36:40.408 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.407+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.411+0000 7f7466f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.409 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.411+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.411+0000 7f7466f959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.411+0000 7f7466f959c0 20 started sync module instance, tier type = 2024-09-12T00:36:40.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.411+0000 7f7466f959c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:40.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.435+0000 7f7466f959c0 20 add_watcher() i=0 2024-09-12T00:36:40.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.435+0000 7f7466f959c0 20 add_watcher() i=1 2024-09-12T00:36:40.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.435+0000 7f7466f959c0 20 add_watcher() i=2 2024-09-12T00:36:40.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.435+0000 7f7466f959c0 20 add_watcher() i=3 2024-09-12T00:36:40.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.435+0000 7f7466f959c0 20 add_watcher() i=4 2024-09-12T00:36:40.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.435+0000 7f7466f959c0 20 add_watcher() i=5 2024-09-12T00:36:40.436 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.435+0000 7f7466f959c0 20 add_watcher() i=6 2024-09-12T00:36:40.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.439+0000 7f7466f959c0 20 add_watcher() i=7 2024-09-12T00:36:40.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.439+0000 7f7466f959c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:40.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.443+0000 7f731afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:40.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.443+0000 7f7466f959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:40.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.443+0000 7f7466f959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:40.444 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.443+0000 7f7466f959c0 5 note: GC not initialized 2024-09-12T00:36:40.445 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.443+0000 7f7319fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:40.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.443+0000 7f7466f959c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:40.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 Filter name: none 2024-09-12T00:36:40.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f728b7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:40.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 rados_obj.operate() r=0 bl.length=176 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 rados_obj.operate() r=0 bl.length=398 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 INFO: main: max_entries=1000, index=gen=3, max_shards=1 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 INFO: main: starting shard=0 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:36:40.447 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17.3.0 2024-09-12T00:36:40.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:40.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.447+0000 7f7466f959c0 20 INFO: main: done 2024-09-12T00:36:40.449 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.451+0000 7f731afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:40.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.455+0000 7f7466f959c0 20 remove_watcher() i=0 2024-09-12T00:36:40.454 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.455+0000 7f7466f959c0 2 removed watcher, disabling cache 2024-09-12T00:36:40.456 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.455+0000 7f7466f959c0 20 remove_watcher() i=1 2024-09-12T00:36:40.459 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.459+0000 7f7466f959c0 20 remove_watcher() i=2 2024-09-12T00:36:40.461 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.463+0000 7f7466f959c0 20 remove_watcher() i=3 2024-09-12T00:36:40.463 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.463+0000 7f7466f959c0 20 remove_watcher() i=4 2024-09-12T00:36:40.466 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.467+0000 7f7466f959c0 20 remove_watcher() i=5 2024-09-12T00:36:40.468 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.467+0000 7f7466f959c0 20 remove_watcher() i=6 2024-09-12T00:36:40.471 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.471+0000 7f7466f959c0 20 remove_watcher() i=7 2024-09-12T00:36:40.494 INFO:tasks.workunit.client.0.smithi078.stderr: test: PUT succeeds during reshard 2024-09-12T00:36:40.494 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:36:40.522 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:40.522 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:40.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.567+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.569 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 realm 2024-09-12T00:36:40.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:40.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:40.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:40.572 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.571+0000 7f8036d519c0 20 searching for the correct realm 2024-09-12T00:36:40.577 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.579+0000 7f8035058640 0 -- 172.21.15.78:0/1124544505 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f802405ea30 msgr2=0x7f802407faa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:40.793 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.795+0000 7f8034857640 0 -- 172.21.15.78:0/1124544505 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55575f292b90 msgr2=0x55575f294ff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:40.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.803+0000 7f8036d519c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:40.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.803+0000 7f8036d519c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:40.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.803+0000 7f8036d519c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:40.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.803+0000 7f8036d519c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:40.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.803+0000 7f8036d519c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:40.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.803+0000 7f8036d519c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:40.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:40.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 zone default found 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 4 Realm: () 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 zonegroup default 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.808 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.807+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.811+0000 7f8036d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.811+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.809 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.811+0000 7f8036d519c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.811+0000 7f8036d519c0 20 started sync module instance, tier type = 2024-09-12T00:36:40.810 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.811+0000 7f8036d519c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:40.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.831+0000 7f8036d519c0 20 add_watcher() i=0 2024-09-12T00:36:40.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.831+0000 7f8036d519c0 20 add_watcher() i=1 2024-09-12T00:36:40.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.831+0000 7f8036d519c0 20 add_watcher() i=2 2024-09-12T00:36:40.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.831+0000 7f8036d519c0 20 add_watcher() i=3 2024-09-12T00:36:40.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.831+0000 7f8036d519c0 20 add_watcher() i=4 2024-09-12T00:36:40.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.831+0000 7f8036d519c0 20 add_watcher() i=5 2024-09-12T00:36:40.833 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.831+0000 7f8036d519c0 20 add_watcher() i=6 2024-09-12T00:36:40.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.835+0000 7f8036d519c0 20 add_watcher() i=7 2024-09-12T00:36:40.834 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.835+0000 7f8036d519c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:40.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.839+0000 7f7eeafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:40.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.839+0000 7f8036d519c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:40.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.839+0000 7f8036d519c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:40.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.839+0000 7f8036d519c0 5 note: GC not initialized 2024-09-12T00:36:40.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.839+0000 7f7ee9fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:40.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.839+0000 7f8036d519c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:40.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.839+0000 7f8036d519c0 20 Filter name: none 2024-09-12T00:36:40.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f7e5b7fe640 20 reqs_thread_entry: start 2024-09-12T00:36:40.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:40.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:40.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:40.843 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:40.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:40.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.843+0000 7f8036d519c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:40.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.847+0000 7f7eeafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:40.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.851+0000 7f8036d519c0 20 remove_watcher() i=0 2024-09-12T00:36:40.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.851+0000 7f8036d519c0 2 removed watcher, disabling cache 2024-09-12T00:36:40.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.855+0000 7f8036d519c0 20 remove_watcher() i=1 2024-09-12T00:36:40.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.859+0000 7f8036d519c0 20 remove_watcher() i=2 2024-09-12T00:36:40.859 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.859+0000 7f8036d519c0 20 remove_watcher() i=3 2024-09-12T00:36:40.861 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.863+0000 7f8036d519c0 20 remove_watcher() i=4 2024-09-12T00:36:40.863 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.863+0000 7f8036d519c0 20 remove_watcher() i=5 2024-09-12T00:36:40.866 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.867+0000 7f8036d519c0 20 remove_watcher() i=6 2024-09-12T00:36:40.868 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.867+0000 7f8036d519c0 20 remove_watcher() i=7 2024-09-12T00:36:40.885 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:BUCKET_STATS: 2024-09-12T00:36:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:bucket: myver id: 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 num_objects: 0 size_kb: 0 num_shards: 12 2024-09-12T00:36:40.886 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:40.886 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin --inject-delay-at=do_reshard --inject-delay-ms=5000 bucket reshard --bucket myver --num-shards 13 2024-09-12T00:36:40.918 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:40.919 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:40.963 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.963+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 realm 2024-09-12T00:36:40.965 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:40.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:40.966 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:40.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:40.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:40.968 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.967+0000 7f74dc47b9c0 20 searching for the correct realm 2024-09-12T00:36:40.973 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:40.975+0000 7f74da782640 0 -- 172.21.15.78:0/1036865694 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f74cc0c0020 msgr2=0x7f74cc10ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:41.189 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.191+0000 7f74da782640 0 -- 172.21.15.78:0/1036865694 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x557d10379a30 msgr2=0x557d1037bed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:41.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:41.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:41.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:41.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:41.201 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:41.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:41.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:41.202 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:41.203 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 zone default found 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 4 Realm: () 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 zonegroup default 2024-09-12T00:36:41.204 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:41.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.203+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.207+0000 7f74dc47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:41.205 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.207+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.207+0000 7f74dc47b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:41.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.207+0000 7f74dc47b9c0 20 started sync module instance, tier type = 2024-09-12T00:36:41.206 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.207+0000 7f74dc47b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:41.229 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.227+0000 7f74dc47b9c0 20 add_watcher() i=0 2024-09-12T00:36:41.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.227+0000 7f74dc47b9c0 20 add_watcher() i=1 2024-09-12T00:36:41.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.227+0000 7f74dc47b9c0 20 add_watcher() i=2 2024-09-12T00:36:41.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.227+0000 7f74dc47b9c0 20 add_watcher() i=3 2024-09-12T00:36:41.230 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.227+0000 7f74dc47b9c0 20 add_watcher() i=4 2024-09-12T00:36:41.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.227+0000 7f74dc47b9c0 20 add_watcher() i=5 2024-09-12T00:36:41.231 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.227+0000 7f74dc47b9c0 20 add_watcher() i=6 2024-09-12T00:36:41.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.231+0000 7f74dc47b9c0 20 add_watcher() i=7 2024-09-12T00:36:41.232 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.231+0000 7f74dc47b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:41.236 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.235+0000 7f738b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:41.238 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.235+0000 7f74dc47b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:41.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.235+0000 7f74dc47b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:41.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.235+0000 7f74dc47b9c0 5 note: GC not initialized 2024-09-12T00:36:41.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f738a7fc640 20 reqs_thread_entry: start 2024-09-12T00:36:41.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:41.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 20 Filter name: none 2024-09-12T00:36:41.239 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f72fbfff640 20 reqs_thread_entry: start 2024-09-12T00:36:41.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:36:41.240 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:41.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:36:41.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:36:41.242 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : miss 2024-09-12T00:36:41.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:41.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:41.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:41.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 adding default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:41.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:41.243 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:41.244 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.239+0000 7f74dc47b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:41.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f74dc47b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:41.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f74dc47b9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:41.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f74dc47b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:41.252 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f74dc47b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:41.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f73bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398972 cookie 93995631421312 notifier 8102 bl.length()=821 2024-09-12T00:36:41.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f73bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:41.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f73bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:41.254 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.251+0000 7f73bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:41.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.255+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:41.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.255+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:41.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.255+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:41.255 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.255+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:41.265 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:41.267+0000 7f74dc47b9c0 -1 Injecting delay=5.000000000s at location=do_reshard 2024-09-12T00:36:41.925 INFO:tasks.workunit.client.0.smithi078.stderr:put object successful 2024-09-12T00:36:46.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:46.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:46.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:46.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:46.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:46.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:46.266 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:46.267 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.0 2024-09-12T00:36:46.268 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.0 2024-09-12T00:36:46.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.1 2024-09-12T00:36:46.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.1 2024-09-12T00:36:46.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.2 2024-09-12T00:36:46.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.267+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.2 2024-09-12T00:36:46.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.271+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.3 2024-09-12T00:36:46.269 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.271+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.3 2024-09-12T00:36:46.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.271+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.4 2024-09-12T00:36:46.271 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.271+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.4 2024-09-12T00:36:46.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.271+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.5 2024-09-12T00:36:46.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.271+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.5 2024-09-12T00:36:46.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.275+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.6 2024-09-12T00:36:46.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.275+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.6 2024-09-12T00:36:46.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.275+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.7 2024-09-12T00:36:46.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.275+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.7 2024-09-12T00:36:46.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.279+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.8 2024-09-12T00:36:46.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.279+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.8 2024-09-12T00:36:46.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.279+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.9 2024-09-12T00:36:46.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.279+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.9 2024-09-12T00:36:46.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.283+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.10 2024-09-12T00:36:46.281 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.283+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.10 2024-09-12T00:36:46.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.283+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.11 2024-09-12T00:36:46.282 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.283+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.11 2024-09-12T00:36:46.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.287+0000 7f74dc47b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:46.287 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.287+0000 7f74dc47b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:46.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f74dc47b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:46.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f74dc47b9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:46.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f74dc47b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:46.291 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f74dc47b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:46.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f73bcff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398973 cookie 93995631421312 notifier 8102 bl.length()=821 2024-09-12T00:36:46.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f73bcff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:46.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f73bcff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:46.292 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.291+0000 7f73bcff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:46.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.295+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:46.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.295+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:46.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.295+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:46.293 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.295+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:46.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.0 2024-09-12T00:36:46.301 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.0 2024-09-12T00:36:46.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.1 2024-09-12T00:36:46.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.1 2024-09-12T00:36:46.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.2 2024-09-12T00:36:46.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.2 2024-09-12T00:36:46.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.3 2024-09-12T00:36:46.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.3 2024-09-12T00:36:46.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.4 2024-09-12T00:36:46.305 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.303+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.4 2024-09-12T00:36:46.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.307+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.5 2024-09-12T00:36:46.306 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.307+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.5 2024-09-12T00:36:46.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.307+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.6 2024-09-12T00:36:46.307 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.307+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.6 2024-09-12T00:36:46.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.307+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.7 2024-09-12T00:36:46.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.307+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.7 2024-09-12T00:36:46.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.8 2024-09-12T00:36:46.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.8 2024-09-12T00:36:46.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.9 2024-09-12T00:36:46.310 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.9 2024-09-12T00:36:46.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.10 2024-09-12T00:36:46.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.10 2024-09-12T00:36:46.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.11 2024-09-12T00:36:46.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.311+0000 7f74dc47b9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.1.11 2024-09-12T00:36:46.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.319+0000 7f74dc47b9c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:46.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.319+0000 7f74dc47b9c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:46.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.319+0000 7f74dc47b9c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:46.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.319+0000 7f74dc47b9c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:46.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.319+0000 7f74dc47b9c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:46.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.319+0000 7f74dc47b9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:46.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f73bd7fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398974 cookie 93995631421312 notifier 8102 bl.length()=789 2024-09-12T00:36:46.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f73bd7fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:46.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f73bd7fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:46.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f73bd7fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:46.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:46.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:46.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:46.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.323+0000 7f74dc47b9c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:46.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.327+0000 7f74dc47b9c0 1 execute INFO: reshard of bucket "myver" from 12 shards to 13 shards completed successfully 2024-09-12T00:36:46.334 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.335+0000 7f738b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:46.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.339+0000 7f74dc47b9c0 20 remove_watcher() i=0 2024-09-12T00:36:46.338 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.339+0000 7f74dc47b9c0 2 removed watcher, disabling cache 2024-09-12T00:36:46.341 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.343+0000 7f74dc47b9c0 20 remove_watcher() i=1 2024-09-12T00:36:46.344 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.343+0000 7f74dc47b9c0 20 remove_watcher() i=2 2024-09-12T00:36:46.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.347+0000 7f74dc47b9c0 20 remove_watcher() i=3 2024-09-12T00:36:46.349 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.351+0000 7f74dc47b9c0 20 remove_watcher() i=4 2024-09-12T00:36:46.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.351+0000 7f74dc47b9c0 20 remove_watcher() i=5 2024-09-12T00:36:46.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.355+0000 7f74dc47b9c0 20 remove_watcher() i=6 2024-09-12T00:36:46.357 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:46.359+0000 7f74dc47b9c0 20 remove_watcher() i=7 2024-09-12T00:36:46.929 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: check that bucket stats are correct after reshard with unlinked entries 2024-09-12T00:36:46.929 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:36:47.114 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:36:47.555 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_olh_cancel_modification_err true 2024-09-12T00:36:49.058 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:36:49.058 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket myver --object x 2024-09-12T00:36:49.095 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:49.095 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:49.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.139+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 realm 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:49.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.144 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:49.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.143+0000 7f795d1599c0 20 searching for the correct realm 2024-09-12T00:36:49.149 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.151+0000 7f795b460640 0 -- 172.21.15.78:0/2787398551 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f794c008040 msgr2=0x7f794c0720b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:36:49.364 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.363+0000 7f795b460640 0 -- 172.21.15.78:0/2787398551 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563a3f844350 msgr2=0x563a3f8467d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.375+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:49.377 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:49.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 zone default found 2024-09-12T00:36:49.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 4 Realm: () 2024-09-12T00:36:49.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:49.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:49.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:49.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 zonegroup default 2024-09-12T00:36:49.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.379 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 started sync module instance, tier type = 2024-09-12T00:36:49.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.379+0000 7f795d1599c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:49.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.403+0000 7f795d1599c0 20 add_watcher() i=0 2024-09-12T00:36:49.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.403+0000 7f795d1599c0 20 add_watcher() i=1 2024-09-12T00:36:49.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.403+0000 7f795d1599c0 20 add_watcher() i=2 2024-09-12T00:36:49.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.403+0000 7f795d1599c0 20 add_watcher() i=3 2024-09-12T00:36:49.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.403+0000 7f795d1599c0 20 add_watcher() i=4 2024-09-12T00:36:49.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.403+0000 7f795d1599c0 20 add_watcher() i=5 2024-09-12T00:36:49.405 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.403+0000 7f795d1599c0 20 add_watcher() i=6 2024-09-12T00:36:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.407+0000 7f795d1599c0 20 add_watcher() i=7 2024-09-12T00:36:49.407 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.407+0000 7f795d1599c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:49.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.411+0000 7f78117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:49.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.411+0000 7f795d1599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:49.412 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.411+0000 7f795d1599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:49.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.411+0000 7f795d1599c0 5 note: GC not initialized 2024-09-12T00:36:49.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f778bfff640 20 reqs_thread_entry: start 2024-09-12T00:36:49.413 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:49.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 Filter name: none 2024-09-12T00:36:49.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f7789ffb640 20 reqs_thread_entry: start 2024-09-12T00:36:49.414 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:49.415 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:36:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 INFO: main: starting shard=0 2024-09-12T00:36:49.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:49.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.415+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:49.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: starting shard=1 2024-09-12T00:36:49.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:49.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:49.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: starting shard=2 2024-09-12T00:36:49.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:49.418 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:49.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.419 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: starting shard=3 2024-09-12T00:36:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 INFO: main: starting shard=4 2024-09-12T00:36:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:49.420 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.419+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 INFO: main: starting shard=5 2024-09-12T00:36:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:49.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:49.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:36:49.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 INFO: main: starting shard=6 2024-09-12T00:36:49.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:49.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:49.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.424 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 INFO: main: starting shard=7 2024-09-12T00:36:49.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:49.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.423+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:49.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: starting shard=8 2024-09-12T00:36:49.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:49.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:49.426 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: starting shard=9 2024-09-12T00:36:49.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:49.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:49.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: starting shard=10 2024-09-12T00:36:49.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:49.427 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:49.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 INFO: main: starting shard=11 2024-09-12T00:36:49.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:49.429 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.427+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.431+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.431+0000 7f795d1599c0 20 INFO: main: starting shard=12 2024-09-12T00:36:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.431+0000 7f795d1599c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:49.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.431+0000 7f795d1599c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:49.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.431+0000 7f795d1599c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.431 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.431+0000 7f795d1599c0 20 INFO: main: done 2024-09-12T00:36:49.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.431+0000 7f78117e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.439+0000 7f795d1599c0 20 remove_watcher() i=0 2024-09-12T00:36:49.437 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.439+0000 7f795d1599c0 2 removed watcher, disabling cache 2024-09-12T00:36:49.439 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.439+0000 7f795d1599c0 20 remove_watcher() i=1 2024-09-12T00:36:49.441 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.443+0000 7f795d1599c0 20 remove_watcher() i=2 2024-09-12T00:36:49.443 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.443+0000 7f795d1599c0 20 remove_watcher() i=3 2024-09-12T00:36:49.446 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.447+0000 7f795d1599c0 20 remove_watcher() i=4 2024-09-12T00:36:49.448 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.447+0000 7f795d1599c0 20 remove_watcher() i=5 2024-09-12T00:36:49.450 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.451+0000 7f795d1599c0 20 remove_watcher() i=6 2024-09-12T00:36:49.453 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.455+0000 7f795d1599c0 20 remove_watcher() i=7 2024-09-12T00:36:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:36:49.534 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket myver --object y 2024-09-12T00:36:49.571 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:49.571 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:49.615 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.615+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 realm 2024-09-12T00:36:49.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.618 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:49.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:49.619 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:49.620 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.619+0000 7f75c3dcc9c0 20 searching for the correct realm 2024-09-12T00:36:49.625 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.627+0000 7f75c20d3640 0 -- 172.21.15.78:0/2615100973 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f75b407aa00 msgr2=0x7f75b406b040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:49.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.839+0000 7f75c20d3640 0 -- 172.21.15.78:0/2615100973 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55d35f96bbb0 msgr2=0x55d35f96dfa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:49.852 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.851+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:49.853 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:49.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 zone default found 2024-09-12T00:36:49.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 4 Realm: () 2024-09-12T00:36:49.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:49.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:49.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:49.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 zonegroup default 2024-09-12T00:36:49.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:49.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 started sync module instance, tier type = 2024-09-12T00:36:49.857 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.855+0000 7f75c3dcc9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:49.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.879+0000 7f75c3dcc9c0 20 add_watcher() i=0 2024-09-12T00:36:49.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.879+0000 7f75c3dcc9c0 20 add_watcher() i=1 2024-09-12T00:36:49.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.879+0000 7f75c3dcc9c0 20 add_watcher() i=2 2024-09-12T00:36:49.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.879+0000 7f75c3dcc9c0 20 add_watcher() i=3 2024-09-12T00:36:49.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.879+0000 7f75c3dcc9c0 20 add_watcher() i=4 2024-09-12T00:36:49.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.879+0000 7f75c3dcc9c0 20 add_watcher() i=5 2024-09-12T00:36:49.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.879+0000 7f75c3dcc9c0 20 add_watcher() i=6 2024-09-12T00:36:49.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.883+0000 7f75c3dcc9c0 20 add_watcher() i=7 2024-09-12T00:36:49.882 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.883+0000 7f75c3dcc9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:49.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f74737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:49.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f75c3dcc9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:49.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f75c3dcc9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:49.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f75c3dcc9c0 5 note: GC not initialized 2024-09-12T00:36:49.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f74727fc640 20 reqs_thread_entry: start 2024-09-12T00:36:49.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f75c3dcc9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:49.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f75c3dcc9c0 20 Filter name: none 2024-09-12T00:36:49.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.887+0000 7f73e3fff640 20 reqs_thread_entry: start 2024-09-12T00:36:49.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:49.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:49.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:49.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:49.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:36:49.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 INFO: main: starting shard=0 2024-09-12T00:36:49.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:49.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:49.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 INFO: main: starting shard=1 2024-09-12T00:36:49.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:49.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:49.892 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 INFO: main: starting shard=2 2024-09-12T00:36:49.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:49.893 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.891+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:49.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 INFO: main: starting shard=3 2024-09-12T00:36:49.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:49.894 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:49.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 INFO: main: starting shard=4 2024-09-12T00:36:49.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:49.895 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:49.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 INFO: main: starting shard=5 2024-09-12T00:36:49.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:49.896 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.895+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:49.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: starting shard=6 2024-09-12T00:36:49.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:49.897 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:49.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: starting shard=7 2024-09-12T00:36:49.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:49.898 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:49.899 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: starting shard=8 2024-09-12T00:36:49.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:49.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:49.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 INFO: main: starting shard=9 2024-09-12T00:36:49.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:49.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.899+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:49.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:36:49.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 20 INFO: main: starting shard=10 2024-09-12T00:36:49.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:49.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:49.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 20 INFO: main: starting shard=11 2024-09-12T00:36:49.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:49.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.903+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:49.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.907+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.907+0000 7f75c3dcc9c0 20 INFO: main: starting shard=12 2024-09-12T00:36:49.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.907+0000 7f75c3dcc9c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:49.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.907+0000 7f75c3dcc9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:49.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.907+0000 7f75c3dcc9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:49.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.907+0000 7f75c3dcc9c0 20 INFO: main: done 2024-09-12T00:36:49.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.907+0000 7f74737fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:49.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.911+0000 7f75c3dcc9c0 20 remove_watcher() i=0 2024-09-12T00:36:49.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.911+0000 7f75c3dcc9c0 2 removed watcher, disabling cache 2024-09-12T00:36:49.914 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.915+0000 7f75c3dcc9c0 20 remove_watcher() i=1 2024-09-12T00:36:49.916 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.915+0000 7f75c3dcc9c0 20 remove_watcher() i=2 2024-09-12T00:36:49.918 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.919+0000 7f75c3dcc9c0 20 remove_watcher() i=3 2024-09-12T00:36:49.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.923+0000 7f75c3dcc9c0 20 remove_watcher() i=4 2024-09-12T00:36:49.923 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.923+0000 7f75c3dcc9c0 20 remove_watcher() i=5 2024-09-12T00:36:49.926 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.927+0000 7f75c3dcc9c0 20 remove_watcher() i=6 2024-09-12T00:36:49.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:49.927+0000 7f75c3dcc9c0 20 remove_watcher() i=7 2024-09-12T00:36:50.005 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:36:50.006 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket myver --object z 2024-09-12T00:36:50.043 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:50.043 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:50.088 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.087+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:50.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 20 realm 2024-09-12T00:36:50.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:50.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:50.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:50.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.091+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.095+0000 7f80061b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:50.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.095+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.095+0000 7f80061b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:50.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.095+0000 7f80061b59c0 20 searching for the correct realm 2024-09-12T00:36:50.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.099+0000 7f80044bc640 0 -- 172.21.15.78:0/371996139 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7ff4040070 msgr2=0x7f7ff404a140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:50.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.315+0000 7f80044bc640 0 -- 172.21.15.78:0/371996139 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5565bcf5e270 msgr2=0x5565bcf60660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:50.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.327+0000 7f80061b59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:50.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.327+0000 7f80061b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:50.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.327+0000 7f80061b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:50.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.327+0000 7f80061b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:50.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.327+0000 7f80061b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:50.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.327+0000 7f80061b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:50.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.327+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.519 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.519+0000 7f80061b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:50.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.519+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.519+0000 7f80061b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:50.520 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.519+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:50.521 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 zone default found 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 4 Realm: () 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 zonegroup default 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:50.522 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:50.523 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:50.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 started sync module instance, tier type = 2024-09-12T00:36:50.524 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.523+0000 7f80061b59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.547+0000 7f80061b59c0 20 add_watcher() i=0 2024-09-12T00:36:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.547+0000 7f80061b59c0 20 add_watcher() i=1 2024-09-12T00:36:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.547+0000 7f80061b59c0 20 add_watcher() i=2 2024-09-12T00:36:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.547+0000 7f80061b59c0 20 add_watcher() i=3 2024-09-12T00:36:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.547+0000 7f80061b59c0 20 add_watcher() i=4 2024-09-12T00:36:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.547+0000 7f80061b59c0 20 add_watcher() i=5 2024-09-12T00:36:50.548 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.547+0000 7f80061b59c0 20 add_watcher() i=6 2024-09-12T00:36:50.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.551+0000 7f80061b59c0 20 add_watcher() i=7 2024-09-12T00:36:50.550 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.551+0000 7f80061b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:50.555 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.555+0000 7f7eb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:50.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.555+0000 7f80061b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:50.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.555+0000 7f80061b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:50.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.555+0000 7f80061b59c0 5 note: GC not initialized 2024-09-12T00:36:50.556 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.555+0000 7f7eb8fe1640 20 reqs_thread_entry: start 2024-09-12T00:36:50.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.555+0000 7f80061b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:50.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 Filter name: none 2024-09-12T00:36:50.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f7e327fc640 20 reqs_thread_entry: start 2024-09-12T00:36:50.557 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:50.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:50.559 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:50.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:50.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 INFO: main: max_entries=1000, index=gen=2, max_shards=13 2024-09-12T00:36:50.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 INFO: main: starting shard=0 2024-09-12T00:36:50.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:50.560 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.559+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=1, is_truncated=0, marker= 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 INFO: main: starting shard=1 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 INFO: main: starting shard=2 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:50.561 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:50.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 INFO: main: starting shard=3 2024-09-12T00:36:50.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:50.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:50.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 INFO: main: starting shard=4 2024-09-12T00:36:50.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:50.564 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.563+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:50.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 INFO: main: starting shard=5 2024-09-12T00:36:50.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:50.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:50.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 INFO: main: starting shard=6 2024-09-12T00:36:50.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:50.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:50.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 INFO: main: starting shard=7 2024-09-12T00:36:50.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:50.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.567+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:50.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 INFO: main: starting shard=8 2024-09-12T00:36:50.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:50.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:50.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.570 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 INFO: main: starting shard=9 2024-09-12T00:36:50.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:50.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:50.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 INFO: main: starting shard=10 2024-09-12T00:36:50.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:50.571 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.571+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:50.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 INFO: main: starting shard=11 2024-09-12T00:36:50.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:50.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:50.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.574 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 INFO: main: starting shard=12 2024-09-12T00:36:50.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:50.575 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:50.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:36:50.576 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.575+0000 7f80061b59c0 20 INFO: main: done 2024-09-12T00:36:50.578 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.579+0000 7f7eb9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:50.582 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.583+0000 7f80061b59c0 20 remove_watcher() i=0 2024-09-12T00:36:50.583 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.583+0000 7f80061b59c0 2 removed watcher, disabling cache 2024-09-12T00:36:50.584 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.583+0000 7f80061b59c0 20 remove_watcher() i=1 2024-09-12T00:36:50.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.587+0000 7f80061b59c0 20 remove_watcher() i=2 2024-09-12T00:36:50.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.587+0000 7f80061b59c0 20 remove_watcher() i=3 2024-09-12T00:36:50.591 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.591+0000 7f80061b59c0 20 remove_watcher() i=4 2024-09-12T00:36:50.593 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.595+0000 7f80061b59c0 20 remove_watcher() i=5 2024-09-12T00:36:50.595 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.595+0000 7f80061b59c0 20 remove_watcher() i=6 2024-09-12T00:36:50.598 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:50.599+0000 7f80061b59c0 20 remove_watcher() i=7 2024-09-12T00:36:50.620 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:36:51.054 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_olh_cancel_modification_err 2024-09-12T00:36:51.488 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket reshard --bucket myver --num-shards 17 --yes-i-really-mean-it 2024-09-12T00:36:51.520 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:51.521 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:51.563 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.563+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:51.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 realm 2024-09-12T00:36:51.565 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:51.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:51.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:51.566 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:51.567 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:51.568 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.567+0000 7f3e884189c0 20 searching for the correct realm 2024-09-12T00:36:51.573 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.575+0000 7f3e8671f640 0 -- 172.21.15.78:0/662802082 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f3e78065260 msgr2=0x7f3e780633d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:51.789 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.791+0000 7f3e8671f640 0 -- 172.21.15.78:0/662802082 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5647f857b810 msgr2=0x5647f857dc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:51.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:51.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:51.801 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:51.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:51.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:51.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:51.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:51.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:51.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.803 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 zone default found 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 4 Realm: () 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 zonegroup default 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.804 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:51.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.803+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.807+0000 7f3e884189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:51.805 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.807+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.807+0000 7f3e884189c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:51.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.807+0000 7f3e884189c0 20 started sync module instance, tier type = 2024-09-12T00:36:51.806 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.807+0000 7f3e884189c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:51.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=0 2024-09-12T00:36:51.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=1 2024-09-12T00:36:51.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=2 2024-09-12T00:36:51.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=3 2024-09-12T00:36:51.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=4 2024-09-12T00:36:51.830 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=5 2024-09-12T00:36:51.831 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=6 2024-09-12T00:36:51.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 20 add_watcher() i=7 2024-09-12T00:36:51.832 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.831+0000 7f3e884189c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:51.837 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.835+0000 7f3d377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:51.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:51.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:51.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 5 note: GC not initialized 2024-09-12T00:36:51.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3d367fc640 20 reqs_thread_entry: start 2024-09-12T00:36:51.838 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:51.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 20 Filter name: none 2024-09-12T00:36:51.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3ca7fff640 20 reqs_thread_entry: start 2024-09-12T00:36:51.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:36:51.839 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:51.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:36:51.840 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:36:51.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : miss 2024-09-12T00:36:51.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.839+0000 7f3e884189c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:51.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.843+0000 7f3e884189c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:51.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.843+0000 7f3e884189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:51.841 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.843+0000 7f3e884189c0 10 adding default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:51.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.843+0000 7f3e884189c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:51.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.843+0000 7f3e884189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:51.842 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.843+0000 7f3e884189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:51.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:51.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:51.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:51.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:51.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3d68ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398975 cookie 94867109241760 notifier 8186 bl.length()=821 2024-09-12T00:36:51.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3d68ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:51.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3d68ff9640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:51.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3d68ff9640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:51.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:51.855 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:51.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:51.856 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.855+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:51.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.0 2024-09-12T00:36:51.869 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.0 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.1 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.1 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.2 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.2 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.3 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.3 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.4 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.4 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.5 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.5 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.6 2024-09-12T00:36:51.870 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.6 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.7 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.7 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.8 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.867+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.8 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.10 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.10 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.11 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.11 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.12 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.12 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.13 2024-09-12T00:36:51.871 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.13 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.14 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.14 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.15 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.15 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.16 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.16 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:51.872 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:51.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:51.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:51.873 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.871+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.875+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:51.874 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.875+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:51.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.875+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:51.875 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.875+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:51.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.875+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:51.876 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.875+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:51.877 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:51.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:51.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:51.878 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:51.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:51.879 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:51.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:51.880 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.879+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:51.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.883+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:51.881 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.883+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:51.886 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.887+0000 7f3e884189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:51.887 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.887+0000 7f3e884189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:51.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.887+0000 7f3e884189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:51.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.887+0000 7f3e884189c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:51.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.887+0000 7f3e884189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:51.888 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.887+0000 7f3e884189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:51.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3d697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398976 cookie 94867109241760 notifier 8186 bl.length()=821 2024-09-12T00:36:51.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3d697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:51.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3d697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:51.889 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3d697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:51.890 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:51.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:51.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:51.891 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.891+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:51.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.899+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:51.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.899+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.0 2024-09-12T00:36:51.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.899+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:51.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.899+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.1 2024-09-12T00:36:51.900 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.899+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:51.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.899+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.2 2024-09-12T00:36:51.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:51.901 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.3 2024-09-12T00:36:51.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:51.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.4 2024-09-12T00:36:51.902 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:51.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.5 2024-09-12T00:36:51.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:51.903 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.6 2024-09-12T00:36:51.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:51.904 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.903+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.7 2024-09-12T00:36:51.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:51.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.8 2024-09-12T00:36:51.905 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:51.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.9 2024-09-12T00:36:51.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:51.906 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.10 2024-09-12T00:36:51.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:51.907 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.11 2024-09-12T00:36:51.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:51.908 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.907+0000 7f3e884189c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.2.12 2024-09-12T00:36:51.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3e884189c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : hit (requested=0x17, cached=0x17) 2024-09-12T00:36:51.909 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3e884189c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:51.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3e884189c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:51.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3e884189c0 10 moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:51.911 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3e884189c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:51.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3e884189c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18, ofs0, ns] 2024-09-12T00:36:51.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3d697fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398977 cookie 94867109241760 notifier 8186 bl.length()=789 2024-09-12T00:36:51.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3d697fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:51.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3d697fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:51.912 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.911+0000 7f3d697fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:51.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.915+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_sources= new_sources= 2024-09-12T00:36:51.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.915+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential sources added=[] removed=[] 2024-09-12T00:36:51.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.915+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): orig_dests= new_dests= 2024-09-12T00:36:51.913 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.915+0000 7f3e884189c0 20 handle_bi_update(): bucket=:myver[88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18]): potential dests added=[] removed=[] 2024-09-12T00:36:51.919 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.919+0000 7f3e884189c0 1 execute INFO: reshard of bucket "myver" from 13 shards to 17 shards completed successfully 2024-09-12T00:36:51.921 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.923+0000 7f3d377fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:51.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.927+0000 7f3e884189c0 20 remove_watcher() i=0 2024-09-12T00:36:51.925 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.927+0000 7f3e884189c0 2 removed watcher, disabling cache 2024-09-12T00:36:51.928 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.927+0000 7f3e884189c0 20 remove_watcher() i=1 2024-09-12T00:36:51.929 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.931+0000 7f3e884189c0 20 remove_watcher() i=2 2024-09-12T00:36:51.932 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.931+0000 7f3e884189c0 20 remove_watcher() i=3 2024-09-12T00:36:51.934 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.935+0000 7f3e884189c0 20 remove_watcher() i=4 2024-09-12T00:36:51.936 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.935+0000 7f3e884189c0 20 remove_watcher() i=5 2024-09-12T00:36:51.939 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.939+0000 7f3e884189c0 20 remove_watcher() i=6 2024-09-12T00:36:51.942 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:51.943+0000 7f3e884189c0 20 remove_watcher() i=7 2024-09-12T00:36:51.956 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check unlinked --bucket myver --fix --min-age-hours 0 --rgw-olh-pending-timeout-sec 0 --dump-keys 2024-09-12T00:36:51.993 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:51.994 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:52.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.035+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 realm 2024-09-12T00:36:52.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:52.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.039 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:52.040 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.039+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.043+0000 7f07df2e49c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:52.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.043+0000 7f07df2e49c0 20 searching for the correct realm 2024-09-12T00:36:52.045 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.047+0000 7f07dd5eb640 0 -- 172.21.15.78:0/405473768 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f07cc10d0b0 msgr2=0x7f07cc0c1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:52.261 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.259+0000 7f07dd5eb640 0 -- 172.21.15.78:0/405473768 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55b0122f4070 msgr2=0x55b0122f6530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:52.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:52.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:52.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:52.273 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:52.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:52.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:52.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.274 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:52.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.275 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 zone default found 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 4 Realm: () 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 zonegroup default 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.276 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.275+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.279+0000 7f07df2e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.277 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.279+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.279+0000 7f07df2e49c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.278 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.279+0000 7f07df2e49c0 20 started sync module instance, tier type = 2024-09-12T00:36:52.279 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.279+0000 7f07df2e49c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:52.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=0 2024-09-12T00:36:52.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=1 2024-09-12T00:36:52.302 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=2 2024-09-12T00:36:52.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=3 2024-09-12T00:36:52.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=4 2024-09-12T00:36:52.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=5 2024-09-12T00:36:52.303 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=6 2024-09-12T00:36:52.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 20 add_watcher() i=7 2024-09-12T00:36:52.304 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.303+0000 7f07df2e49c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:52.308 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.307+0000 7f0692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:52.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:52.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:52.309 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 5 note: GC not initialized 2024-09-12T00:36:52.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f0691fe3640 20 reqs_thread_entry: start 2024-09-12T00:36:52.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:52.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 20 Filter name: none 2024-09-12T00:36:52.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f06037fe640 20 reqs_thread_entry: start 2024-09-12T00:36:52.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 10 cache get: name=default.rgw.meta+root+myver : miss 2024-09-12T00:36:52.312 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:52.313 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 10 cache put: name=default.rgw.meta+root+myver info.flags=0x11 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 10 adding default.rgw.meta+root+myver to cache LRU end 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 : miss 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.311+0000 7f07df2e49c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 info.flags=0x17 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 adding default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 to cache LRU end 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 updating xattr: name=user.rgw.acl bl.length()=143 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myver:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18 2024-09-12T00:36:52.314 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.0 2024-09-12T00:36:52.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.0 2024-09-12T00:36:52.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 1 NOTICE: finished shard 0 (0 entries removed) 2024-09-12T00:36:52.315 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.1 2024-09-12T00:36:52.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.1 2024-09-12T00:36:52.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 1 NOTICE: finished shard 1 (0 entries removed) 2024-09-12T00:36:52.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.2 2024-09-12T00:36:52.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.2 2024-09-12T00:36:52.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 1 NOTICE: finished shard 2 (0 entries removed) 2024-09-12T00:36:52.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.3 2024-09-12T00:36:52.316 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.3 2024-09-12T00:36:52.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 1 NOTICE: finished shard 3 (0 entries removed) 2024-09-12T00:36:52.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.4 2024-09-12T00:36:52.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.4 2024-09-12T00:36:52.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 1 NOTICE: finished shard 4 (0 entries removed) 2024-09-12T00:36:52.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.5 2024-09-12T00:36:52.317 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.315+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.5 2024-09-12T00:36:52.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 1 NOTICE: finished shard 5 (0 entries removed) 2024-09-12T00:36:52.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.6 2024-09-12T00:36:52.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.6 2024-09-12T00:36:52.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 1 NOTICE: finished shard 6 (0 entries removed) 2024-09-12T00:36:52.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.7 2024-09-12T00:36:52.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.7 2024-09-12T00:36:52.318 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 1 NOTICE: finished shard 7 (0 entries removed) 2024-09-12T00:36:52.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.8 2024-09-12T00:36:52.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.8 2024-09-12T00:36:52.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 1 NOTICE: finished shard 8 (0 entries removed) 2024-09-12T00:36:52.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.319 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.320 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.10 2024-09-12T00:36:52.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.319+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.10 2024-09-12T00:36:52.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 1 NOTICE: finished shard 10 (0 entries removed) 2024-09-12T00:36:52.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.11 2024-09-12T00:36:52.321 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.11 2024-09-12T00:36:52.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 1 NOTICE: finished shard 11 (0 entries removed) 2024-09-12T00:36:52.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.12 2024-09-12T00:36:52.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.12 2024-09-12T00:36:52.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 1 NOTICE: finished shard 12 (0 entries removed) 2024-09-12T00:36:52.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.13 2024-09-12T00:36:52.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.13 2024-09-12T00:36:52.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 1 NOTICE: finished shard 13 (0 entries removed) 2024-09-12T00:36:52.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.14 2024-09-12T00:36:52.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.323+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.14 2024-09-12T00:36:52.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 1 NOTICE: finished shard 14 (0 entries removed) 2024-09-12T00:36:52.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.15 2024-09-12T00:36:52.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.15 2024-09-12T00:36:52.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 1 NOTICE: finished shard 15 (0 entries removed) 2024-09-12T00:36:52.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 10 bucket_obj is .dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.16 2024-09-12T00:36:52.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.16 2024-09-12T00:36:52.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 1 NOTICE: finished shard 16 (0 entries removed) 2024-09-12T00:36:52.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.327+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:x state=0x55b012336b18 s->prefetch_data=0 2024-09-12T00:36:52.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.331+0000 7f07df2e49c0 20 get_obj_state: setting s->obj_tag to ra5rzp9p5gr2kdiw590uolyle7wh0tdp 2024-09-12T00:36:52.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.331+0000 7f07df2e49c0 20 get_obj_state_impl: setting s->olh_tag to 921vulunctt48py3tku39lk9xi0bq7t0 2024-09-12T00:36:52.329 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.331+0000 7f07df2e49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=921vulunctt48py3tku39lk9xi0bq7t0 2024-09-12T00:36:52.331 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.331+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.335 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.335+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.335+0000 7f07df2e49c0 20 olh_log_entry: epoch=2 op=2 key=x[] 2024-09-12T00:36:52.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.335+0000 7f07df2e49c0 20 olh_log_entry: epoch=2 op=3 key=x[ORSYCks2T1T4vYC9g7qe-LzYinDmWnq] 2024-09-12T00:36:52.336 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.335+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:_:ORSYCks2T1T4vYC9g7qe-LzYinDmWnq_x state=0x55b0123608c8 s->prefetch_data=0 2024-09-12T00:36:52.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.339+0000 7f07df2e49c0 10 manifest: total_size = 9 2024-09-12T00:36:52.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.339+0000 7f07df2e49c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3472595038977007902 2024-09-12T00:36:52.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.339+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:_:ORSYCks2T1T4vYC9g7qe-LzYinDmWnq_x state=0x55b0123608c8 s->prefetch_data=0 2024-09-12T00:36:52.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.339+0000 7f07df2e49c0 20 prepare_atomic_modification: state is not atomic. state=0x55b0123608c8 2024-09-12T00:36:52.337 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.339+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.347+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:x state=0x55b012336b18 s->prefetch_data=0 2024-09-12T00:36:52.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.347+0000 7f07df2e49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=921vulunctt48py3tku39lk9xi0bq7t0 2024-09-12T00:36:52.346 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.347+0000 7f06b37fe640 20 handle_completion(): completion ok for obj=x[ORSYCks2T1T4vYC9g7qe-LzYinDmWnq] 2024-09-12T00:36:52.350 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.351+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.355+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.354 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.355+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.355+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:y state=0x55b012336b18 s->prefetch_data=0 2024-09-12T00:36:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.355+0000 7f07df2e49c0 20 get_obj_state: setting s->obj_tag to 0ywwovzof7i39ss51qgp1elk7ud0bcfb 2024-09-12T00:36:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.355+0000 7f07df2e49c0 20 get_obj_state_impl: setting s->olh_tag to wxflli7mzkfu4luwd6etfio0p1z0rndq 2024-09-12T00:36:52.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.355+0000 7f07df2e49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wxflli7mzkfu4luwd6etfio0p1z0rndq 2024-09-12T00:36:52.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.359+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.363 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 olh_log_entry: epoch=2 op=2 key=y[] 2024-09-12T00:36:52.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 olh_log_entry: epoch=2 op=3 key=y[hsNNfe.KAztx9-Jda1AtfF0En5mIG79] 2024-09-12T00:36:52.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:_:hsNNfe.KAztx9-Jda1AtfF0En5mIG79_y state=0x55b0123618d8 s->prefetch_data=0 2024-09-12T00:36:52.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 10 manifest: total_size = 11 2024-09-12T00:36:52.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10237071255127173843 2024-09-12T00:36:52.365 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:_:hsNNfe.KAztx9-Jda1AtfF0En5mIG79_y state=0x55b0123618d8 s->prefetch_data=0 2024-09-12T00:36:52.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 prepare_atomic_modification: state is not atomic. state=0x55b0123618d8 2024-09-12T00:36:52.366 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.363+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.375+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:y state=0x55b012336b18 s->prefetch_data=0 2024-09-12T00:36:52.373 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.375+0000 7f07df2e49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=wxflli7mzkfu4luwd6etfio0p1z0rndq 2024-09-12T00:36:52.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.375+0000 7f06b3fff640 20 handle_completion(): completion ok for obj=y[hsNNfe.KAztx9-Jda1AtfF0En5mIG79] 2024-09-12T00:36:52.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.379+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.381 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.383+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.383+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.383 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.383+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:z state=0x55b012336b18 s->prefetch_data=0 2024-09-12T00:36:52.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.383+0000 7f07df2e49c0 20 get_obj_state: setting s->obj_tag to jtvebfdr6x77bk7l2p1gicblyjm9qbw8 2024-09-12T00:36:52.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.383+0000 7f07df2e49c0 20 get_obj_state_impl: setting s->olh_tag to fk620qh2oq2f6j166xnudn3unyosaeq1 2024-09-12T00:36:52.384 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.383+0000 7f07df2e49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fk620qh2oq2f6j166xnudn3unyosaeq1 2024-09-12T00:36:52.387 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.387+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.391 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 olh_log_entry: epoch=2 op=2 key=z[] 2024-09-12T00:36:52.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 olh_log_entry: epoch=2 op=3 key=z[izh1qUrFoVMzrUDrJ36X1MSF3bvWcYV] 2024-09-12T00:36:52.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:_:izh1qUrFoVMzrUDrJ36X1MSF3bvWcYV_z state=0x55b01235f8b8 s->prefetch_data=0 2024-09-12T00:36:52.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 10 manifest: total_size = 22 2024-09-12T00:36:52.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 get_obj_state: setting s->obj_tag to 88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1976231345565549261 2024-09-12T00:36:52.392 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:_:izh1qUrFoVMzrUDrJ36X1MSF3bvWcYV_z state=0x55b01235f8b8 s->prefetch_data=0 2024-09-12T00:36:52.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 prepare_atomic_modification: state is not atomic. state=0x55b01235f8b8 2024-09-12T00:36:52.393 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.391+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.403+0000 7f06b3fff640 20 handle_completion(): completion ok for obj=z[izh1qUrFoVMzrUDrJ36X1MSF3bvWcYV] 2024-09-12T00:36:52.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.403+0000 7f07df2e49c0 20 get_obj_state: octx=0x55b011fd27e0 obj=myver:z state=0x55b012336b18 s->prefetch_data=0 2024-09-12T00:36:52.402 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.403+0000 7f07df2e49c0 20 bucket_index_guard_olh_op(): olh_state.olh_tag=fk620qh2oq2f6j166xnudn3unyosaeq1 2024-09-12T00:36:52.410 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.411+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.415+0000 7f07df2e49c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18.3.9 2024-09-12T00:36:52.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.415+0000 7f07df2e49c0 1 NOTICE: finished shard 9 (3 entries removed) 2024-09-12T00:36:52.416 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.415+0000 7f07df2e49c0 1 NOTICE: finished all shards (3 entries removed) 2024-09-12T00:36:52.417 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.415+0000 7f0692fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:52.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.423+0000 7f07df2e49c0 20 remove_watcher() i=0 2024-09-12T00:36:52.421 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.423+0000 7f07df2e49c0 2 removed watcher, disabling cache 2024-09-12T00:36:52.423 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.423+0000 7f07df2e49c0 20 remove_watcher() i=1 2024-09-12T00:36:52.425 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.427+0000 7f07df2e49c0 20 remove_watcher() i=2 2024-09-12T00:36:52.428 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.427+0000 7f07df2e49c0 20 remove_watcher() i=3 2024-09-12T00:36:52.430 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.431+0000 7f07df2e49c0 20 remove_watcher() i=4 2024-09-12T00:36:52.432 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.431+0000 7f07df2e49c0 20 remove_watcher() i=5 2024-09-12T00:36:52.435 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.435+0000 7f07df2e49c0 20 remove_watcher() i=6 2024-09-12T00:36:52.438 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.439+0000 7f07df2e49c0 20 remove_watcher() i=7 2024-09-12T00:36:52.510 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket stats --bucket myver 2024-09-12T00:36:52.541 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:36:52.541 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:36:52.585 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.587+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.587+0000 7f8c295b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.587+0000 7f8c295b59c0 20 realm 2024-09-12T00:36:52.588 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.587+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.587+0000 7f8c295b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.587+0000 7f8c295b59c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:36:52.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.587+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.591+0000 7f8c295b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:52.589 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.591+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.591+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:52.590 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.591+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:52.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.795+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:36:52.795 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.795+0000 7f8c295b59c0 20 searching for the correct realm 2024-09-12T00:36:52.802 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:52.803+0000 7f8c278bc640 0 -- 172.21.15.78:0/3129792238 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f8c18078b00 msgr2=0x7f8c1804a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:53.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.015+0000 7f8c278bc640 0 -- 172.21.15.78:0/3129792238 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55fc23657370 msgr2=0x55fc23659830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:36:53.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.027+0000 7f8c295b59c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:36:53.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.027+0000 7f8c295b59c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:36:53.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.027+0000 7f8c295b59c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:36:53.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.027+0000 7f8c295b59c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:36:53.029 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.027+0000 7f8c295b59c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:36:53.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.027+0000 7f8c295b59c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:36:53.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:53.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:36:53.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:36:53.031 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 zone default found 2024-09-12T00:36:53.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 4 Realm: () 2024-09-12T00:36:53.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:36:53.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:36:53.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:36:53.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 zonegroup default 2024-09-12T00:36:53.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:53.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.031+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.035+0000 7f8c295b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:53.033 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.035+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.035+0000 7f8c295b59c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:36:53.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.035+0000 7f8c295b59c0 20 started sync module instance, tier type = 2024-09-12T00:36:53.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.035+0000 7f8c295b59c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:36:53.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.059+0000 7f8c295b59c0 20 add_watcher() i=0 2024-09-12T00:36:53.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.059+0000 7f8c295b59c0 20 add_watcher() i=1 2024-09-12T00:36:53.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.059+0000 7f8c295b59c0 20 add_watcher() i=2 2024-09-12T00:36:53.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.059+0000 7f8c295b59c0 20 add_watcher() i=3 2024-09-12T00:36:53.059 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.059+0000 7f8c295b59c0 20 add_watcher() i=4 2024-09-12T00:36:53.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.059+0000 7f8c295b59c0 20 add_watcher() i=5 2024-09-12T00:36:53.060 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.059+0000 7f8c295b59c0 20 add_watcher() i=6 2024-09-12T00:36:53.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.063+0000 7f8c295b59c0 20 add_watcher() i=7 2024-09-12T00:36:53.062 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.063+0000 7f8c295b59c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:36:53.068 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.067+0000 7f8addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:53.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:36:53.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:36:53.069 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 5 note: GC not initialized 2024-09-12T00:36:53.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8adcfe1640 20 reqs_thread_entry: start 2024-09-12T00:36:53.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 init_complete bucket index max shards: 11 2024-09-12T00:36:53.070 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 Filter name: none 2024-09-12T00:36:53.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8a567fc640 20 reqs_thread_entry: start 2024-09-12T00:36:53.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:53.071 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:53.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:53.072 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.071+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.075+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=173 2024-09-12T00:36:53.073 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.075+0000 7f8c295b59c0 20 rados->read ofs=0 len=0 2024-09-12T00:36:53.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.075+0000 7f8c295b59c0 20 rados_obj.operate() r=0 bl.length=395 2024-09-12T00:36:53.074 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.075+0000 7f8c295b59c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:36:53.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.079+0000 7f8addfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:36:53.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.083+0000 7f8c295b59c0 20 remove_watcher() i=0 2024-09-12T00:36:53.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.083+0000 7f8c295b59c0 2 removed watcher, disabling cache 2024-09-12T00:36:53.084 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.083+0000 7f8c295b59c0 20 remove_watcher() i=1 2024-09-12T00:36:53.086 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.087+0000 7f8c295b59c0 20 remove_watcher() i=2 2024-09-12T00:36:53.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.091+0000 7f8c295b59c0 20 remove_watcher() i=3 2024-09-12T00:36:53.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.091+0000 7f8c295b59c0 20 remove_watcher() i=4 2024-09-12T00:36:53.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.095+0000 7f8c295b59c0 20 remove_watcher() i=5 2024-09-12T00:36:53.097 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.099+0000 7f8c295b59c0 20 remove_watcher() i=6 2024-09-12T00:36:53.099 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:36:53.099+0000 7f8c295b59c0 20 remove_watcher() i=7 2024-09-12T00:36:53.116 INFO:tasks.workunit.client.0.smithi078.stderr:{'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}} 2024-09-12T00:36:53.116 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket a-bucket 2024-09-12T00:36:53.147 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket myver 2024-09-12T00:36:53.292 INFO:tasks.workunit.client.0.smithi078.stderr:Completed resharding tests 2024-09-12T00:36:53.293 INFO:tasks.workunit.client.0.smithi078.stdout:connected to http://localhost:80 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ deactivate 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ export PATH 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ hash -r 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-12T00:36:53.409 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:36:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:36:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:36:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset -f deactivate 2024-09-12T00:36:53.410 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK. 2024-09-12T00:36:53.411 INFO:tasks.workunit.client.0.smithi078.stdout:OK. 2024-09-12T00:36:53.411 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:36:53.412 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:36:53.463 INFO:tasks.workunit:Stopping ['rgw/run-reshard.sh'] on client.0... 2024-09-12T00:36:53.464 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:36:53.910 DEBUG:teuthology.parallel:result is None 2024-09-12T00:36:53.911 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:53.922 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:53.922 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:36:53.969 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:36:53.969 INFO:teuthology.run_tasks:Running task s3tests-java... 2024-09-12T00:36:53.987 DEBUG:tasks.s3tests_java:S3 Tests Java: __INIT__ 2024-09-12T00:36:53.987 DEBUG:tasks.s3tests_java:S3 Tests Java: SETUP 2024-09-12T00:36:53.987 INFO:tasks.s3tests_java:S3 Tests Java: Downloading test suite... 2024-09-12T00:36:53.988 DEBUG:teuthology.orchestra.run.smithi078:> git clone -b ceph-master https://github.com/ceph/java_s3tests.git /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:36:54.018 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-java'... 2024-09-12T00:36:58.466 INFO:tasks.s3tests_java:S3 Tests Java: Installing required packages... 2024-09-12T00:36:58.466 DEBUG:teuthology.orchestra.run.smithi078:> /home/ubuntu/cephtest/s3-tests-java/bootstrap.sh 2024-09-12T00:36:58.556 INFO:teuthology.orchestra.run.smithi078.stderr:/home/ubuntu/cephtest/s3-tests-java/bootstrap.sh: missing required DEB packages. Installing via sudo. 2024-09-12T00:36:58.616 INFO:teuthology.orchestra.run.smithi078.stdout:Reading package lists... 2024-09-12T00:36:58.808 INFO:teuthology.orchestra.run.smithi078.stdout:Building dependency tree... 2024-09-12T00:36:58.808 INFO:teuthology.orchestra.run.smithi078.stdout:Reading state information... 2024-09-12T00:36:58.997 INFO:teuthology.orchestra.run.smithi078.stdout:The following packages were automatically installed and are no longer required: 2024-09-12T00:36:58.997 INFO:teuthology.orchestra.run.smithi078.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-09-12T00:36:58.997 INFO:teuthology.orchestra.run.smithi078.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-09-12T00:36:58.997 INFO:teuthology.orchestra.run.smithi078.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-09-12T00:36:58.997 INFO:teuthology.orchestra.run.smithi078.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-09-12T00:36:58.998 INFO:teuthology.orchestra.run.smithi078.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-09-12T00:36:58.998 INFO:teuthology.orchestra.run.smithi078.stdout:Use 'sudo apt autoremove' to remove them. 2024-09-12T00:36:58.998 INFO:teuthology.orchestra.run.smithi078.stdout:The following additional packages will be installed: 2024-09-12T00:36:58.998 INFO:teuthology.orchestra.run.smithi078.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:36:58.998 INFO:teuthology.orchestra.run.smithi078.stdout: openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:36:58.999 INFO:teuthology.orchestra.run.smithi078.stdout:Suggested packages: 2024-09-12T00:36:58.999 INFO:teuthology.orchestra.run.smithi078.stdout: gvfs openjdk-8-demo openjdk-8-source visualvm libnss-mdns fonts-nanum 2024-09-12T00:36:58.999 INFO:teuthology.orchestra.run.smithi078.stdout: fonts-ipafont-gothic fonts-ipafont-mincho fonts-wqy-microhei 2024-09-12T00:36:58.999 INFO:teuthology.orchestra.run.smithi078.stdout: fonts-wqy-zenhei fonts-indic 2024-09-12T00:36:59.035 INFO:teuthology.orchestra.run.smithi078.stdout:The following NEW packages will be installed: 2024-09-12T00:36:59.035 INFO:teuthology.orchestra.run.smithi078.stdout: libgail-common libgail18 libgtk2.0-0 libgtk2.0-bin libgtk2.0-common 2024-09-12T00:36:59.035 INFO:teuthology.orchestra.run.smithi078.stdout: openjdk-8-jdk openjdk-8-jdk-headless openjdk-8-jre openjdk-8-jre-headless 2024-09-12T00:36:59.218 INFO:teuthology.orchestra.run.smithi078.stdout:0 upgraded, 9 newly installed, 0 to remove and 331 not upgraded. 2024-09-12T00:36:59.218 INFO:teuthology.orchestra.run.smithi078.stdout:Need to get 46.0 MB of archives. 2024-09-12T00:36:59.218 INFO:teuthology.orchestra.run.smithi078.stdout:After this operation, 155 MB of additional disk space will be used. 2024-09-12T00:36:59.218 INFO:teuthology.orchestra.run.smithi078.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-common all 2.24.33-2ubuntu2.1 [125 kB] 2024-09-12T00:36:59.585 INFO:teuthology.orchestra.run.smithi078.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-0 amd64 2.24.33-2ubuntu2.1 [2,038 kB] 2024-09-12T00:36:59.941 INFO:teuthology.orchestra.run.smithi078.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail18 amd64 2.24.33-2ubuntu2.1 [15.9 kB] 2024-09-12T00:36:59.941 INFO:teuthology.orchestra.run.smithi078.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgail-common amd64 2.24.33-2ubuntu2.1 [132 kB] 2024-09-12T00:36:59.948 INFO:teuthology.orchestra.run.smithi078.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libgtk2.0-bin amd64 2.24.33-2ubuntu2.1 [7,936 B] 2024-09-12T00:36:59.948 INFO:teuthology.orchestra.run.smithi078.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre-headless amd64 8u422-b05-1~22.04 [30.8 MB] 2024-09-12T00:37:01.009 INFO:teuthology.orchestra.run.smithi078.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jre amd64 8u422-b05-1~22.04 [75.5 kB] 2024-09-12T00:37:01.011 INFO:teuthology.orchestra.run.smithi078.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk-headless amd64 8u422-b05-1~22.04 [8,843 kB] 2024-09-12T00:37:01.266 INFO:teuthology.orchestra.run.smithi078.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 openjdk-8-jdk amd64 8u422-b05-1~22.04 [4,012 kB] 2024-09-12T00:37:01.681 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: unable to initialize frontend: Dialog 2024-09-12T00:37:01.681 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: (Dialog frontend will not work on a dumb terminal, an emacs shell buffer, or without a controlling terminal.) 2024-09-12T00:37:01.681 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: falling back to frontend: Readline 2024-09-12T00:37:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: unable to initialize frontend: Readline 2024-09-12T00:37:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: (This frontend requires a controlling tty.) 2024-09-12T00:37:01.694 INFO:teuthology.orchestra.run.smithi078.stderr:debconf: falling back to frontend: Teletype 2024-09-12T00:37:01.698 INFO:teuthology.orchestra.run.smithi078.stderr:dpkg-preconfigure: unable to re-open stdin: 2024-09-12T00:37:01.731 INFO:teuthology.orchestra.run.smithi078.stdout:Fetched 46.0 MB in 2s (19.7 MB/s) 2024-09-12T00:37:01.846 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgtk2.0-common. 2024-09-12T00:37:01.909 INFO:teuthology.orchestra.run.smithi078.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 177243 files and directories currently installed.) 2024-09-12T00:37:01.914 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../0-libgtk2.0-common_2.24.33-2ubuntu2.1_all.deb ... 2024-09-12T00:37:01.962 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:02.308 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgtk2.0-0:amd64. 2024-09-12T00:37:02.337 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../1-libgtk2.0-0_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:37:02.416 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:02.837 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgail18:amd64. 2024-09-12T00:37:02.865 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../2-libgail18_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:37:02.903 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:03.165 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgail-common:amd64. 2024-09-12T00:37:03.181 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../3-libgail-common_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:37:03.214 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:03.534 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package libgtk2.0-bin. 2024-09-12T00:37:03.550 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../4-libgtk2.0-bin_2.24.33-2ubuntu2.1_amd64.deb ... 2024-09-12T00:37:03.592 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:04.012 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package openjdk-8-jre-headless:amd64. 2024-09-12T00:37:04.041 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../5-openjdk-8-jre-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:37:04.091 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:05.776 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package openjdk-8-jre:amd64. 2024-09-12T00:37:05.805 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../6-openjdk-8-jre_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:37:05.846 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:06.281 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package openjdk-8-jdk-headless:amd64. 2024-09-12T00:37:06.309 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../7-openjdk-8-jdk-headless_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:37:06.350 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:07.118 INFO:teuthology.orchestra.run.smithi078.stdout:Selecting previously unselected package openjdk-8-jdk:amd64. 2024-09-12T00:37:07.147 INFO:teuthology.orchestra.run.smithi078.stdout:Preparing to unpack .../8-openjdk-8-jdk_8u422-b05-1~22.04_amd64.deb ... 2024-09-12T00:37:07.188 INFO:teuthology.orchestra.run.smithi078.stdout:Unpacking openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:07.563 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up openjdk-8-jre-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:08.675 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/orbd to provide /usr/bin/orbd (orbd) in auto mode 2024-09-12T00:37:08.702 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/servertool to provide /usr/bin/servertool (servertool) in auto mode 2024-09-12T00:37:08.727 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/tnameserv to provide /usr/bin/tnameserv (tnameserv) in auto mode 2024-09-12T00:37:09.092 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgtk2.0-common (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:09.277 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgtk2.0-0:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:09.637 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up openjdk-8-jre:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:09.738 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/policytool to provide /usr/bin/policytool (policytool) in auto mode 2024-09-12T00:37:09.805 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up openjdk-8-jdk-headless:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:09.896 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/clhsdb to provide /usr/bin/clhsdb (clhsdb) in auto mode 2024-09-12T00:37:09.926 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/extcheck to provide /usr/bin/extcheck (extcheck) in auto mode 2024-09-12T00:37:09.951 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/hsdb to provide /usr/bin/hsdb (hsdb) in auto mode 2024-09-12T00:37:09.978 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/idlj to provide /usr/bin/idlj (idlj) in auto mode 2024-09-12T00:37:10.096 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/javah to provide /usr/bin/javah (javah) in auto mode 2024-09-12T00:37:10.239 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jhat to provide /usr/bin/jhat (jhat) in auto mode 2024-09-12T00:37:10.350 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/jsadebugd to provide /usr/bin/jsadebugd (jsadebugd) in auto mode 2024-09-12T00:37:10.451 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/native2ascii to provide /usr/bin/native2ascii (native2ascii) in auto mode 2024-09-12T00:37:10.501 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/schemagen to provide /usr/bin/schemagen (schemagen) in auto mode 2024-09-12T00:37:10.555 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsgen to provide /usr/bin/wsgen (wsgen) in auto mode 2024-09-12T00:37:10.580 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/wsimport to provide /usr/bin/wsimport (wsimport) in auto mode 2024-09-12T00:37:10.606 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/xjc to provide /usr/bin/xjc (xjc) in auto mode 2024-09-12T00:37:10.662 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgail18:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:10.821 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgtk2.0-bin (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:11.014 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up openjdk-8-jdk:amd64 (8u422-b05-1~22.04) ... 2024-09-12T00:37:11.107 INFO:teuthology.orchestra.run.smithi078.stdout:update-alternatives: using /usr/lib/jvm/java-8-openjdk-amd64/bin/appletviewer to provide /usr/bin/appletviewer (appletviewer) in auto mode 2024-09-12T00:37:11.200 INFO:teuthology.orchestra.run.smithi078.stdout:Setting up libgail-common:amd64 (2.24.33-2ubuntu2.1) ... 2024-09-12T00:37:11.318 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-09-12T00:37:12.353 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-09-12T00:37:12.446 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-09-12T00:37:12.723 INFO:teuthology.orchestra.run.smithi078.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-09-12T00:37:13.210 INFO:teuthology.orchestra.run.smithi078.stdout: Gradle will be installed under /opt/gradle 2024-09-12T00:37:13.242 INFO:teuthology.orchestra.run.smithi078.stderr:--2024-09-12 00:37:13-- https://services.gradle.org/distributions/gradle-6.0.1-bin.zip 2024-09-12T00:37:13.261 INFO:teuthology.orchestra.run.smithi078.stderr:Resolving services.gradle.org (services.gradle.org)... 104.16.73.101, 104.16.72.101, 2606:4700::6810:4965, ... 2024-09-12T00:37:13.269 INFO:teuthology.orchestra.run.smithi078.stderr:Connecting to services.gradle.org (services.gradle.org)|104.16.73.101|:443... connected. 2024-09-12T00:37:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:HTTP request sent, awaiting response... 301 Moved Permanently 2024-09-12T00:37:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:Location: https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip [following] 2024-09-12T00:37:13.303 INFO:teuthology.orchestra.run.smithi078.stderr:--2024-09-12 00:37:13-- https://github.com/gradle/gradle-distributions/releases/download/v6.0.1/gradle-6.0.1-bin.zip 2024-09-12T00:37:13.305 INFO:teuthology.orchestra.run.smithi078.stderr:Resolving github.com (github.com)... 140.82.114.4 2024-09-12T00:37:13.313 INFO:teuthology.orchestra.run.smithi078.stderr:Connecting to github.com (github.com)|140.82.114.4|:443... connected. 2024-09-12T00:37:13.390 INFO:teuthology.orchestra.run.smithi078.stderr:HTTP request sent, awaiting response... 302 Found 2024-09-12T00:37:13.390 INFO:teuthology.orchestra.run.smithi078.stderr:Location: https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T003713Z&X-Amz-Expires=300&X-Amz-Signature=3b27d3c6d162c455738ee0265533b9fb203ca9395d3704f6c9a93b2af8685754&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream [following] 2024-09-12T00:37:13.390 INFO:teuthology.orchestra.run.smithi078.stderr:--2024-09-12 00:37:13-- https://objects.githubusercontent.com/github-production-release-asset-2e65be/696192900/8f418ba1-c336-448c-95c6-5180382113cb?X-Amz-Algorithm=AWS4-HMAC-SHA256&X-Amz-Credential=releaseassetproduction%2F20240912%2Fus-east-1%2Fs3%2Faws4_request&X-Amz-Date=20240912T003713Z&X-Amz-Expires=300&X-Amz-Signature=3b27d3c6d162c455738ee0265533b9fb203ca9395d3704f6c9a93b2af8685754&X-Amz-SignedHeaders=host&actor_id=0&key_id=0&repo_id=696192900&response-content-disposition=attachment%3B%20filename%3Dgradle-6.0.1-bin.zip&response-content-type=application%2Foctet-stream 2024-09-12T00:37:13.393 INFO:teuthology.orchestra.run.smithi078.stderr:Resolving objects.githubusercontent.com (objects.githubusercontent.com)... 185.199.109.133, 185.199.108.133, 185.199.111.133, ... 2024-09-12T00:37:13.405 INFO:teuthology.orchestra.run.smithi078.stderr:Connecting to objects.githubusercontent.com (objects.githubusercontent.com)|185.199.109.133|:443... connected. 2024-09-12T00:37:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:HTTP request sent, awaiting response... 200 OK 2024-09-12T00:37:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:Length: 95129672 (91M) [application/octet-stream] 2024-09-12T00:37:13.488 INFO:teuthology.orchestra.run.smithi078.stderr:Saving to: 'gradle-6.0.1-bin.zip' 2024-09-12T00:37:13.488 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-12T00:37:13.502 INFO:teuthology.orchestra.run.smithi078.stderr: 0K .......... .......... .......... .......... .......... 0% 3.36M 27s 2024-09-12T00:37:13.512 INFO:teuthology.orchestra.run.smithi078.stderr: 50K .......... .......... .......... .......... .......... 0% 4.80M 23s 2024-09-12T00:37:13.515 INFO:teuthology.orchestra.run.smithi078.stderr: 100K .......... .......... .......... .......... .......... 0% 15.6M 17s 2024-09-12T00:37:13.517 INFO:teuthology.orchestra.run.smithi078.stderr: 150K .......... .......... .......... .......... .......... 0% 26.7M 14s 2024-09-12T00:37:13.524 INFO:teuthology.orchestra.run.smithi078.stderr: 200K .......... .......... .......... .......... .......... 0% 6.83M 14s 2024-09-12T00:37:13.526 INFO:teuthology.orchestra.run.smithi078.stderr: 250K .......... .......... .......... .......... .......... 0% 38.3M 12s 2024-09-12T00:37:13.528 INFO:teuthology.orchestra.run.smithi078.stderr: 300K .......... .......... .......... .......... .......... 0% 24.0M 11s 2024-09-12T00:37:13.529 INFO:teuthology.orchestra.run.smithi078.stderr: 350K .......... .......... .......... .......... .......... 0% 47.4M 10s 2024-09-12T00:37:13.531 INFO:teuthology.orchestra.run.smithi078.stderr: 400K .......... .......... .......... .......... .......... 0% 24.6M 9s 2024-09-12T00:37:13.537 INFO:teuthology.orchestra.run.smithi078.stderr: 450K .......... .......... .......... .......... .......... 0% 9.00M 9s 2024-09-12T00:37:13.537 INFO:teuthology.orchestra.run.smithi078.stderr: 500K .......... .......... .......... .......... .......... 0% 121M 8s 2024-09-12T00:37:13.538 INFO:teuthology.orchestra.run.smithi078.stderr: 550K .......... .......... .......... .......... .......... 0% 35.4M 8s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 600K .......... .......... .......... .......... .......... 0% 52.5M 7s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 650K .......... .......... .......... .......... .......... 0% 60.1M 7s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 700K .......... .......... .......... .......... .......... 0% 53.3M 7s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 750K .......... .......... .......... .......... .......... 0% 134M 6s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 800K .......... .......... .......... .......... .......... 0% 59.0M 6s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 850K .......... .......... .......... .......... .......... 0% 48.7M 6s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 900K .......... .......... .......... .......... .......... 1% 129M 5s 2024-09-12T00:37:13.547 INFO:teuthology.orchestra.run.smithi078.stderr: 950K .......... .......... .......... .......... .......... 1% 152M 5s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1000K .......... .......... .......... .......... .......... 1% 9.43M 5s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1050K .......... .......... .......... .......... .......... 1% 138M 5s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1100K .......... .......... .......... .......... .......... 1% 60.9M 5s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1150K .......... .......... .......... .......... .......... 1% 147M 5s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1200K .......... .......... .......... .......... .......... 1% 153M 5s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1250K .......... .......... .......... .......... .......... 1% 89.8M 4s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1300K .......... .......... .......... .......... .......... 1% 130M 4s 2024-09-12T00:37:14.525 INFO:teuthology.orchestra.run.smithi078.stderr: 1350K .......... .......... .......... .......... .......... 1% 128M 4s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1400K .......... .......... .......... .......... .......... 1% 153M 4s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1450K .......... .......... .......... .......... .......... 1% 148M 4s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1500K .......... .......... .......... .......... .......... 1% 126M 4s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1550K .......... .......... .......... .......... .......... 1% 111M 4s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1600K .......... .......... .......... .......... .......... 1% 147M 4s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1650K .......... .......... .......... .......... .......... 1% 146M 4s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1700K .......... .......... .......... .......... .......... 1% 124M 3s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1750K .......... .......... .......... .......... .......... 1% 89.4M 3s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1800K .......... .......... .......... .......... .......... 1% 137M 3s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1850K .......... .......... .......... .......... .......... 2% 141M 3s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1900K .......... .......... .......... .......... .......... 2% 122M 3s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 1950K .......... .......... .......... .......... .......... 2% 156M 3s 2024-09-12T00:37:14.526 INFO:teuthology.orchestra.run.smithi078.stderr: 2000K .......... .......... .......... .......... .......... 2% 11.2M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2050K .......... .......... .......... .......... .......... 2% 135M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2100K .......... .......... .......... .......... .......... 2% 126M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2150K .......... .......... .......... .......... .......... 2% 146M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2200K .......... .......... .......... .......... .......... 2% 137M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2250K .......... .......... .......... .......... .......... 2% 144M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2300K .......... .......... .......... .......... .......... 2% 118M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2350K .......... .......... .......... .......... .......... 2% 143M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2400K .......... .......... .......... .......... .......... 2% 140M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2450K .......... .......... .......... .......... .......... 2% 138M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2500K .......... .......... .......... .......... .......... 2% 124M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2550K .......... .......... .......... .......... .......... 2% 133M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2600K .......... .......... .......... .......... .......... 2% 130M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2650K .......... .......... .......... .......... .......... 2% 136M 3s 2024-09-12T00:37:14.527 INFO:teuthology.orchestra.run.smithi078.stderr: 2700K .......... .......... .......... .......... .......... 2% 116M 3s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 2750K .......... .......... .......... .......... .......... 3% 138M 3s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 2800K .......... .......... .......... .......... .......... 3% 148M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 2850K .......... .......... .......... .......... .......... 3% 140M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 2900K .......... .......... .......... .......... .......... 3% 132M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 2950K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 3000K .......... .......... .......... .......... .......... 3% 141M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 3050K .......... .......... .......... .......... .......... 3% 143M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 3100K .......... .......... .......... .......... .......... 3% 115M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 3150K .......... .......... .......... .......... .......... 3% 152M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 3200K .......... .......... .......... .......... .......... 3% 146M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 3250K .......... .......... .......... .......... .......... 3% 155M 2s 2024-09-12T00:37:14.528 INFO:teuthology.orchestra.run.smithi078.stderr: 3300K .......... .......... .......... .......... .......... 3% 138M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3350K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3400K .......... .......... .......... .......... .......... 3% 153M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3450K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3500K .......... .......... .......... .......... .......... 3% 130M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3550K .......... .......... .......... .......... .......... 3% 141M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3600K .......... .......... .......... .......... .......... 3% 151M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3650K .......... .......... .......... .......... .......... 3% 154M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3700K .......... .......... .......... .......... .......... 4% 129M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3750K .......... .......... .......... .......... .......... 4% 128M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3800K .......... .......... .......... .......... .......... 4% 133M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3850K .......... .......... .......... .......... .......... 4% 142M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3900K .......... .......... .......... .......... .......... 4% 104M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 3950K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-12T00:37:14.529 INFO:teuthology.orchestra.run.smithi078.stderr: 4000K .......... .......... .......... .......... .......... 4% 143M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4050K .......... .......... .......... .......... .......... 4% 139M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4100K .......... .......... .......... .......... .......... 4% 124M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4150K .......... .......... .......... .......... .......... 4% 150M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4200K .......... .......... .......... .......... .......... 4% 113M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4250K .......... .......... .......... .......... .......... 4% 152M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4300K .......... .......... .......... .......... .......... 4% 117M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4350K .......... .......... .......... .......... .......... 4% 149M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4400K .......... .......... .......... .......... .......... 4% 155M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4450K .......... .......... .......... .......... .......... 4% 158M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4500K .......... .......... .......... .......... .......... 4% 137M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4550K .......... .......... .......... .......... .......... 4% 156M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4600K .......... .......... .......... .......... .......... 5% 142M 2s 2024-09-12T00:37:14.530 INFO:teuthology.orchestra.run.smithi078.stderr: 4650K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 4700K .......... .......... .......... .......... .......... 5% 116M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 4750K .......... .......... .......... .......... .......... 5% 143M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 4800K .......... .......... .......... .......... .......... 5% 143M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 4850K .......... .......... .......... .......... .......... 5% 141M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 4900K .......... .......... .......... .......... .......... 5% 125M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 4950K .......... .......... .......... .......... .......... 5% 148M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5000K .......... .......... .......... .......... .......... 5% 145M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5050K .......... .......... .......... .......... .......... 5% 144M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5100K .......... .......... .......... .......... .......... 5% 124M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5150K .......... .......... .......... .......... .......... 5% 148M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5200K .......... .......... .......... .......... .......... 5% 157M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5250K .......... .......... .......... .......... .......... 5% 152M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5300K .......... .......... .......... .......... .......... 5% 139M 2s 2024-09-12T00:37:14.531 INFO:teuthology.orchestra.run.smithi078.stderr: 5350K .......... .......... .......... .......... .......... 5% 151M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5400K .......... .......... .......... .......... .......... 5% 134M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5450K .......... .......... .......... .......... .......... 5% 128M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5500K .......... .......... .......... .......... .......... 5% 123M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5550K .......... .......... .......... .......... .......... 6% 141M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5600K .......... .......... .......... .......... .......... 6% 144M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5650K .......... .......... .......... .......... .......... 6% 147M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5700K .......... .......... .......... .......... .......... 6% 130M 2s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5750K .......... .......... .......... .......... .......... 6% 154M 1s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5800K .......... .......... .......... .......... .......... 6% 149M 1s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5850K .......... .......... .......... .......... .......... 6% 154M 1s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5900K .......... .......... .......... .......... .......... 6% 113M 1s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 5950K .......... .......... .......... .......... .......... 6% 153M 1s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 6000K .......... .......... .......... .......... .......... 6% 151M 1s 2024-09-12T00:37:14.532 INFO:teuthology.orchestra.run.smithi078.stderr: 6050K .......... .......... .......... .......... .......... 6% 139M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6100K .......... .......... .......... .......... .......... 6% 134M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6150K .......... .......... .......... .......... .......... 6% 155M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6200K .......... .......... .......... .......... .......... 6% 151M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6250K .......... .......... .......... .......... .......... 6% 154M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6300K .......... .......... .......... .......... .......... 6% 123M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6350K .......... .......... .......... .......... .......... 6% 143M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6400K .......... .......... .......... .......... .......... 6% 138M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6450K .......... .......... .......... .......... .......... 6% 152M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6500K .......... .......... .......... .......... .......... 7% 129M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6550K .......... .......... .......... .......... .......... 7% 145M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6600K .......... .......... .......... .......... .......... 7% 124M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6650K .......... .......... .......... .......... .......... 7% 135M 1s 2024-09-12T00:37:14.533 INFO:teuthology.orchestra.run.smithi078.stderr: 6700K .......... .......... .......... .......... .......... 7% 128M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 6750K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 6800K .......... .......... .......... .......... .......... 7% 147M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 6850K .......... .......... .......... .......... .......... 7% 147M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 6900K .......... .......... .......... .......... .......... 7% 127M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 6950K .......... .......... .......... .......... .......... 7% 151M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7000K .......... .......... .......... .......... .......... 7% 163M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7050K .......... .......... .......... .......... .......... 7% 164M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7100K .......... .......... .......... .......... .......... 7% 136M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7150K .......... .......... .......... .......... .......... 7% 122M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7200K .......... .......... .......... .......... .......... 7% 142M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7250K .......... .......... .......... .......... .......... 7% 154M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7300K .......... .......... .......... .......... .......... 7% 148M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7350K .......... .......... .......... .......... .......... 7% 173M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7400K .......... .......... .......... .......... .......... 8% 155M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7450K .......... .......... .......... .......... .......... 8% 175M 1s 2024-09-12T00:37:14.534 INFO:teuthology.orchestra.run.smithi078.stderr: 7500K .......... .......... .......... .......... .......... 8% 144M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7550K .......... .......... .......... .......... .......... 8% 160M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7600K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7650K .......... .......... .......... .......... .......... 8% 148M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7700K .......... .......... .......... .......... .......... 8% 148M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7750K .......... .......... .......... .......... .......... 8% 177M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7800K .......... .......... .......... .......... .......... 8% 176M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7850K .......... .......... .......... .......... .......... 8% 151M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7900K .......... .......... .......... .......... .......... 8% 146M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 7950K .......... .......... .......... .......... .......... 8% 188M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 8000K .......... .......... .......... .......... .......... 8% 190M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 8050K .......... .......... .......... .......... .......... 8% 187M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 8100K .......... .......... .......... .......... .......... 8% 170M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 8150K .......... .......... .......... .......... .......... 8% 181M 1s 2024-09-12T00:37:14.535 INFO:teuthology.orchestra.run.smithi078.stderr: 8200K .......... .......... .......... .......... .......... 8% 181M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8250K .......... .......... .......... .......... .......... 8% 169M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8300K .......... .......... .......... .......... .......... 8% 124M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8350K .......... .......... .......... .......... .......... 9% 181M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8400K .......... .......... .......... .......... .......... 9% 174M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8450K .......... .......... .......... .......... .......... 9% 187M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8500K .......... .......... .......... .......... .......... 9% 158M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8550K .......... .......... .......... .......... .......... 9% 170M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8600K .......... .......... .......... .......... .......... 9% 178M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8650K .......... .......... .......... .......... .......... 9% 191M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8700K .......... .......... .......... .......... .......... 9% 154M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8750K .......... .......... .......... .......... .......... 9% 190M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8800K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8850K .......... .......... .......... .......... .......... 9% 190M 1s 2024-09-12T00:37:14.536 INFO:teuthology.orchestra.run.smithi078.stderr: 8900K .......... .......... .......... .......... .......... 9% 158M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 8950K .......... .......... .......... .......... .......... 9% 178M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9000K .......... .......... .......... .......... .......... 9% 197M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9050K .......... .......... .......... .......... .......... 9% 199M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9100K .......... .......... .......... .......... .......... 9% 166M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9150K .......... .......... .......... .......... .......... 9% 194M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9200K .......... .......... .......... .......... .......... 9% 192M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9250K .......... .......... .......... .......... .......... 10% 173M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9300K .......... .......... .......... .......... .......... 10% 155M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9350K .......... .......... .......... .......... .......... 10% 195M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9400K .......... .......... .......... .......... .......... 10% 203M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9450K .......... .......... .......... .......... .......... 10% 197M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9500K .......... .......... .......... .......... .......... 10% 169M 1s 2024-09-12T00:37:14.537 INFO:teuthology.orchestra.run.smithi078.stderr: 9550K .......... .......... .......... .......... .......... 10% 196M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9600K .......... .......... .......... .......... .......... 10% 201M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9650K .......... .......... .......... .......... .......... 10% 202M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9700K .......... .......... .......... .......... .......... 10% 173M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9750K .......... .......... .......... .......... .......... 10% 207M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9800K .......... .......... .......... .......... .......... 10% 209M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9850K .......... .......... .......... .......... .......... 10% 212M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9900K .......... .......... .......... .......... .......... 10% 160M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 9950K .......... .......... .......... .......... .......... 10% 204M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 10000K .......... .......... .......... .......... .......... 10% 210M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 10050K .......... .......... .......... .......... .......... 10% 199M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 10100K .......... .......... .......... .......... .......... 10% 181M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 10150K .......... .......... .......... .......... .......... 10% 218M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 10200K .......... .......... .......... .......... .......... 11% 213M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 10250K .......... .......... .......... .......... .......... 11% 238M 1s 2024-09-12T00:37:14.538 INFO:teuthology.orchestra.run.smithi078.stderr: 10300K .......... .......... .......... .......... .......... 11% 253M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10350K .......... .......... .......... .......... .......... 11% 199M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10400K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10450K .......... .......... .......... .......... .......... 11% 235M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10500K .......... .......... .......... .......... .......... 11% 208M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10550K .......... .......... .......... .......... .......... 11% 212M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10600K .......... .......... .......... .......... .......... 11% 206M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10650K .......... .......... .......... .......... .......... 11% 209M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10700K .......... .......... .......... .......... .......... 11% 171M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10750K .......... .......... .......... .......... .......... 11% 221M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10800K .......... .......... .......... .......... .......... 11% 229M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10850K .......... .......... .......... .......... .......... 11% 228M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10900K .......... .......... .......... .......... .......... 11% 174M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 10950K .......... .......... .......... .......... .......... 11% 208M 1s 2024-09-12T00:37:14.539 INFO:teuthology.orchestra.run.smithi078.stderr: 11000K .......... .......... .......... .......... .......... 11% 225M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11050K .......... .......... .......... .......... .......... 11% 236M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11100K .......... .......... .......... .......... .......... 12% 182M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11150K .......... .......... .......... .......... .......... 12% 215M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11200K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11250K .......... .......... .......... .......... .......... 12% 225M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11300K .......... .......... .......... .......... .......... 12% 207M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11350K .......... .......... .......... .......... .......... 12% 233M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11400K .......... .......... .......... .......... .......... 12% 202M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11450K .......... .......... .......... .......... .......... 12% 246M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11500K .......... .......... .......... .......... .......... 12% 183M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11550K .......... .......... .......... .......... .......... 12% 242M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11600K .......... .......... .......... .......... .......... 12% 241M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11650K .......... .......... .......... .......... .......... 12% 231M 1s 2024-09-12T00:37:14.540 INFO:teuthology.orchestra.run.smithi078.stderr: 11700K .......... .......... .......... .......... .......... 12% 219M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 11750K .......... .......... .......... .......... .......... 12% 202M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 11800K .......... .......... .......... .......... .......... 12% 199M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 11850K .......... .......... .......... .......... .......... 12% 237M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 11900K .......... .......... .......... .......... .......... 12% 195M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 11950K .......... .......... .......... .......... .......... 12% 236M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12000K .......... .......... .......... .......... .......... 12% 236M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12050K .......... .......... .......... .......... .......... 13% 244M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12100K .......... .......... .......... .......... .......... 13% 220M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12150K .......... .......... .......... .......... .......... 13% 237M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12200K .......... .......... .......... .......... .......... 13% 226M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12250K .......... .......... .......... .......... .......... 13% 240M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12300K .......... .......... .......... .......... .......... 13% 180M 1s 2024-09-12T00:37:14.541 INFO:teuthology.orchestra.run.smithi078.stderr: 12350K .......... .......... .......... .......... .......... 13% 238M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12400K .......... .......... .......... .......... .......... 13% 195M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12450K .......... .......... .......... .......... .......... 13% 248M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12500K .......... .......... .......... .......... .......... 13% 218M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12550K .......... .......... .......... .......... .......... 13% 232M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12600K .......... .......... .......... .......... .......... 13% 221M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12650K .......... .......... .......... .......... .......... 13% 235M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12700K .......... .......... .......... .......... .......... 13% 204M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12750K .......... .......... .......... .......... .......... 13% 207M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12800K .......... .......... .......... .......... .......... 13% 215M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12850K .......... .......... .......... .......... .......... 13% 244M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12900K .......... .......... .......... .......... .......... 13% 217M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 12950K .......... .......... .......... .......... .......... 13% 262M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 13000K .......... .......... .......... .......... .......... 14% 262M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 13050K .......... .......... .......... .......... .......... 14% 200M 1s 2024-09-12T00:37:14.542 INFO:teuthology.orchestra.run.smithi078.stderr: 13100K .......... .......... .......... .......... .......... 14% 217M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13150K .......... .......... .......... .......... .......... 14% 268M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13200K .......... .......... .......... .......... .......... 14% 254M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13250K .......... .......... .......... .......... .......... 14% 242M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13300K .......... .......... .......... .......... .......... 14% 213M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13350K .......... .......... .......... .......... .......... 14% 231M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13400K .......... .......... .......... .......... .......... 14% 240M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13450K .......... .......... .......... .......... .......... 14% 242M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13500K .......... .......... .......... .......... .......... 14% 193M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13550K .......... .......... .......... .......... .......... 14% 238M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13600K .......... .......... .......... .......... .......... 14% 268M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13650K .......... .......... .......... .......... .......... 14% 249M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13700K .......... .......... .......... .......... .......... 14% 217M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13750K .......... .......... .......... .......... .......... 14% 243M 1s 2024-09-12T00:37:14.543 INFO:teuthology.orchestra.run.smithi078.stderr: 13800K .......... .......... .......... .......... .......... 14% 283M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 13850K .......... .......... .......... .......... .......... 14% 270M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 13900K .......... .......... .......... .......... .......... 15% 231M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 13950K .......... .......... .......... .......... .......... 15% 271M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14000K .......... .......... .......... .......... .......... 15% 245M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14050K .......... .......... .......... .......... .......... 15% 286M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14100K .......... .......... .......... .......... .......... 15% 256M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14150K .......... .......... .......... .......... .......... 15% 260M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14200K .......... .......... .......... .......... .......... 15% 285M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14250K .......... .......... .......... .......... .......... 15% 253M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14300K .......... .......... .......... .......... .......... 15% 230M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14350K .......... .......... .......... .......... .......... 15% 286M 1s 2024-09-12T00:37:14.544 INFO:teuthology.orchestra.run.smithi078.stderr: 14400K .......... .......... .......... .......... .......... 15% 285M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14450K .......... .......... .......... .......... .......... 15% 284M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14500K .......... .......... .......... .......... .......... 15% 249M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14550K .......... .......... .......... .......... .......... 15% 289M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14600K .......... .......... .......... .......... .......... 15% 279M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14650K .......... .......... .......... .......... .......... 15% 221M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14700K .......... .......... .......... .......... .......... 15% 195M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14750K .......... .......... .......... .......... .......... 15% 254M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14800K .......... .......... .......... .......... .......... 15% 272M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14850K .......... .......... .......... .......... .......... 16% 280M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14900K .......... .......... .......... .......... .......... 16% 250M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 14950K .......... .......... .......... .......... .......... 16% 268M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 15000K .......... .......... .......... .......... .......... 16% 272M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 15050K .......... .......... .......... .......... .......... 16% 239M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 15100K .......... .......... .......... .......... .......... 16% 267M 1s 2024-09-12T00:37:14.545 INFO:teuthology.orchestra.run.smithi078.stderr: 15150K .......... .......... .......... .......... .......... 16% 223M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15200K .......... .......... .......... .......... .......... 16% 269M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15250K .......... .......... .......... .......... .......... 16% 295M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15300K .......... .......... .......... .......... .......... 16% 243M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15350K .......... .......... .......... .......... .......... 16% 271M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15400K .......... .......... .......... .......... .......... 16% 291M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15450K .......... .......... .......... .......... .......... 16% 292M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15500K .......... .......... .......... .......... .......... 16% 248M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15550K .......... .......... .......... .......... .......... 16% 267M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15600K .......... .......... .......... .......... .......... 16% 263M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15650K .......... .......... .......... .......... .......... 16% 273M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15700K .......... .......... .......... .......... .......... 16% 264M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15750K .......... .......... .......... .......... .......... 17% 236M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15800K .......... .......... .......... .......... .......... 17% 111M 1s 2024-09-12T00:37:14.546 INFO:teuthology.orchestra.run.smithi078.stderr: 15850K .......... .......... .......... .......... .......... 17% 266M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 15900K .......... .......... .......... .......... .......... 17% 228M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 15950K .......... .......... .......... .......... .......... 17% 310M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16000K .......... .......... .......... .......... .......... 17% 32.3M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16050K .......... .......... .......... .......... .......... 17% 257M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16100K .......... .......... .......... .......... .......... 17% 252M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16150K .......... .......... .......... .......... .......... 17% 254M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16200K .......... .......... .......... .......... .......... 17% 205M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16250K .......... .......... .......... .......... .......... 17% 254M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16300K .......... .......... .......... .......... .......... 17% 248M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16350K .......... .......... .......... .......... .......... 17% 260M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16400K .......... .......... .......... .......... .......... 17% 203M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16450K .......... .......... .......... .......... .......... 17% 263M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16500K .......... .......... .......... .......... .......... 17% 207M 1s 2024-09-12T00:37:14.547 INFO:teuthology.orchestra.run.smithi078.stderr: 16550K .......... .......... .......... .......... .......... 17% 230M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16600K .......... .......... .......... .......... .......... 17% 252M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16650K .......... .......... .......... .......... .......... 17% 264M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16700K .......... .......... .......... .......... .......... 18% 219M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16750K .......... .......... .......... .......... .......... 18% 238M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16800K .......... .......... .......... .......... .......... 18% 267M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16850K .......... .......... .......... .......... .......... 18% 264M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16900K .......... .......... .......... .......... .......... 18% 247M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 16950K .......... .......... .......... .......... .......... 18% 277M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 17000K .......... .......... .......... .......... .......... 18% 269M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 17050K .......... .......... .......... .......... .......... 18% 288M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 17100K .......... .......... .......... .......... .......... 18% 240M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 17150K .......... .......... .......... .......... .......... 18% 297M 1s 2024-09-12T00:37:14.548 INFO:teuthology.orchestra.run.smithi078.stderr: 17200K .......... .......... .......... .......... .......... 18% 294M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17250K .......... .......... .......... .......... .......... 18% 290M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17300K .......... .......... .......... .......... .......... 18% 259M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17350K .......... .......... .......... .......... .......... 18% 299M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17400K .......... .......... .......... .......... .......... 18% 163M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17450K .......... .......... .......... .......... .......... 18% 209M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17500K .......... .......... .......... .......... .......... 18% 164M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17550K .......... .......... .......... .......... .......... 18% 186M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17600K .......... .......... .......... .......... .......... 18% 198M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17650K .......... .......... .......... .......... .......... 19% 193M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17700K .......... .......... .......... .......... .......... 19% 180M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17750K .......... .......... .......... .......... .......... 19% 195M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17800K .......... .......... .......... .......... .......... 19% 196M 1s 2024-09-12T00:37:14.549 INFO:teuthology.orchestra.run.smithi078.stderr: 17850K .......... .......... .......... .......... .......... 19% 197M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 17900K .......... .......... .......... .......... .......... 19% 165M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 17950K .......... .......... .......... .......... .......... 19% 216M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18000K .......... .......... .......... .......... .......... 19% 213M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18050K .......... .......... .......... .......... .......... 19% 189M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18100K .......... .......... .......... .......... .......... 19% 176M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18150K .......... .......... .......... .......... .......... 19% 188M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18200K .......... .......... .......... .......... .......... 19% 178M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18250K .......... .......... .......... .......... .......... 19% 210M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18300K .......... .......... .......... .......... .......... 19% 168M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18350K .......... .......... .......... .......... .......... 19% 207M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18400K .......... .......... .......... .......... .......... 19% 212M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18450K .......... .......... .......... .......... .......... 19% 214M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18500K .......... .......... .......... .......... .......... 19% 190M 1s 2024-09-12T00:37:14.550 INFO:teuthology.orchestra.run.smithi078.stderr: 18550K .......... .......... .......... .......... .......... 20% 210M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18600K .......... .......... .......... .......... .......... 20% 215M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18650K .......... .......... .......... .......... .......... 20% 211M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18700K .......... .......... .......... .......... .......... 20% 176M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18750K .......... .......... .......... .......... .......... 20% 217M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18800K .......... .......... .......... .......... .......... 20% 207M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18850K .......... .......... .......... .......... .......... 20% 204M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18900K .......... .......... .......... .......... .......... 20% 184M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 18950K .......... .......... .......... .......... .......... 20% 200M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 19000K .......... .......... .......... .......... .......... 20% 175M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 19050K .......... .......... .......... .......... .......... 20% 160M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 19100K .......... .......... .......... .......... .......... 20% 136M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 19150K .......... .......... .......... .......... .......... 20% 163M 1s 2024-09-12T00:37:14.551 INFO:teuthology.orchestra.run.smithi078.stderr: 19200K .......... .......... .......... .......... .......... 20% 166M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19250K .......... .......... .......... .......... .......... 20% 167M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19300K .......... .......... .......... .......... .......... 20% 148M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19350K .......... .......... .......... .......... .......... 20% 174M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19400K .......... .......... .......... .......... .......... 20% 165M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19450K .......... .......... .......... .......... .......... 20% 175M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19500K .......... .......... .......... .......... .......... 21% 144M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19550K .......... .......... .......... .......... .......... 21% 170M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19600K .......... .......... .......... .......... .......... 21% 173M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19650K .......... .......... .......... .......... .......... 21% 162M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19700K .......... .......... .......... .......... .......... 21% 154M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19750K .......... .......... .......... .......... .......... 21% 166M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19800K .......... .......... .......... .......... .......... 21% 186M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19850K .......... .......... .......... .......... .......... 21% 178M 1s 2024-09-12T00:37:14.552 INFO:teuthology.orchestra.run.smithi078.stderr: 19900K .......... .......... .......... .......... .......... 21% 156M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 19950K .......... .......... .......... .......... .......... 21% 157M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20000K .......... .......... .......... .......... .......... 21% 179M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20050K .......... .......... .......... .......... .......... 21% 173M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20100K .......... .......... .......... .......... .......... 21% 159M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20150K .......... .......... .......... .......... .......... 21% 194M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20200K .......... .......... .......... .......... .......... 21% 190M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20250K .......... .......... .......... .......... .......... 21% 184M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20300K .......... .......... .......... .......... .......... 21% 151M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20350K .......... .......... .......... .......... .......... 21% 176M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20400K .......... .......... .......... .......... .......... 22% 154M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20450K .......... .......... .......... .......... .......... 22% 199M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20500K .......... .......... .......... .......... .......... 22% 183M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20550K .......... .......... .......... .......... .......... 22% 201M 1s 2024-09-12T00:37:14.553 INFO:teuthology.orchestra.run.smithi078.stderr: 20600K .......... .......... .......... .......... .......... 22% 172M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 20650K .......... .......... .......... .......... .......... 22% 200M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 20700K .......... .......... .......... .......... .......... 22% 171M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 20750K .......... .......... .......... .......... .......... 22% 199M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 20800K .......... .......... .......... .......... .......... 22% 200M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 20850K .......... .......... .......... .......... .......... 22% 193M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 20900K .......... .......... .......... .......... .......... 22% 172M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 20950K .......... .......... .......... .......... .......... 22% 200M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 21000K .......... .......... .......... .......... .......... 22% 179M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 21050K .......... .......... .......... .......... .......... 22% 203M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 21100K .......... .......... .......... .......... .......... 22% 138M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 21150K .......... .......... .......... .......... .......... 22% 189M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 21200K .......... .......... .......... .......... .......... 22% 193M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 21250K .......... .......... .......... .......... .......... 22% 171M 1s 2024-09-12T00:37:14.554 INFO:teuthology.orchestra.run.smithi078.stderr: 21300K .......... .......... .......... .......... .......... 22% 191M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21350K .......... .......... .......... .......... .......... 23% 170M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21400K .......... .......... .......... .......... .......... 23% 202M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21450K .......... .......... .......... .......... .......... 23% 172M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21500K .......... .......... .......... .......... .......... 23% 148M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21550K .......... .......... .......... .......... .......... 23% 135M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21600K .......... .......... .......... .......... .......... 23% 137M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21650K .......... .......... .......... .......... .......... 23% 188M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21700K .......... .......... .......... .......... .......... 23% 192M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21750K .......... .......... .......... .......... .......... 23% 216M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21800K .......... .......... .......... .......... .......... 23% 202M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21850K .......... .......... .......... .......... .......... 23% 193M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21900K .......... .......... .......... .......... .......... 23% 156M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 21950K .......... .......... .......... .......... .......... 23% 193M 1s 2024-09-12T00:37:14.555 INFO:teuthology.orchestra.run.smithi078.stderr: 22000K .......... .......... .......... .......... .......... 23% 198M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22050K .......... .......... .......... .......... .......... 23% 215M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22100K .......... .......... .......... .......... .......... 23% 174M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22150K .......... .......... .......... .......... .......... 23% 218M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22200K .......... .......... .......... .......... .......... 23% 196M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22250K .......... .......... .......... .......... .......... 24% 180M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22300K .......... .......... .......... .......... .......... 24% 170M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22350K .......... .......... .......... .......... .......... 24% 208M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22400K .......... .......... .......... .......... .......... 24% 170M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22450K .......... .......... .......... .......... .......... 24% 222M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22500K .......... .......... .......... .......... .......... 24% 195M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22550K .......... .......... .......... .......... .......... 24% 212M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22600K .......... .......... .......... .......... .......... 24% 165M 1s 2024-09-12T00:37:14.556 INFO:teuthology.orchestra.run.smithi078.stderr: 22650K .......... .......... .......... .......... .......... 24% 203M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 22700K .......... .......... .......... .......... .......... 24% 184M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 22750K .......... .......... .......... .......... .......... 24% 199M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 22800K .......... .......... .......... .......... .......... 24% 211M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 22850K .......... .......... .......... .......... .......... 24% 227M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 22900K .......... .......... .......... .......... .......... 24% 196M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 22950K .......... .......... .......... .......... .......... 24% 221M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23000K .......... .......... .......... .......... .......... 24% 220M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23050K .......... .......... .......... .......... .......... 24% 219M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23100K .......... .......... .......... .......... .......... 24% 198M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23150K .......... .......... .......... .......... .......... 24% 211M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23200K .......... .......... .......... .......... .......... 25% 203M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23250K .......... .......... .......... .......... .......... 25% 209M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23300K .......... .......... .......... .......... .......... 25% 205M 1s 2024-09-12T00:37:14.557 INFO:teuthology.orchestra.run.smithi078.stderr: 23350K .......... .......... .......... .......... .......... 25% 205M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23400K .......... .......... .......... .......... .......... 25% 210M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23450K .......... .......... .......... .......... .......... 25% 190M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23500K .......... .......... .......... .......... .......... 25% 190M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23550K .......... .......... .......... .......... .......... 25% 199M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23600K .......... .......... .......... .......... .......... 25% 228M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23650K .......... .......... .......... .......... .......... 25% 228M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23700K .......... .......... .......... .......... .......... 25% 222M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23750K .......... .......... .......... .......... .......... 25% 245M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23800K .......... .......... .......... .......... .......... 25% 198M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23850K .......... .......... .......... .......... .......... 25% 238M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23900K .......... .......... .......... .......... .......... 25% 200M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 23950K .......... .......... .......... .......... .......... 25% 227M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 24000K .......... .......... .......... .......... .......... 25% 229M 1s 2024-09-12T00:37:14.558 INFO:teuthology.orchestra.run.smithi078.stderr: 24050K .......... .......... .......... .......... .......... 25% 248M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24100K .......... .......... .......... .......... .......... 25% 220M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24150K .......... .......... .......... .......... .......... 26% 231M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24200K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24250K .......... .......... .......... .......... .......... 26% 240M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24300K .......... .......... .......... .......... .......... 26% 190M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24350K .......... .......... .......... .......... .......... 26% 238M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24400K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24450K .......... .......... .......... .......... .......... 26% 235M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24500K .......... .......... .......... .......... .......... 26% 221M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24550K .......... .......... .......... .......... .......... 26% 244M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24600K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24650K .......... .......... .......... .......... .......... 26% 252M 1s 2024-09-12T00:37:14.559 INFO:teuthology.orchestra.run.smithi078.stderr: 24700K .......... .......... .......... .......... .......... 26% 142M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 24750K .......... .......... .......... .......... .......... 26% 217M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 24800K .......... .......... .......... .......... .......... 26% 233M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 24850K .......... .......... .......... .......... .......... 26% 288M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 24900K .......... .......... .......... .......... .......... 26% 200M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 24950K .......... .......... .......... .......... .......... 26% 232M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25000K .......... .......... .......... .......... .......... 26% 270M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25050K .......... .......... .......... .......... .......... 27% 242M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25100K .......... .......... .......... .......... .......... 27% 199M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25150K .......... .......... .......... .......... .......... 27% 258M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25200K .......... .......... .......... .......... .......... 27% 251M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25250K .......... .......... .......... .......... .......... 27% 240M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25300K .......... .......... .......... .......... .......... 27% 226M 1s 2024-09-12T00:37:14.560 INFO:teuthology.orchestra.run.smithi078.stderr: 25350K .......... .......... .......... .......... .......... 27% 279M 1s 2024-09-12T00:37:14.561 INFO:teuthology.orchestra.run.smithi078.stderr: 25400K .......... .......... .......... .......... .......... 27% 271M 1s 2024-09-12T00:37:14.561 INFO:teuthology.orchestra.run.smithi078.stderr: 25450K .......... .......... .......... .......... .......... 27% 270M 1s 2024-09-12T00:37:14.561 INFO:teuthology.orchestra.run.smithi078.stderr: 25500K .......... .......... .......... .......... .......... 27% 226M 1s 2024-09-12T00:37:14.561 INFO:teuthology.orchestra.run.smithi078.stderr: 25550K .......... .......... .......... .......... .......... 27% 289M 1s 2024-09-12T00:37:14.561 INFO:teuthology.orchestra.run.smithi078.stderr: 25600K .......... .......... .......... .......... .......... 27% 290M 1s 2024-09-12T00:37:14.561 INFO:teuthology.orchestra.run.smithi078.stderr: 25650K .......... .......... .......... .......... .......... 27% 265M 1s 2024-09-12T00:37:14.564 INFO:teuthology.orchestra.run.smithi078.stderr: 25700K .......... .......... .......... .......... .......... 27% 269M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 25750K .......... .......... .......... .......... .......... 27% 314M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 25800K .......... .......... .......... .......... .......... 27% 303M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 25850K .......... .......... .......... .......... .......... 27% 312M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 25900K .......... .......... .......... .......... .......... 27% 256M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 25950K .......... .......... .......... .......... .......... 27% 314M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26000K .......... .......... .......... .......... .......... 28% 314M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26050K .......... .......... .......... .......... .......... 28% 297M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26100K .......... .......... .......... .......... .......... 28% 248M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26150K .......... .......... .......... .......... .......... 28% 284M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26200K .......... .......... .......... .......... .......... 28% 305M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26250K .......... .......... .......... .......... .......... 28% 306M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26300K .......... .......... .......... .......... .......... 28% 248M 1s 2024-09-12T00:37:14.565 INFO:teuthology.orchestra.run.smithi078.stderr: 26350K .......... .......... .......... .......... .......... 28% 314M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26400K .......... .......... .......... .......... .......... 28% 276M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26450K .......... .......... .......... .......... .......... 28% 276M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26500K .......... .......... .......... .......... .......... 28% 258M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26550K .......... .......... .......... .......... .......... 28% 329M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26600K .......... .......... .......... .......... .......... 28% 314M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26650K .......... .......... .......... .......... .......... 28% 318M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26700K .......... .......... .......... .......... .......... 28% 264M 1s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26750K .......... .......... .......... .......... .......... 28% 314M 0s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26800K .......... .......... .......... .......... .......... 28% 298M 0s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26850K .......... .......... .......... .......... .......... 28% 274M 0s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26900K .......... .......... .......... .......... .......... 29% 281M 0s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 26950K .......... .......... .......... .......... .......... 29% 328M 0s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 27000K .......... .......... .......... .......... .......... 29% 138M 0s 2024-09-12T00:37:14.566 INFO:teuthology.orchestra.run.smithi078.stderr: 27050K .......... .......... .......... .......... .......... 29% 308M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27100K .......... .......... .......... .......... .......... 29% 243M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27150K .......... .......... .......... .......... .......... 29% 314M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27200K .......... .......... .......... .......... .......... 29% 309M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27250K .......... .......... .......... .......... .......... 29% 304M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27300K .......... .......... .......... .......... .......... 29% 179M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27350K .......... .......... .......... .......... .......... 29% 302M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27400K .......... .......... .......... .......... .......... 29% 300M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27450K .......... .......... .......... .......... .......... 29% 81.4M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27500K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27550K .......... .......... .......... .......... .......... 29% 300M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27600K .......... .......... .......... .......... .......... 29% 213M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27650K .......... .......... .......... .......... .......... 29% 255M 0s 2024-09-12T00:37:14.567 INFO:teuthology.orchestra.run.smithi078.stderr: 27700K .......... .......... .......... .......... .......... 29% 144M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 27750K .......... .......... .......... .......... .......... 29% 306M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 27800K .......... .......... .......... .......... .......... 29% 216M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 27850K .......... .......... .......... .......... .......... 30% 311M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 27900K .......... .......... .......... .......... .......... 30% 169M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 27950K .......... .......... .......... .......... .......... 30% 299M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 28000K .......... .......... .......... .......... .......... 30% 248M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 28050K .......... .......... .......... .......... .......... 30% 299M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 28100K .......... .......... .......... .......... .......... 30% 154M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 28150K .......... .......... .......... .......... .......... 30% 317M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 28200K .......... .......... .......... .......... .......... 30% 261M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 28250K .......... .......... .......... .......... .......... 30% 92.8M 0s 2024-09-12T00:37:14.568 INFO:teuthology.orchestra.run.smithi078.stderr: 28300K .......... .......... .......... .......... .......... 30% 225M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28350K .......... .......... .......... .......... .......... 30% 326M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28400K .......... .......... .......... .......... .......... 30% 263M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28450K .......... .......... .......... .......... .......... 30% 310M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28500K .......... .......... .......... .......... .......... 30% 319M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28550K .......... .......... .......... .......... .......... 30% 314M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28600K .......... .......... .......... .......... .......... 30% 177M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28650K .......... .......... .......... .......... .......... 30% 289M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28700K .......... .......... .......... .......... .......... 30% 317M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28750K .......... .......... .......... .......... .......... 31% 313M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28800K .......... .......... .......... .......... .......... 31% 236M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28850K .......... .......... .......... .......... .......... 31% 324M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28900K .......... .......... .......... .......... .......... 31% 321M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 28950K .......... .......... .......... .......... .......... 31% 339M 0s 2024-09-12T00:37:14.569 INFO:teuthology.orchestra.run.smithi078.stderr: 29000K .......... .......... .......... .......... .......... 31% 72.6M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29050K .......... .......... .......... .......... .......... 31% 298M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29100K .......... .......... .......... .......... .......... 31% 299M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29150K .......... .......... .......... .......... .......... 31% 305M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29200K .......... .......... .......... .......... .......... 31% 271M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29250K .......... .......... .......... .......... .......... 31% 315M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29300K .......... .......... .......... .......... .......... 31% 310M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29350K .......... .......... .......... .......... .......... 31% 265M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29400K .......... .......... .......... .......... .......... 31% 260M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29450K .......... .......... .......... .......... .......... 31% 307M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29500K .......... .......... .......... .......... .......... 31% 315M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29550K .......... .......... .......... .......... .......... 31% 323M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29600K .......... .......... .......... .......... .......... 31% 293M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29650K .......... .......... .......... .......... .......... 31% 338M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29700K .......... .......... .......... .......... .......... 32% 318M 0s 2024-09-12T00:37:14.570 INFO:teuthology.orchestra.run.smithi078.stderr: 29750K .......... .......... .......... .......... .......... 32% 328M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 29800K .......... .......... .......... .......... .......... 32% 287M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 29850K .......... .......... .......... .......... .......... 32% 320M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 29900K .......... .......... .......... .......... .......... 32% 149M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 29950K .......... .......... .......... .......... .......... 32% 290M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30000K .......... .......... .......... .......... .......... 32% 291M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30050K .......... .......... .......... .......... .......... 32% 203M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30100K .......... .......... .......... .......... .......... 32% 302M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30150K .......... .......... .......... .......... .......... 32% 331M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30200K .......... .......... .......... .......... .......... 32% 139M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30250K .......... .......... .......... .......... .......... 32% 352M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30300K .......... .......... .......... .......... .......... 32% 289M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30350K .......... .......... .......... .......... .......... 32% 316M 0s 2024-09-12T00:37:14.571 INFO:teuthology.orchestra.run.smithi078.stderr: 30400K .......... .......... .......... .......... .......... 32% 339M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30450K .......... .......... .......... .......... .......... 32% 113M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30500K .......... .......... .......... .......... .......... 32% 263M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30550K .......... .......... .......... .......... .......... 32% 299M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30600K .......... .......... .......... .......... .......... 32% 319M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30650K .......... .......... .......... .......... .......... 33% 222M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30700K .......... .......... .......... .......... .......... 33% 142M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30750K .......... .......... .......... .......... .......... 33% 164M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30800K .......... .......... .......... .......... .......... 33% 328M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30850K .......... .......... .......... .......... .......... 33% 333M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30900K .......... .......... .......... .......... .......... 33% 182M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 30950K .......... .......... .......... .......... .......... 33% 276M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 31000K .......... .......... .......... .......... .......... 33% 230M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 31050K .......... .......... .......... .......... .......... 33% 325M 0s 2024-09-12T00:37:14.572 INFO:teuthology.orchestra.run.smithi078.stderr: 31100K .......... .......... .......... .......... .......... 33% 313M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31150K .......... .......... .......... .......... .......... 33% 87.2M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31200K .......... .......... .......... .......... .......... 33% 297M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31250K .......... .......... .......... .......... .......... 33% 187M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31300K .......... .......... .......... .......... .......... 33% 224M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31350K .......... .......... .......... .......... .......... 33% 271M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31400K .......... .......... .......... .......... .......... 33% 213M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31450K .......... .......... .......... .......... .......... 33% 284M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31500K .......... .......... .......... .......... .......... 33% 247M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31550K .......... .......... .......... .......... .......... 34% 268M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31600K .......... .......... .......... .......... .......... 34% 327M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31650K .......... .......... .......... .......... .......... 34% 176M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31700K .......... .......... .......... .......... .......... 34% 330M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31750K .......... .......... .......... .......... .......... 34% 287M 0s 2024-09-12T00:37:14.573 INFO:teuthology.orchestra.run.smithi078.stderr: 31800K .......... .......... .......... .......... .......... 34% 347M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 31850K .......... .......... .......... .......... .......... 34% 150M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 31900K .......... .......... .......... .......... .......... 34% 71.3M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 31950K .......... .......... .......... .......... .......... 34% 262M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32000K .......... .......... .......... .......... .......... 34% 178M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32050K .......... .......... .......... .......... .......... 34% 307M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32100K .......... .......... .......... .......... .......... 34% 296M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32150K .......... .......... .......... .......... .......... 34% 271M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32200K .......... .......... .......... .......... .......... 34% 318M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32250K .......... .......... .......... .......... .......... 34% 326M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32300K .......... .......... .......... .......... .......... 34% 324M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32350K .......... .......... .......... .......... .......... 34% 291M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32400K .......... .......... .......... .......... .......... 34% 325M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32450K .......... .......... .......... .......... .......... 34% 335M 0s 2024-09-12T00:37:14.574 INFO:teuthology.orchestra.run.smithi078.stderr: 32500K .......... .......... .......... .......... .......... 35% 324M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32550K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32600K .......... .......... .......... .......... .......... 35% 330M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32650K .......... .......... .......... .......... .......... 35% 348M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32700K .......... .......... .......... .......... .......... 35% 325M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32750K .......... .......... .......... .......... .......... 35% 276M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32800K .......... .......... .......... .......... .......... 35% 343M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32850K .......... .......... .......... .......... .......... 35% 141M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32900K .......... .......... .......... .......... .......... 35% 309M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 32950K .......... .......... .......... .......... .......... 35% 304M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 33000K .......... .......... .......... .......... .......... 35% 316M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 33050K .......... .......... .......... .......... .......... 35% 297M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 33100K .......... .......... .......... .......... .......... 35% 342M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 33150K .......... .......... .......... .......... .......... 35% 283M 0s 2024-09-12T00:37:14.575 INFO:teuthology.orchestra.run.smithi078.stderr: 33200K .......... .......... .......... .......... .......... 35% 267M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33250K .......... .......... .......... .......... .......... 35% 212M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33300K .......... .......... .......... .......... .......... 35% 233M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33350K .......... .......... .......... .......... .......... 35% 188M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33400K .......... .......... .......... .......... .......... 36% 306M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33450K .......... .......... .......... .......... .......... 36% 308M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33500K .......... .......... .......... .......... .......... 36% 322M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33550K .......... .......... .......... .......... .......... 36% 182M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33600K .......... .......... .......... .......... .......... 36% 316M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33650K .......... .......... .......... .......... .......... 36% 343M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33700K .......... .......... .......... .......... .......... 36% 136M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33750K .......... .......... .......... .......... .......... 36% 166M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33800K .......... .......... .......... .......... .......... 36% 84.0M 0s 2024-09-12T00:37:14.576 INFO:teuthology.orchestra.run.smithi078.stderr: 33850K .......... .......... .......... .......... .......... 36% 299M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 33900K .......... .......... .......... .......... .......... 36% 311M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 33950K .......... .......... .......... .......... .......... 36% 255M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34000K .......... .......... .......... .......... .......... 36% 317M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34050K .......... .......... .......... .......... .......... 36% 345M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34100K .......... .......... .......... .......... .......... 36% 195M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34150K .......... .......... .......... .......... .......... 36% 278M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34200K .......... .......... .......... .......... .......... 36% 275M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34250K .......... .......... .......... .......... .......... 36% 252M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34300K .......... .......... .......... .......... .......... 36% 160M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34350K .......... .......... .......... .......... .......... 37% 233M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34400K .......... .......... .......... .......... .......... 37% 308M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34450K .......... .......... .......... .......... .......... 37% 245M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34500K .......... .......... .......... .......... .......... 37% 321M 0s 2024-09-12T00:37:14.577 INFO:teuthology.orchestra.run.smithi078.stderr: 34550K .......... .......... .......... .......... .......... 37% 307M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34600K .......... .......... .......... .......... .......... 37% 277M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34650K .......... .......... .......... .......... .......... 37% 214M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34700K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34750K .......... .......... .......... .......... .......... 37% 160M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34800K .......... .......... .......... .......... .......... 37% 212M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34850K .......... .......... .......... .......... .......... 37% 315M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34900K .......... .......... .......... .......... .......... 37% 65.1M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 34950K .......... .......... .......... .......... .......... 37% 275M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 35000K .......... .......... .......... .......... .......... 37% 209M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 35050K .......... .......... .......... .......... .......... 37% 310M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 35100K .......... .......... .......... .......... .......... 37% 123M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 35150K .......... .......... .......... .......... .......... 37% 240M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 35200K .......... .......... .......... .......... .......... 37% 312M 0s 2024-09-12T00:37:14.578 INFO:teuthology.orchestra.run.smithi078.stderr: 35250K .......... .......... .......... .......... .......... 37% 341M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35300K .......... .......... .......... .......... .......... 38% 346M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35350K .......... .......... .......... .......... .......... 38% 268M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35400K .......... .......... .......... .......... .......... 38% 327M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35450K .......... .......... .......... .......... .......... 38% 322M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35500K .......... .......... .......... .......... .......... 38% 311M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35550K .......... .......... .......... .......... .......... 38% 265M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35600K .......... .......... .......... .......... .......... 38% 289M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35650K .......... .......... .......... .......... .......... 38% 342M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35700K .......... .......... .......... .......... .......... 38% 334M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35750K .......... .......... .......... .......... .......... 38% 294M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35800K .......... .......... .......... .......... .......... 38% 287M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35850K .......... .......... .......... .......... .......... 38% 334M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35900K .......... .......... .......... .......... .......... 38% 332M 0s 2024-09-12T00:37:14.579 INFO:teuthology.orchestra.run.smithi078.stderr: 35950K .......... .......... .......... .......... .......... 38% 122M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36000K .......... .......... .......... .......... .......... 38% 296M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36050K .......... .......... .......... .......... .......... 38% 320M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36100K .......... .......... .......... .......... .......... 38% 325M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36150K .......... .......... .......... .......... .......... 38% 294M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36200K .......... .......... .......... .......... .......... 39% 338M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36250K .......... .......... .......... .......... .......... 39% 316M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36300K .......... .......... .......... .......... .......... 39% 336M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36350K .......... .......... .......... .......... .......... 39% 278M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36400K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36450K .......... .......... .......... .......... .......... 39% 293M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36500K .......... .......... .......... .......... .......... 39% 300M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36550K .......... .......... .......... .......... .......... 39% 286M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36600K .......... .......... .......... .......... .......... 39% 309M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36650K .......... .......... .......... .......... .......... 39% 330M 0s 2024-09-12T00:37:14.580 INFO:teuthology.orchestra.run.smithi078.stderr: 36700K .......... .......... .......... .......... .......... 39% 331M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 36750K .......... .......... .......... .......... .......... 39% 114M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 36800K .......... .......... .......... .......... .......... 39% 52.2M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 36850K .......... .......... .......... .......... .......... 39% 305M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 36900K .......... .......... .......... .......... .......... 39% 315M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 36950K .......... .......... .......... .......... .......... 39% 255M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37000K .......... .......... .......... .......... .......... 39% 179M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37050K .......... .......... .......... .......... .......... 39% 250M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37100K .......... .......... .......... .......... .......... 39% 292M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37150K .......... .......... .......... .......... .......... 40% 263M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37200K .......... .......... .......... .......... .......... 40% 314M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37250K .......... .......... .......... .......... .......... 40% 295M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37300K .......... .......... .......... .......... .......... 40% 331M 0s 2024-09-12T00:37:14.581 INFO:teuthology.orchestra.run.smithi078.stderr: 37350K .......... .......... .......... .......... .......... 40% 290M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37400K .......... .......... .......... .......... .......... 40% 328M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37450K .......... .......... .......... .......... .......... 40% 330M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37500K .......... .......... .......... .......... .......... 40% 323M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37550K .......... .......... .......... .......... .......... 40% 266M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37600K .......... .......... .......... .......... .......... 40% 303M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37650K .......... .......... .......... .......... .......... 40% 344M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37700K .......... .......... .......... .......... .......... 40% 267M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37750K .......... .......... .......... .......... .......... 40% 291M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37800K .......... .......... .......... .......... .......... 40% 248M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37850K .......... .......... .......... .......... .......... 40% 317M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37900K .......... .......... .......... .......... .......... 40% 238M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 37950K .......... .......... .......... .......... .......... 40% 63.0M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 38000K .......... .......... .......... .......... .......... 40% 282M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 38050K .......... .......... .......... .......... .......... 41% 93.7M 0s 2024-09-12T00:37:14.582 INFO:teuthology.orchestra.run.smithi078.stderr: 38100K .......... .......... .......... .......... .......... 41% 301M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38150K .......... .......... .......... .......... .......... 41% 251M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38200K .......... .......... .......... .......... .......... 41% 225M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38250K .......... .......... .......... .......... .......... 41% 230M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38300K .......... .......... .......... .......... .......... 41% 294M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38350K .......... .......... .......... .......... .......... 41% 274M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38400K .......... .......... .......... .......... .......... 41% 327M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38450K .......... .......... .......... .......... .......... 41% 310M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38500K .......... .......... .......... .......... .......... 41% 331M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38550K .......... .......... .......... .......... .......... 41% 274M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38600K .......... .......... .......... .......... .......... 41% 328M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38650K .......... .......... .......... .......... .......... 41% 339M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38700K .......... .......... .......... .......... .......... 41% 246M 0s 2024-09-12T00:37:14.583 INFO:teuthology.orchestra.run.smithi078.stderr: 38750K .......... .......... .......... .......... .......... 41% 261M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 38800K .......... .......... .......... .......... .......... 41% 91.4M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 38850K .......... .......... .......... .......... .......... 41% 314M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 38900K .......... .......... .......... .......... .......... 41% 328M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 38950K .......... .......... .......... .......... .......... 41% 306M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39000K .......... .......... .......... .......... .......... 42% 335M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39050K .......... .......... .......... .......... .......... 42% 322M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39100K .......... .......... .......... .......... .......... 42% 288M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39150K .......... .......... .......... .......... .......... 42% 168M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39200K .......... .......... .......... .......... .......... 42% 184M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39250K .......... .......... .......... .......... .......... 42% 309M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39300K .......... .......... .......... .......... .......... 42% 171M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39350K .......... .......... .......... .......... .......... 42% 292M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39400K .......... .......... .......... .......... .......... 42% 337M 0s 2024-09-12T00:37:14.584 INFO:teuthology.orchestra.run.smithi078.stderr: 39450K .......... .......... .......... .......... .......... 42% 320M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39500K .......... .......... .......... .......... .......... 42% 265M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39550K .......... .......... .......... .......... .......... 42% 252M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39600K .......... .......... .......... .......... .......... 42% 331M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39650K .......... .......... .......... .......... .......... 42% 341M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39700K .......... .......... .......... .......... .......... 42% 347M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39750K .......... .......... .......... .......... .......... 42% 303M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39800K .......... .......... .......... .......... .......... 42% 95.0M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39850K .......... .......... .......... .......... .......... 42% 143M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39900K .......... .......... .......... .......... .......... 43% 213M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 39950K .......... .......... .......... .......... .......... 43% 250M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 40000K .......... .......... .......... .......... .......... 43% 331M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 40050K .......... .......... .......... .......... .......... 43% 266M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 40100K .......... .......... .......... .......... .......... 43% 166M 0s 2024-09-12T00:37:14.585 INFO:teuthology.orchestra.run.smithi078.stderr: 40150K .......... .......... .......... .......... .......... 43% 286M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40200K .......... .......... .......... .......... .......... 43% 293M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40250K .......... .......... .......... .......... .......... 43% 301M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40300K .......... .......... .......... .......... .......... 43% 295M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40350K .......... .......... .......... .......... .......... 43% 264M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40400K .......... .......... .......... .......... .......... 43% 284M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40450K .......... .......... .......... .......... .......... 43% 313M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40500K .......... .......... .......... .......... .......... 43% 298M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40550K .......... .......... .......... .......... .......... 43% 271M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40600K .......... .......... .......... .......... .......... 43% 316M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40650K .......... .......... .......... .......... .......... 43% 295M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40700K .......... .......... .......... .......... .......... 43% 315M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40750K .......... .......... .......... .......... .......... 43% 257M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40800K .......... .......... .......... .......... .......... 43% 293M 0s 2024-09-12T00:37:14.586 INFO:teuthology.orchestra.run.smithi078.stderr: 40850K .......... .......... .......... .......... .......... 44% 326M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 40900K .......... .......... .......... .......... .......... 44% 329M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 40950K .......... .......... .......... .......... .......... 44% 52.8M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41000K .......... .......... .......... .......... .......... 44% 151M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41050K .......... .......... .......... .......... .......... 44% 215M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41100K .......... .......... .......... .......... .......... 44% 335M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41150K .......... .......... .......... .......... .......... 44% 190M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41200K .......... .......... .......... .......... .......... 44% 273M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41250K .......... .......... .......... .......... .......... 44% 285M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41300K .......... .......... .......... .......... .......... 44% 298M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41350K .......... .......... .......... .......... .......... 44% 288M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41400K .......... .......... .......... .......... .......... 44% 305M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41450K .......... .......... .......... .......... .......... 44% 326M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41500K .......... .......... .......... .......... .......... 44% 258M 0s 2024-09-12T00:37:14.587 INFO:teuthology.orchestra.run.smithi078.stderr: 41550K .......... .......... .......... .......... .......... 44% 240M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41600K .......... .......... .......... .......... .......... 44% 304M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41650K .......... .......... .......... .......... .......... 44% 319M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41700K .......... .......... .......... .......... .......... 44% 329M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41750K .......... .......... .......... .......... .......... 44% 216M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41800K .......... .......... .......... .......... .......... 45% 311M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41850K .......... .......... .......... .......... .......... 45% 141M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41900K .......... .......... .......... .......... .......... 45% 290M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 41950K .......... .......... .......... .......... .......... 45% 270M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 42000K .......... .......... .......... .......... .......... 45% 292M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 42050K .......... .......... .......... .......... .......... 45% 298M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 42100K .......... .......... .......... .......... .......... 45% 308M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 42150K .......... .......... .......... .......... .......... 45% 260M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 42200K .......... .......... .......... .......... .......... 45% 324M 0s 2024-09-12T00:37:14.588 INFO:teuthology.orchestra.run.smithi078.stderr: 42250K .......... .......... .......... .......... .......... 45% 295M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42300K .......... .......... .......... .......... .......... 45% 220M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42350K .......... .......... .......... .......... .......... 45% 141M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42400K .......... .......... .......... .......... .......... 45% 228M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42450K .......... .......... .......... .......... .......... 45% 320M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42500K .......... .......... .......... .......... .......... 45% 299M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42550K .......... .......... .......... .......... .......... 45% 293M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42600K .......... .......... .......... .......... .......... 45% 342M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42650K .......... .......... .......... .......... .......... 45% 69.1M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42700K .......... .......... .......... .......... .......... 46% 308M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42750K .......... .......... .......... .......... .......... 46% 256M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42800K .......... .......... .......... .......... .......... 46% 311M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42850K .......... .......... .......... .......... .......... 46% 317M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42900K .......... .......... .......... .......... .......... 46% 295M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 42950K .......... .......... .......... .......... .......... 46% 253M 0s 2024-09-12T00:37:14.589 INFO:teuthology.orchestra.run.smithi078.stderr: 43000K .......... .......... .......... .......... .......... 46% 304M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43050K .......... .......... .......... .......... .......... 46% 340M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43100K .......... .......... .......... .......... .......... 46% 292M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43150K .......... .......... .......... .......... .......... 46% 213M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43200K .......... .......... .......... .......... .......... 46% 315M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43250K .......... .......... .......... .......... .......... 46% 230M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43300K .......... .......... .......... .......... .......... 46% 299M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43350K .......... .......... .......... .......... .......... 46% 264M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43400K .......... .......... .......... .......... .......... 46% 313M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43450K .......... .......... .......... .......... .......... 46% 319M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43500K .......... .......... .......... .......... .......... 46% 291M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43550K .......... .......... .......... .......... .......... 46% 262M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43600K .......... .......... .......... .......... .......... 46% 326M 0s 2024-09-12T00:37:14.590 INFO:teuthology.orchestra.run.smithi078.stderr: 43650K .......... .......... .......... .......... .......... 47% 299M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 43700K .......... .......... .......... .......... .......... 47% 326M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 43750K .......... .......... .......... .......... .......... 47% 280M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 43800K .......... .......... .......... .......... .......... 47% 211M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 43850K .......... .......... .......... .......... .......... 47% 112M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 43900K .......... .......... .......... .......... .......... 47% 287M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 43950K .......... .......... .......... .......... .......... 47% 278M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44000K .......... .......... .......... .......... .......... 47% 85.0M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44050K .......... .......... .......... .......... .......... 47% 247M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44100K .......... .......... .......... .......... .......... 47% 123M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44150K .......... .......... .......... .......... .......... 47% 272M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44200K .......... .......... .......... .......... .......... 47% 341M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44250K .......... .......... .......... .......... .......... 47% 68.4M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44300K .......... .......... .......... .......... .......... 47% 193M 0s 2024-09-12T00:37:14.591 INFO:teuthology.orchestra.run.smithi078.stderr: 44350K .......... .......... .......... .......... .......... 47% 262M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44400K .......... .......... .......... .......... .......... 47% 312M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44450K .......... .......... .......... .......... .......... 47% 328M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44500K .......... .......... .......... .......... .......... 47% 334M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44550K .......... .......... .......... .......... .......... 48% 276M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44600K .......... .......... .......... .......... .......... 48% 336M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44650K .......... .......... .......... .......... .......... 48% 321M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44700K .......... .......... .......... .......... .......... 48% 332M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44750K .......... .......... .......... .......... .......... 48% 258M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44800K .......... .......... .......... .......... .......... 48% 306M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44850K .......... .......... .......... .......... .......... 48% 335M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44900K .......... .......... .......... .......... .......... 48% 298M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 44950K .......... .......... .......... .......... .......... 48% 276M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 45000K .......... .......... .......... .......... .......... 48% 313M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 45050K .......... .......... .......... .......... .......... 48% 292M 0s 2024-09-12T00:37:14.592 INFO:teuthology.orchestra.run.smithi078.stderr: 45100K .......... .......... .......... .......... .......... 48% 324M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45150K .......... .......... .......... .......... .......... 48% 223M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45200K .......... .......... .......... .......... .......... 48% 331M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45250K .......... .......... .......... .......... .......... 48% 261M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45300K .......... .......... .......... .......... .......... 48% 307M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45350K .......... .......... .......... .......... .......... 48% 289M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45400K .......... .......... .......... .......... .......... 48% 316M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45450K .......... .......... .......... .......... .......... 48% 90.5M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45500K .......... .......... .......... .......... .......... 49% 274M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45550K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45600K .......... .......... .......... .......... .......... 49% 346M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45650K .......... .......... .......... .......... .......... 49% 176M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45700K .......... .......... .......... .......... .......... 49% 195M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45750K .......... .......... .......... .......... .......... 49% 265M 0s 2024-09-12T00:37:14.593 INFO:teuthology.orchestra.run.smithi078.stderr: 45800K .......... .......... .......... .......... .......... 49% 297M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 45850K .......... .......... .......... .......... .......... 49% 334M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 45900K .......... .......... .......... .......... .......... 49% 317M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 45950K .......... .......... .......... .......... .......... 49% 259M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46000K .......... .......... .......... .......... .......... 49% 283M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46050K .......... .......... .......... .......... .......... 49% 307M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46100K .......... .......... .......... .......... .......... 49% 334M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46150K .......... .......... .......... .......... .......... 49% 299M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46200K .......... .......... .......... .......... .......... 49% 270M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46250K .......... .......... .......... .......... .......... 49% 258M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46300K .......... .......... .......... .......... .......... 49% 303M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46350K .......... .......... .......... .......... .......... 49% 273M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46400K .......... .......... .......... .......... .......... 49% 215M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46450K .......... .......... .......... .......... .......... 50% 316M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46500K .......... .......... .......... .......... .......... 50% 345M 0s 2024-09-12T00:37:14.594 INFO:teuthology.orchestra.run.smithi078.stderr: 46550K .......... .......... .......... .......... .......... 50% 281M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46600K .......... .......... .......... .......... .......... 50% 306M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46650K .......... .......... .......... .......... .......... 50% 215M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46700K .......... .......... .......... .......... .......... 50% 293M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46750K .......... .......... .......... .......... .......... 50% 270M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46800K .......... .......... .......... .......... .......... 50% 337M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46850K .......... .......... .......... .......... .......... 50% 151M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46900K .......... .......... .......... .......... .......... 50% 225M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 46950K .......... .......... .......... .......... .......... 50% 287M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 47000K .......... .......... .......... .......... .......... 50% 90.2M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 47050K .......... .......... .......... .......... .......... 50% 144M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 47100K .......... .......... .......... .......... .......... 50% 267M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 47150K .......... .......... .......... .......... .......... 50% 162M 0s 2024-09-12T00:37:14.595 INFO:teuthology.orchestra.run.smithi078.stderr: 47200K .......... .......... .......... .......... .......... 50% 331M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47250K .......... .......... .......... .......... .......... 50% 99.8M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47300K .......... .......... .......... .......... .......... 50% 122M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47350K .......... .......... .......... .......... .......... 51% 275M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47400K .......... .......... .......... .......... .......... 51% 342M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47450K .......... .......... .......... .......... .......... 51% 235M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47500K .......... .......... .......... .......... .......... 51% 323M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47550K .......... .......... .......... .......... .......... 51% 271M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47600K .......... .......... .......... .......... .......... 51% 155M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47650K .......... .......... .......... .......... .......... 51% 304M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47700K .......... .......... .......... .......... .......... 51% 308M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47750K .......... .......... .......... .......... .......... 51% 287M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47800K .......... .......... .......... .......... .......... 51% 266M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47850K .......... .......... .......... .......... .......... 51% 250M 0s 2024-09-12T00:37:14.596 INFO:teuthology.orchestra.run.smithi078.stderr: 47900K .......... .......... .......... .......... .......... 51% 306M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 47950K .......... .......... .......... .......... .......... 51% 188M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48000K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48050K .......... .......... .......... .......... .......... 51% 321M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48100K .......... .......... .......... .......... .......... 51% 313M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48150K .......... .......... .......... .......... .......... 51% 274M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48200K .......... .......... .......... .......... .......... 51% 347M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48250K .......... .......... .......... .......... .......... 51% 335M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48300K .......... .......... .......... .......... .......... 52% 310M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48350K .......... .......... .......... .......... .......... 52% 191M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48400K .......... .......... .......... .......... .......... 52% 294M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48450K .......... .......... .......... .......... .......... 52% 125M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48500K .......... .......... .......... .......... .......... 52% 143M 0s 2024-09-12T00:37:14.597 INFO:teuthology.orchestra.run.smithi078.stderr: 48550K .......... .......... .......... .......... .......... 52% 146M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48600K .......... .......... .......... .......... .......... 52% 322M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48650K .......... .......... .......... .......... .......... 52% 335M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48700K .......... .......... .......... .......... .......... 52% 267M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48750K .......... .......... .......... .......... .......... 52% 263M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48800K .......... .......... .......... .......... .......... 52% 304M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48850K .......... .......... .......... .......... .......... 52% 345M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48900K .......... .......... .......... .......... .......... 52% 334M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 48950K .......... .......... .......... .......... .......... 52% 298M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 49000K .......... .......... .......... .......... .......... 52% 341M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 49050K .......... .......... .......... .......... .......... 52% 319M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 49100K .......... .......... .......... .......... .......... 52% 345M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 49150K .......... .......... .......... .......... .......... 52% 223M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 49200K .......... .......... .......... .......... .......... 53% 326M 0s 2024-09-12T00:37:14.598 INFO:teuthology.orchestra.run.smithi078.stderr: 49250K .......... .......... .......... .......... .......... 53% 262M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49300K .......... .......... .......... .......... .......... 53% 338M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49350K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49400K .......... .......... .......... .......... .......... 53% 330M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49450K .......... .......... .......... .......... .......... 53% 320M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49500K .......... .......... .......... .......... .......... 53% 352M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49550K .......... .......... .......... .......... .......... 53% 157M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49600K .......... .......... .......... .......... .......... 53% 326M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49650K .......... .......... .......... .......... .......... 53% 315M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49700K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49750K .......... .......... .......... .......... .......... 53% 302M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49800K .......... .......... .......... .......... .......... 53% 344M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49850K .......... .......... .......... .......... .......... 53% 285M 0s 2024-09-12T00:37:14.599 INFO:teuthology.orchestra.run.smithi078.stderr: 49900K .......... .......... .......... .......... .......... 53% 313M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 49950K .......... .......... .......... .......... .......... 53% 96.4M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50000K .......... .......... .......... .......... .......... 53% 274M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50050K .......... .......... .......... .......... .......... 53% 132M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50100K .......... .......... .......... .......... .......... 53% 141M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50150K .......... .......... .......... .......... .......... 54% 287M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50200K .......... .......... .......... .......... .......... 54% 91.7M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50250K .......... .......... .......... .......... .......... 54% 308M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50300K .......... .......... .......... .......... .......... 54% 145M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50350K .......... .......... .......... .......... .......... 54% 136M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50400K .......... .......... .......... .......... .......... 54% 328M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50450K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50500K .......... .......... .......... .......... .......... 54% 314M 0s 2024-09-12T00:37:14.600 INFO:teuthology.orchestra.run.smithi078.stderr: 50550K .......... .......... .......... .......... .......... 54% 305M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50600K .......... .......... .......... .......... .......... 54% 347M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50650K .......... .......... .......... .......... .......... 54% 110M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50700K .......... .......... .......... .......... .......... 54% 224M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50750K .......... .......... .......... .......... .......... 54% 267M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50800K .......... .......... .......... .......... .......... 54% 311M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50850K .......... .......... .......... .......... .......... 54% 311M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50900K .......... .......... .......... .......... .......... 54% 327M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 50950K .......... .......... .......... .......... .......... 54% 313M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 51000K .......... .......... .......... .......... .......... 54% 142M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 51050K .......... .......... .......... .......... .......... 55% 296M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 51100K .......... .......... .......... .......... .......... 55% 311M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 51150K .......... .......... .......... .......... .......... 55% 285M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 51200K .......... .......... .......... .......... .......... 55% 303M 0s 2024-09-12T00:37:14.601 INFO:teuthology.orchestra.run.smithi078.stderr: 51250K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51300K .......... .......... .......... .......... .......... 55% 283M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51350K .......... .......... .......... .......... .......... 55% 323M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51400K .......... .......... .......... .......... .......... 55% 333M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51450K .......... .......... .......... .......... .......... 55% 345M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51500K .......... .......... .......... .......... .......... 55% 130M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51550K .......... .......... .......... .......... .......... 55% 119M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51600K .......... .......... .......... .......... .......... 55% 159M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51650K .......... .......... .......... .......... .......... 55% 298M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51700K .......... .......... .......... .......... .......... 55% 253M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51750K .......... .......... .......... .......... .......... 55% 320M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51800K .......... .......... .......... .......... .......... 55% 332M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51850K .......... .......... .......... .......... .......... 55% 326M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51900K .......... .......... .......... .......... .......... 55% 258M 0s 2024-09-12T00:37:14.602 INFO:teuthology.orchestra.run.smithi078.stderr: 51950K .......... .......... .......... .......... .......... 55% 322M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52000K .......... .......... .......... .......... .......... 56% 334M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52050K .......... .......... .......... .......... .......... 56% 324M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52100K .......... .......... .......... .......... .......... 56% 284M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52150K .......... .......... .......... .......... .......... 56% 348M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52200K .......... .......... .......... .......... .......... 56% 258M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52250K .......... .......... .......... .......... .......... 56% 328M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52300K .......... .......... .......... .......... .......... 56% 255M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52350K .......... .......... .......... .......... .......... 56% 323M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52400K .......... .......... .......... .......... .......... 56% 327M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52450K .......... .......... .......... .......... .......... 56% 106M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52500K .......... .......... .......... .......... .......... 56% 284M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52550K .......... .......... .......... .......... .......... 56% 346M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52600K .......... .......... .......... .......... .......... 56% 337M 0s 2024-09-12T00:37:14.603 INFO:teuthology.orchestra.run.smithi078.stderr: 52650K .......... .......... .......... .......... .......... 56% 345M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 52700K .......... .......... .......... .......... .......... 56% 275M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 52750K .......... .......... .......... .......... .......... 56% 356M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 52800K .......... .......... .......... .......... .......... 56% 362M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 52850K .......... .......... .......... .......... .......... 56% 313M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 52900K .......... .......... .......... .......... .......... 56% 300M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 52950K .......... .......... .......... .......... .......... 57% 137M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53000K .......... .......... .......... .......... .......... 57% 304M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53050K .......... .......... .......... .......... .......... 57% 358M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53100K .......... .......... .......... .......... .......... 57% 119M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53150K .......... .......... .......... .......... .......... 57% 333M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53200K .......... .......... .......... .......... .......... 57% 128M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53250K .......... .......... .......... .......... .......... 57% 103M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53300K .......... .......... .......... .......... .......... 57% 235M 0s 2024-09-12T00:37:14.604 INFO:teuthology.orchestra.run.smithi078.stderr: 53350K .......... .......... .......... .......... .......... 57% 160M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53400K .......... .......... .......... .......... .......... 57% 356M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53450K .......... .......... .......... .......... .......... 57% 185M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53500K .......... .......... .......... .......... .......... 57% 269M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53550K .......... .......... .......... .......... .......... 57% 363M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53600K .......... .......... .......... .......... .......... 57% 220M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53650K .......... .......... .......... .......... .......... 57% 158M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53700K .......... .......... .......... .......... .......... 57% 104M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53750K .......... .......... .......... .......... .......... 57% 314M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53800K .......... .......... .......... .......... .......... 57% 307M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53850K .......... .......... .......... .......... .......... 58% 252M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53900K .......... .......... .......... .......... .......... 58% 165M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 53950K .......... .......... .......... .......... .......... 58% 305M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 54000K .......... .......... .......... .......... .......... 58% 351M 0s 2024-09-12T00:37:14.605 INFO:teuthology.orchestra.run.smithi078.stderr: 54050K .......... .......... .......... .......... .......... 58% 156M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54100K .......... .......... .......... .......... .......... 58% 292M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54150K .......... .......... .......... .......... .......... 58% 330M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54200K .......... .......... .......... .......... .......... 58% 344M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54250K .......... .......... .......... .......... .......... 58% 312M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54300K .......... .......... .......... .......... .......... 58% 269M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54350K .......... .......... .......... .......... .......... 58% 348M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54400K .......... .......... .......... .......... .......... 58% 357M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54450K .......... .......... .......... .......... .......... 58% 361M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54500K .......... .......... .......... .......... .......... 58% 290M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54550K .......... .......... .......... .......... .......... 58% 97.5M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54600K .......... .......... .......... .......... .......... 58% 246M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54650K .......... .......... .......... .......... .......... 58% 289M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54700K .......... .......... .......... .......... .......... 58% 258M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54750K .......... .......... .......... .......... .......... 58% 342M 0s 2024-09-12T00:37:14.606 INFO:teuthology.orchestra.run.smithi078.stderr: 54800K .......... .......... .......... .......... .......... 59% 340M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 54850K .......... .......... .......... .......... .......... 59% 256M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 54900K .......... .......... .......... .......... .......... 59% 298M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 54950K .......... .......... .......... .......... .......... 59% 304M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55000K .......... .......... .......... .......... .......... 59% 130M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55050K .......... .......... .......... .......... .......... 59% 312M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55100K .......... .......... .......... .......... .......... 59% 275M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55150K .......... .......... .......... .......... .......... 59% 338M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55200K .......... .......... .......... .......... .......... 59% 353M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55250K .......... .......... .......... .......... .......... 59% 337M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55300K .......... .......... .......... .......... .......... 59% 305M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55350K .......... .......... .......... .......... .......... 59% 301M 0s 2024-09-12T00:37:14.607 INFO:teuthology.orchestra.run.smithi078.stderr: 55400K .......... .......... .......... .......... .......... 59% 332M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55450K .......... .......... .......... .......... .......... 59% 368M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55500K .......... .......... .......... .......... .......... 59% 122M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55550K .......... .......... .......... .......... .......... 59% 254M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55600K .......... .......... .......... .......... .......... 59% 294M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55650K .......... .......... .......... .......... .......... 59% 294M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55700K .......... .......... .......... .......... .......... 60% 189M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55750K .......... .......... .......... .......... .......... 60% 308M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55800K .......... .......... .......... .......... .......... 60% 215M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55850K .......... .......... .......... .......... .......... 60% 344M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55900K .......... .......... .......... .......... .......... 60% 206M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 55950K .......... .......... .......... .......... .......... 60% 321M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 56000K .......... .......... .......... .......... .......... 60% 204M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 56050K .......... .......... .......... .......... .......... 60% 313M 0s 2024-09-12T00:37:14.608 INFO:teuthology.orchestra.run.smithi078.stderr: 56100K .......... .......... .......... .......... .......... 60% 310M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56150K .......... .......... .......... .......... .......... 60% 346M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56200K .......... .......... .......... .......... .......... 60% 254M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56250K .......... .......... .......... .......... .......... 60% 122M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56300K .......... .......... .......... .......... .......... 60% 136M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56350K .......... .......... .......... .......... .......... 60% 309M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56400K .......... .......... .......... .......... .......... 60% 214M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56450K .......... .......... .......... .......... .......... 60% 172M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56500K .......... .......... .......... .......... .......... 60% 164M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56550K .......... .......... .......... .......... .......... 60% 321M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56600K .......... .......... .......... .......... .......... 60% 211M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56650K .......... .......... .......... .......... .......... 61% 336M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56700K .......... .......... .......... .......... .......... 61% 150M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56750K .......... .......... .......... .......... .......... 61% 108M 0s 2024-09-12T00:37:14.609 INFO:teuthology.orchestra.run.smithi078.stderr: 56800K .......... .......... .......... .......... .......... 61% 301M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 56850K .......... .......... .......... .......... .......... 61% 292M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 56900K .......... .......... .......... .......... .......... 61% 319M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 56950K .......... .......... .......... .......... .......... 61% 277M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57000K .......... .......... .......... .......... .......... 61% 240M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57050K .......... .......... .......... .......... .......... 61% 190M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57100K .......... .......... .......... .......... .......... 61% 193M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57150K .......... .......... .......... .......... .......... 61% 207M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57200K .......... .......... .......... .......... .......... 61% 267M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57250K .......... .......... .......... .......... .......... 61% 340M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57300K .......... .......... .......... .......... .......... 61% 344M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57350K .......... .......... .......... .......... .......... 61% 331M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57400K .......... .......... .......... .......... .......... 61% 264M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57450K .......... .......... .......... .......... .......... 61% 269M 0s 2024-09-12T00:37:14.610 INFO:teuthology.orchestra.run.smithi078.stderr: 57500K .......... .......... .......... .......... .......... 61% 350M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57550K .......... .......... .......... .......... .......... 62% 204M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57600K .......... .......... .......... .......... .......... 62% 174M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57650K .......... .......... .......... .......... .......... 62% 303M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57700K .......... .......... .......... .......... .......... 62% 340M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57750K .......... .......... .......... .......... .......... 62% 212M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57800K .......... .......... .......... .......... .......... 62% 198M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57850K .......... .......... .......... .......... .......... 62% 306M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57900K .......... .......... .......... .......... .......... 62% 333M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 57950K .......... .......... .......... .......... .......... 62% 310M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 58000K .......... .......... .......... .......... .......... 62% 292M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 58050K .......... .......... .......... .......... .......... 62% 107M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 58100K .......... .......... .......... .......... .......... 62% 323M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 58150K .......... .......... .......... .......... .......... 62% 172M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 58200K .......... .......... .......... .......... .......... 62% 297M 0s 2024-09-12T00:37:14.611 INFO:teuthology.orchestra.run.smithi078.stderr: 58250K .......... .......... .......... .......... .......... 62% 248M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58300K .......... .......... .......... .......... .......... 62% 336M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58350K .......... .......... .......... .......... .......... 62% 328M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58400K .......... .......... .......... .......... .......... 62% 277M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58450K .......... .......... .......... .......... .......... 62% 325M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58500K .......... .......... .......... .......... .......... 63% 338M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58550K .......... .......... .......... .......... .......... 63% 352M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58600K .......... .......... .......... .......... .......... 63% 309M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58650K .......... .......... .......... .......... .......... 63% 356M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58700K .......... .......... .......... .......... .......... 63% 309M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58750K .......... .......... .......... .......... .......... 63% 220M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58800K .......... .......... .......... .......... .......... 63% 223M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58850K .......... .......... .......... .......... .......... 63% 155M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58900K .......... .......... .......... .......... .......... 63% 324M 0s 2024-09-12T00:37:14.612 INFO:teuthology.orchestra.run.smithi078.stderr: 58950K .......... .......... .......... .......... .......... 63% 231M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59000K .......... .......... .......... .......... .......... 63% 249M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59050K .......... .......... .......... .......... .......... 63% 246M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59100K .......... .......... .......... .......... .......... 63% 312M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59150K .......... .......... .......... .......... .......... 63% 250M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59200K .......... .......... .......... .......... .......... 63% 290M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59250K .......... .......... .......... .......... .......... 63% 145M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59300K .......... .......... .......... .......... .......... 63% 179M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59350K .......... .......... .......... .......... .......... 63% 230M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59400K .......... .......... .......... .......... .......... 63% 220M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59450K .......... .......... .......... .......... .......... 64% 148M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59500K .......... .......... .......... .......... .......... 64% 205M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59550K .......... .......... .......... .......... .......... 64% 171M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59600K .......... .......... .......... .......... .......... 64% 297M 0s 2024-09-12T00:37:14.613 INFO:teuthology.orchestra.run.smithi078.stderr: 59650K .......... .......... .......... .......... .......... 64% 244M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 59700K .......... .......... .......... .......... .......... 64% 249M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 59750K .......... .......... .......... .......... .......... 64% 128M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 59800K .......... .......... .......... .......... .......... 64% 204M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 59850K .......... .......... .......... .......... .......... 64% 343M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 59900K .......... .......... .......... .......... .......... 64% 216M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 59950K .......... .......... .......... .......... .......... 64% 330M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60000K .......... .......... .......... .......... .......... 64% 111M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60050K .......... .......... .......... .......... .......... 64% 317M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60100K .......... .......... .......... .......... .......... 64% 313M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60150K .......... .......... .......... .......... .......... 64% 134M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60200K .......... .......... .......... .......... .......... 64% 328M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60250K .......... .......... .......... .......... .......... 64% 357M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60300K .......... .......... .......... .......... .......... 64% 264M 0s 2024-09-12T00:37:14.614 INFO:teuthology.orchestra.run.smithi078.stderr: 60350K .......... .......... .......... .......... .......... 65% 228M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60400K .......... .......... .......... .......... .......... 65% 148M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60450K .......... .......... .......... .......... .......... 65% 325M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60500K .......... .......... .......... .......... .......... 65% 329M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60550K .......... .......... .......... .......... .......... 65% 209M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60600K .......... .......... .......... .......... .......... 65% 176M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60650K .......... .......... .......... .......... .......... 65% 194M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60700K .......... .......... .......... .......... .......... 65% 260M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60750K .......... .......... .......... .......... .......... 65% 327M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60800K .......... .......... .......... .......... .......... 65% 95.9M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60850K .......... .......... .......... .......... .......... 65% 347M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60900K .......... .......... .......... .......... .......... 65% 174M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 60950K .......... .......... .......... .......... .......... 65% 332M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 61000K .......... .......... .......... .......... .......... 65% 361M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 61050K .......... .......... .......... .......... .......... 65% 341M 0s 2024-09-12T00:37:14.615 INFO:teuthology.orchestra.run.smithi078.stderr: 61100K .......... .......... .......... .......... .......... 65% 119M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61150K .......... .......... .......... .......... .......... 65% 209M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61200K .......... .......... .......... .......... .......... 65% 312M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61250K .......... .......... .......... .......... .......... 65% 341M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61300K .......... .......... .......... .......... .......... 66% 271M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61350K .......... .......... .......... .......... .......... 66% 208M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61400K .......... .......... .......... .......... .......... 66% 229M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61450K .......... .......... .......... .......... .......... 66% 357M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61500K .......... .......... .......... .......... .......... 66% 264M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61550K .......... .......... .......... .......... .......... 66% 236M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61600K .......... .......... .......... .......... .......... 66% 362M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61650K .......... .......... .......... .......... .......... 66% 249M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61700K .......... .......... .......... .......... .......... 66% 331M 0s 2024-09-12T00:37:14.616 INFO:teuthology.orchestra.run.smithi078.stderr: 61750K .......... .......... .......... .......... .......... 66% 298M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 61800K .......... .......... .......... .......... .......... 66% 264M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 61850K .......... .......... .......... .......... .......... 66% 159M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 61900K .......... .......... .......... .......... .......... 66% 327M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 61950K .......... .......... .......... .......... .......... 66% 134M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62000K .......... .......... .......... .......... .......... 66% 329M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62050K .......... .......... .......... .......... .......... 66% 247M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62100K .......... .......... .......... .......... .......... 66% 172M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62150K .......... .......... .......... .......... .......... 66% 302M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62200K .......... .......... .......... .......... .......... 67% 155M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62250K .......... .......... .......... .......... .......... 67% 323M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62300K .......... .......... .......... .......... .......... 67% 262M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62350K .......... .......... .......... .......... .......... 67% 133M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62400K .......... .......... .......... .......... .......... 67% 248M 0s 2024-09-12T00:37:14.617 INFO:teuthology.orchestra.run.smithi078.stderr: 62450K .......... .......... .......... .......... .......... 67% 184M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62500K .......... .......... .......... .......... .......... 67% 242M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62550K .......... .......... .......... .......... .......... 67% 193M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62600K .......... .......... .......... .......... .......... 67% 372M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62650K .......... .......... .......... .......... .......... 67% 147M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62700K .......... .......... .......... .......... .......... 67% 331M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62750K .......... .......... .......... .......... .......... 67% 215M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62800K .......... .......... .......... .......... .......... 67% 122M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62850K .......... .......... .......... .......... .......... 67% 328M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62900K .......... .......... .......... .......... .......... 67% 169M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 62950K .......... .......... .......... .......... .......... 67% 190M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 63000K .......... .......... .......... .......... .......... 67% 92.0M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 63050K .......... .......... .......... .......... .......... 67% 272M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 63100K .......... .......... .......... .......... .......... 67% 144M 0s 2024-09-12T00:37:14.618 INFO:teuthology.orchestra.run.smithi078.stderr: 63150K .......... .......... .......... .......... .......... 68% 287M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63200K .......... .......... .......... .......... .......... 68% 215M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63250K .......... .......... .......... .......... .......... 68% 253M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63300K .......... .......... .......... .......... .......... 68% 332M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63350K .......... .......... .......... .......... .......... 68% 201M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63400K .......... .......... .......... .......... .......... 68% 213M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63450K .......... .......... .......... .......... .......... 68% 135M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63500K .......... .......... .......... .......... .......... 68% 342M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63550K .......... .......... .......... .......... .......... 68% 114M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63600K .......... .......... .......... .......... .......... 68% 355M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63650K .......... .......... .......... .......... .......... 68% 238M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63700K .......... .......... .......... .......... .......... 68% 133M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63750K .......... .......... .......... .......... .......... 68% 166M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63800K .......... .......... .......... .......... .......... 68% 184M 0s 2024-09-12T00:37:14.619 INFO:teuthology.orchestra.run.smithi078.stderr: 63850K .......... .......... .......... .......... .......... 68% 351M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 63900K .......... .......... .......... .......... .......... 68% 264M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 63950K .......... .......... .......... .......... .......... 68% 110M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64000K .......... .......... .......... .......... .......... 68% 309M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64050K .......... .......... .......... .......... .......... 68% 357M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64100K .......... .......... .......... .......... .......... 69% 240M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64150K .......... .......... .......... .......... .......... 69% 106M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64200K .......... .......... .......... .......... .......... 69% 178M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64250K .......... .......... .......... .......... .......... 69% 294M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64300K .......... .......... .......... .......... .......... 69% 332M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64350K .......... .......... .......... .......... .......... 69% 139M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64400K .......... .......... .......... .......... .......... 69% 94.5M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64450K .......... .......... .......... .......... .......... 69% 278M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64500K .......... .......... .......... .......... .......... 69% 318M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64550K .......... .......... .......... .......... .......... 69% 175M 0s 2024-09-12T00:37:14.620 INFO:teuthology.orchestra.run.smithi078.stderr: 64600K .......... .......... .......... .......... .......... 69% 329M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 64650K .......... .......... .......... .......... .......... 69% 366M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 64700K .......... .......... .......... .......... .......... 69% 341M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 64750K .......... .......... .......... .......... .......... 69% 156M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 64800K .......... .......... .......... .......... .......... 69% 272M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 64850K .......... .......... .......... .......... .......... 69% 178M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 64900K .......... .......... .......... .......... .......... 69% 167M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 64950K .......... .......... .......... .......... .......... 69% 282M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65000K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65050K .......... .......... .......... .......... .......... 70% 331M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65100K .......... .......... .......... .......... .......... 70% 343M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65150K .......... .......... .......... .......... .......... 70% 153M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65200K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65250K .......... .......... .......... .......... .......... 70% 196M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65300K .......... .......... .......... .......... .......... 70% 308M 0s 2024-09-12T00:37:14.621 INFO:teuthology.orchestra.run.smithi078.stderr: 65350K .......... .......... .......... .......... .......... 70% 313M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65400K .......... .......... .......... .......... .......... 70% 348M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65450K .......... .......... .......... .......... .......... 70% 107M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65500K .......... .......... .......... .......... .......... 70% 245M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65550K .......... .......... .......... .......... .......... 70% 182M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65600K .......... .......... .......... .......... .......... 70% 332M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65650K .......... .......... .......... .......... .......... 70% 281M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65700K .......... .......... .......... .......... .......... 70% 136M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65750K .......... .......... .......... .......... .......... 70% 255M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65800K .......... .......... .......... .......... .......... 70% 124M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65850K .......... .......... .......... .......... .......... 70% 351M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65900K .......... .......... .......... .......... .......... 70% 353M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 65950K .......... .......... .......... .......... .......... 71% 204M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 66000K .......... .......... .......... .......... .......... 71% 199M 0s 2024-09-12T00:37:14.622 INFO:teuthology.orchestra.run.smithi078.stderr: 66050K .......... .......... .......... .......... .......... 71% 148M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66100K .......... .......... .......... .......... .......... 71% 318M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66150K .......... .......... .......... .......... .......... 71% 158M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66200K .......... .......... .......... .......... .......... 71% 249M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66250K .......... .......... .......... .......... .......... 71% 148M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66300K .......... .......... .......... .......... .......... 71% 342M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66350K .......... .......... .......... .......... .......... 71% 185M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66400K .......... .......... .......... .......... .......... 71% 282M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66450K .......... .......... .......... .......... .......... 71% 240M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66500K .......... .......... .......... .......... .......... 71% 245M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66550K .......... .......... .......... .......... .......... 71% 231M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66600K .......... .......... .......... .......... .......... 71% 329M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66650K .......... .......... .......... .......... .......... 71% 264M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66700K .......... .......... .......... .......... .......... 71% 323M 0s 2024-09-12T00:37:14.623 INFO:teuthology.orchestra.run.smithi078.stderr: 66750K .......... .......... .......... .......... .......... 71% 130M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 66800K .......... .......... .......... .......... .......... 71% 216M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 66850K .......... .......... .......... .......... .......... 72% 329M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 66900K .......... .......... .......... .......... .......... 72% 327M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 66950K .......... .......... .......... .......... .......... 72% 148M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67000K .......... .......... .......... .......... .......... 72% 214M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67050K .......... .......... .......... .......... .......... 72% 344M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67100K .......... .......... .......... .......... .......... 72% 211M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67150K .......... .......... .......... .......... .......... 72% 73.9M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67200K .......... .......... .......... .......... .......... 72% 137M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67250K .......... .......... .......... .......... .......... 72% 263M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67300K .......... .......... .......... .......... .......... 72% 335M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67350K .......... .......... .......... .......... .......... 72% 126M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67400K .......... .......... .......... .......... .......... 72% 188M 0s 2024-09-12T00:37:14.624 INFO:teuthology.orchestra.run.smithi078.stderr: 67450K .......... .......... .......... .......... .......... 72% 167M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67500K .......... .......... .......... .......... .......... 72% 256M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67550K .......... .......... .......... .......... .......... 72% 269M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67600K .......... .......... .......... .......... .......... 72% 372M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67650K .......... .......... .......... .......... .......... 72% 183M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67700K .......... .......... .......... .......... .......... 72% 326M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67750K .......... .......... .......... .......... .......... 72% 284M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67800K .......... .......... .......... .......... .......... 73% 357M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67850K .......... .......... .......... .......... .......... 73% 189M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67900K .......... .......... .......... .......... .......... 73% 333M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 67950K .......... .......... .......... .......... .......... 73% 183M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 68000K .......... .......... .......... .......... .......... 73% 355M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 68050K .......... .......... .......... .......... .......... 73% 319M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 68100K .......... .......... .......... .......... .......... 73% 348M 0s 2024-09-12T00:37:14.625 INFO:teuthology.orchestra.run.smithi078.stderr: 68150K .......... .......... .......... .......... .......... 73% 328M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68200K .......... .......... .......... .......... .......... 73% 339M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68250K .......... .......... .......... .......... .......... 73% 142M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68300K .......... .......... .......... .......... .......... 73% 149M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68350K .......... .......... .......... .......... .......... 73% 274M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68400K .......... .......... .......... .......... .......... 73% 331M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68450K .......... .......... .......... .......... .......... 73% 352M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68500K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68550K .......... .......... .......... .......... .......... 73% 209M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68600K .......... .......... .......... .......... .......... 73% 155M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68650K .......... .......... .......... .......... .......... 73% 354M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68700K .......... .......... .......... .......... .......... 74% 294M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68750K .......... .......... .......... .......... .......... 74% 164M 0s 2024-09-12T00:37:14.626 INFO:teuthology.orchestra.run.smithi078.stderr: 68800K .......... .......... .......... .......... .......... 74% 244M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 68850K .......... .......... .......... .......... .......... 74% 296M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 68900K .......... .......... .......... .......... .......... 74% 269M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 68950K .......... .......... .......... .......... .......... 74% 308M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69000K .......... .......... .......... .......... .......... 74% 199M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69050K .......... .......... .......... .......... .......... 74% 190M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69100K .......... .......... .......... .......... .......... 74% 115M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69150K .......... .......... .......... .......... .......... 74% 203M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69200K .......... .......... .......... .......... .......... 74% 302M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69250K .......... .......... .......... .......... .......... 74% 286M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69300K .......... .......... .......... .......... .......... 74% 306M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69350K .......... .......... .......... .......... .......... 74% 281M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69400K .......... .......... .......... .......... .......... 74% 369M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69450K .......... .......... .......... .......... .......... 74% 344M 0s 2024-09-12T00:37:14.627 INFO:teuthology.orchestra.run.smithi078.stderr: 69500K .......... .......... .......... .......... .......... 74% 86.7M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69550K .......... .......... .......... .......... .......... 74% 280M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69600K .......... .......... .......... .......... .......... 74% 355M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69650K .......... .......... .......... .......... .......... 75% 327M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69700K .......... .......... .......... .......... .......... 75% 343M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69750K .......... .......... .......... .......... .......... 75% 252M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69800K .......... .......... .......... .......... .......... 75% 334M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69850K .......... .......... .......... .......... .......... 75% 352M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69900K .......... .......... .......... .......... .......... 75% 328M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 69950K .......... .......... .......... .......... .......... 75% 288M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 70000K .......... .......... .......... .......... .......... 75% 359M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 70050K .......... .......... .......... .......... .......... 75% 370M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 70100K .......... .......... .......... .......... .......... 75% 367M 0s 2024-09-12T00:37:14.628 INFO:teuthology.orchestra.run.smithi078.stderr: 70150K .......... .......... .......... .......... .......... 75% 79.2M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70200K .......... .......... .......... .......... .......... 75% 325M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70250K .......... .......... .......... .......... .......... 75% 259M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70300K .......... .......... .......... .......... .......... 75% 312M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70350K .......... .......... .......... .......... .......... 75% 268M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70400K .......... .......... .......... .......... .......... 75% 189M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70450K .......... .......... .......... .......... .......... 75% 179M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70500K .......... .......... .......... .......... .......... 75% 144M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70550K .......... .......... .......... .......... .......... 75% 215M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70600K .......... .......... .......... .......... .......... 76% 340M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70650K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70700K .......... .......... .......... .......... .......... 76% 316M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70750K .......... .......... .......... .......... .......... 76% 269M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70800K .......... .......... .......... .......... .......... 76% 340M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70850K .......... .......... .......... .......... .......... 76% 339M 0s 2024-09-12T00:37:14.629 INFO:teuthology.orchestra.run.smithi078.stderr: 70900K .......... .......... .......... .......... .......... 76% 154M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 70950K .......... .......... .......... .......... .......... 76% 184M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71000K .......... .......... .......... .......... .......... 76% 306M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71050K .......... .......... .......... .......... .......... 76% 335M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71100K .......... .......... .......... .......... .......... 76% 301M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71150K .......... .......... .......... .......... .......... 76% 282M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71200K .......... .......... .......... .......... .......... 76% 154M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71250K .......... .......... .......... .......... .......... 76% 330M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71300K .......... .......... .......... .......... .......... 76% 225M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71350K .......... .......... .......... .......... .......... 76% 178M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71400K .......... .......... .......... .......... .......... 76% 251M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71450K .......... .......... .......... .......... .......... 76% 304M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71500K .......... .......... .......... .......... .......... 77% 319M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71550K .......... .......... .......... .......... .......... 77% 283M 0s 2024-09-12T00:37:14.630 INFO:teuthology.orchestra.run.smithi078.stderr: 71600K .......... .......... .......... .......... .......... 77% 272M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 71650K .......... .......... .......... .......... .......... 77% 218M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 71700K .......... .......... .......... .......... .......... 77% 383M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 71750K .......... .......... .......... .......... .......... 77% 163M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 71800K .......... .......... .......... .......... .......... 77% 178M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 71850K .......... .......... .......... .......... .......... 77% 287M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 71900K .......... .......... .......... .......... .......... 77% 342M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 71950K .......... .......... .......... .......... .......... 77% 225M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 72000K .......... .......... .......... .......... .......... 77% 339M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 72050K .......... .......... .......... .......... .......... 77% 145M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 72100K .......... .......... .......... .......... .......... 77% 175M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 72150K .......... .......... .......... .......... .......... 77% 272M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 72200K .......... .......... .......... .......... .......... 77% 273M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 72250K .......... .......... .......... .......... .......... 77% 151M 0s 2024-09-12T00:37:14.631 INFO:teuthology.orchestra.run.smithi078.stderr: 72300K .......... .......... .......... .......... .......... 77% 187M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72350K .......... .......... .......... .......... .......... 77% 233M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72400K .......... .......... .......... .......... .......... 77% 325M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72450K .......... .......... .......... .......... .......... 78% 367M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72500K .......... .......... .......... .......... .......... 78% 239M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72550K .......... .......... .......... .......... .......... 78% 115M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72600K .......... .......... .......... .......... .......... 78% 319M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72650K .......... .......... .......... .......... .......... 78% 357M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72700K .......... .......... .......... .......... .......... 78% 311M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72750K .......... .......... .......... .......... .......... 78% 222M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72800K .......... .......... .......... .......... .......... 78% 268M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72850K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72900K .......... .......... .......... .......... .......... 78% 337M 0s 2024-09-12T00:37:14.632 INFO:teuthology.orchestra.run.smithi078.stderr: 72950K .......... .......... .......... .......... .......... 78% 306M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73000K .......... .......... .......... .......... .......... 78% 345M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73050K .......... .......... .......... .......... .......... 78% 100M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73100K .......... .......... .......... .......... .......... 78% 317M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73150K .......... .......... .......... .......... .......... 78% 265M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73200K .......... .......... .......... .......... .......... 78% 344M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73250K .......... .......... .......... .......... .......... 78% 235M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73300K .......... .......... .......... .......... .......... 78% 340M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73350K .......... .......... .......... .......... .......... 79% 214M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73400K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73450K .......... .......... .......... .......... .......... 79% 229M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73500K .......... .......... .......... .......... .......... 79% 136M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73550K .......... .......... .......... .......... .......... 79% 211M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73600K .......... .......... .......... .......... .......... 79% 326M 0s 2024-09-12T00:37:14.633 INFO:teuthology.orchestra.run.smithi078.stderr: 73650K .......... .......... .......... .......... .......... 79% 334M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 73700K .......... .......... .......... .......... .......... 79% 331M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 73750K .......... .......... .......... .......... .......... 79% 123M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 73800K .......... .......... .......... .......... .......... 79% 338M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 73850K .......... .......... .......... .......... .......... 79% 253M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 73900K .......... .......... .......... .......... .......... 79% 364M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 73950K .......... .......... .......... .......... .......... 79% 167M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74000K .......... .......... .......... .......... .......... 79% 143M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74050K .......... .......... .......... .......... .......... 79% 334M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74100K .......... .......... .......... .......... .......... 79% 349M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74150K .......... .......... .......... .......... .......... 79% 318M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74200K .......... .......... .......... .......... .......... 79% 152M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74250K .......... .......... .......... .......... .......... 79% 295M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74300K .......... .......... .......... .......... .......... 80% 365M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74350K .......... .......... .......... .......... .......... 80% 295M 0s 2024-09-12T00:37:14.634 INFO:teuthology.orchestra.run.smithi078.stderr: 74400K .......... .......... .......... .......... .......... 80% 189M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74450K .......... .......... .......... .......... .......... 80% 204M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74500K .......... .......... .......... .......... .......... 80% 296M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74550K .......... .......... .......... .......... .......... 80% 329M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74600K .......... .......... .......... .......... .......... 80% 351M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74650K .......... .......... .......... .......... .......... 80% 255M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74700K .......... .......... .......... .......... .......... 80% 265M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74750K .......... .......... .......... .......... .......... 80% 176M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74800K .......... .......... .......... .......... .......... 80% 314M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74850K .......... .......... .......... .......... .......... 80% 334M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74900K .......... .......... .......... .......... .......... 80% 370M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 74950K .......... .......... .......... .......... .......... 80% 225M 0s 2024-09-12T00:37:14.635 INFO:teuthology.orchestra.run.smithi078.stderr: 75000K .......... .......... .......... .......... .......... 80% 305M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75050K .......... .......... .......... .......... .......... 80% 329M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75100K .......... .......... .......... .......... .......... 80% 179M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75150K .......... .......... .......... .......... .......... 80% 174M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75200K .......... .......... .......... .......... .......... 81% 201M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75250K .......... .......... .......... .......... .......... 81% 291M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75300K .......... .......... .......... .......... .......... 81% 217M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75350K .......... .......... .......... .......... .......... 81% 154M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75400K .......... .......... .......... .......... .......... 81% 324M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75450K .......... .......... .......... .......... .......... 81% 259M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75500K .......... .......... .......... .......... .......... 81% 210M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75550K .......... .......... .......... .......... .......... 81% 143M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75600K .......... .......... .......... .......... .......... 81% 177M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75650K .......... .......... .......... .......... .......... 81% 333M 0s 2024-09-12T00:37:14.636 INFO:teuthology.orchestra.run.smithi078.stderr: 75700K .......... .......... .......... .......... .......... 81% 372M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 75750K .......... .......... .......... .......... .......... 81% 215M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 75800K .......... .......... .......... .......... .......... 81% 125M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 75850K .......... .......... .......... .......... .......... 81% 335M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 75900K .......... .......... .......... .......... .......... 81% 336M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 75950K .......... .......... .......... .......... .......... 81% 302M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76000K .......... .......... .......... .......... .......... 81% 345M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76050K .......... .......... .......... .......... .......... 81% 183M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76100K .......... .......... .......... .......... .......... 81% 206M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76150K .......... .......... .......... .......... .......... 82% 291M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76200K .......... .......... .......... .......... .......... 82% 208M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76250K .......... .......... .......... .......... .......... 82% 329M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76300K .......... .......... .......... .......... .......... 82% 194M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76350K .......... .......... .......... .......... .......... 82% 282M 0s 2024-09-12T00:37:14.637 INFO:teuthology.orchestra.run.smithi078.stderr: 76400K .......... .......... .......... .......... .......... 82% 336M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76450K .......... .......... .......... .......... .......... 82% 345M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76500K .......... .......... .......... .......... .......... 82% 342M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76550K .......... .......... .......... .......... .......... 82% 159M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76600K .......... .......... .......... .......... .......... 82% 308M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76650K .......... .......... .......... .......... .......... 82% 341M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76700K .......... .......... .......... .......... .......... 82% 318M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76750K .......... .......... .......... .......... .......... 82% 200M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76800K .......... .......... .......... .......... .......... 82% 199M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76850K .......... .......... .......... .......... .......... 82% 257M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76900K .......... .......... .......... .......... .......... 82% 100M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 76950K .......... .......... .......... .......... .......... 82% 311M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 77000K .......... .......... .......... .......... .......... 82% 331M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 77050K .......... .......... .......... .......... .......... 82% 332M 0s 2024-09-12T00:37:14.638 INFO:teuthology.orchestra.run.smithi078.stderr: 77100K .......... .......... .......... .......... .......... 83% 239M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77150K .......... .......... .......... .......... .......... 83% 148M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77200K .......... .......... .......... .......... .......... 83% 331M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77250K .......... .......... .......... .......... .......... 83% 173M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77300K .......... .......... .......... .......... .......... 83% 319M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77350K .......... .......... .......... .......... .......... 83% 325M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77400K .......... .......... .......... .......... .......... 83% 350M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77450K .......... .......... .......... .......... .......... 83% 192M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77500K .......... .......... .......... .......... .......... 83% 277M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77550K .......... .......... .......... .......... .......... 83% 285M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77600K .......... .......... .......... .......... .......... 83% 313M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77650K .......... .......... .......... .......... .......... 83% 329M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77700K .......... .......... .......... .......... .......... 83% 232M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77750K .......... .......... .......... .......... .......... 83% 217M 0s 2024-09-12T00:37:14.639 INFO:teuthology.orchestra.run.smithi078.stderr: 77800K .......... .......... .......... .......... .......... 83% 331M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 77850K .......... .......... .......... .......... .......... 83% 214M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 77900K .......... .......... .......... .......... .......... 83% 288M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 77950K .......... .......... .......... .......... .......... 83% 256M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78000K .......... .......... .......... .......... .......... 84% 368M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78050K .......... .......... .......... .......... .......... 84% 359M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78100K .......... .......... .......... .......... .......... 84% 341M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78150K .......... .......... .......... .......... .......... 84% 91.3M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78200K .......... .......... .......... .......... .......... 84% 344M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78250K .......... .......... .......... .......... .......... 84% 357M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78300K .......... .......... .......... .......... .......... 84% 378M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78350K .......... .......... .......... .......... .......... 84% 179M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78400K .......... .......... .......... .......... .......... 84% 153M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78450K .......... .......... .......... .......... .......... 84% 347M 0s 2024-09-12T00:37:14.640 INFO:teuthology.orchestra.run.smithi078.stderr: 78500K .......... .......... .......... .......... .......... 84% 344M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78550K .......... .......... .......... .......... .......... 84% 321M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78600K .......... .......... .......... .......... .......... 84% 102M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78650K .......... .......... .......... .......... .......... 84% 235M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78700K .......... .......... .......... .......... .......... 84% 336M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78750K .......... .......... .......... .......... .......... 84% 300M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78800K .......... .......... .......... .......... .......... 84% 130M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78850K .......... .......... .......... .......... .......... 84% 195M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78900K .......... .......... .......... .......... .......... 84% 339M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 78950K .......... .......... .......... .......... .......... 85% 314M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 79000K .......... .......... .......... .......... .......... 85% 202M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 79050K .......... .......... .......... .......... .......... 85% 289M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 79100K .......... .......... .......... .......... .......... 85% 345M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 79150K .......... .......... .......... .......... .......... 85% 163M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 79200K .......... .......... .......... .......... .......... 85% 329M 0s 2024-09-12T00:37:14.641 INFO:teuthology.orchestra.run.smithi078.stderr: 79250K .......... .......... .......... .......... .......... 85% 204M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79300K .......... .......... .......... .......... .......... 85% 349M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79350K .......... .......... .......... .......... .......... 85% 250M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79400K .......... .......... .......... .......... .......... 85% 357M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79450K .......... .......... .......... .......... .......... 85% 369M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79500K .......... .......... .......... .......... .......... 85% 212M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79550K .......... .......... .......... .......... .......... 85% 192M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79600K .......... .......... .......... .......... .......... 85% 216M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79650K .......... .......... .......... .......... .......... 85% 344M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79700K .......... .......... .......... .......... .......... 85% 224M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79750K .......... .......... .......... .......... .......... 85% 322M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79800K .......... .......... .......... .......... .......... 85% 356M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79850K .......... .......... .......... .......... .......... 86% 68.8M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79900K .......... .......... .......... .......... .......... 86% 271M 0s 2024-09-12T00:37:14.642 INFO:teuthology.orchestra.run.smithi078.stderr: 79950K .......... .......... .......... .......... .......... 86% 303M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80000K .......... .......... .......... .......... .......... 86% 246M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80050K .......... .......... .......... .......... .......... 86% 326M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80100K .......... .......... .......... .......... .......... 86% 358M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80150K .......... .......... .......... .......... .......... 86% 325M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80200K .......... .......... .......... .......... .......... 86% 211M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80250K .......... .......... .......... .......... .......... 86% 366M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80300K .......... .......... .......... .......... .......... 86% 118M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80350K .......... .......... .......... .......... .......... 86% 296M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80400K .......... .......... .......... .......... .......... 86% 359M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80450K .......... .......... .......... .......... .......... 86% 371M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80500K .......... .......... .......... .......... .......... 86% 315M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80550K .......... .......... .......... .......... .......... 86% 305M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80600K .......... .......... .......... .......... .......... 86% 362M 0s 2024-09-12T00:37:14.643 INFO:teuthology.orchestra.run.smithi078.stderr: 80650K .......... .......... .......... .......... .......... 86% 237M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 80700K .......... .......... .......... .......... .......... 86% 361M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 80750K .......... .......... .......... .......... .......... 86% 315M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 80800K .......... .......... .......... .......... .......... 87% 146M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 80850K .......... .......... .......... .......... .......... 87% 334M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 80900K .......... .......... .......... .......... .......... 87% 347M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 80950K .......... .......... .......... .......... .......... 87% 153M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81000K .......... .......... .......... .......... .......... 87% 333M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81050K .......... .......... .......... .......... .......... 87% 348M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81100K .......... .......... .......... .......... .......... 87% 210M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81150K .......... .......... .......... .......... .......... 87% 148M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81200K .......... .......... .......... .......... .......... 87% 157M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81250K .......... .......... .......... .......... .......... 87% 332M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81300K .......... .......... .......... .......... .......... 87% 355M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81350K .......... .......... .......... .......... .......... 87% 321M 0s 2024-09-12T00:37:14.644 INFO:teuthology.orchestra.run.smithi078.stderr: 81400K .......... .......... .......... .......... .......... 87% 246M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81450K .......... .......... .......... .......... .......... 87% 186M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81500K .......... .......... .......... .......... .......... 87% 363M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81550K .......... .......... .......... .......... .......... 87% 301M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81600K .......... .......... .......... .......... .......... 87% 200M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81650K .......... .......... .......... .......... .......... 87% 168M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81700K .......... .......... .......... .......... .......... 87% 248M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81750K .......... .......... .......... .......... .......... 88% 336M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81800K .......... .......... .......... .......... .......... 88% 359M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81850K .......... .......... .......... .......... .......... 88% 114M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81900K .......... .......... .......... .......... .......... 88% 256M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 81950K .......... .......... .......... .......... .......... 88% 261M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 82000K .......... .......... .......... .......... .......... 88% 297M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 82050K .......... .......... .......... .......... .......... 88% 232M 0s 2024-09-12T00:37:14.645 INFO:teuthology.orchestra.run.smithi078.stderr: 82100K .......... .......... .......... .......... .......... 88% 138M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82150K .......... .......... .......... .......... .......... 88% 307M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82200K .......... .......... .......... .......... .......... 88% 355M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82250K .......... .......... .......... .......... .......... 88% 373M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82300K .......... .......... .......... .......... .......... 88% 343M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82350K .......... .......... .......... .......... .......... 88% 286M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82400K .......... .......... .......... .......... .......... 88% 334M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82450K .......... .......... .......... .......... .......... 88% 374M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82500K .......... .......... .......... .......... .......... 88% 231M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82550K .......... .......... .......... .......... .......... 88% 155M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82600K .......... .......... .......... .......... .......... 88% 339M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82650K .......... .......... .......... .......... .......... 89% 252M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82700K .......... .......... .......... .......... .......... 89% 344M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82750K .......... .......... .......... .......... .......... 89% 153M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82800K .......... .......... .......... .......... .......... 89% 326M 0s 2024-09-12T00:37:14.646 INFO:teuthology.orchestra.run.smithi078.stderr: 82850K .......... .......... .......... .......... .......... 89% 83.7M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 82900K .......... .......... .......... .......... .......... 89% 259M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 82950K .......... .......... .......... .......... .......... 89% 299M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83000K .......... .......... .......... .......... .......... 89% 173M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83050K .......... .......... .......... .......... .......... 89% 343M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83100K .......... .......... .......... .......... .......... 89% 323M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83150K .......... .......... .......... .......... .......... 89% 242M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83200K .......... .......... .......... .......... .......... 89% 329M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83250K .......... .......... .......... .......... .......... 89% 335M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83300K .......... .......... .......... .......... .......... 89% 125M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83350K .......... .......... .......... .......... .......... 89% 228M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83400K .......... .......... .......... .......... .......... 89% 316M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83450K .......... .......... .......... .......... .......... 89% 330M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83500K .......... .......... .......... .......... .......... 89% 194M 0s 2024-09-12T00:37:14.647 INFO:teuthology.orchestra.run.smithi078.stderr: 83550K .......... .......... .......... .......... .......... 89% 270M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83600K .......... .......... .......... .......... .......... 90% 368M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83650K .......... .......... .......... .......... .......... 90% 334M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83700K .......... .......... .......... .......... .......... 90% 359M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83750K .......... .......... .......... .......... .......... 90% 266M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83800K .......... .......... .......... .......... .......... 90% 347M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83850K .......... .......... .......... .......... .......... 90% 267M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83900K .......... .......... .......... .......... .......... 90% 314M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 83950K .......... .......... .......... .......... .......... 90% 117M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 84000K .......... .......... .......... .......... .......... 90% 152M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 84050K .......... .......... .......... .......... .......... 90% 312M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 84100K .......... .......... .......... .......... .......... 90% 341M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 84150K .......... .......... .......... .......... .......... 90% 321M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 84200K .......... .......... .......... .......... .......... 90% 136M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 84250K .......... .......... .......... .......... .......... 90% 186M 0s 2024-09-12T00:37:14.648 INFO:teuthology.orchestra.run.smithi078.stderr: 84300K .......... .......... .......... .......... .......... 90% 356M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84350K .......... .......... .......... .......... .......... 90% 150M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84400K .......... .......... .......... .......... .......... 90% 358M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84450K .......... .......... .......... .......... .......... 90% 380M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84500K .......... .......... .......... .......... .......... 91% 378M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84550K .......... .......... .......... .......... .......... 91% 350M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84600K .......... .......... .......... .......... .......... 91% 176M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84650K .......... .......... .......... .......... .......... 91% 267M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84700K .......... .......... .......... .......... .......... 91% 361M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84750K .......... .......... .......... .......... .......... 91% 319M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84800K .......... .......... .......... .......... .......... 91% 254M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84850K .......... .......... .......... .......... .......... 91% 125M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84900K .......... .......... .......... .......... .......... 91% 328M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 84950K .......... .......... .......... .......... .......... 91% 211M 0s 2024-09-12T00:37:14.649 INFO:teuthology.orchestra.run.smithi078.stderr: 85000K .......... .......... .......... .......... .......... 91% 362M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85050K .......... .......... .......... .......... .......... 91% 329M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85100K .......... .......... .......... .......... .......... 91% 344M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85150K .......... .......... .......... .......... .......... 91% 93.4M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85200K .......... .......... .......... .......... .......... 91% 364M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85250K .......... .......... .......... .......... .......... 91% 383M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85300K .......... .......... .......... .......... .......... 91% 370M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85350K .......... .......... .......... .......... .......... 91% 155M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85400K .......... .......... .......... .......... .......... 91% 378M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85450K .......... .......... .......... .......... .......... 92% 321M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85500K .......... .......... .......... .......... .......... 92% 383M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85550K .......... .......... .......... .......... .......... 92% 372M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85600K .......... .......... .......... .......... .......... 92% 172M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85650K .......... .......... .......... .......... .......... 92% 250M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85700K .......... .......... .......... .......... .......... 92% 169M 0s 2024-09-12T00:37:14.650 INFO:teuthology.orchestra.run.smithi078.stderr: 85750K .......... .......... .......... .......... .......... 92% 329M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 85800K .......... .......... .......... .......... .......... 92% 346M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 85850K .......... .......... .......... .......... .......... 92% 114M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 85900K .......... .......... .......... .......... .......... 92% 174M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 85950K .......... .......... .......... .......... .......... 92% 345M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86000K .......... .......... .......... .......... .......... 92% 331M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86050K .......... .......... .......... .......... .......... 92% 129M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86100K .......... .......... .......... .......... .......... 92% 298M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86150K .......... .......... .......... .......... .......... 92% 333M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86200K .......... .......... .......... .......... .......... 92% 365M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86250K .......... .......... .......... .......... .......... 92% 229M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86300K .......... .......... .......... .......... .......... 92% 245M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86350K .......... .......... .......... .......... .......... 93% 163M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86400K .......... .......... .......... .......... .......... 93% 188M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86450K .......... .......... .......... .......... .......... 93% 336M 0s 2024-09-12T00:37:14.651 INFO:teuthology.orchestra.run.smithi078.stderr: 86500K .......... .......... .......... .......... .......... 93% 342M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86550K .......... .......... .......... .......... .......... 93% 133M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86600K .......... .......... .......... .......... .......... 93% 165M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86650K .......... .......... .......... .......... .......... 93% 343M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86700K .......... .......... .......... .......... .......... 93% 360M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86750K .......... .......... .......... .......... .......... 93% 310M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86800K .......... .......... .......... .......... .......... 93% 232M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86850K .......... .......... .......... .......... .......... 93% 279M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86900K .......... .......... .......... .......... .......... 93% 336M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 86950K .......... .......... .......... .......... .......... 93% 337M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 87000K .......... .......... .......... .......... .......... 93% 247M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 87050K .......... .......... .......... .......... .......... 93% 340M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 87100K .......... .......... .......... .......... .......... 93% 359M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 87150K .......... .......... .......... .......... .......... 93% 275M 0s 2024-09-12T00:37:14.652 INFO:teuthology.orchestra.run.smithi078.stderr: 87200K .......... .......... .......... .......... .......... 93% 153M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87250K .......... .......... .......... .......... .......... 93% 217M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87300K .......... .......... .......... .......... .......... 94% 175M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87350K .......... .......... .......... .......... .......... 94% 284M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87400K .......... .......... .......... .......... .......... 94% 152M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87450K .......... .......... .......... .......... .......... 94% 360M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87500K .......... .......... .......... .......... .......... 94% 185M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87550K .......... .......... .......... .......... .......... 94% 239M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87600K .......... .......... .......... .......... .......... 94% 352M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87650K .......... .......... .......... .......... .......... 94% 180M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87700K .......... .......... .......... .......... .......... 94% 182M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87750K .......... .......... .......... .......... .......... 94% 306M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87800K .......... .......... .......... .......... .......... 94% 355M 0s 2024-09-12T00:37:14.653 INFO:teuthology.orchestra.run.smithi078.stderr: 87850K .......... .......... .......... .......... .......... 94% 358M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 87900K .......... .......... .......... .......... .......... 94% 178M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 87950K .......... .......... .......... .......... .......... 94% 265M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88000K .......... .......... .......... .......... .......... 94% 345M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88050K .......... .......... .......... .......... .......... 94% 360M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88100K .......... .......... .......... .......... .......... 94% 353M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88150K .......... .......... .......... .......... .......... 94% 202M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88200K .......... .......... .......... .......... .......... 94% 132M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88250K .......... .......... .......... .......... .......... 95% 105M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88300K .......... .......... .......... .......... .......... 95% 238M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88350K .......... .......... .......... .......... .......... 95% 195M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88400K .......... .......... .......... .......... .......... 95% 298M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88450K .......... .......... .......... .......... .......... 95% 353M 0s 2024-09-12T00:37:14.654 INFO:teuthology.orchestra.run.smithi078.stderr: 88500K .......... .......... .......... .......... .......... 95% 378M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88550K .......... .......... .......... .......... .......... 95% 339M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88600K .......... .......... .......... .......... .......... 95% 358M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88650K .......... .......... .......... .......... .......... 95% 260M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88700K .......... .......... .......... .......... .......... 95% 246M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88750K .......... .......... .......... .......... .......... 95% 175M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88800K .......... .......... .......... .......... .......... 95% 284M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88850K .......... .......... .......... .......... .......... 95% 84.7M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88900K .......... .......... .......... .......... .......... 95% 352M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 88950K .......... .......... .......... .......... .......... 95% 252M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 89000K .......... .......... .......... .......... .......... 95% 356M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 89050K .......... .......... .......... .......... .......... 95% 178M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 89100K .......... .......... .......... .......... .......... 95% 323M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 89150K .......... .......... .......... .......... .......... 96% 291M 0s 2024-09-12T00:37:14.655 INFO:teuthology.orchestra.run.smithi078.stderr: 89200K .......... .......... .......... .......... .......... 96% 370M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89250K .......... .......... .......... .......... .......... 96% 286M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89300K .......... .......... .......... .......... .......... 96% 347M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89350K .......... .......... .......... .......... .......... 96% 161M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89400K .......... .......... .......... .......... .......... 96% 139M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89450K .......... .......... .......... .......... .......... 96% 347M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89500K .......... .......... .......... .......... .......... 96% 357M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89550K .......... .......... .......... .......... .......... 96% 276M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89600K .......... .......... .......... .......... .......... 96% 228M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89650K .......... .......... .......... .......... .......... 96% 163M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89700K .......... .......... .......... .......... .......... 96% 340M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89750K .......... .......... .......... .......... .......... 96% 342M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89800K .......... .......... .......... .......... .......... 96% 358M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89850K .......... .......... .......... .......... .......... 96% 191M 0s 2024-09-12T00:37:14.656 INFO:teuthology.orchestra.run.smithi078.stderr: 89900K .......... .......... .......... .......... .......... 96% 321M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 89950K .......... .......... .......... .......... .......... 96% 306M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90000K .......... .......... .......... .......... .......... 96% 366M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90050K .......... .......... .......... .......... .......... 96% 380M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90100K .......... .......... .......... .......... .......... 97% 316M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90150K .......... .......... .......... .......... .......... 97% 310M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90200K .......... .......... .......... .......... .......... 97% 288M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90250K .......... .......... .......... .......... .......... 97% 149M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90300K .......... .......... .......... .......... .......... 97% 162M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90350K .......... .......... .......... .......... .......... 97% 286M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90400K .......... .......... .......... .......... .......... 97% 374M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90450K .......... .......... .......... .......... .......... 97% 220M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90500K .......... .......... .......... .......... .......... 97% 103M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90550K .......... .......... .......... .......... .......... 97% 330M 0s 2024-09-12T00:37:14.657 INFO:teuthology.orchestra.run.smithi078.stderr: 90600K .......... .......... .......... .......... .......... 97% 371M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 90650K .......... .......... .......... .......... .......... 97% 285M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 90700K .......... .......... .......... .......... .......... 97% 180M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 90750K .......... .......... .......... .......... .......... 97% 130M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 90800K .......... .......... .......... .......... .......... 97% 355M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 90850K .......... .......... .......... .......... .......... 97% 376M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 90900K .......... .......... .......... .......... .......... 97% 302M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 90950K .......... .......... .......... .......... .......... 97% 179M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 91000K .......... .......... .......... .......... .......... 98% 320M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 91050K .......... .......... .......... .......... .......... 98% 355M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 91100K .......... .......... .......... .......... .......... 98% 342M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 91150K .......... .......... .......... .......... .......... 98% 304M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 91200K .......... .......... .......... .......... .......... 98% 253M 0s 2024-09-12T00:37:14.658 INFO:teuthology.orchestra.run.smithi078.stderr: 91250K .......... .......... .......... .......... .......... 98% 84.3M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91300K .......... .......... .......... .......... .......... 98% 337M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91350K .......... .......... .......... .......... .......... 98% 224M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91400K .......... .......... .......... .......... .......... 98% 122M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91450K .......... .......... .......... .......... .......... 98% 235M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91500K .......... .......... .......... .......... .......... 98% 325M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91550K .......... .......... .......... .......... .......... 98% 261M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91600K .......... .......... .......... .......... .......... 98% 335M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91650K .......... .......... .......... .......... .......... 98% 322M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91700K .......... .......... .......... .......... .......... 98% 113M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91750K .......... .......... .......... .......... .......... 98% 281M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91800K .......... .......... .......... .......... .......... 98% 324M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91850K .......... .......... .......... .......... .......... 98% 122M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91900K .......... .......... .......... .......... .......... 98% 342M 0s 2024-09-12T00:37:14.659 INFO:teuthology.orchestra.run.smithi078.stderr: 91950K .......... .......... .......... .......... .......... 99% 289M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92000K .......... .......... .......... .......... .......... 99% 207M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92050K .......... .......... .......... .......... .......... 99% 341M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92100K .......... .......... .......... .......... .......... 99% 273M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92150K .......... .......... .......... .......... .......... 99% 334M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92200K .......... .......... .......... .......... .......... 99% 148M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92250K .......... .......... .......... .......... .......... 99% 352M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92300K .......... .......... .......... .......... .......... 99% 359M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92350K .......... .......... .......... .......... .......... 99% 307M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92400K .......... .......... .......... .......... .......... 99% 249M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92450K .......... .......... .......... .......... .......... 99% 184M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92500K .......... .......... .......... .......... .......... 99% 350M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92550K .......... .......... .......... .......... .......... 99% 317M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92600K .......... .......... .......... .......... .......... 99% 363M 0s 2024-09-12T00:37:14.660 INFO:teuthology.orchestra.run.smithi078.stderr: 92650K .......... .......... .......... .......... .......... 99% 217M 0s 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr: 92700K .......... .......... .......... .......... .......... 99% 346M 0s 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr: 92750K .......... .......... .......... .......... .......... 99% 276M 0s 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr: 92800K .......... .......... .......... .......... .......... 99% 177M 0s 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr: 92850K .......... .......... .......... .......... .......... 99% 220M 0s 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr: 92900K 100% 134G=0.5s 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12 00:37:13 (190 MB/s) - 'gradle-6.0.1-bin.zip' saved [95129672/95129672] 2024-09-12T00:37:14.661 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-12T00:37:14.688 INFO:teuthology.orchestra.run.smithi078.stdout:Archive: gradle-6.0.1-bin.zip 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/ 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/getting-started.html 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/LICENSE 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/NOTICE 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/init.d/ 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/init.d/readme.txt 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/bin/ 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/bin/gradle.bat 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/lib/ 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-api-metadata-6.0.1.jar 2024-09-12T00:37:14.689 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-launcher-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-runtime-api-info-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-tooling-api-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-wrapper-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-installation-beacon-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-bootstrap-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-file-collections-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-groovy-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-execution-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-model-core-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-packaging-6.0.1.jar 2024-09-12T00:37:14.690 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-cache-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-core-api-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-persistent-cache-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-worker-processes-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-logging-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-jvm-services-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-process-services-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-resources-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-messaging-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-native-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-groovy-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-base-services-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-build-option-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-cli-6.0.1.jar 2024-09-12T00:37:14.691 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-snapshots-6.0.1.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-files-6.0.1.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-kotlin-dsl-tooling-models-6.0.1.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-compiler-embeddable-1.3.50-patched-for-gradle-6.0.1.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-hashing-6.0.1.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-pineapple-6.0.1.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/gradle-docs-6.0.1.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/groovy-all-1.3-2.5.8.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jul-to-slf4j-1.7.28.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/log4j-over-slf4j-1.7.28.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jcl-over-slf4j-1.7.28.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/slf4j-api-1.7.28.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/guava-27.1-android.jar 2024-09-12T00:37:14.692 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-io-2.6.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-lang-2.6.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-commons-7.1.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-analysis-7.1.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-tree-7.1.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/asm-7.1.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-1.10.7.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk8-1.3.50.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/javax.inject-1.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-common-1.3.50.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-1.3.50.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-jvm-host-embeddable-1.3.50.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-embeddable-1.3.50.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-scripting-compiler-impl-embeddable-1.3.50.jar 2024-09-12T00:37:14.693 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-sam-with-receiver-compiler-plugin-1.3.50.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlinx-metadata-jvm-0.1.0.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/commons-compress-1.19.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/fastutil-8.3.0-min.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jansi-1.18.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/jsr305-3.0.2.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kryo-2.24.0.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-0.18.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/objenesis-2.6.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/trove4j-1.0.20181211.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/xml-apis-1.4.01.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-reflect-1.3.50.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-jdk7-1.3.50.jar 2024-09-12T00:37:14.694 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-1.3.50.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/annotations-13.0.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/ant-launcher-1.10.7.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/minlog-1.2.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-script-runtime-1.3.50.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-daemon-embeddable-1.3.50.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/failureaccess-1.0.1.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/kotlin-stdlib-common-1.3.50.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libcpp-0.18.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-amd64-libstdcpp-0.18.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libcpp-0.18.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-freebsd-i386-libstdcpp-0.18.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-0.18.jar 2024-09-12T00:37:14.695 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-osx-amd64-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-amd64-min-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-windows-i386-min-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-aarch64-ncurses5-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses5-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-amd64-ncurses6-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses5-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/native-platform-linux-i386-ncurses6-0.18.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: creating: /opt/gradle/gradle-6.0.1/lib/plugins/ 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-antlr-6.0.1.jar 2024-09-12T00:37:14.696 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-code-quality-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-signing-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-native-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-native-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-native-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-native-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-provider-plugins-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-development-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-maven-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-play-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ide-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-scala-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ear-6.0.1.jar 2024-09-12T00:37:14.697 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-play-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-javascript-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-ivy-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-jacoco-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-init-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-kotlin-dsl-tooling-builders-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugins-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-test-kit-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-groovy-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-scala-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-junit-platform-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-tooling-api-builders-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-jvm-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-java-6.0.1.jar 2024-09-12T00:37:14.698 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-language-jvm-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-jvm-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-native-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-diagnostics-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-publish-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-testing-base-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-platform-base-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-plugin-use-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-instant-execution-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-version-control-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-dependency-management-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-composite-builds-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-reporting-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-s3-6.0.1.jar 2024-09-12T00:37:14.699 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-gcs-6.0.1.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-cache-http-6.0.1.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-http-6.0.1.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-resources-sftp-6.0.1.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-build-profile-6.0.1.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gradle-workers-6.0.1.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/org.eclipse.jgit-5.5.0.201909110433-r.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-3.0.0.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-http-shared-3.0.0.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-services-storage-v1-rev136-1.25.0.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-api-client-1.25.0.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/asm-util-7.1.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ivy-2.3.0.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-compat-3.0.4.jar 2024-09-12T00:37:14.700 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-core-3.0.4.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-common-0.8-20100325.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/pmaven-groovy-0.8-20100325.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-file-3.0.0.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-container-default-1.7.1.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-connector-wagon-1.13.1.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpg-jdk15on-1.63.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/rhino-1.7.10.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/gson-2.8.5.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/simple-4.1.21.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jatl-0.2.3.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-plugin-api-3.0.4.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-oauth-client-1.25.0.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-jackson2-1.25.0.jar 2024-09-12T00:37:14.701 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/google-http-client-1.25.0.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/testng-6.3.1.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/snakeyaml-1.17.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/dd-plist-1.21.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-4.12.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bsh-2.0b6.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-launcher-1.3.1.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-s3-1.11.633.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-kms-1.11.633.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aws-java-sdk-core-1.11.633.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpclient-4.5.10.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcifs-1.3.17.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/nekohtml-1.9.22.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xercesImpl-2.12.0.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jsch-0.1.55.jar 2024-09-12T00:37:14.702 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jaxb-impl-2.3.2.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jmespath-java-1.11.633.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-databind-2.9.10.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-core-2.9.10.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jackson-annotations-2.9.10.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/joda-time-2.10.4.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcpkix-jdk15on-1.61.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/bcprov-jdk15on-1.63.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/commons-codec-1.13.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-aether-provider-3.0.4.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-impl-1.13.1.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-util-1.13.1.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-spi-1.13.1.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/aether-api-1.13.1.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/hamcrest-core-1.3.jar 2024-09-12T00:37:14.703 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/httpcore-4.4.12.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jcommander-1.72.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/jzlib-1.1.3.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-artifact-3.0.4.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-builder-3.0.4.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-model-3.0.4.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-repository-metadata-3.0.4.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-builder-3.0.4.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/maven-settings-3.0.4.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-sec-dispatcher-1.3.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-cipher-1.7.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-classworlds-2.5.1.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-component-annotations-1.5.5.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-interpolation-1.14.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/wagon-provider-api-3.0.0.jar 2024-09-12T00:37:14.704 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/plexus-utils-3.1.0.jar 2024-09-12T00:37:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/xbean-reflect-3.7.jar 2024-09-12T00:37:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/ion-java-1.0.2.jar 2024-09-12T00:37:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-engine-1.3.1.jar 2024-09-12T00:37:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/junit-platform-commons-1.3.1.jar 2024-09-12T00:37:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/apiguardian-api-1.0.0.jar 2024-09-12T00:37:14.705 INFO:teuthology.orchestra.run.smithi078.stdout: inflating: /opt/gradle/gradle-6.0.1/lib/plugins/opentest4j-1.1.1.jar 2024-09-12T00:37:14.718 INFO:teuthology.orchestra.run.smithi078.stdout:export PATH=/opt/gradle/gradle-6.0.1/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin 2024-09-12T00:37:15.142 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout:Welcome to Gradle 6.0.1! 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout:Here are the highlights of this release: 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Substantial improvements in dependency management, including 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Publishing Gradle Module Metadata in addition to pom.xml 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Advanced control of transitive versions 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Support for optional features and dependencies 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Rules to tweak published metadata 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Support for Java 13 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Faster incremental Java and Groovy compilation 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - New Zinc compiler for Scala 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - VS2019 support 2024-09-12T00:37:15.143 INFO:teuthology.orchestra.run.smithi078.stdout: - Support for Gradle Enterprise plugin 3.0 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout:For more details see https://docs.gradle.org/6.0.1/release-notes.html 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout:------------------------------------------------------------ 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout:Gradle 6.0.1 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout:------------------------------------------------------------ 2024-09-12T00:37:15.144 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.145 INFO:teuthology.orchestra.run.smithi078.stdout:Build time: 2019-11-18 20:25:01 UTC 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout:Revision: fad121066a68c4701acd362daf4287a7c309a0f5 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout:Kotlin: 1.3.50 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout:Groovy: 2.5.8 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout:Ant: Apache Ant(TM) version 1.10.7 compiled on September 1 2019 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout:JVM: 11.0.17 (Ubuntu 11.0.17+8-post-Ubuntu-1ubuntu222.04) 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout:OS: Linux 5.15.0-119-generic amd64 2024-09-12T00:37:15.146 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.150 DEBUG:tasks.s3tests_java:S3 Tests Java: BEGIN 2024-09-12T00:37:15.150 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-09-12T00:37:15.150 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:37:15.150 DEBUG:tasks.s3tests_java:S3 Tests Java: Cluster config is: ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-09-12T00:37:15.150 DEBUG:tasks.s3tests_java:S3 Tests Java: Host is: ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:37:15.150 INFO:tasks.s3tests_java:S3 Tests Java: Creating S3 users... 2024-09-12T00:37:15.373 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf is {'bucket_prefix': 'test-', 's3main': {'access_key': None, 'access_secret': None, 'region': 'mexico', 'endpoint': None, 'port': None, 'display_name': None, 'email': None, 'is_secure': None, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data'}} 2024-09-12T00:37:15.373 DEBUG:tasks.s3tests_java:S3 Tests Java: Creating user tester.client.0 2024-09-12T00:37:15.373 DEBUG:tasks.s3tests_java:S3 Tests Java: s3tests_conf[s3main] is {'access_key': 'QQWYWBRBNIPBIYHOPNXY', 'access_secret': 'wd14U6TX8yE8mP/I/whgJEsGDH7VsetJsA+ipXXo7aR443ku/1HTwA==', 'region': 'mexico', 'endpoint': 'smithi078.front.sepia.ceph.com:80', 'port': 80, 'display_name': 'Ms. tester.client.0', 'email': 'tester.client.0_test@test.test', 'is_secure': False, 'SSE': 'AES256', 's3dir': 'folder', 'dir': '../data', 'user_id': 'tester.client.0', 'host': 'smithi078.front.sepia.ceph.com'} 2024-09-12T00:37:15.373 DEBUG:tasks.s3tests_java:S3 Tests Java: Setion, User = s3main, tester.client.0 2024-09-12T00:37:15.374 INFO:tasks.s3tests_java:['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '-n', 'client.0', 'user', 'create', '--uid', 'tester.client.0', '--display-name', 'Ms. tester.client.0', '--access-key', 'QQWYWBRBNIPBIYHOPNXY', '--secret', 'wd14U6TX8yE8mP/I/whgJEsGDH7VsetJsA+ipXXo7aR443ku/1HTwA==', '--email', 'tester.client.0_test@test.test', '--cluster', 'ceph'] 2024-09-12T00:37:15.374 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid tester.client.0 --display-name 'Ms. tester.client.0' --access-key QQWYWBRBNIPBIYHOPNXY --secret wd14U6TX8yE8mP/I/whgJEsGDH7VsetJsA+ipXXo7aR443ku/1HTwA== --email tester.client.0_test@test.test --cluster ceph 2024-09-12T00:37:15.416 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:15.417 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:15.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.454+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 realm 2024-09-12T00:37:15.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:15.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:15.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.458+0000 7f7cd738d9c0 20 searching for the correct realm 2024-09-12T00:37:15.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.466+0000 7f7cd5694640 0 -- 172.21.15.78:0/630083251 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f7cc4008070 msgr2=0x7f7cc402f3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:15.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.678+0000 7f7cd4e93640 0 -- 172.21.15.78:0/630083251 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x564cf915c050 msgr2=0x564cf915e510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:15.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.690+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 zone default found 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 4 Realm: () 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 zonegroup default 2024-09-12T00:37:15.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 started sync module instance, tier type = 2024-09-12T00:37:15.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.694+0000 7f7cd738d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:37:15.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.722+0000 7f7cd738d9c0 20 add_watcher() i=0 2024-09-12T00:37:15.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.722+0000 7f7cd738d9c0 20 add_watcher() i=1 2024-09-12T00:37:15.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.722+0000 7f7cd738d9c0 20 add_watcher() i=2 2024-09-12T00:37:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.722+0000 7f7cd738d9c0 20 add_watcher() i=3 2024-09-12T00:37:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.722+0000 7f7cd738d9c0 20 add_watcher() i=4 2024-09-12T00:37:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.722+0000 7f7cd738d9c0 20 add_watcher() i=5 2024-09-12T00:37:15.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.722+0000 7f7cd738d9c0 20 add_watcher() i=6 2024-09-12T00:37:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.726+0000 7f7cd738d9c0 20 add_watcher() i=7 2024-09-12T00:37:15.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.726+0000 7f7cd738d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:15.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 5 note: GC not initialized 2024-09-12T00:37:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7b8a7e4640 20 reqs_thread_entry: start 2024-09-12T00:37:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 Filter name: none 2024-09-12T00:37:15.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7b837fe640 20 reqs_thread_entry: start 2024-09-12T00:37:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:37:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x0 2024-09-12T00:37:15.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:37:15.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache get: name=default.rgw.meta+users.email+tester.client.0_test@test.test : miss 2024-09-12T00:37:15.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x0 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 adding default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache get: name=default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY : miss 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache put: name=default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY info.flags=0x0 2024-09-12T00:37:15.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 adding default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY to cache LRU end 2024-09-12T00:37:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache get: name=default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY : hit (negative entry) 2024-09-12T00:37:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.734+0000 7f7cd738d9c0 10 cache get: name=default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY : hit (negative entry) 2024-09-12T00:37:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.738+0000 7f7cd738d9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:37:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.738+0000 7f7cd738d9c0 10 moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:37:15.738 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.738+0000 7f7cd738d9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:37:15.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.738+0000 7f7babfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398979 cookie 94888596535504 notifier 8234 bl.length()=670 2024-09-12T00:37:15.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.738+0000 7f7babfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x17 2024-09-12T00:37:15.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.738+0000 7f7babfff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:37:15.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.742+0000 7f7cd738d9c0 10 cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:37:15.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.742+0000 7f7cd738d9c0 10 moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:37:15.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.742+0000 7f7cd738d9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:37:15.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.742+0000 7f7babfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398885 cookie 94888596523824 notifier 8234 bl.length()=200 2024-09-12T00:37:15.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.742+0000 7f7babfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+tester.client.0_test@test.test info.flags=0x7 2024-09-12T00:37:15.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.742+0000 7f7babfff640 10 rgw watcher librados: moving default.rgw.meta+users.email+tester.client.0_test@test.test to cache LRU end 2024-09-12T00:37:15.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.750+0000 7f7cd738d9c0 10 cache put: name=default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY info.flags=0x7 2024-09-12T00:37:15.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.750+0000 7f7cd738d9c0 10 moving default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY to cache LRU end 2024-09-12T00:37:15.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.750+0000 7f7cd738d9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.keys:QQWYWBRBNIPBIYHOPNXY, ofs0, ns] 2024-09-12T00:37:15.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.750+0000 7f7babfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398878 cookie 94888596463520 notifier 8234 bl.length()=189 2024-09-12T00:37:15.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.750+0000 7f7babfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY info.flags=0x7 2024-09-12T00:37:15.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.750+0000 7f7babfff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+QQWYWBRBNIPBIYHOPNXY to cache LRU end 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "tester.client.0", 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Ms. tester.client.0", 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "tester.client.0_test@test.test", 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:37:15.750 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "tester.client.0", 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "QQWYWBRBNIPBIYHOPNXY", 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "wd14U6TX8yE8mP/I/whgJEsGDH7VsetJsA+ipXXo7aR443ku/1HTwA==", 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:37:15.742021Z" 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:37:15.751 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:37:15.752 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:37:15.752 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:37:15.752 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:37:15.752 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:37:15.752 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:37:15.752 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:37:15.753 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:37:15.741988Z", 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:15.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.750+0000 7f7b8b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:15.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.754+0000 7f7cd738d9c0 20 remove_watcher() i=0 2024-09-12T00:37:15.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.754+0000 7f7cd738d9c0 2 removed watcher, disabling cache 2024-09-12T00:37:15.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.758+0000 7f7cd738d9c0 20 remove_watcher() i=1 2024-09-12T00:37:15.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.762+0000 7f7cd738d9c0 20 remove_watcher() i=2 2024-09-12T00:37:15.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.762+0000 7f7cd738d9c0 20 remove_watcher() i=3 2024-09-12T00:37:15.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.766+0000 7f7cd738d9c0 20 remove_watcher() i=4 2024-09-12T00:37:15.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.770+0000 7f7cd738d9c0 20 remove_watcher() i=5 2024-09-12T00:37:15.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.774+0000 7f7cd738d9c0 20 remove_watcher() i=6 2024-09-12T00:37:15.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:15.774+0000 7f7cd738d9c0 20 remove_watcher() i=7 2024-09-12T00:37:15.796 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:37:15.796 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf 2024-09-12T00:37:15.840 INFO:tasks.s3tests_java:S3 Tests Java: Running tests... 2024-09-12T00:37:15.840 DEBUG:teuthology.orchestra.run.smithi078:> cp /home/ubuntu/cephtest/archive/s3-tests-java.client.0.conf /home/ubuntu/cephtest/s3-tests-java/config.properties 2024-09-12T00:37:15.886 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:37:15.959 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:15.960 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:16.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.006+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 realm 2024-09-12T00:37:16.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:16.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:16.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.010+0000 7f37e282e9c0 20 searching for the correct realm 2024-09-12T00:37:16.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.018+0000 7f37dfb33640 0 -- 172.21.15.78:0/3461602280 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f37d80c4040 msgr2=0x7f37d80b7420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:16.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.022+0000 7f37dfb33640 0 -- 172.21.15.78:0/3461602280 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x56546322b560 msgr2=0x7f37d80ef400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:37:16.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:37:16.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:16.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:16.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:37:16.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:16.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:16.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:16.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:16.032 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 zone default found 2024-09-12T00:37:16.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 4 Realm: () 2024-09-12T00:37:16.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:37:16.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:37:16.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:16.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 zonegroup default 2024-09-12T00:37:16.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.030+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.034+0000 7f37e282e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.034+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.034+0000 7f37e282e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.034+0000 7f37e282e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.034+0000 7f37e282e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.034+0000 7f37e282e9c0 20 started sync module instance, tier type = 2024-09-12T00:37:16.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.034+0000 7f37e282e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:37:16.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.054+0000 7f37e282e9c0 20 add_watcher() i=0 2024-09-12T00:37:16.055 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.054+0000 7f37e282e9c0 20 add_watcher() i=1 2024-09-12T00:37:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.054+0000 7f37e282e9c0 20 add_watcher() i=2 2024-09-12T00:37:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.054+0000 7f37e282e9c0 20 add_watcher() i=3 2024-09-12T00:37:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.054+0000 7f37e282e9c0 20 add_watcher() i=4 2024-09-12T00:37:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.054+0000 7f37e282e9c0 20 add_watcher() i=5 2024-09-12T00:37:16.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.054+0000 7f37e282e9c0 20 add_watcher() i=6 2024-09-12T00:37:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.058+0000 7f37e282e9c0 20 add_watcher() i=7 2024-09-12T00:37:16.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.058+0000 7f37e282e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:16.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.062+0000 7f3696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:16.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.062+0000 7f37e282e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:16.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.062+0000 7f37e282e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:16.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.126+0000 7f3695fdb640 20 reqs_thread_entry: start 2024-09-12T00:37:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.126+0000 7f37e282e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.126+0000 7f37e282e9c0 20 Filter name: none 2024-09-12T00:37:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.126+0000 7f36077fe640 20 reqs_thread_entry: start 2024-09-12T00:37:16.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.126+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:37:16.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.126+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.130+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.130+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.130+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:37:16.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.130+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.134+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.134+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.134+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4810448816227242926', time=2024-09-12T02:28:27.896514+0000, chain.objs.size()=3 2024-09-12T00:37:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.134+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.0KP9-VArl2W5VI2XLziD_3ot3N4C8TM_0 2024-09-12T00:37:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.134+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.0KP9-VArl2W5VI2XLziD_3ot3N4C8TM_1 2024-09-12T00:37:16.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.134+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.0KP9-VArl2W5VI2XLziD_3ot3N4C8TM_2 2024-09-12T00:37:16.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.142+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.142+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:37:16.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.146+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.146+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.146+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.150+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:37:16.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.150+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.154+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.154+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.154+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_rYXwXN7jiooMrkkOh0q8scF-BkGUjHs', time=2024-09-12T02:28:27.557619+0000, chain.objs.size()=1 2024-09-12T00:37:16.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.154+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.iZjSnhTYYVZRH7IQW8meQcPCwezwXWy_0 2024-09-12T00:37:16.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.154+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.158+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:37:16.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.162+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.162+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_MGtnEWXkfZotvOm_1BZ0QD9FvpzIhmq', time=2024-09-12T02:28:27.412728+0000, chain.objs.size()=2 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.eH9ZEeILgdoUajXHYbzBOpBzJaU8srp_0 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.eH9ZEeILgdoUajXHYbzBOpBzJaU8srp_1 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_-Ud2n_014q1wHNXcbXkUb95xRQq3o4w', time=2024-09-12T02:28:27.607407+0000, chain.objs.size()=3 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.waHH1aCSLy7IN_iBWMXNr0-BSeyo160_0 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.waHH1aCSLy7IN_iBWMXNr0-BSeyo160_1 2024-09-12T00:37:16.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.166+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.waHH1aCSLy7IN_iBWMXNr0-BSeyo160_2 2024-09-12T00:37:16.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.174+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.178+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:37:16.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.178+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.182+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.182+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.182+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.164568517454645964', time=2024-09-12T02:28:27.655964+0000, chain.objs.size()=3 2024-09-12T00:37:16.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.182+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.1 2024-09-12T00:37:16.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.182+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.2 2024-09-12T00:37:16.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.182+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.3 2024-09-12T00:37:16.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.186+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.190+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:37:16.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.194+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.194+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.198+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.198+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:37:16.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.198+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13680846715615614488', time=2024-09-12T02:28:27.229246+0000, chain.objs.size()=7 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.1 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__shadow_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.1_1 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.2 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__shadow_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.2_1 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.3 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__shadow_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.3_1 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12__multipart_foo.2~0dj1wv8xpB7dHhXFwtVMbvYQaSfzeEm.4 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15848241144789875135', time=2024-09-12T02:28:27.282362+0000, chain.objs.size()=4 2024-09-12T00:37:16.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.1 2024-09-12T00:37:16.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.2 2024-09-12T00:37:16.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.3 2024-09-12T00:37:16.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.202+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10__multipart_foo.2~ofx3MilcJR9Qk5YhAUpmWMP1dmKSaRW.4 2024-09-12T00:37:16.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.210+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.214+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:37:16.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6866448550724242207', time=2024-09-12T02:28:27.188696+0000, chain.objs.size()=4 2024-09-12T00:37:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.1 2024-09-12T00:37:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.2 2024-09-12T00:37:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.3 2024-09-12T00:37:16.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.218+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11__multipart_foo.2~su7gwOKKHcr24pk-3gNmBKAj9BXpkkP.4 2024-09-12T00:37:16.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.226+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.230+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:37:16.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_cY84uCBbM42YsZHhn_Ub9ntScd0-dVn', time=2024-09-12T02:28:27.489273+0000, chain.objs.size()=2 2024-09-12T00:37:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.bIv8P1kQTaIfgpcniMq03tb48pRNtmt_0 2024-09-12T00:37:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.bIv8P1kQTaIfgpcniMq03tb48pRNtmt_1 2024-09-12T00:37:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_Qi8Yw8z-rcRXDs5vyAhIbp6dvntn3c-', time=2024-09-12T02:28:27.569546+0000, chain.objs.size()=2 2024-09-12T00:37:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.KcRWH3OV9ubYQTCyl0ys1TweU9R2-5d_1 2024-09-12T00:37:16.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.234+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.KcRWH3OV9ubYQTCyl0ys1TweU9R2-5d_2 2024-09-12T00:37:16.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.238+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.242+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:37:16.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1170014077582854684', time=2024-09-12T02:28:27.667636+0000, chain.objs.size()=5 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1_1 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2_1 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.246+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.3 2024-09-12T00:37:16.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.250+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2287584523344853376', time=2024-09-12T02:28:27.744402+0000, chain.objs.size()=5 2024-09-12T00:37:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.250+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.1 2024-09-12T00:37:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.250+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.1_1 2024-09-12T00:37:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.250+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.2 2024-09-12T00:37:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.250+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.2_1 2024-09-12T00:37:16.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.250+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-FROZEN.2~m3RT1Hdot1BuRj0jzO6QV9VJgyuROvx.3 2024-09-12T00:37:16.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.254+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.262+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:37:16.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.262+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.266+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.266+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.266+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12247121667611165907', time=2024-09-12T02:28:27.481738+0000, chain.objs.size()=2 2024-09-12T00:37:16.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.266+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_0 2024-09-12T00:37:16.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.266+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_1 2024-09-12T00:37:16.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.270+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.274+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:37:16.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.278+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.278+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.278+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.278+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_c4jIs3Tahl3g23gM_0N-2TfHiBcbTNs', time=2024-09-12T02:28:27.419755+0000, chain.objs.size()=2 2024-09-12T00:37:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.278+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.MotVFXc18HMeuUF6KD6pDIsaTdNA5JP_0 2024-09-12T00:37:16.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.278+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.MotVFXc18HMeuUF6KD6pDIsaTdNA5JP_1 2024-09-12T00:37:16.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.282+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.290+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:37:16.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10760192229307867919', time=2024-09-12T02:28:27.766385+0000, chain.objs.size()=5 2024-09-12T00:37:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.1 2024-09-12T00:37:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.1_1 2024-09-12T00:37:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.2 2024-09-12T00:37:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__shadow_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.2_1 2024-09-12T00:37:16.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.294+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-LUKEWARM.2~1c_77U9sVUjAl26hXV0hBqwI72zFPWD.3 2024-09-12T00:37:16.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.302+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.306+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:37:16.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.310+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.310+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.314+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.314+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_FxF__9uy9H9heaHZKJBKs8TabLVSUzQ', time=2024-09-12T02:28:27.391719+0000, chain.objs.size()=1 2024-09-12T00:37:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.314+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.-MQLskYtgLx1Kw1p-cacQF3eJa3DpE4_1 2024-09-12T00:37:16.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.314+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_ZPewx4S-qLsnEihihOhldROdmNX7wde', time=2024-09-12T02:28:27.447935+0000, chain.objs.size()=1 2024-09-12T00:37:16.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.314+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.1oDRHaLyAj_PjAhk9HeQ9L10tOtv4LH_1 2024-09-12T00:37:16.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.318+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.322+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:37:16.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.326+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.326+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_l5qtj9CAYSIXFjgcKI5VfpAobeberax', time=2024-09-12T02:28:27.632111+0000, chain.objs.size()=2 2024-09-12T00:37:16.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.vQwvOutFWrSutlS4bkxG37xoOwHITef_1 2024-09-12T00:37:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.vQwvOutFWrSutlS4bkxG37xoOwHITef_2 2024-09-12T00:37:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2873798180363383908', time=2024-09-12T02:28:27.644040+0000, chain.objs.size()=5 2024-09-12T00:37:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1 2024-09-12T00:37:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.1_1 2024-09-12T00:37:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2 2024-09-12T00:37:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.2_1 2024-09-12T00:37:16.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.330+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-LUKEWARM.2~hPmf1WxpibGMJ89VqvaovdHvGW29g61.3 2024-09-12T00:37:16.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.338+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.346+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:37:16.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.346+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.350+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.350+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.350+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17221409918446709520', time=2024-09-12T02:28:27.466570+0000, chain.objs.size()=1 2024-09-12T00:37:16.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.350+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.Fs9VUaj8m3FHBUzD2KsTqZS6VZb-ZvL_1 2024-09-12T00:37:16.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.350+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.358+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:37:16.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.362+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.362+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.362+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.366+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:37:16.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.370+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.370+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.370+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.374+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:37:16.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.378+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.378+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.378+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.382+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:37:16.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.386+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.386+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.386+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.386+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5129143859965715391', time=2024-09-12T02:28:27.500943+0000, chain.objs.size()=2 2024-09-12T00:37:16.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.386+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_0 2024-09-12T00:37:16.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.386+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_1 2024-09-12T00:37:16.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.390+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.398+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:37:16.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_JeEhb5rxyrPIEalp7ZNTh1knhX2y0ud', time=2024-09-12T02:28:27.378928+0000, chain.objs.size()=2 2024-09-12T00:37:16.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.wssclK2_yzTaF861dQutTj4eGqHuqgv_0 2024-09-12T00:37:16.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.wssclK2_yzTaF861dQutTj4eGqHuqgv_1 2024-09-12T00:37:16.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16080735421554646484', time=2024-09-12T02:28:27.432556+0000, chain.objs.size()=1 2024-09-12T00:37:16.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.402+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.Fs9VUaj8m3FHBUzD2KsTqZS6VZb-ZvL_1 2024-09-12T00:37:16.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.410+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.414+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:37:16.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.418+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.421 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.422+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.422+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.422+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15195941230104383500', time=2024-09-12T02:28:27.876015+0000, chain.objs.size()=3 2024-09-12T00:37:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.422+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.7pQymxok79S7hpSnegKOgv2jf97pqNJ_0 2024-09-12T00:37:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.422+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.7pQymxok79S7hpSnegKOgv2jf97pqNJ_1 2024-09-12T00:37:16.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.422+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13__shadow_.7pQymxok79S7hpSnegKOgv2jf97pqNJ_2 2024-09-12T00:37:16.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.430+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.438+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:37:16.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:37:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6290783858316596427', time=2024-09-12T02:28:27.402617+0000, chain.objs.size()=2 2024-09-12T00:37:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_0 2024-09-12T00:37:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.a9kYATdJr0pBCBDtAkEQZkIaz2tS0X3_1 2024-09-12T00:37:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4601412571682205722', time=2024-09-12T02:28:27.458547+0000, chain.objs.size()=2 2024-09-12T00:37:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_0 2024-09-12T00:37:16.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.442+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15__shadow_.dx8lrL8Rbhcj2oDs-D2eeJoxSqxtKCk_1 2024-09-12T00:37:16.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.450+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.454+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:37:16.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.458+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.458+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.462+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.462+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:37:16.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.466+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11515984522338195923', time=2024-09-12T02:28:27.584816+0000, chain.objs.size()=5 2024-09-12T00:37:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1 2024-09-12T00:37:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1_1 2024-09-12T00:37:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2 2024-09-12T00:37:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2_1 2024-09-12T00:37:16.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.470+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.3 2024-09-12T00:37:16.475 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.474+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.482+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:37:16.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.486+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.486+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.486+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.486+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_W9ktUuAFekshmiUOqXgAhaxJZ2qZiS0', time=2024-09-12T02:28:27.595735+0000, chain.objs.size()=3 2024-09-12T00:37:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.486+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.kAFrcWNYNZyyEMqJSSKSkQfGHglPS7H_0 2024-09-12T00:37:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.486+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.kAFrcWNYNZyyEMqJSSKSkQfGHglPS7H_1 2024-09-12T00:37:16.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.486+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.kAFrcWNYNZyyEMqJSSKSkQfGHglPS7H_2 2024-09-12T00:37:16.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.494+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.502+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:37:16.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.507 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2423826511234987677', time=2024-09-12T02:28:27.615390+0000, chain.objs.size()=3 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.1 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.2 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-STANDARD.2~wc2E7F_KMTpeqVqYHZ3PYWv-QsavYGa.3 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4314825876673728153', time=2024-09-12T02:28:27.686243+0000, chain.objs.size()=5 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.1_1 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.2_1 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__multipart_foo-FROZEN.2~jkD8pPLvGIZUQmlRQEUK_jHrG3QPFsr.3 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.255924249743586597', time=2024-09-12T02:28:27.751712+0000, chain.objs.size()=3 2024-09-12T00:37:16.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-STANDARD.2~JpErWK2LREdiIuRJw3EOnb-k4DjwqM_.1 2024-09-12T00:37:16.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-STANDARD.2~JpErWK2LREdiIuRJw3EOnb-k4DjwqM_.2 2024-09-12T00:37:16.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.506+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14__multipart_foo-STANDARD.2~JpErWK2LREdiIuRJw3EOnb-k4DjwqM_.3 2024-09-12T00:37:16.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.518+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.522+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:37:16.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.526+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.526+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.530+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.530+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:37:16.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.534+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.538+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.538+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.538+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='_36fk1NFU9xuZc7g4JWcFg0dnv55uDhU', time=2024-09-12T02:28:27.679272+0000, chain.objs.size()=1 2024-09-12T00:37:16.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.538+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16__shadow_.Tqkr-drTcWpq2NYy6n0ya0q2YYgs8iO_0 2024-09-12T00:37:16.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.542+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.546+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:37:16.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.550+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.554+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.554+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:37:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.554+0000 7f37e282e9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.602460215211618388', time=2024-09-12T02:28:27.335496+0000, chain.objs.size()=4 2024-09-12T00:37:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.554+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.1 2024-09-12T00:37:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.554+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.2 2024-09-12T00:37:16.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.554+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.3 2024-09-12T00:37:16.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.554+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9__multipart_foo.2~wDRO5LEcJQBxwGJuFMowuIuL9lTEuBM.4 2024-09-12T00:37:16.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.558+0000 7f37e282e9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:37:16.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.566+0000 7f37e282e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:37:16.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.570+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.570+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:16.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.570+0000 7f37e282e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:16.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.574+0000 7f3696fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:16.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.582+0000 7f37e282e9c0 20 remove_watcher() i=0 2024-09-12T00:37:16.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.582+0000 7f37e282e9c0 2 removed watcher, disabling cache 2024-09-12T00:37:16.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.582+0000 7f37e282e9c0 20 remove_watcher() i=1 2024-09-12T00:37:16.587 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.586+0000 7f37e282e9c0 20 remove_watcher() i=2 2024-09-12T00:37:16.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.590+0000 7f37e282e9c0 20 remove_watcher() i=3 2024-09-12T00:37:16.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.590+0000 7f37e282e9c0 20 remove_watcher() i=4 2024-09-12T00:37:16.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.594+0000 7f37e282e9c0 20 remove_watcher() i=5 2024-09-12T00:37:16.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.594+0000 7f37e282e9c0 20 remove_watcher() i=6 2024-09-12T00:37:16.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.598+0000 7f37e282e9c0 20 remove_watcher() i=7 2024-09-12T00:37:16.619 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:37:16.695 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:37:16.696 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:37:16.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.742+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.742+0000 7ff70e98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.742+0000 7ff70e98d9c0 20 realm 2024-09-12T00:37:16.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.742+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:37:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:16.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:37:16.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.746+0000 7ff70e98d9c0 20 searching for the correct realm 2024-09-12T00:37:16.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.754+0000 7ff70cc94640 0 -- 172.21.15.78:0/2968220928 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7ff6fc024040 msgr2=0x7ff6fc06c8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:16.969 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.966+0000 7ff70cc94640 0 -- 172.21.15.78:0/2968220928 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55809eb70c20 msgr2=0x55809eb73030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:37:16.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.978+0000 7ff70e98d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:37:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.978+0000 7ff70e98d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:37:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.978+0000 7ff70e98d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:37:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.978+0000 7ff70e98d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:37:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.978+0000 7ff70e98d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:37:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.978+0000 7ff70e98d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:37:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.978+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:37:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:37:16.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 zone default found 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 4 Realm: () 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 zonegroup default 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.982+0000 7ff70e98d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:37:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.986+0000 7ff70e98d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:37:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.986+0000 7ff70e98d9c0 20 started sync module instance, tier type = 2024-09-12T00:37:16.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:16.986+0000 7ff70e98d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:37:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.006+0000 7ff70e98d9c0 20 add_watcher() i=0 2024-09-12T00:37:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.006+0000 7ff70e98d9c0 20 add_watcher() i=1 2024-09-12T00:37:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.006+0000 7ff70e98d9c0 20 add_watcher() i=2 2024-09-12T00:37:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.006+0000 7ff70e98d9c0 20 add_watcher() i=3 2024-09-12T00:37:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.006+0000 7ff70e98d9c0 20 add_watcher() i=4 2024-09-12T00:37:17.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.006+0000 7ff70e98d9c0 20 add_watcher() i=5 2024-09-12T00:37:17.008 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.006+0000 7ff70e98d9c0 20 add_watcher() i=6 2024-09-12T00:37:17.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.010+0000 7ff70e98d9c0 20 add_watcher() i=7 2024-09-12T00:37:17.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.010+0000 7ff70e98d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:37:17.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.014+0000 7ff5c37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.014+0000 7ff70e98d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:37:17.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.014+0000 7ff70e98d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:37:17.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.106+0000 7ff5c27dc640 20 reqs_thread_entry: start 2024-09-12T00:37:17.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.106+0000 7ff70e98d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:37:17.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.106+0000 7ff70e98d9c0 20 Filter name: none 2024-09-12T00:37:17.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.106+0000 7ff5bb7fe640 20 reqs_thread_entry: start 2024-09-12T00:37:17.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.106+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:37:17.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.110+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.110+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.110+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.110+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:37:17.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.114+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.114+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.114+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.118+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:37:17.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.122+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.122+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.122+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.126+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:37:17.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.130+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.130+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.130+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.138+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:37:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.138+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.138+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.142+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.142+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:37:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.146+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.146+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.146+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.146+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:37:17.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.150+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.154+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.154+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.154+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:37:17.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.158+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.158+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.158+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.162+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:37:17.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.166+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.166+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.166+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.170+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:37:17.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.174+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.174+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.174+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.178 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.178+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:37:17.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.182+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.182+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.182+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.186+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:37:17.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.186+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.190+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.190+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.190+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:37:17.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.194+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.194+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.198+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.198+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:37:17.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.202+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.202+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.202+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.206+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:37:17.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.210+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.210+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.210+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.214+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:37:17.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.218+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.218+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.218+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.222+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:37:17.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.222+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.226+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.226+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.226+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:37:17.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.230+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.233 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.230+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.234+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.238+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:37:17.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.238+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.238+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.242+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.242+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:37:17.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.246+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.246+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.246+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.250+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:37:17.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.254+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.254+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.254+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.258+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:37:17.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.262+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.262+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.266+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.266+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:37:17.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.270+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.270+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.270+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.274+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:37:17.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.278+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.278+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.282+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.282+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:37:17.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.286+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.290+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.290+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.294+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:37:17.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.294+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.298+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.298+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.301 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.302+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:37:17.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.302+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.306+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.306+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.310+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:37:17.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.310+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.314+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.314+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.314+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:37:17.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.318+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.322+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.322 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.322+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.326+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:37:17.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.326+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.330+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.330+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.333 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.334+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:37:17.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.338+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.339 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.338+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.338+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.342+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:37:17.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.346+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.346+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:37:17.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.350+0000 7ff70e98d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:37:17.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.354+0000 7ff5c37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:37:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.358+0000 7ff70e98d9c0 20 remove_watcher() i=0 2024-09-12T00:37:17.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.358+0000 7ff70e98d9c0 2 removed watcher, disabling cache 2024-09-12T00:37:17.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.358+0000 7ff70e98d9c0 20 remove_watcher() i=1 2024-09-12T00:37:17.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.362+0000 7ff70e98d9c0 20 remove_watcher() i=2 2024-09-12T00:37:17.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.366+0000 7ff70e98d9c0 20 remove_watcher() i=3 2024-09-12T00:37:17.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.370+0000 7ff70e98d9c0 20 remove_watcher() i=4 2024-09-12T00:37:17.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.370+0000 7ff70e98d9c0 20 remove_watcher() i=5 2024-09-12T00:37:17.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.374+0000 7ff70e98d9c0 20 remove_watcher() i=6 2024-09-12T00:37:17.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:37:17.378+0000 7ff70e98d9c0 20 remove_watcher() i=7 2024-09-12T00:37:17.396 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests AWS4Test 2024-09-12T00:37:18.092 INFO:teuthology.orchestra.run.smithi078.stdout:Starting a Gradle Daemon (subsequent builds will be faster) 2024-09-12T00:37:22.693 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :clean UP-TO-DATE 2024-09-12T00:37:41.392 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileJava 2024-09-12T00:37:41.491 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processResources 2024-09-12T00:37:41.491 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :classes 2024-09-12T00:37:42.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:42.291 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileTestJava 2024-09-12T00:37:42.292 INFO:teuthology.orchestra.run.smithi078.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:37:42.292 INFO:teuthology.orchestra.run.smithi078.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:37:42.293 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:42.293 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:37:42.293 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :testClasses 2024-09-12T00:37:49.493 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:49.493 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :test 2024-09-12T00:37:49.493 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:49.493 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 STARTED 2024-09-12T00:37:50.191 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:50.191 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadLLAPIAWS4 PASSED 2024-09-12T00:37:50.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:50.491 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 STARTED 2024-09-12T00:37:50.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:50.591 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testAbortMultipartUploadNotFoundLLAPIAWS4 PASSED 2024-09-12T00:37:50.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:50.891 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 STARTED 2024-09-12T00:37:51.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:51.391 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadHLAPIAWS4 PASSED 2024-09-12T00:37:51.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:51.692 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:37:51.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:51.692 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:37:51.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:51.791 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 STARTED 2024-09-12T00:37:51.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:51.891 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testDownloadNoKeyHLAPIAWS4 PASSED 2024-09-12T00:37:52.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:52.091 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 STARTED 2024-09-12T00:37:52.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:52.691 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyHLAPIAWS4 PASSED 2024-09-12T00:37:53.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:53.091 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:37:53.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:53.391 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 STANDARD_OUT 2024-09-12T00:37:53.392 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12 00:37:53,341 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:37:59.892 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:37:59.892 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:38:00.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:00.392 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 STARTED 2024-09-12T00:38:00.392 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:00.392 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCBucketHLAPIAWS4 PASSED 2024-09-12T00:38:00.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:00.692 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 STARTED 2024-09-12T00:38:00.692 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:00.692 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartCopyNoSRCKeyHLAPIAWS4 PASSED 2024-09-12T00:38:01.191 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:01.191 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 STARTED 2024-09-12T00:38:01.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:01.691 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadHLAPIAWS4 PASSED 2024-09-12T00:38:01.992 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:01.992 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 STARTED 2024-09-12T00:38:01.993 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:01.993 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadNoBucketHLAPIAWS4 PASSED 2024-09-12T00:38:02.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:02.091 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 STARTED 2024-09-12T00:38:04.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:04.491 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartDownloadWithPauseHLAPIAWS4 PASSED 2024-09-12T00:38:04.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:04.791 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:38:05.392 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:05.392 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:38:05.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:05.691 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 STARTED 2024-09-12T00:38:06.591 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:06.591 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadIncorrectMissingPartLLAPIAWS4 PASSED 2024-09-12T00:38:06.891 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:06.891 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 STARTED 2024-09-12T00:38:15.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:15.492 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadMultipleSizesLLAPIAWS4 PASSED 2024-09-12T00:38:15.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:15.791 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 STARTED 2024-09-12T00:38:17.291 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:17.291 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadOverwriteExistingObjectLLAPIAWS4 PASSED 2024-09-12T00:38:17.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:17.491 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 STARTED 2024-09-12T00:38:18.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:18.491 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadSmallLLAPIAWS4 PASSED 2024-09-12T00:38:18.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:18.691 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 STARTED 2024-09-12T00:38:19.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:19.091 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testMultipartUploadWithPauseAWS4 PASSED 2024-09-12T00:38:19.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:19.491 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 STARTED 2024-09-12T00:38:19.492 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:19.492 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateAfterToday4AWS4 PASSED 2024-09-12T00:38:19.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:19.791 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 STARTED 2024-09-12T00:38:19.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:19.791 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeEpochAWS4 PASSED 2024-09-12T00:38:20.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:20.091 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 STARTED 2024-09-12T00:38:20.191 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:20.191 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateBeforeToday4AWS4 PASSED 2024-09-12T00:38:20.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:20.391 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 STARTED 2024-09-12T00:38:20.491 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:20.491 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateEmptyAWS4 PASSED 2024-09-12T00:38:20.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:20.791 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 STARTED 2024-09-12T00:38:20.791 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:20.791 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateInvalidAWS4 PASSED 2024-09-12T00:38:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:21.091 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 STARTED 2024-09-12T00:38:21.091 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:21.091 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadDateNoneAWS4 PASSED 2024-09-12T00:38:21.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:21.391 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 STARTED 2024-09-12T00:38:21.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:21.392 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testObjectCreateBadMd5InvalidGarbageAWS4 PASSED 2024-09-12T00:38:21.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:21.691 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 STARTED 2024-09-12T00:38:22.391 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:22.391 INFO:teuthology.orchestra.run.smithi078.stdout:suite > AWS4 tests > AWS4Test.testUploadFileHLAPIBigFileAWS4 PASSED 2024-09-12T00:38:22.691 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:22.691 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-12T00:38:22.691 INFO:teuthology.orchestra.run.smithi078.stdout:| Results: SUCCESS (26 tests, 26 successes, 0 failures, 0 skipped) | 2024-09-12T00:38:22.692 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-12T00:38:22.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:22.754 INFO:teuthology.orchestra.run.smithi078.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:38:22.754 INFO:teuthology.orchestra.run.smithi078.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:38:22.754 INFO:teuthology.orchestra.run.smithi078.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:38:22.754 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:22.754 INFO:teuthology.orchestra.run.smithi078.stdout:BUILD SUCCESSFUL in 1m 5s 2024-09-12T00:38:22.755 INFO:teuthology.orchestra.run.smithi078.stdout:5 actionable tasks: 4 executed, 1 up-to-date 2024-09-12T00:38:23.081 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:23.113 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:23.113 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:23.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.162+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.162+0000 7f9efe27c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.162+0000 7f9efe27c9c0 20 realm 2024-09-12T00:38:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.162+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:23.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:23.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.166+0000 7f9efe27c9c0 20 searching for the correct realm 2024-09-12T00:38:23.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.170+0000 7f9efc583640 0 -- 172.21.15.78:0/3208785611 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f9eec066590 msgr2=0x7f9eec07e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:23.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.385+0000 7f9efbd82640 0 -- 172.21.15.78:0/3208785611 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55da198b9120 msgr2=0x55da198bb560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:23.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:23.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:23.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:23.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:23.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:23.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 zone default found 2024-09-12T00:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 4 Realm: () 2024-09-12T00:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:23.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 zonegroup default 2024-09-12T00:38:23.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.397+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.401+0000 7f9efe27c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.401+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.401+0000 7f9efe27c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.401+0000 7f9efe27c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:23.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.401+0000 7f9efe27c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:23.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.401+0000 7f9efe27c9c0 20 started sync module instance, tier type = 2024-09-12T00:38:23.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.401+0000 7f9efe27c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:23.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.421+0000 7f9efe27c9c0 20 add_watcher() i=0 2024-09-12T00:38:23.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.421+0000 7f9efe27c9c0 20 add_watcher() i=1 2024-09-12T00:38:23.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.421+0000 7f9efe27c9c0 20 add_watcher() i=2 2024-09-12T00:38:23.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.421+0000 7f9efe27c9c0 20 add_watcher() i=3 2024-09-12T00:38:23.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.421+0000 7f9efe27c9c0 20 add_watcher() i=4 2024-09-12T00:38:23.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.421+0000 7f9efe27c9c0 20 add_watcher() i=5 2024-09-12T00:38:23.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.421+0000 7f9efe27c9c0 20 add_watcher() i=6 2024-09-12T00:38:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.425+0000 7f9efe27c9c0 20 add_watcher() i=7 2024-09-12T00:38:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.425+0000 7f9efe27c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:23.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.429+0000 7f9db1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:23.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.429+0000 7f9efe27c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:23.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.429+0000 7f9efe27c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.525+0000 7f9db0fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:23.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.525+0000 7f9efe27c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.525+0000 7f9efe27c9c0 20 Filter name: none 2024-09-12T00:38:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.525+0000 7f9d2a7fc640 20 reqs_thread_entry: start 2024-09-12T00:38:23.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.525+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:23.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16981895892200751621', time=2024-09-12T02:37:52.719085+0000, chain.objs.size()=9 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.1 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.1_1 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.2 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.2_1 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.3 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.3_1 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.4 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.4_1 2024-09-12T00:38:23.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.529+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.5 2024-09-12T00:38:23.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.537+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.545+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.545+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.545+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.549+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.549+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:23.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5162585937474634950', time=2024-09-12T02:37:57.531034+0000, chain.objs.size()=9 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.1 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.1_1 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.2 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.2_1 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.3 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.3_1 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.4 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.4_1 2024-09-12T00:38:23.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.553+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~Bi0kk_F2JdtiNQ_DcZm-2vLfEyU_7h3.5 2024-09-12T00:38:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.565+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.569+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:23.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.573+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.573+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:38:23.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ', time=2024-09-12T02:38:19.332362+0000, chain.objs.size()=76 2024-09-12T00:38:23.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.1 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.2 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.3 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.4 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.5 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.6 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.7 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.8 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.9 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.10 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.11 2024-09-12T00:38:23.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.577+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.12 2024-09-12T00:38:23.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.13 2024-09-12T00:38:23.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.14 2024-09-12T00:38:23.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.15 2024-09-12T00:38:23.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.16 2024-09-12T00:38:23.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.17 2024-09-12T00:38:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.18 2024-09-12T00:38:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.19 2024-09-12T00:38:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.20 2024-09-12T00:38:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.21 2024-09-12T00:38:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.22 2024-09-12T00:38:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.585+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.23 2024-09-12T00:38:23.590 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.593+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.24 2024-09-12T00:38:23.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.593+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.25 2024-09-12T00:38:23.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.593+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.26 2024-09-12T00:38:23.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.593+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.27 2024-09-12T00:38:23.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.593+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.28 2024-09-12T00:38:23.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.593+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.29 2024-09-12T00:38:23.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.593+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.30 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.597+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.31 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.597+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.32 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.597+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.33 2024-09-12T00:38:23.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.597+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.34 2024-09-12T00:38:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.597+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.35 2024-09-12T00:38:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.597+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.36 2024-09-12T00:38:23.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.601+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.37 2024-09-12T00:38:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.601+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.38 2024-09-12T00:38:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.601+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.39 2024-09-12T00:38:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.601+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.40 2024-09-12T00:38:23.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.601+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.41 2024-09-12T00:38:23.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.605+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.42 2024-09-12T00:38:23.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.605+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.43 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.609+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.44 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.609+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.45 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.609+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.46 2024-09-12T00:38:23.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.609+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.47 2024-09-12T00:38:23.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.609+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.48 2024-09-12T00:38:23.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.49 2024-09-12T00:38:23.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.50 2024-09-12T00:38:23.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.51 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.52 2024-09-12T00:38:23.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.53 2024-09-12T00:38:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.54 2024-09-12T00:38:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.55 2024-09-12T00:38:23.612 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.613+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.56 2024-09-12T00:38:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.617+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.57 2024-09-12T00:38:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.617+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.58 2024-09-12T00:38:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.617+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.59 2024-09-12T00:38:23.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.617+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.60 2024-09-12T00:38:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.621+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.61 2024-09-12T00:38:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.621+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.62 2024-09-12T00:38:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.621+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.63 2024-09-12T00:38:23.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.621+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.64 2024-09-12T00:38:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.625+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.65 2024-09-12T00:38:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.625+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.66 2024-09-12T00:38:23.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.625+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.67 2024-09-12T00:38:23.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.625+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.68 2024-09-12T00:38:23.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.625+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.69 2024-09-12T00:38:23.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.625+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.70 2024-09-12T00:38:23.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.71 2024-09-12T00:38:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.72 2024-09-12T00:38:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.73 2024-09-12T00:38:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.74 2024-09-12T00:38:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.75 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.58__multipart_key1.2~z4mOGwVeknrx5Xd0XUa5ebbAkdxOwtJ.76 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16687092583431033435', time=2024-09-12T02:38:22.406148+0000, chain.objs.size()=21 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.1 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.1_1 2024-09-12T00:38:23.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.2 2024-09-12T00:38:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.2_1 2024-09-12T00:38:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.629+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.3 2024-09-12T00:38:23.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.633+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.3_1 2024-09-12T00:38:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.637+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.4 2024-09-12T00:38:23.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.637+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.4_1 2024-09-12T00:38:23.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.637+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.5 2024-09-12T00:38:23.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.637+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.5_1 2024-09-12T00:38:23.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.637+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.6 2024-09-12T00:38:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.637+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.6_1 2024-09-12T00:38:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.637+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.7 2024-09-12T00:38:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.7_1 2024-09-12T00:38:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.8 2024-09-12T00:38:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.8_1 2024-09-12T00:38:23.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.9 2024-09-12T00:38:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.9_1 2024-09-12T00:38:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.10 2024-09-12T00:38:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__shadow_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.10_1 2024-09-12T00:38:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.641+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.66__multipart_key1.2~l5IJ_L1TVbrjkP7KVFQYGH88sR_QN5S.11 2024-09-12T00:38:23.645 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.649+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7114423666478027955', time=2024-09-12T02:38:01.725677+0000, chain.objs.size()=9 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__multipart_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.1 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__shadow_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.1_1 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__multipart_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.2 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__shadow_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.2_1 2024-09-12T00:38:23.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__multipart_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.3 2024-09-12T00:38:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__shadow_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.3_1 2024-09-12T00:38:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__multipart_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.4 2024-09-12T00:38:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__shadow_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.4_1 2024-09-12T00:38:23.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.653+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.51__multipart_key1.2~t9SRW5j6Q2nre0UaqtKhaf-qgwQUclH.5 2024-09-12T00:38:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.661+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.661+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:23.661 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11276675494337997757', time=2024-09-12T02:38:05.406314+0000, chain.objs.size()=9 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.1 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.1_1 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.2 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.2_1 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.3 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.3_1 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.4 2024-09-12T00:38:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.4_1 2024-09-12T00:38:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file.mpg.2~hSc5dG9beTBVwvZhR4lBYAI4d1co2YT.5 2024-09-12T00:38:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4544834967129099004', time=2024-09-12T02:38:11.564337+0000, chain.objs.size()=21 2024-09-12T00:38:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.1 2024-09-12T00:38:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.1_1 2024-09-12T00:38:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.665+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.2 2024-09-12T00:38:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.669+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.2_1 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.3 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.3_1 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.4 2024-09-12T00:38:23.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.4_1 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.5 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.5_1 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.6 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.6_1 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.7 2024-09-12T00:38:23.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.7_1 2024-09-12T00:38:23.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.673+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.8 2024-09-12T00:38:23.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.8_1 2024-09-12T00:38:23.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.9 2024-09-12T00:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.9_1 2024-09-12T00:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.10 2024-09-12T00:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.10_1 2024-09-12T00:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~-mloqsGumzKSItJeWZrka2QLFhNjDHn.11 2024-09-12T00:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17572772154958094683', time=2024-09-12T02:38:14.206697+0000, chain.objs.size()=16 2024-09-12T00:38:23.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.677+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.1 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.681+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.1_1 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.681+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.1_2 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.681+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.2 2024-09-12T00:38:23.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.681+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.2_1 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.681+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.2_2 2024-09-12T00:38:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.681+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.3 2024-09-12T00:38:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.681+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.3_1 2024-09-12T00:38:23.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.3_2 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.4 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.4_1 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.4_2 2024-09-12T00:38:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.5 2024-09-12T00:38:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.5_1 2024-09-12T00:38:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.5_2 2024-09-12T00:38:23.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.685+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~7EQ8NwcOiEdaOQk3wibw48kjNPHz7hP.6 2024-09-12T00:38:23.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.693+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.693+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:38:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2734380453770665170', time=2024-09-12T02:37:52.907372+0000, chain.objs.size()=9 2024-09-12T00:38:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.1 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.1_1 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.2 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.2_1 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.3 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.3_1 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.4 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__shadow_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.4_1 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.44__multipart_key1.2~yE7VFJ761NU9ZTiMqqdZ0WlpOgaS-xw.5 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10725725783345314677', time=2024-09-12T02:38:12.979386+0000, chain.objs.size()=19 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.1 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.1_1 2024-09-12T00:38:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.697+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.2 2024-09-12T00:38:23.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.2_1 2024-09-12T00:38:23.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.3 2024-09-12T00:38:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.3_1 2024-09-12T00:38:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.4 2024-09-12T00:38:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.4_1 2024-09-12T00:38:23.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.5 2024-09-12T00:38:23.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.5_1 2024-09-12T00:38:23.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.6 2024-09-12T00:38:23.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.701+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.6_1 2024-09-12T00:38:23.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.705+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.7 2024-09-12T00:38:23.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.705+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.7_1 2024-09-12T00:38:23.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.705+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.8 2024-09-12T00:38:23.701 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.705+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.8_1 2024-09-12T00:38:23.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.705+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.9 2024-09-12T00:38:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.709+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.9_1 2024-09-12T00:38:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.709+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~pG0Mnrg6iFFCoQmqTPRjm34p4cKlcVW.10 2024-09-12T00:38:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.713+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.717+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.717+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.717+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.717+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.717+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.721+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.721+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.721+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.718 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.721+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:23.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.721+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13783276046876141385', time=2024-09-12T02:37:59.068095+0000, chain.objs.size()=7 2024-09-12T00:38:23.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~cFFEwBaXS1r1-6WE0xzD-nkzj3VUr09.1 2024-09-12T00:38:23.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~cFFEwBaXS1r1-6WE0xzD-nkzj3VUr09.1_1 2024-09-12T00:38:23.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~cFFEwBaXS1r1-6WE0xzD-nkzj3VUr09.1_2 2024-09-12T00:38:23.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~cFFEwBaXS1r1-6WE0xzD-nkzj3VUr09.2 2024-09-12T00:38:23.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~cFFEwBaXS1r1-6WE0xzD-nkzj3VUr09.2_1 2024-09-12T00:38:23.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~cFFEwBaXS1r1-6WE0xzD-nkzj3VUr09.2_2 2024-09-12T00:38:23.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.725+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~cFFEwBaXS1r1-6WE0xzD-nkzj3VUr09.3 2024-09-12T00:38:23.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.729+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.729+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:23.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI', time=2024-09-12T02:37:50.129183+0000, chain.objs.size()=9 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__multipart_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.1 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__shadow_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.1_1 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__multipart_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.2 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__shadow_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.2_1 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__multipart_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.3 2024-09-12T00:38:23.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__shadow_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.3_1 2024-09-12T00:38:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__multipart_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.4 2024-09-12T00:38:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__shadow_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.4_1 2024-09-12T00:38:23.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.733+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.40__multipart_key1.2~nOE9-Ol5i3wxK3oHr8_M3_giaGXCKbI.5 2024-09-12T00:38:23.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.737+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:38:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13676330500687682062', time=2024-09-12T02:37:58.292939+0000, chain.objs.size()=9 2024-09-12T00:38:23.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.1 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.1_1 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.2 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.2_1 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.3 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.3_1 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.4 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.4_1 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~ePViRMz07r5hO39YZhbE11T8KorZQ73.5 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.186508432211559961', time=2024-09-12T02:38:15.376958+0000, chain.objs.size()=16 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.1 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.1_1 2024-09-12T00:38:23.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.741+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.1_2 2024-09-12T00:38:23.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.745+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.2 2024-09-12T00:38:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.745+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.2_1 2024-09-12T00:38:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.745+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.2_2 2024-09-12T00:38:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.745+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.3 2024-09-12T00:38:23.744 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.745+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.3_1 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.749+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.3_2 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.749+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.4 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.749+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.4_1 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.749+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.4_2 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.749+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.5 2024-09-12T00:38:23.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.749+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.5_1 2024-09-12T00:38:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.753+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.5_2 2024-09-12T00:38:23.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.753+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~FoGg8D3Q2aOQFk6wULrxvHgJVVD6UKm.6 2024-09-12T00:38:23.753 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.757+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.756 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.757+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:23.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10301850449528351990', time=2024-09-12T02:37:55.664158+0000, chain.objs.size()=9 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.1 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.1_1 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.2 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.2_1 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.3 2024-09-12T00:38:23.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.3_1 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.4 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.4_1 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~IwFZWAE4C7AOjDPXzgBDK85yh-70Abo.5 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13304828987746815631', time=2024-09-12T02:38:15.537462+0000, chain.objs.size()=16 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.1 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.1_1 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.761+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.1_2 2024-09-12T00:38:23.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.765+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.2 2024-09-12T00:38:23.761 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.765+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.2_1 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.765+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.2_2 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.765+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.3 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.765+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.3_1 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.765+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.3_2 2024-09-12T00:38:23.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.765+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.4 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.769+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.4_1 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.769+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.4_2 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.769+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.5 2024-09-12T00:38:23.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.769+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.5_1 2024-09-12T00:38:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.769+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.5_2 2024-09-12T00:38:23.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.769+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~1r1cBCuIcn03pxmzco21Tv3ucVf8jER.6 2024-09-12T00:38:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.777+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.777+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:23.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.781+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.781+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.781+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.781+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:23.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.781+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.781+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.785+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.785+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:23.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.785+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.785+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.785+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8253529431469077279', time=2024-09-12T02:37:59.797609+0000, chain.objs.size()=7 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~5dB4icI2vawrdchD_uWWkGEqF0hd_On.1 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~5dB4icI2vawrdchD_uWWkGEqF0hd_On.1_1 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~5dB4icI2vawrdchD_uWWkGEqF0hd_On.1_2 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~5dB4icI2vawrdchD_uWWkGEqF0hd_On.2 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~5dB4icI2vawrdchD_uWWkGEqF0hd_On.2_1 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~5dB4icI2vawrdchD_uWWkGEqF0hd_On.2_2 2024-09-12T00:38:23.787 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.789+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~5dB4icI2vawrdchD_uWWkGEqF0hd_On.3 2024-09-12T00:38:23.791 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.793+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:23.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17641398394556015032', time=2024-09-12T02:38:10.076302+0000, chain.objs.size()=21 2024-09-12T00:38:23.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.1 2024-09-12T00:38:23.796 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.1_1 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.2 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.2_1 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.3 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.3_1 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.4 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.4_1 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.5 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.5_1 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.6 2024-09-12T00:38:23.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.797+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.6_1 2024-09-12T00:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.801+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.7 2024-09-12T00:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.801+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.7_1 2024-09-12T00:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.801+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.8 2024-09-12T00:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.801+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.8_1 2024-09-12T00:38:23.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.805+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.9 2024-09-12T00:38:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.805+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.9_1 2024-09-12T00:38:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.805+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.10 2024-09-12T00:38:23.801 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.805+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__shadow_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.10_1 2024-09-12T00:38:23.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.805+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.55__multipart_key1.2~gDE5C8iuzUsVrC_F74p3tKWegdvPKXv.11 2024-09-12T00:38:23.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.809+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:23.810 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.811 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10848192225848738208', time=2024-09-12T02:38:04.552119+0000, chain.objs.size()=9 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__multipart_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.1 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__shadow_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.1_1 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__multipart_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.2 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__shadow_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.2_1 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__multipart_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.3 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__shadow_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.3_1 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__multipart_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.4 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__shadow_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.4_1 2024-09-12T00:38:23.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.813+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.52__multipart_key1.2~xeITSKIsAn84dXgkK4hFihMdq7Od-Yq.5 2024-09-12T00:38:23.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.821+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:23.822 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.823 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:38:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1227710377399509463', time=2024-09-12T02:37:51.483899+0000, chain.objs.size()=9 2024-09-12T00:38:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__multipart_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.1 2024-09-12T00:38:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__shadow_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.1_1 2024-09-12T00:38:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__multipart_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.2 2024-09-12T00:38:23.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__shadow_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.2_1 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__multipart_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.3 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__shadow_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.3_1 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__multipart_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.4 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__shadow_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.4_1 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.42__multipart_key1.2~e2IkGyEoUIp-3jYomTzuueXOFXOwzxj.5 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1832031704551317060', time=2024-09-12T02:38:00.144682+0000, chain.objs.size()=5 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.46__shadow_.L1TLDmtBXKpyGpaTxdLuB3PX4hACUkh_1 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.46__shadow_.L1TLDmtBXKpyGpaTxdLuB3PX4hACUkh_2 2024-09-12T00:38:23.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.825+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.46__shadow_.L1TLDmtBXKpyGpaTxdLuB3PX4hACUkh_3 2024-09-12T00:38:23.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.833+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.46__shadow_.L1TLDmtBXKpyGpaTxdLuB3PX4hACUkh_4 2024-09-12T00:38:23.830 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.833+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.46__shadow_.L1TLDmtBXKpyGpaTxdLuB3PX4hACUkh_5 2024-09-12T00:38:23.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.837+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.837+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.841+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.841+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.838 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.841+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.841+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:23.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.841+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11752894828839749536', time=2024-09-12T02:37:59.966001+0000, chain.objs.size()=7 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~dSOQPYN_COw26B4uaWeqqzxMqidN2YU.1 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~dSOQPYN_COw26B4uaWeqqzxMqidN2YU.1_1 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~dSOQPYN_COw26B4uaWeqqzxMqidN2YU.1_2 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~dSOQPYN_COw26B4uaWeqqzxMqidN2YU.2 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~dSOQPYN_COw26B4uaWeqqzxMqidN2YU.2_1 2024-09-12T00:38:23.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__shadow_key1.2~dSOQPYN_COw26B4uaWeqqzxMqidN2YU.2_2 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.47__multipart_key1.2~dSOQPYN_COw26B4uaWeqqzxMqidN2YU.3 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~54xPxIRRE-17yhPnZRKkdlPvBeldw_2', time=2024-09-12T02:38:06.729685+0000, chain.objs.size()=5 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.54__multipart_key1.2~54xPxIRRE-17yhPnZRKkdlPvBeldw_2.7 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.54__shadow_key1.2~54xPxIRRE-17yhPnZRKkdlPvBeldw_2.7_1 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.54__multipart_key1.2~54xPxIRRE-17yhPnZRKkdlPvBeldw_2.10 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.54__shadow_key1.2~54xPxIRRE-17yhPnZRKkdlPvBeldw_2.10_1 2024-09-12T00:38:23.843 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.845+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.54__multipart_key1.2~54xPxIRRE-17yhPnZRKkdlPvBeldw_2.13 2024-09-12T00:38:23.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.849+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.853+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:23.851 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.853+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.853+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.852 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.857+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.857+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:23.855 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.857+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.857+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.857+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.861+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:23.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.861+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.861+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.861+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17836547451608291354', time=2024-09-12T02:38:05.431610+0000, chain.objs.size()=9 2024-09-12T00:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.1 2024-09-12T00:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.1_1 2024-09-12T00:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.2 2024-09-12T00:38:23.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.2_1 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.3 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.3_1 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.4 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__shadow_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.4_1 2024-09-12T00:38:23.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.865+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.53__multipart_file2.mpg.2~IQEJsLcJEb_fCrf3Wqz7BW3fmBDyn5p.5 2024-09-12T00:38:23.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.869+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1987567938180112170', time=2024-09-12T02:38:18.501849+0000, chain.objs.size()=9 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__multipart_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.1 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__shadow_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.1_1 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__multipart_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.2 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__shadow_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.2_1 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__multipart_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.3 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__shadow_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.3_1 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__multipart_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.4 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__shadow_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.4_1 2024-09-12T00:38:23.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.873+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.57__multipart_key1.2~-qbs-7hVjfguW6ZFQfRjr2wU1uiKOe8.5 2024-09-12T00:38:23.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.881+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.881+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:23.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.885+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.885+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.885+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.885+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:23.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.889+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.889+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.889+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.889+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.889+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.888 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.889+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.891 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:38:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12702078720386495992', time=2024-09-12T02:38:17.315348+0000, chain.objs.size()=9 2024-09-12T00:38:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__multipart_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.1 2024-09-12T00:38:23.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__shadow_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.1_1 2024-09-12T00:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__multipart_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.2 2024-09-12T00:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__shadow_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.2_1 2024-09-12T00:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__multipart_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.3 2024-09-12T00:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__shadow_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.3_1 2024-09-12T00:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__multipart_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.4 2024-09-12T00:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__shadow_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.4_1 2024-09-12T00:38:23.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.893+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.56__multipart_key1.2~2qpcktOS7jFsZa13XhC96wD1lYkYr33.5 2024-09-12T00:38:23.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.897+0000 7f9efe27c9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:38:23.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.901+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.905+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.905+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:23.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.905+0000 7f9efe27c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:23.904 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.905+0000 7f9db1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:23.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.909+0000 7f9efe27c9c0 20 remove_watcher() i=0 2024-09-12T00:38:23.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.909+0000 7f9efe27c9c0 2 removed watcher, disabling cache 2024-09-12T00:38:23.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.909+0000 7f9efe27c9c0 20 remove_watcher() i=1 2024-09-12T00:38:23.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.913+0000 7f9efe27c9c0 20 remove_watcher() i=2 2024-09-12T00:38:23.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.913+0000 7f9efe27c9c0 20 remove_watcher() i=3 2024-09-12T00:38:23.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.913+0000 7f9efe27c9c0 20 remove_watcher() i=4 2024-09-12T00:38:23.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.917+0000 7f9efe27c9c0 20 remove_watcher() i=5 2024-09-12T00:38:23.914 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.917+0000 7f9efe27c9c0 20 remove_watcher() i=6 2024-09-12T00:38:23.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:23.917+0000 7f9efe27c9c0 20 remove_watcher() i=7 2024-09-12T00:38:23.927 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:23.999 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:23.999 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:24.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.045+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 realm 2024-09-12T00:38:24.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:24.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:24.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.049+0000 7f03651209c0 20 searching for the correct realm 2024-09-12T00:38:24.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.057+0000 7f0363427640 0 -- 172.21.15.78:0/665143858 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f0358008050 msgr2=0x7f0358067600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:24.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.269+0000 7f0363427640 0 -- 172.21.15.78:0/665143858 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x560102c769d0 msgr2=0x560102c78e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:24.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.281+0000 7f03651209c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:24.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.281+0000 7f03651209c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:24.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.281+0000 7f03651209c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:24.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.281+0000 7f03651209c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:24.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.281+0000 7f03651209c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:24.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.281+0000 7f03651209c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:24.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.281+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:24.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 zone default found 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 4 Realm: () 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 zonegroup default 2024-09-12T00:38:24.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.285+0000 7f03651209c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.289+0000 7f03651209c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.289+0000 7f03651209c0 20 started sync module instance, tier type = 2024-09-12T00:38:24.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.289+0000 7f03651209c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=0 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=1 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=2 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=3 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=4 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=5 2024-09-12T00:38:24.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=6 2024-09-12T00:38:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 20 add_watcher() i=7 2024-09-12T00:38:24.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.313+0000 7f03651209c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:24.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.317+0000 7f02197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.317+0000 7f03651209c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:24.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.317+0000 7f03651209c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:24.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.413+0000 7f0193fff640 20 reqs_thread_entry: start 2024-09-12T00:38:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.413+0000 7f03651209c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.413+0000 7f03651209c0 20 Filter name: none 2024-09-12T00:38:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.417+0000 7f0191ffb640 20 reqs_thread_entry: start 2024-09-12T00:38:24.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.417+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:24.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.417+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.421+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.421+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.421+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:24.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.429+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.429+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.427 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.429+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.433+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:24.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.437+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.437+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.437+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.438 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.441+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:24.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.445+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.445+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.445+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.449+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:24.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.449+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.448 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.449+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.453+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.453+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:24.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.457+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.457+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.457+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.461+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:24.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.465+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.465+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.465+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.469+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:24.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.473+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.473+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.473+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.477+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:24.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.481+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.481+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.481+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.485+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:24.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.489+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.493+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.493+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.497+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:24.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.497+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.497+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.501+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.501+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:24.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.505+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.505+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.505+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.509+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:24.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.513+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.513+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.513+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.513 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.517+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:24.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.517+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.521+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.521+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.522 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.525+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:24.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.529+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.529+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.529+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.533+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:24.534 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.537+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.537+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.537+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.541+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.545+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.545+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.549+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.553+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:24.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.553+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.557+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.557+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.561+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:24.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.565+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.563 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.565+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.565+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.569+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:24.570 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.573+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.573+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.573+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.577+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:24.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.581+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.580 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.581+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.585+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.585+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:24.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.589+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.589 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.593+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.591 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.593+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.597+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:24.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.597+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.601+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.601+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.605+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:24.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.609+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.609+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.609+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.613+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:24.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.617+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.617+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.617+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.617 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.621+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:24.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.621+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.625+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.625+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.625+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:24.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.629+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.633+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.633+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.637+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:24.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.637+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.641+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.641+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.645+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.649+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.649+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.649+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.653+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:24.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.657+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.655 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.657+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.657+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.661+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:24.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.665+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.665+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.669+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.669+0000 7f03651209c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:24.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.673+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.673+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:24.671 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.673+0000 7f03651209c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:24.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.677+0000 7f02197e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.681+0000 7f03651209c0 20 remove_watcher() i=0 2024-09-12T00:38:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.681+0000 7f03651209c0 2 removed watcher, disabling cache 2024-09-12T00:38:24.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.685+0000 7f03651209c0 20 remove_watcher() i=1 2024-09-12T00:38:24.685 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.689+0000 7f03651209c0 20 remove_watcher() i=2 2024-09-12T00:38:24.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.689+0000 7f03651209c0 20 remove_watcher() i=3 2024-09-12T00:38:24.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.693+0000 7f03651209c0 20 remove_watcher() i=4 2024-09-12T00:38:24.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.693+0000 7f03651209c0 20 remove_watcher() i=5 2024-09-12T00:38:24.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.697+0000 7f03651209c0 20 remove_watcher() i=6 2024-09-12T00:38:24.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.701+0000 7f03651209c0 20 remove_watcher() i=7 2024-09-12T00:38:24.718 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:24.791 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:24.792 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:24.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 realm 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:24.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.841+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.845+0000 7fb3981599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.845+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.845+0000 7fb3981599c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:24.842 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.845+0000 7fb3981599c0 20 searching for the correct realm 2024-09-12T00:38:24.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:24.849+0000 7fb396460640 0 -- 172.21.15.78:0/871860420 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fb38803e410 msgr2=0x7fb38803e890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:25.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.061+0000 7fb395c5f640 0 -- 172.21.15.78:0/871860420 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x559df69208a0 msgr2=0x559df6922cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.073+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:25.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 zone default found 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 4 Realm: () 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 zonegroup default 2024-09-12T00:38:25.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 started sync module instance, tier type = 2024-09-12T00:38:25.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.077+0000 7fb3981599c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.101+0000 7fb3981599c0 20 add_watcher() i=0 2024-09-12T00:38:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.101+0000 7fb3981599c0 20 add_watcher() i=1 2024-09-12T00:38:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.101+0000 7fb3981599c0 20 add_watcher() i=2 2024-09-12T00:38:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.101+0000 7fb3981599c0 20 add_watcher() i=3 2024-09-12T00:38:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.101+0000 7fb3981599c0 20 add_watcher() i=4 2024-09-12T00:38:25.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.101+0000 7fb3981599c0 20 add_watcher() i=5 2024-09-12T00:38:25.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.101+0000 7fb3981599c0 20 add_watcher() i=6 2024-09-12T00:38:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.105+0000 7fb3981599c0 20 add_watcher() i=7 2024-09-12T00:38:25.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.105+0000 7fb3981599c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:25.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.109+0000 7fb2477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:25.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.109+0000 7fb3981599c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:25.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.109+0000 7fb3981599c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:25.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.197+0000 7fb2467fc640 20 reqs_thread_entry: start 2024-09-12T00:38:25.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.197+0000 7fb3981599c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:25.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.197+0000 7fb3981599c0 20 Filter name: none 2024-09-12T00:38:25.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.197+0000 7fb1b7fff640 20 reqs_thread_entry: start 2024-09-12T00:38:25.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.197+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:25.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.201+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.201+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.201+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.201+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:25.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.209+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.209+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.209+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.210 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.213+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:25.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.217+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.217+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.217+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.221+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:25.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.225+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.223 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.225+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.225+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.229+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:25.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.233+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.233+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.233+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.237+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:25.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.237+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.241+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.241+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.245+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:25.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.249+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.249+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.249+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.249+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:25.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.253+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.257+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.257+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.261+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:25.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.261+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.265+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.265+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.265+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:25.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.269+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.273+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.269 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.273+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.273+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:25.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.277+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.277+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.277+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.281+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:25.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.285+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.285+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.285+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.289+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:25.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.293+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.293+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.293+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.297+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:25.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.301+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.301+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.305+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.305+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:25.309 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.313+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.313+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.313+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.317+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:25.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.321+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.321+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.325+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.325+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:25.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.329+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.329+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.333+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.333+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:25.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.337+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.341+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.341+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.340 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.345+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:25.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.345+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.349+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.349+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.353+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:25.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.357+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.357+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.361+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.361+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:25.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.365+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.369+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.369+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.373+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:25.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.377+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.377+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.377+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.381+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:25.381 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.385+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.385+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.385+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.389+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:25.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.393+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.393+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.391 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.393+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.394 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.397+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:25.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.401+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.401+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.401+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.405+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:25.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.409+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.409+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.408 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.409+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.413+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:25.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.417+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.417+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.421+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.421+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:25.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.425+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.429+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.429+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.429+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:25.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.433+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.437+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.437+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.441+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:25.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.445+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.445+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.445+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.449+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:25.449 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.453+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.453+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.452 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.453+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.457+0000 7fb3981599c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:25.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.461+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.461+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.460 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.465+0000 7fb3981599c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.469+0000 7fb2477fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:25.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.473+0000 7fb3981599c0 20 remove_watcher() i=0 2024-09-12T00:38:25.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.473+0000 7fb3981599c0 2 removed watcher, disabling cache 2024-09-12T00:38:25.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.473+0000 7fb3981599c0 20 remove_watcher() i=1 2024-09-12T00:38:25.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.477+0000 7fb3981599c0 20 remove_watcher() i=2 2024-09-12T00:38:25.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.481+0000 7fb3981599c0 20 remove_watcher() i=3 2024-09-12T00:38:25.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.481+0000 7fb3981599c0 20 remove_watcher() i=4 2024-09-12T00:38:25.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.485+0000 7fb3981599c0 20 remove_watcher() i=5 2024-09-12T00:38:25.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.485+0000 7fb3981599c0 20 remove_watcher() i=6 2024-09-12T00:38:25.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.489+0000 7fb3981599c0 20 remove_watcher() i=7 2024-09-12T00:38:25.506 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:25.580 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:25.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.629+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.629+0000 7f66b0a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.629+0000 7f66b0a0d9c0 20 realm 2024-09-12T00:38:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.629+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.629+0000 7f66b0a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.629+0000 7f66b0a0d9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.629+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.633+0000 7f66b0a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.633+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.633+0000 7f66b0a0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:25.629 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.633+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.633+0000 7f66b0a0d9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:25.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.633+0000 7f66b0a0d9c0 20 searching for the correct realm 2024-09-12T00:38:25.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.637+0000 7f66aed14640 0 -- 172.21.15.78:0/1055269385 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x55fbdbff1fb0 msgr2=0x55fbdbff43a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:25.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.645+0000 7f66add12640 0 -- 172.21.15.78:0/1055269385 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f66a8079bc0 msgr2=0x7f66a80627c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:25.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:25.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:25.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:25.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:25.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:25.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:25.864 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:25.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 zone default found 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 4 Realm: () 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 zonegroup default 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.865+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.869+0000 7f66b0a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.869+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.869+0000 7f66b0a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.869+0000 7f66b0a0d9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:25.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.869+0000 7f66b0a0d9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:25.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.869+0000 7f66b0a0d9c0 20 started sync module instance, tier type = 2024-09-12T00:38:25.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.869+0000 7f66b0a0d9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=0 2024-09-12T00:38:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=1 2024-09-12T00:38:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=2 2024-09-12T00:38:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=3 2024-09-12T00:38:25.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=4 2024-09-12T00:38:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=5 2024-09-12T00:38:25.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=6 2024-09-12T00:38:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 20 add_watcher() i=7 2024-09-12T00:38:25.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.893+0000 7f66b0a0d9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:25.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.897+0000 7f6564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.897+0000 7f66b0a0d9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:25.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.897+0000 7f66b0a0d9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:25.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.989+0000 7f64df7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:25.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.989+0000 7f66b0a0d9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:25.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.989+0000 7f66b0a0d9c0 20 Filter name: none 2024-09-12T00:38:25.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.989+0000 7f64dd7fa640 20 reqs_thread_entry: start 2024-09-12T00:38:25.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.989+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:25.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.993+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.993+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:25.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.993+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:25.997+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:25.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.001+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:25.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.001+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.005+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.005+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:26.006 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.009+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.009+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.009+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.013+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:26.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.013+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.013+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.013+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.017+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.021+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.019 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.021+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.021+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.022 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.025+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:26.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.029+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.029+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.025 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.029+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.029+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:26.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.033+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.037+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.037+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.037+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:26.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.041+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.045+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.045+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.045+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:26.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.049+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.049+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.049+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.053+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.053+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.057+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.057+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.057+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:26.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.061+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.061+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.061+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.065+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:26.064 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.065+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.069+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.069+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.069+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:26.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.073+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.073+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.077+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.077+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:26.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.081+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.085+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.085+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.089+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:26.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.089+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.089+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.093+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.093+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:26.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.097+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.097+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.097+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.101+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:26.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.105+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.105+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.105+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.109+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:26.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.113+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.113+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.113+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.117+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:26.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.117+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.117+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.121+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.125+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:26.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.125+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.129+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.129+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.133+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:26.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.137+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.133 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.137+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.134 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.137+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.137+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:26.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.141+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.145+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.145+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.153+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.153+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.153+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.157+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.157+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:26.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.161+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.161+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.161+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.165+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:26.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.165+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.169+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.165 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.169+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.169+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:26.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.177+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.177+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.181+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.181+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:26.182 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.185+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.185+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.185+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.189+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:26.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.193+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.191 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.193+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.193+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.197+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:26.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.201+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.201+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.205+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.205+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:26.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.209+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.209+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.213+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.213+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.217+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.217+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.217+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.217+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:26.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.221+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.225+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:26.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.225+0000 7f66b0a0d9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:26.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.229+0000 7f6564fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:26.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.233+0000 7f66b0a0d9c0 20 remove_watcher() i=0 2024-09-12T00:38:26.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.233+0000 7f66b0a0d9c0 2 removed watcher, disabling cache 2024-09-12T00:38:26.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.237+0000 7f66b0a0d9c0 20 remove_watcher() i=1 2024-09-12T00:38:26.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.237+0000 7f66b0a0d9c0 20 remove_watcher() i=2 2024-09-12T00:38:26.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.241+0000 7f66b0a0d9c0 20 remove_watcher() i=3 2024-09-12T00:38:26.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.241+0000 7f66b0a0d9c0 20 remove_watcher() i=4 2024-09-12T00:38:26.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.245+0000 7f66b0a0d9c0 20 remove_watcher() i=5 2024-09-12T00:38:26.243 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.245+0000 7f66b0a0d9c0 20 remove_watcher() i=6 2024-09-12T00:38:26.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:26.249+0000 7f66b0a0d9c0 20 remove_watcher() i=7 2024-09-12T00:38:26.264 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests BucketTest 2024-09-12T00:38:26.941 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :clean 2024-09-12T00:38:27.639 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileJava 2024-09-12T00:38:27.639 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processResources 2024-09-12T00:38:27.639 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :classes 2024-09-12T00:38:28.240 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:28.240 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileTestJava 2024-09-12T00:38:28.240 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:28.240 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:38:28.240 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :testClasses 2024-09-12T00:38:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:38:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:38:30.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.239 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :test 2024-09-12T00:38:30.239 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests STANDARD_OUT 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12 00:38:29,627 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty STARTED 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectEmpty PASSED 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.241 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch STARTED 2024-09-12T00:38:30.242 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.242 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectMismatch PASSED 2024-09-12T00:38:30.339 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.339 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable STARTED 2024-09-12T00:38:30.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.439 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateBadExpectUnreadable PASSED 2024-09-12T00:38:30.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.639 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete STARTED 2024-09-12T00:38:30.839 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.839 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketCreateReadDelete PASSED 2024-09-12T00:38:30.939 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:30.939 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty STARTED 2024-09-12T00:38:31.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:31.039 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNonEmpty PASSED 2024-09-12T00:38:31.339 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:31.339 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist STARTED 2024-09-12T00:38:31.340 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:31.340 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketDeleteNotExist PASSED 2024-09-12T00:38:31.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:31.439 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct STARTED 2024-09-12T00:38:31.639 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:31.639 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListDistinct PASSED 2024-09-12T00:38:32.039 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:32.039 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty STARTED 2024-09-12T00:38:32.139 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:32.139 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketListEmpty PASSED 2024-09-12T00:38:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:32.439 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketNotExist STARTED 2024-09-12T00:38:32.439 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:32.439 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Bucket tests > BucketTest.testBucketNotExist PASSED 2024-09-12T00:38:32.584 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:32.584 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------- 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:| Results: SUCCESS (9 tests, 9 successes, 0 failures, 0 skipped) | 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:-------------------------------------------------------------------- 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:BUILD SUCCESSFUL in 6s 2024-09-12T00:38:32.585 INFO:teuthology.orchestra.run.smithi078.stdout:5 actionable tasks: 5 executed 2024-09-12T00:38:32.593 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:32.622 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:32.622 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:32.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.669+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.669+0000 7f893cb899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.669+0000 7f893cb899c0 20 realm 2024-09-12T00:38:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.669+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.668 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.669+0000 7f893cb899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.669+0000 7f893cb899c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:32.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.669+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.673+0000 7f893cb899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.673+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.673+0000 7f893cb899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.673+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.673+0000 7f893cb899c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:32.670 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.673+0000 7f893cb899c0 20 searching for the correct realm 2024-09-12T00:38:32.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.677+0000 7f893a68f640 0 -- 172.21.15.78:0/1342396588 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55e381805f50 msgr2=0x55e381808410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.681+0000 7f8939e8e640 0 -- 172.21.15.78:0/1342396588 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f892c0ff910 msgr2=0x7f892c118690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:32.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:32.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:32.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:32.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:32.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:32.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:32.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:32.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 zone default found 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 4 Realm: () 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 zonegroup default 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.901+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.905+0000 7f893cb899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.901 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.905+0000 7f893cb899c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:32.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.905+0000 7f893cb899c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:32.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.905+0000 7f893cb899c0 20 started sync module instance, tier type = 2024-09-12T00:38:32.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.905+0000 7f893cb899c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:32.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=0 2024-09-12T00:38:32.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=1 2024-09-12T00:38:32.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=2 2024-09-12T00:38:32.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=3 2024-09-12T00:38:32.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=4 2024-09-12T00:38:32.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=5 2024-09-12T00:38:32.925 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=6 2024-09-12T00:38:32.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 20 add_watcher() i=7 2024-09-12T00:38:32.927 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.929+0000 7f893cb899c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:32.931 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.933+0000 7f87f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.937+0000 7f893cb899c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:32.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:32.937+0000 7f893cb899c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.029+0000 7f876b7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.029+0000 7f893cb899c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.029+0000 7f893cb899c0 20 Filter name: none 2024-09-12T00:38:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.029+0000 7f87697fa640 20 reqs_thread_entry: start 2024-09-12T00:38:33.028 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.029+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:33.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.033+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.033+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.031 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.033+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.033 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.037+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:33.037 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.041+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.041+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.041+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.045+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:33.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.045+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.049+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.049+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.049+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:33.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.053+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.053+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.057+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.057+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:33.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.061+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.065+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.065+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.069+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:33.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.073+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.073+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.073+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.077+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:33.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.077+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.081+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.081+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.085+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:33.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.089+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.089+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.089+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.093+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:33.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.097+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.097+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.097+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.101+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:33.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.105+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.105+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.105+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.109+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.113+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.113+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.113+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.117+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:33.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.121+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.121+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.121+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.125+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:33.127 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.129+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.129+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.133+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.133+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:33.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.137+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.137+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.141+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.141+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:33.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.145+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.145+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.145+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.146 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.149+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:33.149 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.153+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.153+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.153+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.157+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:33.158 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.161+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.161+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.165+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.164 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.165+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:33.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.169+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.168 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.169+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.173+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.173+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:33.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.177+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.176 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.177+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.181+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.181+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:33.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.185+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.184 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.189+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.185 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.189+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.189+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:33.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.193+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.197+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.197+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.201+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:33.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.205+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.205+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.205+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.209+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:33.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.213+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.213+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.217+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.217+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:33.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.221+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.225+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.225+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.225+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:33.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.229+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.233+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.233+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.237+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:33.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.241+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.241+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.245+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.245+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:33.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.249+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.253+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.253+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.253+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:33.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.257+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.261+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.261+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.262 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.265+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:33.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.269+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.269+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.269+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.273+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:33.275 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.277+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.281+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.278 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.281+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.285+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:33.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.289+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.289+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.293+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.292 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.297+0000 7f893cb899c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:33.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.297+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.301+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:33.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.301+0000 7f893cb899c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:33.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.305+0000 7f87f0fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:33.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.309+0000 7f893cb899c0 20 remove_watcher() i=0 2024-09-12T00:38:33.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.309+0000 7f893cb899c0 2 removed watcher, disabling cache 2024-09-12T00:38:33.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.313+0000 7f893cb899c0 20 remove_watcher() i=1 2024-09-12T00:38:33.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.317+0000 7f893cb899c0 20 remove_watcher() i=2 2024-09-12T00:38:33.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.317+0000 7f893cb899c0 20 remove_watcher() i=3 2024-09-12T00:38:33.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.321+0000 7f893cb899c0 20 remove_watcher() i=4 2024-09-12T00:38:33.320 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.321+0000 7f893cb899c0 20 remove_watcher() i=5 2024-09-12T00:38:33.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.325+0000 7f893cb899c0 20 remove_watcher() i=6 2024-09-12T00:38:33.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.329+0000 7f893cb899c0 20 remove_watcher() i=7 2024-09-12T00:38:33.346 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:33.419 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:33.419 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:33.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:33.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 realm 2024-09-12T00:38:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.677+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.681+0000 7fa29562e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.681+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.681+0000 7fa29562e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.681+0000 7fa29562e9c0 20 searching for the correct realm 2024-09-12T00:38:33.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.685+0000 7fa292933640 0 -- 172.21.15.78:0/1019332142 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x55faab841d00 msgr2=0x55faab844130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:33.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.689+0000 7fa293134640 0 -- 172.21.15.78:0/1019332142 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fa27c0cf040 msgr2=0x7fa27c0b63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 zone default found 2024-09-12T00:38:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 4 Realm: () 2024-09-12T00:38:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:33.907 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 zonegroup default 2024-09-12T00:38:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.909+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.913+0000 7fa29562e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:33.909 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.913+0000 7fa29562e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:33.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.913+0000 7fa29562e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:33.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.913+0000 7fa29562e9c0 20 started sync module instance, tier type = 2024-09-12T00:38:33.910 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.913+0000 7fa29562e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:33.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=0 2024-09-12T00:38:33.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=1 2024-09-12T00:38:33.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=2 2024-09-12T00:38:33.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=3 2024-09-12T00:38:33.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=4 2024-09-12T00:38:33.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=5 2024-09-12T00:38:33.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=6 2024-09-12T00:38:33.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 20 add_watcher() i=7 2024-09-12T00:38:33.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.937+0000 7fa29562e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:33.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.941+0000 7fa149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:33.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.945+0000 7fa29562e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:33.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:33.945+0000 7fa29562e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:34.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.045+0000 7fa148fe1640 20 reqs_thread_entry: start 2024-09-12T00:38:34.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.045+0000 7fa29562e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:34.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.045+0000 7fa29562e9c0 20 Filter name: none 2024-09-12T00:38:34.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.045+0000 7fa0c27fc640 20 reqs_thread_entry: start 2024-09-12T00:38:34.043 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.045+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:34.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.049+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.049+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.053+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.053+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:34.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.057+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.057+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.056 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.057+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.061+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:34.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.065+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.065+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.065+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.069+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:34.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.069+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.069+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.073+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.073+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:34.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.077+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.077+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.077+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.077+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.081+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.085+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.085+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.085+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:34.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.089+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.093+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.090 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.093+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.097+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:34.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.097+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.101+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.101+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.101+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:34.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.105+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.109+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.106 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.109+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.113+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:34.113 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.117+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.117+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.117+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.121+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:34.121 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.125+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.125+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.125+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.129+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:34.128 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.133+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.129 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.133+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.130 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.133+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.132 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.133+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:34.136 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.137+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.137 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.141+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.141+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.140 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.145+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:34.144 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.145+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.149+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.145 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.149+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.147 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.149+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:34.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.153+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.153+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.157+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.156 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.157+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:34.159 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.161+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.161+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.161 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.165+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.163 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.165+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:34.166 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.169+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.169+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.169+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.173+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:34.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.177+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.177+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.177+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.177 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.181+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:34.180 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.181+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.185+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.181 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.185+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.185+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:34.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.189+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.193+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.193+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.192 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.193+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:34.195 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.197+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.201+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.201+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.201+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:34.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.205+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.209+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.209+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.209+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:34.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.217+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.213 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.217+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.217+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.217+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:34.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.221+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.225+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.225+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.225+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:34.227 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.229+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.233+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.229 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.233+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.231 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.233+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:34.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.237+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.241+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.241+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.245+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:34.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.249+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.249+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.249+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.253+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:34.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.257+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.254 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.257+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.257+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.261+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:34.261 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.265+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.265+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.265+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.269+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:34.271 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.273+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.277+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.277+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.281+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:34.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.281+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.285+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.285+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.289+0000 7fa29562e9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:34.289 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.293+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.293+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.293+0000 7fa29562e9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.297+0000 7fa149fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:34.299 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.301+0000 7fa29562e9c0 20 remove_watcher() i=0 2024-09-12T00:38:34.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.301+0000 7fa29562e9c0 2 removed watcher, disabling cache 2024-09-12T00:38:34.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.305+0000 7fa29562e9c0 20 remove_watcher() i=1 2024-09-12T00:38:34.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.309+0000 7fa29562e9c0 20 remove_watcher() i=2 2024-09-12T00:38:34.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.309+0000 7fa29562e9c0 20 remove_watcher() i=3 2024-09-12T00:38:34.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.313+0000 7fa29562e9c0 20 remove_watcher() i=4 2024-09-12T00:38:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.317+0000 7fa29562e9c0 20 remove_watcher() i=5 2024-09-12T00:38:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.317+0000 7fa29562e9c0 20 remove_watcher() i=6 2024-09-12T00:38:34.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.321+0000 7fa29562e9c0 20 remove_watcher() i=7 2024-09-12T00:38:34.338 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:34.411 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:34.412 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:34.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.461+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 realm 2024-09-12T00:38:34.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:34.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:34.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.465+0000 7fc8ba79c9c0 20 searching for the correct realm 2024-09-12T00:38:34.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.469+0000 7fc8b8aa3640 0 -- 172.21.15.78:0/1175880127 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x55a6b9b06a20 msgr2=0x55a6b9b08e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:34.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.477+0000 7fc8afaa1640 0 -- 172.21.15.78:0/1175880127 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fc8a806e730 msgr2=0x7fc8a8063d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:38:34.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.693+0000 7fc8ba79c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:34.692 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.693+0000 7fc8ba79c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.693+0000 7fc8ba79c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.693+0000 7fc8ba79c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.693+0000 7fc8ba79c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.693+0000 7fc8ba79c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.693+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:34.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 zone default found 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 4 Realm: () 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 zonegroup default 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.697+0000 7fc8ba79c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:34.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.701+0000 7fc8ba79c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:34.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.701+0000 7fc8ba79c9c0 20 started sync module instance, tier type = 2024-09-12T00:38:34.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.701+0000 7fc8ba79c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.721+0000 7fc8ba79c9c0 20 add_watcher() i=0 2024-09-12T00:38:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.721+0000 7fc8ba79c9c0 20 add_watcher() i=1 2024-09-12T00:38:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.721+0000 7fc8ba79c9c0 20 add_watcher() i=2 2024-09-12T00:38:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.721+0000 7fc8ba79c9c0 20 add_watcher() i=3 2024-09-12T00:38:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.721+0000 7fc8ba79c9c0 20 add_watcher() i=4 2024-09-12T00:38:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.721+0000 7fc8ba79c9c0 20 add_watcher() i=5 2024-09-12T00:38:34.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.721+0000 7fc8ba79c9c0 20 add_watcher() i=6 2024-09-12T00:38:34.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.725+0000 7fc8ba79c9c0 20 add_watcher() i=7 2024-09-12T00:38:34.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.725+0000 7fc8ba79c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:34.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.733+0000 7fc76efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:34.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.733+0000 7fc8ba79c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:34.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.733+0000 7fc8ba79c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.825+0000 7fc76dfdb640 20 reqs_thread_entry: start 2024-09-12T00:38:34.825 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.829+0000 7fc8ba79c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.829+0000 7fc8ba79c9c0 20 Filter name: none 2024-09-12T00:38:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.829+0000 7fc6df7fe640 20 reqs_thread_entry: start 2024-09-12T00:38:34.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.829+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:34.829 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.833+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.833+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.833+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.837+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:34.839 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.841+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.845+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.841 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.845+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.845+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:34.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.849+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.849+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.849+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.850 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.853+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:34.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.857+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.857+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.854 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.857+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.861+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:34.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.861+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.865+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.863 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.865+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.869+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.869+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.869+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.873+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.873+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:34.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.877+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.877+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.881+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.881+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:34.882 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.885+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.885+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.889+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.886 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.889+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:34.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.893+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.893+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.893 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.893+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.893+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:34.896 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.897+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.901+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.901+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.902 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.905+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:34.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.909+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.909+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.909+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.909+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:34.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.913+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.917+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.915 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.917+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.918 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.921+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:34.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.925+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.925+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.924 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.925+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.929+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:34.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.933+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.933+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.937+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.937+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.941+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.941+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.939 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.941+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.945+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:34.945 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.949+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.949+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.948 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.949+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.950 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.953+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:34.953 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.957+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.954 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.957+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.955 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.957+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.961+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:34.961 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.965+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.963 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.965+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.965+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.969+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:34.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.973+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.977+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.975 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.977+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.981+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:34.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.985+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.982 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.985+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.985+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.989+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:34.989 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.993+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.993+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:34.991 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.993+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:34.997+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:34.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.001+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:34.999 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.001+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.001+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.003 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.005+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:35.007 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.009+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.009 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.013+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.010 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.013+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.017+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:35.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.017+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.021+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.021+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.020 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.025+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:35.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.029+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.026 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.029+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.027 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.029+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.030 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.033+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:35.034 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.037+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.035 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.037+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.036 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.037+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.038 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.041+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:35.042 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.045+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.044 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.045+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.045 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.049+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.049+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:35.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.053+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.057+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.057+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.061+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:35.060 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.065+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.065+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.065+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.065 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.069+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:35.068 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.073+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.073+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.073+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.077+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:35.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.081+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.081+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.081+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.085+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:35.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.089+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.089+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.089+0000 7fc8ba79c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.097+0000 7fc76efdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.101+0000 7fc8ba79c9c0 20 remove_watcher() i=0 2024-09-12T00:38:35.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.101+0000 7fc8ba79c9c0 2 removed watcher, disabling cache 2024-09-12T00:38:35.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.101+0000 7fc8ba79c9c0 20 remove_watcher() i=1 2024-09-12T00:38:35.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.105+0000 7fc8ba79c9c0 20 remove_watcher() i=2 2024-09-12T00:38:35.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.109+0000 7fc8ba79c9c0 20 remove_watcher() i=3 2024-09-12T00:38:35.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.109+0000 7fc8ba79c9c0 20 remove_watcher() i=4 2024-09-12T00:38:35.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.113+0000 7fc8ba79c9c0 20 remove_watcher() i=5 2024-09-12T00:38:35.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.113+0000 7fc8ba79c9c0 20 remove_watcher() i=6 2024-09-12T00:38:35.115 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.117+0000 7fc8ba79c9c0 20 remove_watcher() i=7 2024-09-12T00:38:35.133 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:38:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:38:35.207 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:38:35.255 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.257+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 realm 2024-09-12T00:38:35.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:38:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.258 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.259 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:38:35.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.261+0000 7f01f47009c0 20 searching for the correct realm 2024-09-12T00:38:35.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.269+0000 7f01f2a07640 0 -- 172.21.15.78:0/3027744424 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f01ec000ee0 msgr2=0x7f01ec07b790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:35.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.485+0000 7f01f2a07640 0 -- 172.21.15.78:0/3027744424 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x562b59aeb960 msgr2=0x562b59aede20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:38:35.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.493+0000 7f01f47009c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.493+0000 7f01f47009c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.493+0000 7f01f47009c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.493+0000 7f01f47009c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.493+0000 7f01f47009c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.493+0000 7f01f47009c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:38:35.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:38:35.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 zone default found 2024-09-12T00:38:35.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 4 Realm: () 2024-09-12T00:38:35.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 zonegroup default 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.497+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.501+0000 7f01f47009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.501+0000 7f01f47009c0 20 rados->read ofs=0 len=0 2024-09-12T00:38:35.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.501+0000 7f01f47009c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:38:35.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.501+0000 7f01f47009c0 20 started sync module instance, tier type = 2024-09-12T00:38:35.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.501+0000 7f01f47009c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:38:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.521+0000 7f01f47009c0 20 add_watcher() i=0 2024-09-12T00:38:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.521+0000 7f01f47009c0 20 add_watcher() i=1 2024-09-12T00:38:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.521+0000 7f01f47009c0 20 add_watcher() i=2 2024-09-12T00:38:35.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.521+0000 7f01f47009c0 20 add_watcher() i=3 2024-09-12T00:38:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.521+0000 7f01f47009c0 20 add_watcher() i=4 2024-09-12T00:38:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.521+0000 7f01f47009c0 20 add_watcher() i=5 2024-09-12T00:38:35.520 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.521+0000 7f01f47009c0 20 add_watcher() i=6 2024-09-12T00:38:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.525+0000 7f01f47009c0 20 add_watcher() i=7 2024-09-12T00:38:35.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.525+0000 7f01f47009c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:38:35.525 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.529+0000 7f00a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.529+0000 7f01f47009c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:38:35.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.529+0000 7f01f47009c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:38:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.617+0000 7f00237fe640 20 reqs_thread_entry: start 2024-09-12T00:38:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.617+0000 7f01f47009c0 20 init_complete bucket index max shards: 11 2024-09-12T00:38:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.617+0000 7f01f47009c0 20 Filter name: none 2024-09-12T00:38:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.617+0000 7f00217fa640 20 reqs_thread_entry: start 2024-09-12T00:38:35.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.617+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:38:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.621+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.621+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.618 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.621+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.625+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:38:35.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.625+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.625 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.629+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.629+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.628 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.633+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:38:35.631 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.633+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.633+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.637+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.634 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.637+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:38:35.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.641+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.637 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.641+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.641+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.641+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:38:35.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.645+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.643 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.645+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.645+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.649+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:38:35.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.653+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.653+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.653+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.654 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.657+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:38:35.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.661+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.661+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.658 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.661+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.665+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:38:35.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.665+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.669+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.669+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.673+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:38:35.673 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.677+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.677+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.677+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.681+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:38:35.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.681+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.685+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.685+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.685+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:38:35.687 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.689+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.689+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.693+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.693+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:38:35.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.697+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.701+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.701+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.700 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.705+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:38:35.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.705+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.709+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.709+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.713+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:38:35.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.713+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.717+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.717+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.717 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.721+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:38:35.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.721+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.725+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.725+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.725+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:38:35.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.729+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.729+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.729+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.733+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:38:35.731 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.733+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.737+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.734 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.737+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.736 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.737+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:38:35.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.741+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.741+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.745+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.743 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.745+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:38:35.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.749+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.748 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.749+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.753+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.753+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:38:35.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.757+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.761+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.761+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.760 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.761+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:38:35.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.765+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.765 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.769+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.769+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.773+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:38:35.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.773+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.773+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.777+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.774 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.777+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:38:35.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.781+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.785+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.785+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.784 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.789+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:38:35.788 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.789+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.789 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.793+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.790 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.793+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.797+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:38:35.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.801+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.801+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.800 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.801+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.805+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:38:35.806 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.809+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.808 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.809+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.809 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.813+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.812 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.813+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:38:35.815 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.817+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.816 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.817+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.817 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.821+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.820 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.821+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:38:35.824 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.825+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.829+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.827 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.829+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.833+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:38:35.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.837+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.841+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.841+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.841+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:38:35.845 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.849+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.849+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.849+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.853 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.857+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:38:35.857 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.861+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.858 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.861+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.859 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.861+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.865+0000 7f01f47009c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:38:35.865 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.869+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.869+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:38:35.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.869+0000 7f01f47009c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:38:35.873 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.877+0000 7f00a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:38:35.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.881+0000 7f01f47009c0 20 remove_watcher() i=0 2024-09-12T00:38:35.878 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.881+0000 7f01f47009c0 2 removed watcher, disabling cache 2024-09-12T00:38:35.881 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.885+0000 7f01f47009c0 20 remove_watcher() i=1 2024-09-12T00:38:35.884 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.885+0000 7f01f47009c0 20 remove_watcher() i=2 2024-09-12T00:38:35.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.889+0000 7f01f47009c0 20 remove_watcher() i=3 2024-09-12T00:38:35.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.893+0000 7f01f47009c0 20 remove_watcher() i=4 2024-09-12T00:38:35.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.897+0000 7f01f47009c0 20 remove_watcher() i=5 2024-09-12T00:38:35.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.897+0000 7f01f47009c0 20 remove_watcher() i=6 2024-09-12T00:38:35.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:38:35.901+0000 7f01f47009c0 20 remove_watcher() i=7 2024-09-12T00:38:35.921 DEBUG:teuthology.orchestra.run.smithi078:> cd /home/ubuntu/cephtest/s3-tests-java && /opt/gradle/gradle/bin/gradle clean test --rerun-tasks --no-build-cache --tests ObjectTest 2024-09-12T00:38:36.612 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :clean 2024-09-12T00:38:37.309 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileJava 2024-09-12T00:38:37.310 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processResources 2024-09-12T00:38:37.310 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :classes 2024-09-12T00:38:37.713 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:37.713 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :compileTestJava 2024-09-12T00:38:37.714 INFO:teuthology.orchestra.run.smithi078.stderr:Note: /home/ubuntu/cephtest/s3-tests-java/src/test/java/BucketTest.java uses or overrides a deprecated API. 2024-09-12T00:38:37.714 INFO:teuthology.orchestra.run.smithi078.stderr:Note: Recompile with -Xlint:deprecation for details. 2024-09-12T00:38:37.715 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:37.715 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :processTestResources NO-SOURCE 2024-09-12T00:38:37.715 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :testClasses 2024-09-12T00:38:39.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:> Task :test 2024-09-12T00:38:39.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:39.710 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests STANDARD_OUT 2024-09-12T00:38:39.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12 00:38:39,072 [Test worker] WARN com.amazonaws.util.Base64 - JAXB is unavailable. Will fallback to SDK implementation which may be less performant 2024-09-12T00:38:39.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:39.711 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound STARTED 2024-09-12T00:38:39.711 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:39.711 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCopyKeyNotFound PASSED 2024-09-12T00:38:39.810 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:39.810 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone STARTED 2024-09-12T00:38:39.810 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:39.810 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadExpectNone PASSED 2024-09-12T00:38:40.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:40.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty STARTED 2024-09-12T00:38:40.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:40.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.TestObjectCreateBadMd5Empty PASSED 2024-09-12T00:38:40.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:40.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI STARTED 2024-09-12T00:38:41.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:41.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadLLAPI PASSED 2024-09-12T00:38:41.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:41.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI STARTED 2024-09-12T00:38:41.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:41.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testAbortMultipartUploadNotFoundLLAPI PASSED 2024-09-12T00:38:41.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:41.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI STARTED 2024-09-12T00:38:41.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:41.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadHLAPI PASSED 2024-09-12T00:38:42.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:42.210 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI STARTED 2024-09-12T00:38:42.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:42.210 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoBucketHLAPI PASSED 2024-09-12T00:38:42.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:42.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI STARTED 2024-09-12T00:38:42.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:42.410 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testDownloadNoKeyHLAPI PASSED 2024-09-12T00:38:42.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:42.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB STARTED 2024-09-12T00:38:42.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:42.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1MB PASSED 2024-09-12T00:38:43.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:43.210 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b STARTED 2024-09-12T00:38:43.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:43.210 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1b PASSED 2024-09-12T00:38:43.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:43.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb STARTED 2024-09-12T00:38:43.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:43.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptedTransfer1kb PASSED 2024-09-12T00:38:43.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:43.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC STARTED 2024-09-12T00:38:43.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:43.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeyNoSSEC PASSED 2024-09-12T00:38:44.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:44.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 STARTED 2024-09-12T00:38:44.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:44.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECInvalidMd5 PASSED 2024-09-12T00:38:44.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:44.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey STARTED 2024-09-12T00:38:44.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:44.610 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoKey PASSED 2024-09-12T00:38:44.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:44.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 STARTED 2024-09-12T00:38:45.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:45.010 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testEncryptionKeySSECNoMd5 PASSED 2024-09-12T00:38:45.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:45.210 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete STARTED 2024-09-12T00:38:45.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:45.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultiObjectDelete PASSED 2024-09-12T00:38:45.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:45.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA STARTED 2024-09-12T00:38:46.210 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:46.210 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyHLAPIA PASSED 2024-09-12T00:38:46.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:46.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI STARTED 2024-09-12T00:38:51.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:51.910 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyMultipleSizesLLAPI PASSED 2024-09-12T00:38:52.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:52.410 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI STARTED 2024-09-12T00:38:52.410 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:52.410 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCBucketHLAPI PASSED 2024-09-12T00:38:52.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:52.710 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI STARTED 2024-09-12T00:38:52.710 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:52.710 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartCopyNoSRCKeyHLAPI PASSED 2024-09-12T00:38:53.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:53.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI STARTED 2024-09-12T00:38:53.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:53.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadHLAPI PASSED 2024-09-12T00:38:53.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:53.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI STARTED 2024-09-12T00:38:54.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:54.010 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadNoBucketHLAPI PASSED 2024-09-12T00:38:54.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:54.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI STARTED 2024-09-12T00:38:54.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:54.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartDownloadWithPauseHLAPI PASSED 2024-09-12T00:38:55.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:55.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 STARTED 2024-09-12T00:38:55.610 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:55.610 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadHLAPIAWS4 PASSED 2024-09-12T00:38:55.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:55.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI STARTED 2024-09-12T00:38:57.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:57.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadIncorrectMissingPartLLAPI PASSED 2024-09-12T00:38:57.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:38:57.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI STARTED 2024-09-12T00:39:03.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:03.010 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadMultipleSizesLLAPI PASSED 2024-09-12T00:39:03.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:03.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI STARTED 2024-09-12T00:39:04.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:04.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadOverwriteExistingObjectLLAPI PASSED 2024-09-12T00:39:04.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:04.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI STARTED 2024-09-12T00:39:05.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:05.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadSmallLLAPI PASSED 2024-09-12T00:39:05.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:05.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause STARTED 2024-09-12T00:39:06.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:06.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testMultipartUploadWithPause PASSED 2024-09-12T00:39:06.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:06.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound STARTED 2024-09-12T00:39:06.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:06.810 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCopyBucketNotFound PASSED 2024-09-12T00:39:06.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:06.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch STARTED 2024-09-12T00:39:07.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:07.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadExpectMismatch PASSED 2024-09-12T00:39:07.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:07.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort STARTED 2024-09-12T00:39:07.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:07.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5InvalidShort PASSED 2024-09-12T00:39:07.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:07.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid STARTED 2024-09-12T00:39:07.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:07.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Ivalid PASSED 2024-09-12T00:39:07.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:07.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None STARTED 2024-09-12T00:39:08.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:08.010 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5None PASSED 2024-09-12T00:39:08.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:08.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable STARTED 2024-09-12T00:39:08.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:08.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectCreateBadMd5Unreadable PASSED 2024-09-12T00:39:08.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:08.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes STARTED 2024-09-12T00:39:08.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:08.610 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectHeadZeroBytes PASSED 2024-09-12T00:39:08.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:08.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot STARTED 2024-09-12T00:39:09.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:09.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterDot PASSED 2024-09-12T00:39:09.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:09.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist STARTED 2024-09-12T00:39:09.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:09.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterNotExist PASSED 2024-09-12T00:39:09.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:09.709 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage STARTED 2024-09-12T00:39:09.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:09.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListDelimiterPercentage PASSED 2024-09-12T00:39:10.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:10.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList STARTED 2024-09-12T00:39:10.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:10.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerAfterList PASSED 2024-09-12T00:39:10.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:10.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList STARTED 2024-09-12T00:39:10.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:10.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerBeforeList PASSED 2024-09-12T00:39:10.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:10.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList STARTED 2024-09-12T00:39:11.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:11.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerNotInList PASSED 2024-09-12T00:39:11.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:11.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable STARTED 2024-09-12T00:39:11.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:11.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMarkerUnreadable PASSED 2024-09-12T00:39:11.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:11.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative STARTED 2024-09-12T00:39:11.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:11.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNegative PASSED 2024-09-12T00:39:12.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:12.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone STARTED 2024-09-12T00:39:12.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:12.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysNone PASSED 2024-09-12T00:39:12.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:12.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne STARTED 2024-09-12T00:39:12.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:12.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysOne PASSED 2024-09-12T00:39:13.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:13.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero STARTED 2024-09-12T00:39:13.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:13.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListMaxkeysZero PASSED 2024-09-12T00:39:13.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:13.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt STARTED 2024-09-12T00:39:13.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:13.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixAlt PASSED 2024-09-12T00:39:13.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:13.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic STARTED 2024-09-12T00:39:14.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:14.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixBasic PASSED 2024-09-12T00:39:14.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:14.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt STARTED 2024-09-12T00:39:14.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:14.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterAlt PASSED 2024-09-12T00:39:14.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:14.709 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic STARTED 2024-09-12T00:39:14.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:14.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterBasic PASSED 2024-09-12T00:39:15.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:15.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist STARTED 2024-09-12T00:39:15.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:15.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterDelimiterNotExist PASSED 2024-09-12T00:39:15.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:15.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist STARTED 2024-09-12T00:39:15.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:15.709 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixDelimiterNotExist PASSED 2024-09-12T00:39:16.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:16.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist STARTED 2024-09-12T00:39:16.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:16.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixDelimiterPrefixNotExist PASSED 2024-09-12T00:39:16.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:16.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty STARTED 2024-09-12T00:39:16.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:16.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixEmpty PASSED 2024-09-12T00:39:16.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:16.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone STARTED 2024-09-12T00:39:16.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:16.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNone PASSED 2024-09-12T00:39:17.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:17.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist STARTED 2024-09-12T00:39:17.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:17.313 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixNotExist PASSED 2024-09-12T00:39:17.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:17.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable STARTED 2024-09-12T00:39:17.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:17.709 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectListPrefixUnreadable PASSED 2024-09-12T00:39:18.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:18.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket STARTED 2024-09-12T00:39:18.109 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:18.109 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadFromNonExistantBucket PASSED 2024-09-12T00:39:18.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:18.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist STARTED 2024-09-12T00:39:18.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:18.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectReadNotExist PASSED 2024-09-12T00:39:18.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:18.709 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl STARTED 2024-09-12T00:39:18.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:18.710 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCacheControl PASSED 2024-09-12T00:39:19.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag STARTED 2024-09-12T00:39:19.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteCheckEtag PASSED 2024-09-12T00:39:19.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete STARTED 2024-09-12T00:39:19.409 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.409 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteReadUpdateReadDelete PASSED 2024-09-12T00:39:19.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.710 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket STARTED 2024-09-12T00:39:19.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.809 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testObjectWriteToNonExistantBucket PASSED 2024-09-12T00:39:19.809 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.810 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode STARTED 2024-09-12T00:39:19.909 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:19.909 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedSkipLeadingBytesResponseCode PASSED 2024-09-12T00:39:20.209 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:20.209 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode STARTED 2024-09-12T00:39:20.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:20.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testRangedrequestResponseCode PASSED 2024-09-12T00:39:20.609 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:20.609 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey STARTED 2024-09-12T00:39:20.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:20.709 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNoKey PASSED 2024-09-12T00:39:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:21.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared STARTED 2024-09-12T00:39:21.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:21.009 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testSSEKMSNotDeclared PASSED 2024-09-12T00:39:21.309 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:21.309 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile STARTED 2024-09-12T00:39:21.709 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:21.709 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileHLAPIBigFile PASSED 2024-09-12T00:39:22.009 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:22.010 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileList STARTED 2024-09-12T00:39:22.509 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:22.509 INFO:teuthology.orchestra.run.smithi078.stdout:suite > Object tests > ObjectTest.testUploadFileList PASSED 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout:| Results: SUCCESS (70 tests, 70 successes, 0 failures, 0 skipped) | 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout:---------------------------------------------------------------------- 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout:Deprecated Gradle features were used in this build, making it incompatible with Gradle 7.0. 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout:Use '--warning-mode all' to show the individual deprecation warnings. 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout:See https://docs.gradle.org/6.0.1/userguide/command_line_interface.html#sec:command_line_warnings 2024-09-12T00:39:22.743 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:22.744 INFO:teuthology.orchestra.run.smithi078.stdout:BUILD SUCCESSFUL in 46s 2024-09-12T00:39:22.744 INFO:teuthology.orchestra.run.smithi078.stdout:5 actionable tasks: 5 executed 2024-09-12T00:39:22.762 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:39:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:22.788 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:22.831 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.833+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 realm 2024-09-12T00:39:22.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:22.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:22.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:22.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:22.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:22.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.837+0000 7f4ac435b9c0 20 searching for the correct realm 2024-09-12T00:39:22.840 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:22.845+0000 7f4ac2662640 0 -- 172.21.15.78:0/2496438782 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f4ab406b3d0 msgr2=0x7f4ab405b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:23.057 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.061+0000 7f4ac1e61640 0 -- 172.21.15.78:0/2496438782 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5584e0a8e9b0 msgr2=0x5584e0a90da0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:23.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:23.069 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:23.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 zone default found 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 4 Realm: () 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 zonegroup default 2024-09-12T00:39:23.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.073+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.077+0000 7f4ac435b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.077+0000 7f4ac435b9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:23.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.077+0000 7f4ac435b9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:23.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.077+0000 7f4ac435b9c0 20 started sync module instance, tier type = 2024-09-12T00:39:23.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.077+0000 7f4ac435b9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.097+0000 7f4ac435b9c0 20 add_watcher() i=0 2024-09-12T00:39:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.097+0000 7f4ac435b9c0 20 add_watcher() i=1 2024-09-12T00:39:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.097+0000 7f4ac435b9c0 20 add_watcher() i=2 2024-09-12T00:39:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.097+0000 7f4ac435b9c0 20 add_watcher() i=3 2024-09-12T00:39:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.097+0000 7f4ac435b9c0 20 add_watcher() i=4 2024-09-12T00:39:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.097+0000 7f4ac435b9c0 20 add_watcher() i=5 2024-09-12T00:39:23.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.097+0000 7f4ac435b9c0 20 add_watcher() i=6 2024-09-12T00:39:23.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.101+0000 7f4ac435b9c0 20 add_watcher() i=7 2024-09-12T00:39:23.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.101+0000 7f4ac435b9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:23.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.105+0000 7f4973fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.105+0000 7f4ac435b9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:23.103 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.105+0000 7f4ac435b9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.201+0000 7f4972ffd640 20 reqs_thread_entry: start 2024-09-12T00:39:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.201+0000 7f4ac435b9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.201+0000 7f4ac435b9c0 20 Filter name: none 2024-09-12T00:39:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.201+0000 7f4970ff9640 20 reqs_thread_entry: start 2024-09-12T00:39:23.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.201+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:39:23.202 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.205+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.209+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.209+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.209+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:39:23.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.213+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.213+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.212 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.217+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.214 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.217+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:39:23.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2488511962946391468', time=2024-09-12T02:38:46.233638+0000, chain.objs.size()=9 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.1 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.1_1 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.2 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.2_1 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.3 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.3_1 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.4 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.4_1 2024-09-12T00:39:23.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.221+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.5 2024-09-12T00:39:23.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.229+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.237+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:39:23.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.237+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.241+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.241+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.245+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:39:23.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.245 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4907439832372742868', time=2024-09-12T02:38:55.656517+0000, chain.objs.size()=9 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.1 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.1_1 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.2 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.2_1 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.3 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.3_1 2024-09-12T00:39:23.247 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.4 2024-09-12T00:39:23.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.4_1 2024-09-12T00:39:23.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.249+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file.mpg.2~UOHC_TNST8Jg2Dpw2Jc0tSewnpUwjxw.5 2024-09-12T00:39:23.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.257+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.260 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.265+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:39:23.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.265+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.264 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.265 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2218349276240933598', time=2024-09-12T02:39:01.895890+0000, chain.objs.size()=9 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.1 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.1_1 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.2 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.2_1 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.3 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.3_1 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.4 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.4_1 2024-09-12T00:39:23.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.269+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~bg2b-Elm4W-QnRHNJwiM7klwU432OoH.5 2024-09-12T00:39:23.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.273+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.281+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:39:23.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18084451586029587287', time=2024-09-12T02:38:46.417450+0000, chain.objs.size()=9 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.1 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.1_1 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.2 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.2_1 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.3 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.3_1 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.4 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__shadow_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.4_1 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.91__multipart_key1.2~Ngb9Fqfbf1Z6G1uvgpNjGZjX_LChZmP.5 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11065977831772412168', time=2024-09-12T02:38:50.408251+0000, chain.objs.size()=9 2024-09-12T00:39:23.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.1 2024-09-12T00:39:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.1_1 2024-09-12T00:39:23.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.285+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.2 2024-09-12T00:39:23.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.289+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.2_1 2024-09-12T00:39:23.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.3 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.3_1 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.4 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.4_1 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~kQHS14-m51TXYv70ztTriA4rMdESD08.5 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2064600834591878177', time=2024-09-12T02:39:04.664187+0000, chain.objs.size()=9 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__multipart_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.1 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__shadow_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.1_1 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__multipart_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.2 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__shadow_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.2_1 2024-09-12T00:39:23.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.297+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__multipart_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.3 2024-09-12T00:39:23.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.301+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__shadow_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.3_1 2024-09-12T00:39:23.303 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.305+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__multipart_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.4 2024-09-12T00:39:23.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.365+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__shadow_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.4_1 2024-09-12T00:39:23.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.365+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.103__multipart_key1.2~LAQXgiNaPt7rsVJ6i422L1wvcqEI6PL.5 2024-09-12T00:39:23.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.369+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.377+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:39:23.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.379 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8218336292828182949', time=2024-09-12T02:39:05.633538+0000, chain.objs.size()=9 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__multipart_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.1 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__shadow_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.1_1 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__multipart_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.2 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__shadow_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.2_1 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__multipart_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.3 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__shadow_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.3_1 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__multipart_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.4 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__shadow_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.4_1 2024-09-12T00:39:23.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.381+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.104__multipart_key1.2~5SVrwGRUlCxLZHYn1xNIHIQPMKCmsUD.5 2024-09-12T00:39:23.390 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.393+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.395 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.397+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:39:23.399 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.401+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM', time=2024-09-12T02:38:57.669151+0000, chain.objs.size()=9 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__multipart_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.7 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__shadow_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.7_1 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__multipart_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.8 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__shadow_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.8_1 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__multipart_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.9 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__shadow_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.9_1 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__multipart_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.10 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__shadow_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.10_1 2024-09-12T00:39:23.402 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.405+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.101__multipart_key1.2~3sz5tEjoUeSdkla32MI9OkqyNIAOtgM.11 2024-09-12T00:39:23.412 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.413+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.421+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:39:23.422 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.425+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.423 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.425+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.425+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.429+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:39:23.429 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.433+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.433+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.433+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.437+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:39:23.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4131670130759595276', time=2024-09-12T02:38:51.827353+0000, chain.objs.size()=7 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~3SBQkEWignmyH7ja7cR54Cvo8V9SBDq.1 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~3SBQkEWignmyH7ja7cR54Cvo8V9SBDq.1_1 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~3SBQkEWignmyH7ja7cR54Cvo8V9SBDq.1_2 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~3SBQkEWignmyH7ja7cR54Cvo8V9SBDq.2 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~3SBQkEWignmyH7ja7cR54Cvo8V9SBDq.2_1 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~3SBQkEWignmyH7ja7cR54Cvo8V9SBDq.2_2 2024-09-12T00:39:23.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~3SBQkEWignmyH7ja7cR54Cvo8V9SBDq.3 2024-09-12T00:39:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9426461622862672256', time=2024-09-12T02:39:03.075261+0000, chain.objs.size()=7 2024-09-12T00:39:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~5Kw88dch2Sl7YlJVy4dmq129kaFkelY.1 2024-09-12T00:39:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~5Kw88dch2Sl7YlJVy4dmq129kaFkelY.1_1 2024-09-12T00:39:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~5Kw88dch2Sl7YlJVy4dmq129kaFkelY.1_2 2024-09-12T00:39:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~5Kw88dch2Sl7YlJVy4dmq129kaFkelY.2 2024-09-12T00:39:23.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.441+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~5Kw88dch2Sl7YlJVy4dmq129kaFkelY.2_1 2024-09-12T00:39:23.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.449+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~5Kw88dch2Sl7YlJVy4dmq129kaFkelY.2_2 2024-09-12T00:39:23.450 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.453+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~5Kw88dch2Sl7YlJVy4dmq129kaFkelY.3 2024-09-12T00:39:23.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.461+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.465+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:39:23.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.469+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.469+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.469+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.473+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:39:23.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.477+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.477+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.477+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.476 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.477+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:39:23.479 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.481+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.481+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:39:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11235696963706346259', time=2024-09-12T02:38:42.957783+0000, chain.objs.size()=2 2024-09-12T00:39:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.83__shadow_.UPJPG7qzb1jY-hutd06rA440Y20Vw_o_1 2024-09-12T00:39:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.83__shadow_.UPJPG7qzb1jY-hutd06rA440Y20Vw_o_2 2024-09-12T00:39:23.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16212068204081399394', time=2024-09-12T02:38:54.906817+0000, chain.objs.size()=9 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__multipart_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.1 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__shadow_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.1_1 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__multipart_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.2 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__shadow_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.2_1 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__multipart_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.3 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__shadow_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.3_1 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__multipart_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.4 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__shadow_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.4_1 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.99__multipart_key1.2~nfJX9_zOed0kr1N1-KhogpkWumb_IQ_.5 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3152784424588146491', time=2024-09-12T02:38:59.957827+0000, chain.objs.size()=9 2024-09-12T00:39:23.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.485+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.1 2024-09-12T00:39:23.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.489+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.1_1 2024-09-12T00:39:23.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.493+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.2 2024-09-12T00:39:23.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.493+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.2_1 2024-09-12T00:39:23.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.493+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.3 2024-09-12T00:39:23.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.493+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.3_1 2024-09-12T00:39:23.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.493+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.4 2024-09-12T00:39:23.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.493+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.4_1 2024-09-12T00:39:23.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.493+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~psss1OlqS52QdIFL6JH5tImT3JWXfaG.5 2024-09-12T00:39:23.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.505+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.509+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:39:23.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15828789689133052008', time=2024-09-12T02:39:00.522097+0000, chain.objs.size()=9 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.1 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.1_1 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.2 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.2_1 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.3 2024-09-12T00:39:23.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.3_1 2024-09-12T00:39:23.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.4 2024-09-12T00:39:23.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.4_1 2024-09-12T00:39:23.512 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.513+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ybkJaNfB83rNWC68xEJfz0CWc23wYpn.5 2024-09-12T00:39:23.519 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.521+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.525+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:39:23.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.529+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.529+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.533+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.533+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:39:23.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.537+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.541+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.541+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.541+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:39:23.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13214002036641951253', time=2024-09-12T02:38:52.181202+0000, chain.objs.size()=7 2024-09-12T00:39:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~q20SSIYXfKSbyHrByZwYzPzdac5NwgK.1 2024-09-12T00:39:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~q20SSIYXfKSbyHrByZwYzPzdac5NwgK.1_1 2024-09-12T00:39:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~q20SSIYXfKSbyHrByZwYzPzdac5NwgK.1_2 2024-09-12T00:39:23.543 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~q20SSIYXfKSbyHrByZwYzPzdac5NwgK.2 2024-09-12T00:39:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~q20SSIYXfKSbyHrByZwYzPzdac5NwgK.2_1 2024-09-12T00:39:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~q20SSIYXfKSbyHrByZwYzPzdac5NwgK.2_2 2024-09-12T00:39:23.544 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.545+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~q20SSIYXfKSbyHrByZwYzPzdac5NwgK.3 2024-09-12T00:39:23.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.553+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.557+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:39:23.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.561+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.561+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4958230346262250901', time=2024-09-12T02:38:51.998660+0000, chain.objs.size()=5 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.93__shadow_.CBic9DCAR-llXXmyDbJ-I1YI_YhoO3T_1 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.93__shadow_.CBic9DCAR-llXXmyDbJ-I1YI_YhoO3T_2 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.93__shadow_.CBic9DCAR-llXXmyDbJ-I1YI_YhoO3T_3 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.93__shadow_.CBic9DCAR-llXXmyDbJ-I1YI_YhoO3T_4 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.93__shadow_.CBic9DCAR-llXXmyDbJ-I1YI_YhoO3T_5 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8499620169262749210', time=2024-09-12T02:39:02.908960+0000, chain.objs.size()=7 2024-09-12T00:39:23.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ueQONvrCHrsFG_hl996tJKU41nXNaiR.1 2024-09-12T00:39:23.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ueQONvrCHrsFG_hl996tJKU41nXNaiR.1_1 2024-09-12T00:39:23.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ueQONvrCHrsFG_hl996tJKU41nXNaiR.1_2 2024-09-12T00:39:23.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ueQONvrCHrsFG_hl996tJKU41nXNaiR.2 2024-09-12T00:39:23.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ueQONvrCHrsFG_hl996tJKU41nXNaiR.2_1 2024-09-12T00:39:23.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~ueQONvrCHrsFG_hl996tJKU41nXNaiR.2_2 2024-09-12T00:39:23.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.565+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~ueQONvrCHrsFG_hl996tJKU41nXNaiR.3 2024-09-12T00:39:23.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.577+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.581+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:39:23.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.582 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9394873428807433914', time=2024-09-12T02:38:55.679895+0000, chain.objs.size()=9 2024-09-12T00:39:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.1 2024-09-12T00:39:23.583 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.1_1 2024-09-12T00:39:23.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.2 2024-09-12T00:39:23.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.2_1 2024-09-12T00:39:23.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.3 2024-09-12T00:39:23.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.3_1 2024-09-12T00:39:23.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.4 2024-09-12T00:39:23.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__shadow_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.4_1 2024-09-12T00:39:23.584 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.585+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.100__multipart_file2.mpg.2~ahd9S-XVOQVSu1-wrx_CxZ3BTIDgdZ-.5 2024-09-12T00:39:23.592 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.593+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.597+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:39:23.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.601+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.601+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6129026504855113643', time=2024-09-12T02:38:49.713410+0000, chain.objs.size()=9 2024-09-12T00:39:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.1 2024-09-12T00:39:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.1_1 2024-09-12T00:39:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.2 2024-09-12T00:39:23.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.2_1 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.3 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.3_1 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.4 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.4_1 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~6bVznHzBBuHYAXBnjjqnxA15-baC7-3.5 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn', time=2024-09-12T02:39:06.639747+0000, chain.objs.size()=78 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.1 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.2 2024-09-12T00:39:23.602 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.605+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.3 2024-09-12T00:39:23.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.609+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.4 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.5 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.6 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.7 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.8 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.9 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.10 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.11 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.12 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.13 2024-09-12T00:39:23.611 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.613+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.14 2024-09-12T00:39:23.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.617+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.15 2024-09-12T00:39:23.614 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.617+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.16 2024-09-12T00:39:23.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.617+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.17 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.18 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.19 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.20 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.21 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.22 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.23 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.24 2024-09-12T00:39:23.620 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.25 2024-09-12T00:39:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.26 2024-09-12T00:39:23.621 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.621+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.27 2024-09-12T00:39:23.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.625+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.28 2024-09-12T00:39:23.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.629+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.29 2024-09-12T00:39:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.629+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.30 2024-09-12T00:39:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.629+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.31 2024-09-12T00:39:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.629+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.32 2024-09-12T00:39:23.627 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.629+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.33 2024-09-12T00:39:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.34 2024-09-12T00:39:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.35 2024-09-12T00:39:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.36 2024-09-12T00:39:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.37 2024-09-12T00:39:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.38 2024-09-12T00:39:23.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.39 2024-09-12T00:39:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.40 2024-09-12T00:39:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.41 2024-09-12T00:39:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.42 2024-09-12T00:39:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.43 2024-09-12T00:39:23.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.633+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.44 2024-09-12T00:39:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.637+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.45 2024-09-12T00:39:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.637+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.46 2024-09-12T00:39:23.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.637+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.47 2024-09-12T00:39:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.48 2024-09-12T00:39:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.49 2024-09-12T00:39:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.50 2024-09-12T00:39:23.638 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.51 2024-09-12T00:39:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.52 2024-09-12T00:39:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.53 2024-09-12T00:39:23.639 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.54 2024-09-12T00:39:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.55 2024-09-12T00:39:23.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.641+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.56 2024-09-12T00:39:23.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.645+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.57 2024-09-12T00:39:23.642 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.645+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.58 2024-09-12T00:39:23.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.59 2024-09-12T00:39:23.646 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.60 2024-09-12T00:39:23.647 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.61 2024-09-12T00:39:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.62 2024-09-12T00:39:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.63 2024-09-12T00:39:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.64 2024-09-12T00:39:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.65 2024-09-12T00:39:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.66 2024-09-12T00:39:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.67 2024-09-12T00:39:23.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.649+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.68 2024-09-12T00:39:23.649 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.69 2024-09-12T00:39:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.70 2024-09-12T00:39:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.71 2024-09-12T00:39:23.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.72 2024-09-12T00:39:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.73 2024-09-12T00:39:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.74 2024-09-12T00:39:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.75 2024-09-12T00:39:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.76 2024-09-12T00:39:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.77 2024-09-12T00:39:23.652 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.653+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.105__multipart_key1.2~sS2WifqM6czfAdi6DaoRxkpS-b42gRn.78 2024-09-12T00:39:23.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.661+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.660 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.665+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:39:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.665+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.662 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.665+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.665+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.664 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.665+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:39:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6198887451986070825', time=2024-09-12T02:39:22.518644+0000, chain.objs.size()=9 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__multipart_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.1 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__shadow_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.1_1 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__multipart_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.2 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__shadow_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.2_1 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__multipart_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.3 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__shadow_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.3_1 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__multipart_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.4 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__shadow_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.4_1 2024-09-12T00:39:23.667 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.669+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.144__multipart_key1/data/file.mpg.2~wjHm23kXLP-mdy73iyydTGI7za_YI-z.5 2024-09-12T00:39:23.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.677+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.677+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:39:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:39:23.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu', time=2024-09-12T02:38:41.105621+0000, chain.objs.size()=9 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__multipart_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.1 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__shadow_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.1_1 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__multipart_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.2 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__shadow_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.2_1 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__multipart_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.3 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__shadow_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.3_1 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__multipart_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.4 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__shadow_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.4_1 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.79__multipart_key1.2~3-NiNM-qgMiKx-cP42ARob6_MB0yiPu.5 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15309976315243767773', time=2024-09-12T02:39:02.379454+0000, chain.objs.size()=7 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~YB87k3H-2hwCUH-5gtZzL6HAEhn4nNY.1 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~YB87k3H-2hwCUH-5gtZzL6HAEhn4nNY.1_1 2024-09-12T00:39:23.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.681+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~YB87k3H-2hwCUH-5gtZzL6HAEhn4nNY.1_2 2024-09-12T00:39:23.682 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.685+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~YB87k3H-2hwCUH-5gtZzL6HAEhn4nNY.2 2024-09-12T00:39:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.685+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~YB87k3H-2hwCUH-5gtZzL6HAEhn4nNY.2_1 2024-09-12T00:39:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.685+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__shadow_key1.2~YB87k3H-2hwCUH-5gtZzL6HAEhn4nNY.2_2 2024-09-12T00:39:23.683 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.685+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.102__multipart_key1.2~YB87k3H-2hwCUH-5gtZzL6HAEhn4nNY.3 2024-09-12T00:39:23.689 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.693+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.693+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:39:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.697+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.697+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.694 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.697+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.695 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.697+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:39:23.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.697 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10800510090015105361', time=2024-09-12T02:38:51.111750+0000, chain.objs.size()=7 2024-09-12T00:39:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~UnYxk1rKl7-FhIrTwI_7Vu_jLR3vE6b.1 2024-09-12T00:39:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~UnYxk1rKl7-FhIrTwI_7Vu_jLR3vE6b.1_1 2024-09-12T00:39:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~UnYxk1rKl7-FhIrTwI_7Vu_jLR3vE6b.1_2 2024-09-12T00:39:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~UnYxk1rKl7-FhIrTwI_7Vu_jLR3vE6b.2 2024-09-12T00:39:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~UnYxk1rKl7-FhIrTwI_7Vu_jLR3vE6b.2_1 2024-09-12T00:39:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~UnYxk1rKl7-FhIrTwI_7Vu_jLR3vE6b.2_2 2024-09-12T00:39:23.699 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.701+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~UnYxk1rKl7-FhIrTwI_7Vu_jLR3vE6b.3 2024-09-12T00:39:23.702 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.705+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.709+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:39:23.706 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.709+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.709+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.709+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:39:23.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.65163502492278827', time=2024-09-12T02:38:48.846561+0000, chain.objs.size()=9 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.1 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.1_1 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.2 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.2_1 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.3 2024-09-12T00:39:23.711 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.3_1 2024-09-12T00:39:23.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.4 2024-09-12T00:39:23.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__shadow_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.4_1 2024-09-12T00:39:23.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.713+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.94__multipart_key1.2~Oym_tCYrZXwffB1G-KqmduBrzkBeo2H.5 2024-09-12T00:39:23.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.717+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.721+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:39:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.721+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1676473645875418111', time=2024-09-12T02:39:21.783072+0000, chain.objs.size()=9 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__multipart_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.1 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__shadow_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.1_1 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__multipart_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.2 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__shadow_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.2_1 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__multipart_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.3 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__shadow_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.3_1 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__multipart_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.4 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__shadow_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.4_1 2024-09-12T00:39:23.770 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.725+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.143__multipart_key1.2~vjX2w8zQblo2cPoV-yS2f10QYpHl-Fn.5 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.729+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.733+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.733+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.733+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.733+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.733+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9615931166139025669', time=2024-09-12T02:38:53.696476+0000, chain.objs.size()=9 2024-09-12T00:39:23.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__multipart_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.1 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__shadow_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.1_1 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__multipart_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.2 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__shadow_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.2_1 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__multipart_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.3 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__shadow_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.3_1 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__multipart_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.4 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__shadow_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.4_1 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.737+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.98__multipart_key1.2~fZ7M3_EK4GMTw4rQ4hfZzVE6ApPAknd.5 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.741+0000 7f4ac435b9c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.745+0000 7f4973fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.749+0000 7f4ac435b9c0 20 remove_watcher() i=0 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.749+0000 7f4ac435b9c0 2 removed watcher, disabling cache 2024-09-12T00:39:23.772 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.749+0000 7f4ac435b9c0 20 remove_watcher() i=1 2024-09-12T00:39:23.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.753+0000 7f4ac435b9c0 20 remove_watcher() i=2 2024-09-12T00:39:23.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.753+0000 7f4ac435b9c0 20 remove_watcher() i=3 2024-09-12T00:39:23.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.753+0000 7f4ac435b9c0 20 remove_watcher() i=4 2024-09-12T00:39:23.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.757+0000 7f4ac435b9c0 20 remove_watcher() i=5 2024-09-12T00:39:23.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.757+0000 7f4ac435b9c0 20 remove_watcher() i=6 2024-09-12T00:39:23.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:23.757+0000 7f4ac435b9c0 20 remove_watcher() i=7 2024-09-12T00:39:23.773 DEBUG:teuthology.orchestra.run.smithi078:> radosgw-admin gc process --include-all 2024-09-12T00:39:23.838 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:23.838 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:24.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.093+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.093+0000 7f5c3497c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.093+0000 7f5c3497c9c0 20 realm 2024-09-12T00:39:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.093+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.094 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:24.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.097+0000 7f5c3497c9c0 20 searching for the correct realm 2024-09-12T00:39:24.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.101+0000 7f5c32482640 0 -- 172.21.15.78:0/2241592915 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x55a245f926f0 msgr2=0x55a245f94bb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:24.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.109+0000 7f5c31c81640 0 -- 172.21.15.78:0/2241592915 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f5c2406ca50 msgr2=0x7f5c2407ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:24.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:24.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 zone default found 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 4 Realm: () 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 zonegroup default 2024-09-12T00:39:24.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.329+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.333+0000 7f5c3497c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.329 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.333+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.333+0000 7f5c3497c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.330 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.333+0000 7f5c3497c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.333+0000 7f5c3497c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.333+0000 7f5c3497c9c0 20 started sync module instance, tier type = 2024-09-12T00:39:24.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.333+0000 7f5c3497c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:24.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.357+0000 7f5c3497c9c0 20 add_watcher() i=0 2024-09-12T00:39:24.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.357+0000 7f5c3497c9c0 20 add_watcher() i=1 2024-09-12T00:39:24.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.357+0000 7f5c3497c9c0 20 add_watcher() i=2 2024-09-12T00:39:24.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.357+0000 7f5c3497c9c0 20 add_watcher() i=3 2024-09-12T00:39:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.357+0000 7f5c3497c9c0 20 add_watcher() i=4 2024-09-12T00:39:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.357+0000 7f5c3497c9c0 20 add_watcher() i=5 2024-09-12T00:39:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.357+0000 7f5c3497c9c0 20 add_watcher() i=6 2024-09-12T00:39:24.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.361+0000 7f5c3497c9c0 20 add_watcher() i=7 2024-09-12T00:39:24.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.361+0000 7f5c3497c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:24.361 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.365+0000 7f5ae8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:24.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.365+0000 7f5c3497c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:24.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.365+0000 7f5c3497c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.461+0000 7f5a637fe640 20 reqs_thread_entry: start 2024-09-12T00:39:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.461+0000 7f5c3497c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.461+0000 7f5c3497c9c0 20 Filter name: none 2024-09-12T00:39:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.461+0000 7f5a617fa640 20 reqs_thread_entry: start 2024-09-12T00:39:24.458 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.461+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:39:24.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.465+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.465+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.469+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.469+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:39:24.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.473+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.473+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.477+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.477+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:39:24.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.481+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.481+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.481+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.481 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.485+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:39:24.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.485+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.485+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.489+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.489+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:39:24.489 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.493+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.491 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.493+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.492 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.493+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.497+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:39:24.497 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.501+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.501+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.501+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.505+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:39:24.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.505+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.505+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.505+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.509+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:39:24.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.509+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.513+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.513+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.513+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:39:24.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.517+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.517 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.521+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.518 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.521+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.521 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.525+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:39:24.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.525+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.529+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.524 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.529+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.529+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:39:24.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.533+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.531 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.533+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.533+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.537+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:39:24.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.541+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.541+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.545+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.542 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.545+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:39:24.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.549+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.549+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.549+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.548 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.553+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:39:24.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.553+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.553 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.557+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.557+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.557+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:39:24.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.561+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.565+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.565+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.569+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:39:24.567 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.569+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.573+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.573+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.573+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:39:24.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.577+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.577 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.581+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.581+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.581 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.585+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:39:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.589+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.585 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.589+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.586 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.589+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.588 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.593+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:39:24.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.593+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.597+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.593 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.597+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.597+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:39:24.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.601+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.601+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.600 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.605+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.605+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:39:24.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.609+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.609+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.609+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.610 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.613+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:39:24.613 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.617+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.615 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.617+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.616 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.621+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.619 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.621+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:39:24.622 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.625+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.623 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.625+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.624 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.625+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.626 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.629+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:39:24.630 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.633+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.632 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.633+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.633 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.637+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.636 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.641+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:39:24.640 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.641+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.645+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.641 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.645+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.644 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.645+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:39:24.648 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.649+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.650 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.653+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.651 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.653+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.653 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.657+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:39:24.656 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.661+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.661+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.657 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.661+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.659 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.661+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:39:24.663 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.665+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.665 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.669+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.666 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.669+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.669 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.673+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:39:24.672 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.677+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.674 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.677+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.677+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.681+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:39:24.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.681+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.681 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.685+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.685+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.684 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.685+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:39:24.688 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.693+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.693+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.693+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.693 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.697+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:39:24.696 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.701+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.701+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:39:24.698 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.701+0000 7f5c3497c9c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:39:24.703 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.705+0000 7f5ae8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:24.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.709+0000 7f5c3497c9c0 20 remove_watcher() i=0 2024-09-12T00:39:24.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.709+0000 7f5c3497c9c0 2 removed watcher, disabling cache 2024-09-12T00:39:24.710 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.713+0000 7f5c3497c9c0 20 remove_watcher() i=1 2024-09-12T00:39:24.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.713+0000 7f5c3497c9c0 20 remove_watcher() i=2 2024-09-12T00:39:24.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.717+0000 7f5c3497c9c0 20 remove_watcher() i=3 2024-09-12T00:39:24.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.721+0000 7f5c3497c9c0 20 remove_watcher() i=4 2024-09-12T00:39:24.719 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.721+0000 7f5c3497c9c0 20 remove_watcher() i=5 2024-09-12T00:39:24.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.725+0000 7f5c3497c9c0 20 remove_watcher() i=6 2024-09-12T00:39:24.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:24.729+0000 7f5c3497c9c0 20 remove_watcher() i=7 2024-09-12T00:39:24.743 INFO:teuthology.run_tasks:Running task s3tests... 2024-09-12T00:39:24.763 DEBUG:tasks.s3tests:s3tests config is {'client.0': {'rgw_server': 'client.0', 'accounts': {'iam alt root': 'RGW99999999999999999', 'iam root': 'RGW88888888888888888'}, 'force-branch': 'ceph-master', 'slow_backend': True, 'storage classes': 'LUKEWARM, FROZEN'}} 2024-09-12T00:39:24.764 INFO:tasks.s3tests:Downloading s3-tests... 2024-09-12T00:39:24.764 INFO:tasks.s3tests:Using branch 'ceph-master' for s3tests 2024-09-12T00:39:24.764 DEBUG:teuthology.orchestra.run.smithi078:> git clone -b ceph-master https://git.ceph.com/s3-tests.git /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:39:24.789 INFO:teuthology.orchestra.run.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/s3-tests-client.0'... 2024-09-12T00:39:25.644 INFO:tasks.s3tests:Creating rgw users... 2024-09-12T00:39:25.645 DEBUG:tasks.s3tests:Creating user foo.client.0 on client.0 2024-09-12T00:39:25.645 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foo.client.0 --display-name Mr.foo.client.0 --email foo+test@test.test --access-key XMJNDLJIZFVBRFOQJMPF --secret xoiXLvMIvRS5llPIIQJ2yebuByDhe9UNWtP1EuZSDNYxUEuvgYPm5A== --cluster ceph 2024-09-12T00:39:25.734 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:25.734 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:25.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.777+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 realm 2024-09-12T00:39:25.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:25.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:25.779 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:25.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.781+0000 7f9f01f199c0 20 searching for the correct realm 2024-09-12T00:39:25.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:25.789+0000 7f9f00220640 0 -- 172.21.15.78:0/3521942731 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f9ef80b2c10 msgr2=0x7f9ef812b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:26.000 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.001+0000 7f9effa1f640 0 -- 172.21.15.78:0/3521942731 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5566ef541c20 msgr2=0x5566ef544090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:26.011 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.012 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.013+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:26.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 zone default found 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 4 Realm: () 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 zonegroup default 2024-09-12T00:39:26.014 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.017+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.021+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.021+0000 7f9f01f199c0 20 started sync module instance, tier type = 2024-09-12T00:39:26.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.021+0000 7f9f01f199c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:26.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.041+0000 7f9f01f199c0 20 add_watcher() i=0 2024-09-12T00:39:26.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.041+0000 7f9f01f199c0 20 add_watcher() i=1 2024-09-12T00:39:26.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.041+0000 7f9f01f199c0 20 add_watcher() i=2 2024-09-12T00:39:26.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.041+0000 7f9f01f199c0 20 add_watcher() i=3 2024-09-12T00:39:26.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.041+0000 7f9f01f199c0 20 add_watcher() i=4 2024-09-12T00:39:26.039 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.041+0000 7f9f01f199c0 20 add_watcher() i=5 2024-09-12T00:39:26.040 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.041+0000 7f9f01f199c0 20 add_watcher() i=6 2024-09-12T00:39:26.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.045+0000 7f9f01f199c0 20 add_watcher() i=7 2024-09-12T00:39:26.041 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.045+0000 7f9f01f199c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:26.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9db5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:26.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:26.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:26.046 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 5 note: GC not initialized 2024-09-12T00:39:26.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9db4fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:26.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:26.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 20 Filter name: none 2024-09-12T00:39:26.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9d2e7fc640 20 reqs_thread_entry: start 2024-09-12T00:39:26.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:39:26.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x0 2024-09-12T00:39:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 10 cache get: name=default.rgw.meta+users.email+foo+test@test.test : miss 2024-09-12T00:39:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.049+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x0 2024-09-12T00:39:26.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 10 adding default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:39:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 10 cache get: name=default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF : miss 2024-09-12T00:39:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 10 cache put: name=default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF info.flags=0x0 2024-09-12T00:39:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 10 adding default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF to cache LRU end 2024-09-12T00:39:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 10 cache get: name=default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF : hit (negative entry) 2024-09-12T00:39:26.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.053+0000 7f9f01f199c0 10 cache get: name=default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF : hit (negative entry) 2024-09-12T00:39:26.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.057+0000 7f9f01f199c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:26.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.057+0000 7f9f01f199c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:26.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.057+0000 7f9f01f199c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:39:26.053 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.057+0000 7f9ddeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576398933 cookie 93900590297856 notifier 9054 bl.length()=645 2024-09-12T00:39:26.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.057+0000 7f9ddeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:26.054 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.057+0000 7f9ddeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:26.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.061+0000 7f9f01f199c0 10 cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:39:26.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.061+0000 7f9f01f199c0 10 moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:39:26.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.061+0000 7f9f01f199c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.email:foo+test@test.test, ofs0, ns] 2024-09-12T00:39:26.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.061+0000 7f9ddeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399118 cookie 93900590366768 notifier 9054 bl.length()=185 2024-09-12T00:39:26.058 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.061+0000 7f9ddeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo+test@test.test info.flags=0x7 2024-09-12T00:39:26.059 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.061+0000 7f9ddeffd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo+test@test.test to cache LRU end 2024-09-12T00:39:26.061 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.065+0000 7f9f01f199c0 10 cache put: name=default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF info.flags=0x7 2024-09-12T00:39:26.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.065+0000 7f9f01f199c0 10 moving default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF to cache LRU end 2024-09-12T00:39:26.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.065+0000 7f9f01f199c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:XMJNDLJIZFVBRFOQJMPF, ofs0, ns] 2024-09-12T00:39:26.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.065+0000 7f9dde7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1129576399137 cookie 93900590359936 notifier 9054 bl.length()=186 2024-09-12T00:39:26.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.065+0000 7f9dde7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF info.flags=0x7 2024-09-12T00:39:26.062 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.065+0000 7f9dde7fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+XMJNDLJIZFVBRFOQJMPF to cache LRU end 2024-09-12T00:39:26.063 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:26.063 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "foo.client.0", 2024-09-12T00:39:26.063 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.foo.client.0", 2024-09-12T00:39:26.064 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "foo+test@test.test", 2024-09-12T00:39:26.064 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:39:26.064 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:26.064 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:39:26.064 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:39:26.064 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:26.064 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "foo.client.0", 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "XMJNDLJIZFVBRFOQJMPF", 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "xoiXLvMIvRS5llPIIQJ2yebuByDhe9UNWtP1EuZSDNYxUEuvgYPm5A==", 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:26.055392Z" 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:39:26.065 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:26.066 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:26.067 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:26.055361Z", 2024-09-12T00:39:26.068 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:39:26.069 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:39:26.069 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:26.069 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:26.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.069+0000 7f9db5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:26.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.073+0000 7f9f01f199c0 20 remove_watcher() i=0 2024-09-12T00:39:26.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.073+0000 7f9f01f199c0 2 removed watcher, disabling cache 2024-09-12T00:39:26.071 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.073+0000 7f9f01f199c0 20 remove_watcher() i=1 2024-09-12T00:39:26.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.077+0000 7f9f01f199c0 20 remove_watcher() i=2 2024-09-12T00:39:26.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.077+0000 7f9f01f199c0 20 remove_watcher() i=3 2024-09-12T00:39:26.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.081+0000 7f9f01f199c0 20 remove_watcher() i=4 2024-09-12T00:39:26.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.081+0000 7f9f01f199c0 20 remove_watcher() i=5 2024-09-12T00:39:26.082 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.085+0000 7f9f01f199c0 20 remove_watcher() i=6 2024-09-12T00:39:26.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.089+0000 7f9f01f199c0 20 remove_watcher() i=7 2024-09-12T00:39:26.105 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foo.client.0 --totp-serial 6687138381 --totp-seed LAGIX6WK6MVP6GQPFYOTGDSDRGTKUV3P2D5SA3Z7C42LVYIFHWVXMET27OCLIEVT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:26.153 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:26.194 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.197+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.196 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 realm 2024-09-12T00:39:26.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:26.197 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:26.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:26.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.201+0000 7f629d0529c0 20 searching for the correct realm 2024-09-12T00:39:26.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.209+0000 7f629b359640 0 -- 172.21.15.78:0/2125338276 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f6294085c20 msgr2=0x7f629408a920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:26.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.421+0000 7f629b359640 0 -- 172.21.15.78:0/2125338276 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55cab83157e0 msgr2=0x55cab8317c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:26.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.433+0000 7f629d0529c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:26.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.433+0000 7f629d0529c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:26.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.433+0000 7f629d0529c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:26.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.433+0000 7f629d0529c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:26.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.433+0000 7f629d0529c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:26.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.433+0000 7f629d0529c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:26.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.433+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:26.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 zone default found 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 4 Realm: () 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 zonegroup default 2024-09-12T00:39:26.435 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.437+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.441+0000 7f629d0529c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:26.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.441+0000 7f629d0529c0 20 started sync module instance, tier type = 2024-09-12T00:39:26.437 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.441+0000 7f629d0529c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:26.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=0 2024-09-12T00:39:26.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=1 2024-09-12T00:39:26.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=2 2024-09-12T00:39:26.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=3 2024-09-12T00:39:26.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=4 2024-09-12T00:39:26.461 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=5 2024-09-12T00:39:26.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=6 2024-09-12T00:39:26.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 20 add_watcher() i=7 2024-09-12T00:39:26.463 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.465+0000 7f629d0529c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:26.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.469+0000 7f61517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:26.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.469+0000 7f629d0529c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:26.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.469+0000 7f629d0529c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:26.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.469+0000 7f629d0529c0 5 note: GC not initialized 2024-09-12T00:39:26.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f60cbfff640 20 reqs_thread_entry: start 2024-09-12T00:39:26.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:26.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 20 Filter name: none 2024-09-12T00:39:26.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f60c9ffb640 20 reqs_thread_entry: start 2024-09-12T00:39:26.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 10 cache get: name=default.rgw.meta+users.uid+foo.client.0 : miss 2024-09-12T00:39:26.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:26.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:39:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x13 2024-09-12T00:39:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 10 adding default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:26.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:26.473+0000 7f629d0529c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:28.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.145+0000 7f629d0529c0 10 cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:28.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.145+0000 7f629d0529c0 10 moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:28.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.145+0000 7f629d0529c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:foo.client.0, ofs0, ns] 2024-09-12T00:39:28.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.145+0000 7f617dffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333526 cookie 94329162004272 notifier 8480 bl.length()=659 2024-09-12T00:39:28.141 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.145+0000 7f617dffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo.client.0 info.flags=0x17 2024-09-12T00:39:28.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.145+0000 7f617dffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo.client.0 to cache LRU end 2024-09-12T00:39:28.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.145+0000 7f61517e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.149+0000 7f629d0529c0 20 remove_watcher() i=0 2024-09-12T00:39:28.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.149+0000 7f629d0529c0 2 removed watcher, disabling cache 2024-09-12T00:39:28.150 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.153+0000 7f629d0529c0 20 remove_watcher() i=1 2024-09-12T00:39:28.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.153+0000 7f629d0529c0 20 remove_watcher() i=2 2024-09-12T00:39:28.154 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.157+0000 7f629d0529c0 20 remove_watcher() i=3 2024-09-12T00:39:28.155 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.157+0000 7f629d0529c0 20 remove_watcher() i=4 2024-09-12T00:39:28.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.161+0000 7f629d0529c0 20 remove_watcher() i=5 2024-09-12T00:39:28.160 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.161+0000 7f629d0529c0 20 remove_watcher() i=6 2024-09-12T00:39:28.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.165+0000 7f629d0529c0 20 remove_watcher() i=7 2024-09-12T00:39:28.180 DEBUG:tasks.s3tests:Creating user bar.client.0 on client.0 2024-09-12T00:39:28.180 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid bar.client.0 --display-name Mr.bar.client.0 --email bar+test@test.test --access-key TXGKNBOUZZTJRZEHOUTK --secret 4lEsT+OguuTGoXi+LcyZrL/kbaLBfDgtvyWHOlxbrh1rZf3HWBjDtw== --cluster ceph 2024-09-12T00:39:28.222 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:28.223 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:28.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.265+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 realm 2024-09-12T00:39:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.269+0000 7f462e3a19c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.273+0000 7f462e3a19c0 20 searching for the correct realm 2024-09-12T00:39:28.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.277+0000 7f462c6a8640 0 -- 172.21.15.78:0/915495307 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f461c05c5a0 msgr2=0x7f461c062d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.489+0000 7f462bea7640 0 -- 172.21.15.78:0/915495307 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x5634389d7b50 msgr2=0x5634389da010 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:28.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.501+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 zone default found 2024-09-12T00:39:28.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 4 Realm: () 2024-09-12T00:39:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 zonegroup default 2024-09-12T00:39:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.505+0000 7f462e3a19c0 20 started sync module instance, tier type = 2024-09-12T00:39:28.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.509+0000 7f462e3a19c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.529+0000 7f462e3a19c0 20 add_watcher() i=0 2024-09-12T00:39:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.529+0000 7f462e3a19c0 20 add_watcher() i=1 2024-09-12T00:39:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.529+0000 7f462e3a19c0 20 add_watcher() i=2 2024-09-12T00:39:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.529+0000 7f462e3a19c0 20 add_watcher() i=3 2024-09-12T00:39:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.529+0000 7f462e3a19c0 20 add_watcher() i=4 2024-09-12T00:39:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.529+0000 7f462e3a19c0 20 add_watcher() i=5 2024-09-12T00:39:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.529+0000 7f462e3a19c0 20 add_watcher() i=6 2024-09-12T00:39:28.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.533+0000 7f462e3a19c0 20 add_watcher() i=7 2024-09-12T00:39:28.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.533+0000 7f462e3a19c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:28.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.537+0000 7f44e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.537+0000 7f462e3a19c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:28.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.537+0000 7f462e3a19c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:28.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.537+0000 7f462e3a19c0 5 note: GC not initialized 2024-09-12T00:39:28.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.537+0000 7f44e17e2640 20 reqs_thread_entry: start 2024-09-12T00:39:28.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.537+0000 7f462e3a19c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:28.536 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 20 Filter name: none 2024-09-12T00:39:28.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f44daffd640 20 reqs_thread_entry: start 2024-09-12T00:39:28.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:39:28.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x0 2024-09-12T00:39:28.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache get: name=default.rgw.meta+users.email+bar+test@test.test : miss 2024-09-12T00:39:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x0 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 adding default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache get: name=default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK : miss 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache put: name=default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK info.flags=0x0 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 adding default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK to cache LRU end 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache get: name=default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK : hit (negative entry) 2024-09-12T00:39:28.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.541+0000 7f462e3a19c0 10 cache get: name=default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK : hit (negative entry) 2024-09-12T00:39:28.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.545+0000 7f462e3a19c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:28.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.545+0000 7f462e3a19c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:28.540 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.545+0000 7f462e3a19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:39:28.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.545+0000 7f450affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333711 cookie 94782288200960 notifier 8498 bl.length()=645 2024-09-12T00:39:28.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.545+0000 7f450affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:28.541 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.545+0000 7f450affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.549+0000 7f462e3a19c0 10 cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:39:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.549+0000 7f462e3a19c0 10 moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:39:28.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.549+0000 7f462e3a19c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:bar+test@test.test, ofs0, ns] 2024-09-12T00:39:28.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.549+0000 7f450affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333730 cookie 94782288209120 notifier 8498 bl.length()=185 2024-09-12T00:39:28.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.549+0000 7f450affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+bar+test@test.test info.flags=0x7 2024-09-12T00:39:28.546 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.549+0000 7f450affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+bar+test@test.test to cache LRU end 2024-09-12T00:39:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.553+0000 7f462e3a19c0 10 cache put: name=default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK info.flags=0x7 2024-09-12T00:39:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.553+0000 7f462e3a19c0 10 moving default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK to cache LRU end 2024-09-12T00:39:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.553+0000 7f462e3a19c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:TXGKNBOUZZTJRZEHOUTK, ofs0, ns] 2024-09-12T00:39:28.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.553+0000 7f450affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333712 cookie 94782288200960 notifier 8498 bl.length()=186 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.553+0000 7f450affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK info.flags=0x7 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.553+0000 7f450affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+TXGKNBOUZZTJRZEHOUTK to cache LRU end 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "bar.client.0", 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.bar.client.0", 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "bar+test@test.test", 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:39:28.550 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "bar.client.0", 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "TXGKNBOUZZTJRZEHOUTK", 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "4lEsT+OguuTGoXi+LcyZrL/kbaLBfDgtvyWHOlxbrh1rZf3HWBjDtw==", 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:28.544258Z" 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:39:28.551 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:28.552 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:28.544226Z", 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:28.553 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:28.554 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.553+0000 7f44e27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.557+0000 7f462e3a19c0 20 remove_watcher() i=0 2024-09-12T00:39:28.556 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.557+0000 7f462e3a19c0 2 removed watcher, disabling cache 2024-09-12T00:39:28.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.561+0000 7f462e3a19c0 20 remove_watcher() i=1 2024-09-12T00:39:28.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.561+0000 7f462e3a19c0 20 remove_watcher() i=2 2024-09-12T00:39:28.562 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.565+0000 7f462e3a19c0 20 remove_watcher() i=3 2024-09-12T00:39:28.564 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.565+0000 7f462e3a19c0 20 remove_watcher() i=4 2024-09-12T00:39:28.566 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.569+0000 7f462e3a19c0 20 remove_watcher() i=5 2024-09-12T00:39:28.569 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.573+0000 7f462e3a19c0 20 remove_watcher() i=6 2024-09-12T00:39:28.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.573+0000 7f462e3a19c0 20 remove_watcher() i=7 2024-09-12T00:39:28.591 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid bar.client.0 --totp-serial 2560120184 --totp-seed RM7DOTCHQPY2G474LH55C4334BY4QZIS4I6WUEEPP6THNDLR62IPUOTU75RKBAJR --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:28.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.725+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.725+0000 7fb8310349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.725+0000 7fb8310349c0 20 realm 2024-09-12T00:39:28.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.725+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.725+0000 7fb8310349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.725+0000 7fb8310349c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.725+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.729+0000 7fb8310349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.729+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.726 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.729+0000 7fb8310349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.729+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.727 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.729+0000 7fb8310349c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:28.728 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.729+0000 7fb8310349c0 20 searching for the correct realm 2024-09-12T00:39:28.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.733+0000 7fb82f33b640 0 -- 172.21.15.78:0/1331538030 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7fb820011410 msgr2=0x7fb820011870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.741+0000 7fb82eb3a640 0 -- 172.21.15.78:0/1331538030 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x562394333ee0 msgr2=0x562394336370 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:28.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.749+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 zone default found 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 4 Realm: () 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:28.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 zonegroup default 2024-09-12T00:39:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 started sync module instance, tier type = 2024-09-12T00:39:28.752 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.753+0000 7fb8310349c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:28.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=0 2024-09-12T00:39:28.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=1 2024-09-12T00:39:28.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=2 2024-09-12T00:39:28.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=3 2024-09-12T00:39:28.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=4 2024-09-12T00:39:28.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=5 2024-09-12T00:39:28.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=6 2024-09-12T00:39:28.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 20 add_watcher() i=7 2024-09-12T00:39:28.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.773+0000 7fb8310349c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb6e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb8310349c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb8310349c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb8310349c0 5 note: GC not initialized 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb6e4fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb8310349c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb8310349c0 20 Filter name: none 2024-09-12T00:39:28.776 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb6ddffb640 20 reqs_thread_entry: start 2024-09-12T00:39:28.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb8310349c0 10 cache get: name=default.rgw.meta+users.uid+bar.client.0 : miss 2024-09-12T00:39:28.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.777+0000 7fb8310349c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:28.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.781+0000 7fb8310349c0 20 rados_obj.operate() r=0 bl.length=460 2024-09-12T00:39:28.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.781+0000 7fb8310349c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x13 2024-09-12T00:39:28.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.781+0000 7fb8310349c0 10 adding default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:28.777 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.781+0000 7fb8310349c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb8310349c0 10 cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb8310349c0 10 moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:28.781 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb8310349c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:bar.client.0, ofs0, ns] 2024-09-12T00:39:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb7127fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333713 cookie 94710810294368 notifier 8516 bl.length()=659 2024-09-12T00:39:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb7127fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:28.782 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb7127fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb711ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1138166333714 cookie 94710810294368 notifier 8516 bl.length()=659 2024-09-12T00:39:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb711ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar.client.0 info.flags=0x17 2024-09-12T00:39:28.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.785+0000 7fb711ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar.client.0 to cache LRU end 2024-09-12T00:39:28.785 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.789+0000 7fb6e5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:28.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.793+0000 7fb8310349c0 20 remove_watcher() i=0 2024-09-12T00:39:28.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.793+0000 7fb8310349c0 2 removed watcher, disabling cache 2024-09-12T00:39:28.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.793+0000 7fb8310349c0 20 remove_watcher() i=1 2024-09-12T00:39:28.793 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.797+0000 7fb8310349c0 20 remove_watcher() i=2 2024-09-12T00:39:28.795 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.797+0000 7fb8310349c0 20 remove_watcher() i=3 2024-09-12T00:39:28.797 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.801+0000 7fb8310349c0 20 remove_watcher() i=4 2024-09-12T00:39:28.799 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.801+0000 7fb8310349c0 20 remove_watcher() i=5 2024-09-12T00:39:28.802 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.805+0000 7fb8310349c0 20 remove_watcher() i=6 2024-09-12T00:39:28.805 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:28.809+0000 7fb8310349c0 20 remove_watcher() i=7 2024-09-12T00:39:28.819 DEBUG:tasks.s3tests:Creating user testx$tenanteduser.client.0 on client.0 2024-09-12T00:39:28.820 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid 'testx$tenanteduser.client.0' --display-name 'Mr.testx$tenanteduser.client.0' --email 'testx$tenanteduser+test@test.test' --access-key EQJVGGJEHPQLFMVOUIHC --secret jjhikHM5leiryal2gS9ASbIjYP3hltCSHmDV7I4CRzQu0VU0L5y5cA== --cluster ceph 2024-09-12T00:39:28.859 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:28.859 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:29.098 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.101+0000 7f6547c3e640 0 --2- 172.21.15.78:0/3630662470 >> [v2:172.21.15.78:3301/0,v1:172.21.15.78:6790/0] conn(0x5600c8b32470 0x5600c8b32850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request get_initial_auth_request returned -2 2024-09-12T00:39:29.105 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.109+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.109+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.109+0000 7f654a9399c0 20 realm 2024-09-12T00:39:29.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.109+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.109 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:29.111 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.113+0000 7f654a9399c0 20 searching for the correct realm 2024-09-12T00:39:29.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.117+0000 7f6547c3e640 0 -- 172.21.15.78:0/1978561056 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f6538021410 msgr2=0x7f6538021830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.148 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.149+0000 7f654843f640 0 -- 172.21.15.78:0/1978561056 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f653011fc20 msgr2=0x7f65300fec50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:29.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:29.368 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.369 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.369+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:29.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 zone default found 2024-09-12T00:39:29.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 4 Realm: () 2024-09-12T00:39:29.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:29.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 zonegroup default 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.373 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 started sync module instance, tier type = 2024-09-12T00:39:29.374 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.373+0000 7f654a9399c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:29.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.397+0000 7f654a9399c0 20 add_watcher() i=0 2024-09-12T00:39:29.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.397+0000 7f654a9399c0 20 add_watcher() i=1 2024-09-12T00:39:29.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.397+0000 7f654a9399c0 20 add_watcher() i=2 2024-09-12T00:39:29.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.397+0000 7f654a9399c0 20 add_watcher() i=3 2024-09-12T00:39:29.396 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.397+0000 7f654a9399c0 20 add_watcher() i=4 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.397+0000 7f654a9399c0 20 add_watcher() i=5 2024-09-12T00:39:29.397 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.401+0000 7f654a9399c0 20 add_watcher() i=6 2024-09-12T00:39:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.401+0000 7f654a9399c0 20 add_watcher() i=7 2024-09-12T00:39:29.400 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.401+0000 7f654a9399c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:29.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f63fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f654a9399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:29.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f654a9399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:29.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f654a9399c0 5 note: GC not initialized 2024-09-12T00:39:29.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f63fdfdb640 20 reqs_thread_entry: start 2024-09-12T00:39:29.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f654a9399c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:29.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f654a9399c0 20 Filter name: none 2024-09-12T00:39:29.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f636f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:29.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f654a9399c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:39:29.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.405+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x0 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 cache get: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test : miss 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x0 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 adding default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 cache get: name=default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC : miss 2024-09-12T00:39:29.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 cache put: name=default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC info.flags=0x0 2024-09-12T00:39:29.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 adding default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC to cache LRU end 2024-09-12T00:39:29.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 cache get: name=default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC : hit (negative entry) 2024-09-12T00:39:29.407 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.409+0000 7f654a9399c0 10 cache get: name=default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC : hit (negative entry) 2024-09-12T00:39:29.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.413+0000 7f654a9399c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:29.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.413+0000 7f654a9399c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:29.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.413+0000 7f654a9399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:39:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.413+0000 7f641f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301027 cookie 94561367349936 notifier 9126 bl.length()=719 2024-09-12T00:39:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.413+0000 7f641f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:29.411 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.413+0000 7f641f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.417+0000 7f654a9399c0 10 cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:39:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.417+0000 7f654a9399c0 10 moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:39:29.414 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.417+0000 7f654a9399c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.email:testx$tenanteduser+test@test.test, ofs0, ns] 2024-09-12T00:39:29.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.417+0000 7f641f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301028 cookie 94561367356032 notifier 9126 bl.length()=215 2024-09-12T00:39:29.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.417+0000 7f641f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+testx$tenanteduser+test@test.test info.flags=0x7 2024-09-12T00:39:29.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.417+0000 7f641f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+testx$tenanteduser+test@test.test to cache LRU end 2024-09-12T00:39:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.421+0000 7f654a9399c0 10 cache put: name=default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC info.flags=0x7 2024-09-12T00:39:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.421+0000 7f654a9399c0 10 moving default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC to cache LRU end 2024-09-12T00:39:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.421+0000 7f654a9399c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:EQJVGGJEHPQLFMVOUIHC, ofs0, ns] 2024-09-12T00:39:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.421+0000 7f641f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301011 cookie 94561367331232 notifier 9126 bl.length()=201 2024-09-12T00:39:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.421+0000 7f641f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC info.flags=0x7 2024-09-12T00:39:29.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.421+0000 7f641f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+EQJVGGJEHPQLFMVOUIHC to cache LRU end 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "testx$tenanteduser.client.0", 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.testx$tenanteduser.client.0", 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "testx$tenanteduser+test@test.test", 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "testx$tenanteduser.client.0", 2024-09-12T00:39:29.420 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "EQJVGGJEHPQLFMVOUIHC", 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "jjhikHM5leiryal2gS9ASbIjYP3hltCSHmDV7I4CRzQu0VU0L5y5cA==", 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:29.411864Z" 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:29.421 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:29.422 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:29.411833Z", 2024-09-12T00:39:29.423 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:39:29.424 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:39:29.424 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:29.424 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:29.424 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.425+0000 7f63fefdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.429+0000 7f654a9399c0 20 remove_watcher() i=0 2024-09-12T00:39:29.426 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.429+0000 7f654a9399c0 2 removed watcher, disabling cache 2024-09-12T00:39:29.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.429+0000 7f654a9399c0 20 remove_watcher() i=1 2024-09-12T00:39:29.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.433+0000 7f654a9399c0 20 remove_watcher() i=2 2024-09-12T00:39:29.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.437+0000 7f654a9399c0 20 remove_watcher() i=3 2024-09-12T00:39:29.434 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.437+0000 7f654a9399c0 20 remove_watcher() i=4 2024-09-12T00:39:29.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.441+0000 7f654a9399c0 20 remove_watcher() i=5 2024-09-12T00:39:29.440 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.441+0000 7f654a9399c0 20 remove_watcher() i=6 2024-09-12T00:39:29.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.445+0000 7f654a9399c0 20 remove_watcher() i=7 2024-09-12T00:39:29.460 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid 'testx$tenanteduser.client.0' --totp-serial 4214901358 --totp-seed DAEXYBMXYM6UB35ZMLGCD5NZNGFJR4BY5FIFV563QQXAWXNW2BTAGFZETZRSFZFP --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:29.553 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:29.553 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:29.594 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.597+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 realm 2024-09-12T00:39:29.596 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:29.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.597 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.598 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:29.599 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.601+0000 7f37d7fc79c0 20 searching for the correct realm 2024-09-12T00:39:29.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.609+0000 7f37d62ce640 0 -- 172.21.15.78:0/2209916851 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f37c80838d0 msgr2=0x7f37c8077af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.821 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.825+0000 7f37d5acd640 0 -- 172.21.15.78:0/2209916851 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x561e86f34490 msgr2=0x561e86f36920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:29.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.833+0000 7f37d7fc79c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:29.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.833+0000 7f37d7fc79c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:29.832 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.833+0000 7f37d7fc79c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:29.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.833+0000 7f37d7fc79c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:29.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.833+0000 7f37d7fc79c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:29.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.833+0000 7f37d7fc79c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:29.833 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.833+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:29.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.834 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 zone default found 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 4 Realm: () 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 zonegroup default 2024-09-12T00:39:29.835 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.836 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.837+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.841+0000 7f37d7fc79c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:29.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.841+0000 7f37d7fc79c0 20 started sync module instance, tier type = 2024-09-12T00:39:29.837 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.841+0000 7f37d7fc79c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:29.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.861+0000 7f37d7fc79c0 20 add_watcher() i=0 2024-09-12T00:39:29.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.861+0000 7f37d7fc79c0 20 add_watcher() i=1 2024-09-12T00:39:29.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.861+0000 7f37d7fc79c0 20 add_watcher() i=2 2024-09-12T00:39:29.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.861+0000 7f37d7fc79c0 20 add_watcher() i=3 2024-09-12T00:39:29.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.861+0000 7f37d7fc79c0 20 add_watcher() i=4 2024-09-12T00:39:29.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.861+0000 7f37d7fc79c0 20 add_watcher() i=5 2024-09-12T00:39:29.860 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.861+0000 7f37d7fc79c0 20 add_watcher() i=6 2024-09-12T00:39:29.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.865+0000 7f37d7fc79c0 20 add_watcher() i=7 2024-09-12T00:39:29.862 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.865+0000 7f37d7fc79c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f3687fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f37d7fc79c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f37d7fc79c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:29.866 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f37d7fc79c0 5 note: GC not initialized 2024-09-12T00:39:29.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f3686ffd640 20 reqs_thread_entry: start 2024-09-12T00:39:29.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f37d7fc79c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:29.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f37d7fc79c0 20 Filter name: none 2024-09-12T00:39:29.867 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f3684ff9640 20 reqs_thread_entry: start 2024-09-12T00:39:29.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f37d7fc79c0 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 : miss 2024-09-12T00:39:29.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.869+0000 7f37d7fc79c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:29.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.873+0000 7f37d7fc79c0 20 rados_obj.operate() r=0 bl.length=519 2024-09-12T00:39:29.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.873+0000 7f37d7fc79c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x13 2024-09-12T00:39:29.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.873+0000 7f37d7fc79c0 10 adding default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:29.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.873+0000 7f37d7fc79c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.877+0000 7f37d7fc79c0 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.877+0000 7f37d7fc79c0 10 moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:29.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.877+0000 7f37d7fc79c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser.client.0, ofs0, ns] 2024-09-12T00:39:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.877+0000 7f36b97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301029 cookie 94689113170224 notifier 9144 bl.length()=733 2024-09-12T00:39:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.877+0000 7f36b97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser.client.0 info.flags=0x17 2024-09-12T00:39:29.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.877+0000 7f36b97fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser.client.0 to cache LRU end 2024-09-12T00:39:29.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.881+0000 7f3687fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.885+0000 7f37d7fc79c0 20 remove_watcher() i=0 2024-09-12T00:39:29.883 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.885+0000 7f37d7fc79c0 2 removed watcher, disabling cache 2024-09-12T00:39:29.885 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.889+0000 7f37d7fc79c0 20 remove_watcher() i=1 2024-09-12T00:39:29.887 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.889+0000 7f37d7fc79c0 20 remove_watcher() i=2 2024-09-12T00:39:29.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.893+0000 7f37d7fc79c0 20 remove_watcher() i=3 2024-09-12T00:39:29.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.893+0000 7f37d7fc79c0 20 remove_watcher() i=4 2024-09-12T00:39:29.894 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.897+0000 7f37d7fc79c0 20 remove_watcher() i=5 2024-09-12T00:39:29.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.901+0000 7f37d7fc79c0 20 remove_watcher() i=6 2024-09-12T00:39:29.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:29.901+0000 7f37d7fc79c0 20 remove_watcher() i=7 2024-09-12T00:39:29.924 DEBUG:tasks.s3tests:Creating user foobar.client.0 on client.0 2024-09-12T00:39:29.924 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid foobar.client.0 --display-name Mr.foobar.client.0 --email foobar+test@test.test --access-key ZYQRFLULJWKADUISWLKU --secret Z7UwslftZWAc186ylcMb9Aw4fDb/yUXbvy9gUJAtoQfOkivpg7rL2A== --cluster ceph 2024-09-12T00:39:29.967 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:29.967 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:30.013 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 realm 2024-09-12T00:39:30.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:30.015 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.016 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.017+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.021+0000 7f3447a959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.017 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.021+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.021+0000 7f3447a959c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:30.018 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.021+0000 7f3447a959c0 20 searching for the correct realm 2024-09-12T00:39:30.024 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.025+0000 7f3445d9c640 0 -- 172.21.15.78:0/725814171 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f34400df400 msgr2=0x7f34400df860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:30.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.241+0000 7f344559b640 0 -- 172.21.15.78:0/725814171 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x555c7e270af0 msgr2=0x555c7e272fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:30.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.249+0000 7f3447a959c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:30.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.249+0000 7f3447a959c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:30.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.249+0000 7f3447a959c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:30.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.249+0000 7f3447a959c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:30.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.249+0000 7f3447a959c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:30.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.249+0000 7f3447a959c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:30.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.249+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:30.250 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 zone default found 2024-09-12T00:39:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 4 Realm: () 2024-09-12T00:39:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 zonegroup default 2024-09-12T00:39:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.251 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.252 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.253+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.257+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.257+0000 7f3447a959c0 20 started sync module instance, tier type = 2024-09-12T00:39:30.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.257+0000 7f3447a959c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:30.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.277+0000 7f3447a959c0 20 add_watcher() i=0 2024-09-12T00:39:30.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 20 add_watcher() i=1 2024-09-12T00:39:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 20 add_watcher() i=2 2024-09-12T00:39:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 20 add_watcher() i=3 2024-09-12T00:39:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 20 add_watcher() i=4 2024-09-12T00:39:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 20 add_watcher() i=5 2024-09-12T00:39:30.277 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 20 add_watcher() i=6 2024-09-12T00:39:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 20 add_watcher() i=7 2024-09-12T00:39:30.279 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.281+0000 7f3447a959c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.285+0000 7f32fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.285+0000 7f3447a959c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.285+0000 7f3447a959c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:30.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.285+0000 7f3447a959c0 5 note: GC not initialized 2024-09-12T00:39:30.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.285+0000 7f32f9fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:30.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.285+0000 7f3447a959c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.285+0000 7f3447a959c0 20 Filter name: none 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f326b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x0 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:30.285 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache get: name=default.rgw.meta+users.email+foobar+test@test.test : miss 2024-09-12T00:39:30.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x0 2024-09-12T00:39:30.286 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 adding default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:39:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache get: name=default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU : miss 2024-09-12T00:39:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache put: name=default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU info.flags=0x0 2024-09-12T00:39:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 adding default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU to cache LRU end 2024-09-12T00:39:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache get: name=default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU : hit (negative entry) 2024-09-12T00:39:30.287 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.289+0000 7f3447a959c0 10 cache get: name=default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU : hit (negative entry) 2024-09-12T00:39:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.293+0000 7f3447a959c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.293+0000 7f3447a959c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.293+0000 7f3447a959c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:39:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.293+0000 7f331b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301030 cookie 93855741921872 notifier 8567 bl.length()=660 2024-09-12T00:39:30.290 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.293+0000 7f331b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:30.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.293+0000 7f331b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.297+0000 7f3447a959c0 10 cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:39:30.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.297+0000 7f3447a959c0 10 moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:39:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.297+0000 7f3447a959c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.email:foobar+test@test.test, ofs0, ns] 2024-09-12T00:39:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.297+0000 7f331affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301012 cookie 93855741907920 notifier 8567 bl.length()=191 2024-09-12T00:39:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.297+0000 7f331affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foobar+test@test.test info.flags=0x7 2024-09-12T00:39:30.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.297+0000 7f331affd640 10 rgw watcher librados: moving default.rgw.meta+users.email+foobar+test@test.test to cache LRU end 2024-09-12T00:39:30.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.301+0000 7f3447a959c0 10 cache put: name=default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU info.flags=0x7 2024-09-12T00:39:30.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.301+0000 7f3447a959c0 10 moving default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU to cache LRU end 2024-09-12T00:39:30.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.301+0000 7f3447a959c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:ZYQRFLULJWKADUISWLKU, ofs0, ns] 2024-09-12T00:39:30.297 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.301+0000 7f331affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300826 cookie 93855741912672 notifier 8567 bl.length()=189 2024-09-12T00:39:30.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.301+0000 7f331affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU info.flags=0x7 2024-09-12T00:39:30.298 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.301+0000 7f331affd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+ZYQRFLULJWKADUISWLKU to cache LRU end 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "foobar.client.0", 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "foobar+test@test.test", 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:39:30.299 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "foobar.client.0", 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "ZYQRFLULJWKADUISWLKU", 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "Z7UwslftZWAc186ylcMb9Aw4fDb/yUXbvy9gUJAtoQfOkivpg7rL2A==", 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:30.292286Z" 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:39:30.300 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:30.301 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:30.292257Z", 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:30.302 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.305+0000 7f32fafdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.309+0000 7f3447a959c0 20 remove_watcher() i=0 2024-09-12T00:39:30.305 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.309+0000 7f3447a959c0 2 removed watcher, disabling cache 2024-09-12T00:39:30.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.309+0000 7f3447a959c0 20 remove_watcher() i=1 2024-09-12T00:39:30.308 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.313+0000 7f3447a959c0 20 remove_watcher() i=2 2024-09-12T00:39:30.311 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.313+0000 7f3447a959c0 20 remove_watcher() i=3 2024-09-12T00:39:30.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.317+0000 7f3447a959c0 20 remove_watcher() i=4 2024-09-12T00:39:30.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.317+0000 7f3447a959c0 20 remove_watcher() i=5 2024-09-12T00:39:30.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.321+0000 7f3447a959c0 20 remove_watcher() i=6 2024-09-12T00:39:30.321 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.325+0000 7f3447a959c0 20 remove_watcher() i=7 2024-09-12T00:39:30.338 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid foobar.client.0 --totp-serial 5563173226 --totp-seed NIFN2ENCNMVW6ZHXCS3GHSI4GCZLMQJEHHJWBVCNNG3TV57YY4STMXJCD325YNYZ --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:30.428 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:30.469 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.473+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.471 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.473+0000 7f3fe67af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.473+0000 7f3fe67af9c0 20 realm 2024-09-12T00:39:30.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.473+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.473+0000 7f3fe67af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.473+0000 7f3fe67af9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:30.472 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.473+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.477+0000 7f3fe67af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.477+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.477+0000 7f3fe67af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.473 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.477+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.477+0000 7f3fe67af9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:30.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.477+0000 7f3fe67af9c0 20 searching for the correct realm 2024-09-12T00:39:30.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.481+0000 7f3fe4ab6640 0 -- 172.21.15.78:0/3492031064 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f3fdc090910 msgr2=0x7f3fdc05b680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:30.691 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.693+0000 7f3fe42b5640 0 -- 172.21.15.78:0/3492031064 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55b536d41520 msgr2=0x55b536d43990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:30.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.705+0000 7f3fe67af9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:30.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.705+0000 7f3fe67af9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:30.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.705+0000 7f3fe67af9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:30.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.705+0000 7f3fe67af9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:30.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.705+0000 7f3fe67af9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:30.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.705+0000 7f3fe67af9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:30.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.705+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 zone default found 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 4 Realm: () 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 zonegroup default 2024-09-12T00:39:30.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.709+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.713+0000 7f3fe67af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.708 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.713+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.713+0000 7f3fe67af9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.713+0000 7f3fe67af9c0 20 started sync module instance, tier type = 2024-09-12T00:39:30.709 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.713+0000 7f3fe67af9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.733+0000 7f3fe67af9c0 20 add_watcher() i=0 2024-09-12T00:39:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.733+0000 7f3fe67af9c0 20 add_watcher() i=1 2024-09-12T00:39:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.733+0000 7f3fe67af9c0 20 add_watcher() i=2 2024-09-12T00:39:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.733+0000 7f3fe67af9c0 20 add_watcher() i=3 2024-09-12T00:39:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.733+0000 7f3fe67af9c0 20 add_watcher() i=4 2024-09-12T00:39:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.733+0000 7f3fe67af9c0 20 add_watcher() i=5 2024-09-12T00:39:30.732 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.733+0000 7f3fe67af9c0 20 add_watcher() i=6 2024-09-12T00:39:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.737+0000 7f3fe67af9c0 20 add_watcher() i=7 2024-09-12T00:39:30.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.737+0000 7f3fe67af9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3e9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3fe67af9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3fe67af9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:30.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3fe67af9c0 5 note: GC not initialized 2024-09-12T00:39:30.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3e99fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:30.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3fe67af9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:30.740 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3fe67af9c0 20 Filter name: none 2024-09-12T00:39:30.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.741+0000 7f3e0b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:30.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.745+0000 7f3fe67af9c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:39:30.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.745+0000 7f3fe67af9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.741 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.745+0000 7f3fe67af9c0 20 rados_obj.operate() r=0 bl.length=472 2024-09-12T00:39:30.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.745+0000 7f3fe67af9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:39:30.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.745+0000 7f3fe67af9c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:30.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.745+0000 7f3fe67af9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:30.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.749+0000 7f3fe67af9c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:30.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.749+0000 7f3fe67af9c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:30.746 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.749+0000 7f3fe67af9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:39:30.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.749+0000 7f3ebb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301031 cookie 94236797388608 notifier 9183 bl.length()=674 2024-09-12T00:39:30.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.749+0000 7f3ebb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:30.747 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.749+0000 7f3ebb7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:30.750 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.753+0000 7f3e9afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:30.754 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.757+0000 7f3fe67af9c0 20 remove_watcher() i=0 2024-09-12T00:39:30.755 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.757+0000 7f3fe67af9c0 2 removed watcher, disabling cache 2024-09-12T00:39:30.757 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.761+0000 7f3fe67af9c0 20 remove_watcher() i=1 2024-09-12T00:39:30.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.761+0000 7f3fe67af9c0 20 remove_watcher() i=2 2024-09-12T00:39:30.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.765+0000 7f3fe67af9c0 20 remove_watcher() i=3 2024-09-12T00:39:30.764 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.765+0000 7f3fe67af9c0 20 remove_watcher() i=4 2024-09-12T00:39:30.766 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.769+0000 7f3fe67af9c0 20 remove_watcher() i=5 2024-09-12T00:39:30.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.773+0000 7f3fe67af9c0 20 remove_watcher() i=6 2024-09-12T00:39:30.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.773+0000 7f3fe67af9c0 20 remove_watcher() i=7 2024-09-12T00:39:30.792 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 caps add --uid foobar.client.0 --caps 'oidc-provider=*;roles=*;user-policy=*' --cluster ceph 2024-09-12T00:39:30.829 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:30.829 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:30.872 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.873+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 realm 2024-09-12T00:39:30.874 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:30.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:30.875 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:30.876 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.877+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:30.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.881+0000 7fc0556269c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:30.877 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.881+0000 7fc0556269c0 20 searching for the correct realm 2024-09-12T00:39:30.879 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:30.881+0000 7fc05292b640 0 -- 172.21.15.78:0/3533826922 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fc0440d5040 msgr2=0x7fc0440b8420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.097+0000 7fc05312c640 0 -- 172.21.15.78:0/3533826922 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fc040003100 msgr2=0x7fc03c031930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.721+0000 7fc0556269c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.721+0000 7fc0556269c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.721+0000 7fc0556269c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:31.720 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.721+0000 7fc0556269c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.721+0000 7fc0556269c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.721+0000 7fc0556269c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.721+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.721 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:31.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 zone default found 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 4 Realm: () 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 zonegroup default 2024-09-12T00:39:31.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.725+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.729+0000 7fc0556269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:31.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.729+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.729+0000 7fc0556269c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.729+0000 7fc0556269c0 20 started sync module instance, tier type = 2024-09-12T00:39:31.725 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.729+0000 7fc0556269c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=0 2024-09-12T00:39:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=1 2024-09-12T00:39:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=2 2024-09-12T00:39:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=3 2024-09-12T00:39:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=4 2024-09-12T00:39:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=5 2024-09-12T00:39:31.749 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=6 2024-09-12T00:39:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 20 add_watcher() i=7 2024-09-12T00:39:31.751 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.753+0000 7fc0556269c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.757+0000 7fbf09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.757+0000 7fc0556269c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.757+0000 7fc0556269c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.757+0000 7fc0556269c0 5 note: GC not initialized 2024-09-12T00:39:31.758 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.757+0000 7fbf08fe1640 20 reqs_thread_entry: start 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 20 Filter name: none 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fbe827fc640 20 reqs_thread_entry: start 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 10 cache get: name=default.rgw.meta+users.uid+foobar.client.0 : miss 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 20 rados_obj.operate() r=0 bl.length=486 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x13 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 10 adding default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:31.759 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.761+0000 7fc0556269c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.765+0000 7fc0556269c0 10 cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.765+0000 7fc0556269c0 10 moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.765+0000 7fc0556269c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:foobar.client.0, ofs0, ns] 2024-09-12T00:39:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.765+0000 7fbf36ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301032 cookie 94719080515280 notifier 9201 bl.length()=727 2024-09-12T00:39:31.762 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.765+0000 7fbf36ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foobar.client.0 info.flags=0x17 2024-09-12T00:39:31.763 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.765+0000 7fbf36ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foobar.client.0 to cache LRU end 2024-09-12T00:39:31.764 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:31.764 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "foobar.client.0", 2024-09-12T00:39:31.764 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.foobar.client.0", 2024-09-12T00:39:31.764 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "foobar+test@test.test", 2024-09-12T00:39:31.764 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:39:31.764 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "foobar.client.0", 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "ZYQRFLULJWKADUISWLKU", 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "Z7UwslftZWAc186ylcMb9Aw4fDb/yUXbvy9gUJAtoQfOkivpg7rL2A==", 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:30.292286Z" 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [ 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:31.765 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "oidc-provider", 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "perm": "*" 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "roles", 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "perm": "*" 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "user-policy", 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "perm": "*" 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:39:31.766 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:31.767 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "rgw", 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [ 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "5563173226" 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "", 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:30.292257Z", 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:39:31.768 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:31.769 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:31.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.769+0000 7fbf09fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:31.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.773+0000 7fc0556269c0 20 remove_watcher() i=0 2024-09-12T00:39:31.769 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.773+0000 7fc0556269c0 2 removed watcher, disabling cache 2024-09-12T00:39:31.771 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.773+0000 7fc0556269c0 20 remove_watcher() i=1 2024-09-12T00:39:31.773 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.777+0000 7fc0556269c0 20 remove_watcher() i=2 2024-09-12T00:39:31.775 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.777+0000 7fc0556269c0 20 remove_watcher() i=3 2024-09-12T00:39:31.778 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.781+0000 7fc0556269c0 20 remove_watcher() i=4 2024-09-12T00:39:31.780 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.785+0000 7fc0556269c0 20 remove_watcher() i=5 2024-09-12T00:39:31.783 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.785+0000 7fc0556269c0 20 remove_watcher() i=6 2024-09-12T00:39:31.786 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.789+0000 7fc0556269c0 20 remove_watcher() i=7 2024-09-12T00:39:31.802 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW88888888888888888 --account-name Mr.RGW88888888888888888 --email RGW88888888888888888+test@test.test 2024-09-12T00:39:31.888 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:31.888 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:31.929 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.933+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.933+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.933+0000 7f643704f9c0 20 realm 2024-09-12T00:39:31.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.933+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:31.933 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:31.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:31.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:31.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.937+0000 7f643704f9c0 20 searching for the correct realm 2024-09-12T00:39:31.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:31.945+0000 7f6435356640 0 -- 172.21.15.78:0/282068276 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f642403a390 msgr2=0x7f642403a7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:32.157 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.161+0000 7f6434b55640 0 -- 172.21.15.78:0/282068276 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ae8a52f600 msgr2=0x55ae8a531ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:32.169 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:32.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.173+0000 7f643704f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 zone default found 2024-09-12T00:39:32.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 4 Realm: () 2024-09-12T00:39:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 zonegroup default 2024-09-12T00:39:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.174 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 started sync module instance, tier type = 2024-09-12T00:39:32.175 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.177+0000 7f643704f9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.201+0000 7f643704f9c0 20 add_watcher() i=0 2024-09-12T00:39:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.201+0000 7f643704f9c0 20 add_watcher() i=1 2024-09-12T00:39:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.201+0000 7f643704f9c0 20 add_watcher() i=2 2024-09-12T00:39:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.201+0000 7f643704f9c0 20 add_watcher() i=3 2024-09-12T00:39:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.201+0000 7f643704f9c0 20 add_watcher() i=4 2024-09-12T00:39:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.201+0000 7f643704f9c0 20 add_watcher() i=5 2024-09-12T00:39:32.199 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.201+0000 7f643704f9c0 20 add_watcher() i=6 2024-09-12T00:39:32.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.205+0000 7f643704f9c0 20 add_watcher() i=7 2024-09-12T00:39:32.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.205+0000 7f643704f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:32.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f62eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:32.205 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:32.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:32.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 5 note: GC not initialized 2024-09-12T00:39:32.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f62e9fe3640 20 reqs_thread_entry: start 2024-09-12T00:39:32.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:32.206 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 Filter name: none 2024-09-12T00:39:32.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f625b7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:32.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 : miss 2024-09-12T00:39:32.207 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x0 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 failed to read name.$Mr.RGW88888888888888888 with: (2) No such file or directory 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 10 cache get: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test : miss 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.209+0000 7f643704f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f643704f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f643704f9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x0 2024-09-12T00:39:32.208 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f643704f9c0 10 adding default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:39:32.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f643704f9c0 20 failed to read rgw88888888888888888+test@test.test with: (2) No such file or directory 2024-09-12T00:39:32.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f643704f9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:32.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f643704f9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:32.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f643704f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW88888888888888888, ofs0, ns] 2024-09-12T00:39:32.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f630bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301013 cookie 94208133426944 notifier 8615 bl.length()=384 2024-09-12T00:39:32.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f630bfff640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:32.211 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.213+0000 7f630bfff640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:32.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.217+0000 7f643704f9c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:32.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.217+0000 7f643704f9c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:32.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.217+0000 7f643704f9c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW88888888888888888, ofs0, ns] 2024-09-12T00:39:32.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.217+0000 7f630b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301014 cookie 94208133436208 notifier 8615 bl.length()=225 2024-09-12T00:39:32.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.217+0000 7f630b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:32.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.217+0000 7f630b7fe640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:32.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.221+0000 7f643704f9c0 10 cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:39:32.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.221+0000 7f643704f9c0 10 moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:39:32.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.221+0000 7f643704f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw88888888888888888+test@test.test, ofs0, ns] 2024-09-12T00:39:32.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.221+0000 7f630b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300827 cookie 94208133432592 notifier 8615 bl.length()=234 2024-09-12T00:39:32.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.221+0000 7f630b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw88888888888888888+test@test.test info.flags=0x17 2024-09-12T00:39:32.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.221+0000 7f630b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw88888888888888888+test@test.test to cache LRU end 2024-09-12T00:39:32.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.225+0000 7f62eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:32.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.229+0000 7f643704f9c0 20 remove_watcher() i=0 2024-09-12T00:39:32.226 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.229+0000 7f643704f9c0 2 removed watcher, disabling cache 2024-09-12T00:39:32.228 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.229+0000 7f643704f9c0 20 remove_watcher() i=1 2024-09-12T00:39:32.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.233+0000 7f643704f9c0 20 remove_watcher() i=2 2024-09-12T00:39:32.232 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.233+0000 7f643704f9c0 20 remove_watcher() i=3 2024-09-12T00:39:32.234 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.237+0000 7f643704f9c0 20 remove_watcher() i=4 2024-09-12T00:39:32.236 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.241+0000 7f643704f9c0 20 remove_watcher() i=5 2024-09-12T00:39:32.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.241+0000 7f643704f9c0 20 remove_watcher() i=6 2024-09-12T00:39:32.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.245+0000 7f643704f9c0 20 remove_watcher() i=7 2024-09-12T00:39:32.254 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "id": "RGW88888888888888888", 2024-09-12T00:39:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "tenant": "", 2024-09-12T00:39:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "Mr.RGW88888888888888888", 2024-09-12T00:39:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "RGW88888888888888888+test@test.test", 2024-09-12T00:39:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "quota": { 2024-09-12T00:39:32.254 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:32.255 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max_users": 1000, 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max_roles": 1000, 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max_groups": 1000, 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout: "max_access_keys": 4 2024-09-12T00:39:32.256 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:32.258 DEBUG:tasks.s3tests:Creating user RGW88888888888888888 on client.0 2024-09-12T00:39:32.258 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root1.client.0 --display-name Mr.RGW88888888888888888 --email root1+test@test.test --access-key YUMZAJHATDZESKAZDFRE --secret hMMZsXPvwuHNn8o8jbjkWyaQiKHZyQCzKUBIlMarckdwaOipwfS4hQ== --cluster ceph --account-id RGW88888888888888888 --account-root 2024-09-12T00:39:32.349 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:32.350 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:32.601 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.605+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.603 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.605+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.605+0000 7f530051f9c0 20 realm 2024-09-12T00:39:32.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.605+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:32.604 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:32.605 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:32.606 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:32.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:32.607 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.609+0000 7f530051f9c0 20 searching for the correct realm 2024-09-12T00:39:32.609 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.613+0000 7f52fd824640 0 -- 172.21.15.78:0/3994157279 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7f52f001c040 msgr2=0x7f52f001e950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:32.826 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:32.829+0000 7f52fe025640 0 -- 172.21.15.78:0/3994157279 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7f52f4127040 msgr2=0x7f52f40e9970 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:33.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:33.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:33.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:33.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:33.047 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:33.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:33.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.048 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.049+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.049 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:33.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 zone default found 2024-09-12T00:39:33.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 4 Realm: () 2024-09-12T00:39:33.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:33.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:33.050 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:33.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 zonegroup default 2024-09-12T00:39:33.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.051 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.053+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.057+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.057+0000 7f530051f9c0 20 started sync module instance, tier type = 2024-09-12T00:39:33.052 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.057+0000 7f530051f9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:33.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.077+0000 7f530051f9c0 20 add_watcher() i=0 2024-09-12T00:39:33.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.077+0000 7f530051f9c0 20 add_watcher() i=1 2024-09-12T00:39:33.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.077+0000 7f530051f9c0 20 add_watcher() i=2 2024-09-12T00:39:33.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.077+0000 7f530051f9c0 20 add_watcher() i=3 2024-09-12T00:39:33.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.077+0000 7f530051f9c0 20 add_watcher() i=4 2024-09-12T00:39:33.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.077+0000 7f530051f9c0 20 add_watcher() i=5 2024-09-12T00:39:33.077 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.081+0000 7f530051f9c0 20 add_watcher() i=6 2024-09-12T00:39:33.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.081+0000 7f530051f9c0 20 add_watcher() i=7 2024-09-12T00:39:33.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.081+0000 7f530051f9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:33.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.085+0000 7f51b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.085+0000 7f530051f9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:33.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.085+0000 7f530051f9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:33.083 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.085+0000 7f530051f9c0 5 note: GC not initialized 2024-09-12T00:39:33.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.085+0000 7f512f7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:33.084 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.085+0000 7f530051f9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:33.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.085+0000 7f530051f9c0 20 Filter name: none 2024-09-12T00:39:33.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f512d7fa640 20 reqs_thread_entry: start 2024-09-12T00:39:33.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:39:33.085 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x0 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache get: name=default.rgw.meta+users.email+root1+test@test.test : miss 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x0 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 adding default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache get: name=default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE : miss 2024-09-12T00:39:33.087 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache put: name=default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE info.flags=0x0 2024-09-12T00:39:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 adding default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE to cache LRU end 2024-09-12T00:39:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache get: name=default.rgw.meta+accounts+account.RGW88888888888888888 : miss 2024-09-12T00:39:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.088 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:39:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache put: name=default.rgw.meta+accounts+account.RGW88888888888888888 info.flags=0x17 2024-09-12T00:39:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 adding default.rgw.meta+accounts+account.RGW88888888888888888 to cache LRU end 2024-09-12T00:39:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache get: name=default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE : hit (negative entry) 2024-09-12T00:39:33.089 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.089+0000 7f530051f9c0 10 cache get: name=default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE : hit (negative entry) 2024-09-12T00:39:33.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.093+0000 7f530051f9c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:33.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.093+0000 7f530051f9c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:33.091 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.093+0000 7f530051f9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:39:33.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.093+0000 7f51e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301015 cookie 94274662206816 notifier 8633 bl.length()=681 2024-09-12T00:39:33.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.093+0000 7f51e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:33.092 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.093+0000 7f51e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:33.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.097+0000 7f530051f9c0 10 cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:39:33.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.097+0000 7f530051f9c0 10 moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:39:33.095 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.097+0000 7f530051f9c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root1+test@test.test, ofs0, ns] 2024-09-12T00:39:33.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.097+0000 7f51e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301033 cookie 94274662219520 notifier 8633 bl.length()=189 2024-09-12T00:39:33.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.097+0000 7f51e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root1+test@test.test info.flags=0x7 2024-09-12T00:39:33.096 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.097+0000 7f51e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.email+root1+test@test.test to cache LRU end 2024-09-12T00:39:33.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.101+0000 7f530051f9c0 10 cache put: name=default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE info.flags=0x7 2024-09-12T00:39:33.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.101+0000 7f530051f9c0 10 moving default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE to cache LRU end 2024-09-12T00:39:33.099 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.101+0000 7f530051f9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:YUMZAJHATDZESKAZDFRE, ofs0, ns] 2024-09-12T00:39:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.101+0000 7f51e17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300828 cookie 94274662212224 notifier 8633 bl.length()=188 2024-09-12T00:39:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.101+0000 7f51e17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE info.flags=0x7 2024-09-12T00:39:33.100 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.101+0000 7f51e17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+YUMZAJHATDZESKAZDFRE to cache LRU end 2024-09-12T00:39:33.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.105+0000 7f530051f9c0 20 linked user root1.client.0 to account RGW88888888888888888 2024-09-12T00:39:33.104 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "root1.client.0", 2024-09-12T00:39:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.RGW88888888888888888", 2024-09-12T00:39:33.104 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "root1+test@test.test", 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "root1.client.0", 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "YUMZAJHATDZESKAZDFRE", 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "hMMZsXPvwuHNn8o8jbjkWyaQiKHZyQCzKUBIlMarckdwaOipwfS4hQ==", 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:33.093299Z" 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:33.105 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:39:33.106 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "root", 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "RGW88888888888888888", 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:33.093270Z", 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:33.107 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:33.108 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.109+0000 7f51b4fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.113+0000 7f530051f9c0 20 remove_watcher() i=0 2024-09-12T00:39:33.110 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.113+0000 7f530051f9c0 2 removed watcher, disabling cache 2024-09-12T00:39:33.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.113+0000 7f530051f9c0 20 remove_watcher() i=1 2024-09-12T00:39:33.114 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.117+0000 7f530051f9c0 20 remove_watcher() i=2 2024-09-12T00:39:33.116 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.121+0000 7f530051f9c0 20 remove_watcher() i=3 2024-09-12T00:39:33.118 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.121+0000 7f530051f9c0 20 remove_watcher() i=4 2024-09-12T00:39:33.120 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.125+0000 7f530051f9c0 20 remove_watcher() i=5 2024-09-12T00:39:33.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.125+0000 7f530051f9c0 20 remove_watcher() i=6 2024-09-12T00:39:33.126 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.129+0000 7f530051f9c0 20 remove_watcher() i=7 2024-09-12T00:39:33.145 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root1.client.0 --totp-serial 8239677625 --totp-seed LR7WWTERHXFV5CMLMKDK5PMJ473T7RU5IZBPTJN5DJPY2MC4ZM2ZBUKZUD2B47GT --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:33.191 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:33.192 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:33.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.445+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.445+0000 7fda064f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.445+0000 7fda064f69c0 20 realm 2024-09-12T00:39:33.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.445+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.444 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:33.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.445 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.446 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:33.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.449+0000 7fda064f69c0 20 searching for the correct realm 2024-09-12T00:39:33.451 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.453+0000 7fda03ffc640 0 -- 172.21.15.78:0/2810356328 >> [v2:172.21.15.171:6808/2267522783,v1:172.21.15.171:6809/2267522783] conn(0x558ca5b50270 msgr2=0x558ca5b52730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:33.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.461+0000 7fd9fbfff640 0 -- 172.21.15.78:0/2810356328 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fd9f4116b80 msgr2=0x7fd9f4003030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:33.675 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:33.676 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.677+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.677 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 zone default found 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 4 Realm: () 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 zonegroup default 2024-09-12T00:39:33.678 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.679 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.681+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.685+0000 7fda064f69c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.685+0000 7fda064f69c0 20 started sync module instance, tier type = 2024-09-12T00:39:33.680 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.685+0000 7fda064f69c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:33.704 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=0 2024-09-12T00:39:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=1 2024-09-12T00:39:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=2 2024-09-12T00:39:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=3 2024-09-12T00:39:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=4 2024-09-12T00:39:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=5 2024-09-12T00:39:33.705 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=6 2024-09-12T00:39:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 20 add_watcher() i=7 2024-09-12T00:39:33.707 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.709+0000 7fda064f69c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.713+0000 7fd8ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.713+0000 7fda064f69c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:33.712 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.713+0000 7fda064f69c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:33.713 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.713+0000 7fda064f69c0 5 note: GC not initialized 2024-09-12T00:39:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fd8b97e2640 20 reqs_thread_entry: start 2024-09-12T00:39:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:33.714 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 20 Filter name: none 2024-09-12T00:39:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fd8b27fc640 20 reqs_thread_entry: start 2024-09-12T00:39:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 10 cache get: name=default.rgw.meta+users.uid+root1.client.0 : miss 2024-09-12T00:39:33.715 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:39:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x13 2024-09-12T00:39:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 10 adding default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:33.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.717+0000 7fda064f69c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.725+0000 7fda064f69c0 10 cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.725+0000 7fda064f69c0 10 moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.725+0000 7fda064f69c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root1.client.0, ofs0, ns] 2024-09-12T00:39:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.725+0000 7fd8e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301016 cookie 94062563900336 notifier 8651 bl.length()=695 2024-09-12T00:39:33.722 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.725+0000 7fd8e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root1.client.0 info.flags=0x17 2024-09-12T00:39:33.723 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.725+0000 7fd8e2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root1.client.0 to cache LRU end 2024-09-12T00:39:33.724 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.729+0000 7fd8ba7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.733+0000 7fda064f69c0 20 remove_watcher() i=0 2024-09-12T00:39:33.729 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.733+0000 7fda064f69c0 2 removed watcher, disabling cache 2024-09-12T00:39:33.730 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.733+0000 7fda064f69c0 20 remove_watcher() i=1 2024-09-12T00:39:33.733 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.737+0000 7fda064f69c0 20 remove_watcher() i=2 2024-09-12T00:39:33.735 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.737+0000 7fda064f69c0 20 remove_watcher() i=3 2024-09-12T00:39:33.737 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.741+0000 7fda064f69c0 20 remove_watcher() i=4 2024-09-12T00:39:33.739 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.741+0000 7fda064f69c0 20 remove_watcher() i=5 2024-09-12T00:39:33.742 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.745+0000 7fda064f69c0 20 remove_watcher() i=6 2024-09-12T00:39:33.745 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.749+0000 7fda064f69c0 20 remove_watcher() i=7 2024-09-12T00:39:33.763 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 --cluster ceph account create --account-id RGW99999999999999999 --account-name Mr.RGW99999999999999999 --email RGW99999999999999999+test@test.test 2024-09-12T00:39:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:33.803 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:33.844 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.845+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 20 realm 2024-09-12T00:39:33.846 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.847 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.849+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.853+0000 7f2e68bd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.848 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.853+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.853+0000 7f2e68bd99c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:33.849 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.853+0000 7f2e68bd99c0 20 searching for the correct realm 2024-09-12T00:39:33.856 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.857+0000 7f2e66ee0640 0 -- 172.21.15.78:0/645268065 >> [v2:172.21.15.78:6824/4270621360,v1:172.21.15.78:6825/4270621360] conn(0x56473dc467d0 msgr2=0x56473dc48bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:33.861 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.865+0000 7f2e65ede640 0 -- 172.21.15.78:0/645268065 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f2e60066790 msgr2=0x7f2e60082130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:33.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.869+0000 7f2e68bd99c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:33.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.869+0000 7f2e68bd99c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:33.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.869+0000 7f2e68bd99c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:33.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.869+0000 7f2e68bd99c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:33.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.869+0000 7f2e68bd99c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:33.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.869+0000 7f2e68bd99c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:33.868 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.869+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:33.869 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 zone default found 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 4 Realm: () 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 zonegroup default 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.870 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 started sync module instance, tier type = 2024-09-12T00:39:33.871 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.873+0000 7f2e68bd99c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=0 2024-09-12T00:39:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=1 2024-09-12T00:39:33.889 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=2 2024-09-12T00:39:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=3 2024-09-12T00:39:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=4 2024-09-12T00:39:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=5 2024-09-12T00:39:33.890 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=6 2024-09-12T00:39:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 20 add_watcher() i=7 2024-09-12T00:39:33.892 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.893+0000 7f2e68bd99c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2d1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2e68bd99c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2e68bd99c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:33.895 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2e68bd99c0 5 note: GC not initialized 2024-09-12T00:39:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2c977fe640 20 reqs_thread_entry: start 2024-09-12T00:39:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2e68bd99c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2e68bd99c0 20 Filter name: none 2024-09-12T00:39:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2c957fa640 20 reqs_thread_entry: start 2024-09-12T00:39:33.897 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.897+0000 7f2e68bd99c0 10 cache get: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 : miss 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x0 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 adding default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 20 failed to read name.$Mr.RGW99999999999999999 with: (2) No such file or directory 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 cache get: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test : miss 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x0 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 adding default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:39:33.898 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 20 failed to read rgw99999999999999999+test@test.test with: (2) No such file or directory 2024-09-12T00:39:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2e68bd99c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:accounts:account.RGW99999999999999999, ofs0, ns] 2024-09-12T00:39:33.899 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2d49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301017 cookie 94863978981520 notifier 9267 bl.length()=384 2024-09-12T00:39:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2d49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:33.900 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.901+0000 7f2d49ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.905+0000 7f2e68bd99c0 10 cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.905+0000 7f2e68bd99c0 10 moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.905+0000 7f2e68bd99c0 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:accounts:name.$Mr.RGW99999999999999999, ofs0, ns] 2024-09-12T00:39:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.905+0000 7f2d49ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301018 cookie 94863978988816 notifier 9267 bl.length()=225 2024-09-12T00:39:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.905+0000 7f2d49ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:33.903 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.905+0000 7f2d49ffb640 10 rgw watcher librados: moving default.rgw.meta+accounts+name.$Mr.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.909+0000 7f2e68bd99c0 10 cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:39:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.909+0000 7f2e68bd99c0 10 moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:39:33.905 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.909+0000 7f2e68bd99c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:rgw99999999999999999+test@test.test, ofs0, ns] 2024-09-12T00:39:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.909+0000 7f2d497fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300829 cookie 94863978955328 notifier 9267 bl.length()=234 2024-09-12T00:39:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.909+0000 7f2d497fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+rgw99999999999999999+test@test.test info.flags=0x17 2024-09-12T00:39:33.906 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.909+0000 7f2d497fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+rgw99999999999999999+test@test.test to cache LRU end 2024-09-12T00:39:33.908 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.909+0000 7f2d1cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:33.911 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.913+0000 7f2e68bd99c0 20 remove_watcher() i=0 2024-09-12T00:39:33.912 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.913+0000 7f2e68bd99c0 2 removed watcher, disabling cache 2024-09-12T00:39:33.913 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.917+0000 7f2e68bd99c0 20 remove_watcher() i=1 2024-09-12T00:39:33.916 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.917+0000 7f2e68bd99c0 20 remove_watcher() i=2 2024-09-12T00:39:33.917 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.921+0000 7f2e68bd99c0 20 remove_watcher() i=3 2024-09-12T00:39:33.919 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.921+0000 7f2e68bd99c0 20 remove_watcher() i=4 2024-09-12T00:39:33.921 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.925+0000 7f2e68bd99c0 20 remove_watcher() i=5 2024-09-12T00:39:33.923 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.925+0000 7f2e68bd99c0 20 remove_watcher() i=6 2024-09-12T00:39:33.926 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:33.929+0000 7f2e68bd99c0 20 remove_watcher() i=7 2024-09-12T00:39:33.938 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:33.938 INFO:teuthology.orchestra.run.smithi078.stdout: "id": "RGW99999999999999999", 2024-09-12T00:39:33.938 INFO:teuthology.orchestra.run.smithi078.stdout: "tenant": "", 2024-09-12T00:39:33.938 INFO:teuthology.orchestra.run.smithi078.stdout: "name": "Mr.RGW99999999999999999", 2024-09-12T00:39:33.938 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "RGW99999999999999999+test@test.test", 2024-09-12T00:39:33.938 INFO:teuthology.orchestra.run.smithi078.stdout: "quota": { 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:33.939 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout: "max_users": 1000, 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout: "max_roles": 1000, 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout: "max_groups": 1000, 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout: "max_access_keys": 4 2024-09-12T00:39:33.940 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:33.941 DEBUG:tasks.s3tests:Creating user RGW99999999999999999 on client.0 2024-09-12T00:39:33.941 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user create --uid root2.client.0 --display-name Mr.RGW99999999999999999 --email root2+test@test.test --access-key BBFVOAPJBXOMOELTIGSQ --secret mD0gWRCzuZ1XuDqGELe/nZM06CHNHTftMnFh7Z/lK8OW1fS6YKthwA== --cluster ceph --account-id RGW99999999999999999 --account-root 2024-09-12T00:39:34.032 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:34.033 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:34.076 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.077+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.078 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 realm 2024-09-12T00:39:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.079 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.081+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.085+0000 7f4fd6b399c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:34.081 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.085+0000 7f4fd6b399c0 20 searching for the correct realm 2024-09-12T00:39:34.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.089+0000 7f4fd4e40640 0 -- 172.21.15.78:0/1459176948 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f4fc40d6420 msgr2=0x7f4fc40d68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.301+0000 7f4fd463f640 0 -- 172.21.15.78:0/1459176948 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55ef6079c8e0 msgr2=0x55ef6079eda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.313+0000 7f4fd6b399c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.313+0000 7f4fd6b399c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.313+0000 7f4fd6b399c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.313+0000 7f4fd6b399c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.313+0000 7f4fd6b399c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.313+0000 7f4fd6b399c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:34.312 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.313+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.314 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 zone default found 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 4 Realm: () 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 zonegroup default 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.315 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.317+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.321+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.321+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.321+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.321+0000 7f4fd6b399c0 20 started sync module instance, tier type = 2024-09-12T00:39:34.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.321+0000 7f4fd6b399c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:34.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.345+0000 7f4fd6b399c0 20 add_watcher() i=0 2024-09-12T00:39:34.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.345+0000 7f4fd6b399c0 20 add_watcher() i=1 2024-09-12T00:39:34.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.345+0000 7f4fd6b399c0 20 add_watcher() i=2 2024-09-12T00:39:34.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.345+0000 7f4fd6b399c0 20 add_watcher() i=3 2024-09-12T00:39:34.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.345+0000 7f4fd6b399c0 20 add_watcher() i=4 2024-09-12T00:39:34.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.345+0000 7f4fd6b399c0 20 add_watcher() i=5 2024-09-12T00:39:34.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.345+0000 7f4fd6b399c0 20 add_watcher() i=6 2024-09-12T00:39:34.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.349+0000 7f4fd6b399c0 20 add_watcher() i=7 2024-09-12T00:39:34.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.349+0000 7f4fd6b399c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:34.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4e8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:34.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:34.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 5 note: GC not initialized 2024-09-12T00:39:34.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4e89fdb640 20 reqs_thread_entry: start 2024-09-12T00:39:34.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:34.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 20 Filter name: none 2024-09-12T00:39:34.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4dfb7fe640 20 reqs_thread_entry: start 2024-09-12T00:39:34.352 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:39:34.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x0 2024-09-12T00:39:34.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:34.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 10 cache get: name=default.rgw.meta+users.email+root2+test@test.test : miss 2024-09-12T00:39:34.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.353+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.354 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x0 2024-09-12T00:39:34.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 adding default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 cache get: name=default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ : miss 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 cache put: name=default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ info.flags=0x0 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 adding default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ to cache LRU end 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 cache get: name=default.rgw.meta+accounts+account.RGW99999999999999999 : miss 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 20 rados_obj.operate() r=0 bl.length=184 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 cache put: name=default.rgw.meta+accounts+account.RGW99999999999999999 info.flags=0x17 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 adding default.rgw.meta+accounts+account.RGW99999999999999999 to cache LRU end 2024-09-12T00:39:34.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:34.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 cache get: name=default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ : hit (negative entry) 2024-09-12T00:39:34.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.357+0000 7f4fd6b399c0 10 cache get: name=default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ : hit (negative entry) 2024-09-12T00:39:34.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.361+0000 7f4fd6b399c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:34.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.361+0000 7f4fd6b399c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:34.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.361+0000 7f4fd6b399c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:39:34.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.361+0000 7f4eab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301019 cookie 94486604146912 notifier 8687 bl.length()=681 2024-09-12T00:39:34.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.361+0000 7f4eab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:34.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.361+0000 7f4eab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:34.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.365+0000 7f4fd6b399c0 10 cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:39:34.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.365+0000 7f4fd6b399c0 10 moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:39:34.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.365+0000 7f4fd6b399c0 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.email:root2+test@test.test, ofs0, ns] 2024-09-12T00:39:34.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.365+0000 7f4eab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301034 cookie 94486604216432 notifier 8687 bl.length()=189 2024-09-12T00:39:34.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.365+0000 7f4eab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+root2+test@test.test info.flags=0x7 2024-09-12T00:39:34.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.365+0000 7f4eab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.email+root2+test@test.test to cache LRU end 2024-09-12T00:39:34.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.369+0000 7f4fd6b399c0 10 cache put: name=default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ info.flags=0x7 2024-09-12T00:39:34.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.369+0000 7f4fd6b399c0 10 moving default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ to cache LRU end 2024-09-12T00:39:34.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.369+0000 7f4fd6b399c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:BBFVOAPJBXOMOELTIGSQ, ofs0, ns] 2024-09-12T00:39:34.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.369+0000 7f4eaaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461300830 cookie 94486604209136 notifier 8687 bl.length()=188 2024-09-12T00:39:34.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.369+0000 7f4eaaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ info.flags=0x7 2024-09-12T00:39:34.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.369+0000 7f4eaaffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+BBFVOAPJBXOMOELTIGSQ to cache LRU end 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.373+0000 7f4fd6b399c0 20 linked user root2.client.0 to account RGW99999999999999999 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stdout: "user_id": "root2.client.0", 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stdout: "display_name": "Mr.RGW99999999999999999", 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stdout: "email": "root2+test@test.test", 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stdout: "suspended": 0, 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stdout: "max_buckets": 1000, 2024-09-12T00:39:34.370 INFO:teuthology.orchestra.run.smithi078.stdout: "subusers": [], 2024-09-12T00:39:34.371 INFO:teuthology.orchestra.run.smithi078.stdout: "keys": [ 2024-09-12T00:39:34.371 INFO:teuthology.orchestra.run.smithi078.stdout: { 2024-09-12T00:39:34.371 INFO:teuthology.orchestra.run.smithi078.stdout: "user": "root2.client.0", 2024-09-12T00:39:34.371 INFO:teuthology.orchestra.run.smithi078.stdout: "access_key": "BBFVOAPJBXOMOELTIGSQ", 2024-09-12T00:39:34.371 INFO:teuthology.orchestra.run.smithi078.stdout: "secret_key": "mD0gWRCzuZ1XuDqGELe/nZM06CHNHTftMnFh7Z/lK8OW1fS6YKthwA==", 2024-09-12T00:39:34.371 INFO:teuthology.orchestra.run.smithi078.stdout: "active": true, 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:34.360196Z" 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: } 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: ], 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: "swift_keys": [], 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: "caps": [], 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: "op_mask": "read, write, delete", 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: "default_placement": "", 2024-09-12T00:39:34.372 INFO:teuthology.orchestra.run.smithi078.stdout: "default_storage_class": "", 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "placement_tags": [], 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "bucket_quota": { 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "user_quota": { 2024-09-12T00:39:34.373 INFO:teuthology.orchestra.run.smithi078.stdout: "enabled": false, 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "check_on_raw": false, 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size": -1, 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "max_size_kb": 0, 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "max_objects": -1 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: }, 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "temp_url_keys": [], 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "type": "root", 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "mfa_ids": [], 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "account_id": "RGW99999999999999999", 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "path": "/", 2024-09-12T00:39:34.374 INFO:teuthology.orchestra.run.smithi078.stdout: "create_date": "2024-09-12T00:39:34.360178Z", 2024-09-12T00:39:34.375 INFO:teuthology.orchestra.run.smithi078.stdout: "tags": [], 2024-09-12T00:39:34.375 INFO:teuthology.orchestra.run.smithi078.stdout: "group_ids": [] 2024-09-12T00:39:34.375 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:39:34.375 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:39:34.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.373+0000 7f4e8afdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.377+0000 7f4fd6b399c0 20 remove_watcher() i=0 2024-09-12T00:39:34.376 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.377+0000 7f4fd6b399c0 2 removed watcher, disabling cache 2024-09-12T00:39:34.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.381+0000 7f4fd6b399c0 20 remove_watcher() i=1 2024-09-12T00:39:34.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.385+0000 7f4fd6b399c0 20 remove_watcher() i=2 2024-09-12T00:39:34.382 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.385+0000 7f4fd6b399c0 20 remove_watcher() i=3 2024-09-12T00:39:34.384 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.389+0000 7f4fd6b399c0 20 remove_watcher() i=4 2024-09-12T00:39:34.386 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.389+0000 7f4fd6b399c0 20 remove_watcher() i=5 2024-09-12T00:39:34.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.393+0000 7f4fd6b399c0 20 remove_watcher() i=6 2024-09-12T00:39:34.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.393+0000 7f4fd6b399c0 20 remove_watcher() i=7 2024-09-12T00:39:34.409 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 mfa create --uid root2.client.0 --totp-serial 9005541305 --totp-seed UMOROZ3O4V7RAP4STGWJ3IT63OXXOJKRE67L5XFNRTW5MV7QC6BOFDCXDPCLERAE --totp-seconds 5 --totp-window 8 --totp-seed-type base32 --cluster ceph 2024-09-12T00:39:34.454 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:39:34.455 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:39:34.496 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.497+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.499 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 20 realm 2024-09-12T00:39:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:39:34.500 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.501+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.505+0000 7fe2b079c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.505+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.505+0000 7fe2b079c9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:39:34.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.505+0000 7fe2b079c9c0 20 searching for the correct realm 2024-09-12T00:39:34.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.505+0000 7fe2adaa1640 0 -- 172.21.15.78:0/942546458 >> [v2:172.21.15.78:6816/1585845466,v1:172.21.15.78:6817/1585845466] conn(0x7fe2a805d7d0 msgr2=0x7fe2a805c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:39:34.716 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.717+0000 7fe2ae2a2640 0 -- 172.21.15.78:0/942546458 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fe2980fdb70 msgr2=0x7fe298106a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:39:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.937+0000 7fe2b079c9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:39:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.937+0000 7fe2b079c9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:39:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.937+0000 7fe2b079c9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:39:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.937+0000 7fe2b079c9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:39:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.937+0000 7fe2b079c9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:39:34.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.937+0000 7fe2b079c9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:39:34.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.937+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:39:34.938 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:39:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 zone default found 2024-09-12T00:39:34.941 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 4 Realm: () 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 zonegroup default 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.942 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.941+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.945+0000 7fe2b079c9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:39:34.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.945+0000 7fe2b079c9c0 20 started sync module instance, tier type = 2024-09-12T00:39:34.943 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.945+0000 7fe2b079c9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:39:34.964 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.965+0000 7fe2b079c9c0 20 add_watcher() i=0 2024-09-12T00:39:34.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.965+0000 7fe2b079c9c0 20 add_watcher() i=1 2024-09-12T00:39:34.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.965+0000 7fe2b079c9c0 20 add_watcher() i=2 2024-09-12T00:39:34.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.965+0000 7fe2b079c9c0 20 add_watcher() i=3 2024-09-12T00:39:34.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.965+0000 7fe2b079c9c0 20 add_watcher() i=4 2024-09-12T00:39:34.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.965+0000 7fe2b079c9c0 20 add_watcher() i=5 2024-09-12T00:39:34.965 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.969+0000 7fe2b079c9c0 20 add_watcher() i=6 2024-09-12T00:39:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.969+0000 7fe2b079c9c0 20 add_watcher() i=7 2024-09-12T00:39:34.967 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.969+0000 7fe2b079c9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:39:34.971 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe0e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe2b079c9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:39:34.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe2b079c9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:39:34.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe2b079c9c0 5 note: GC not initialized 2024-09-12T00:39:34.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe0e2ffd640 20 reqs_thread_entry: start 2024-09-12T00:39:34.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe2b079c9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:39:34.972 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe2b079c9c0 20 Filter name: none 2024-09-12T00:39:34.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe0e0ff9640 20 reqs_thread_entry: start 2024-09-12T00:39:34.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe2b079c9c0 10 cache get: name=default.rgw.meta+users.uid+root2.client.0 : miss 2024-09-12T00:39:34.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.973+0000 7fe2b079c9c0 20 rados->read ofs=0 len=0 2024-09-12T00:39:34.973 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.977+0000 7fe2b079c9c0 20 rados_obj.operate() r=0 bl.length=494 2024-09-12T00:39:34.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.977+0000 7fe2b079c9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x13 2024-09-12T00:39:34.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.977+0000 7fe2b079c9c0 10 adding default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:34.974 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.977+0000 7fe2b079c9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:39:34.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.981+0000 7fe2b079c9c0 10 cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:34.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.981+0000 7fe2b079c9c0 10 moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:34.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.981+0000 7fe2b079c9c0 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.uid:root2.client.0, ofs0, ns] 2024-09-12T00:39:34.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.981+0000 7fe1917fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301020 cookie 94828600380864 notifier 8705 bl.length()=695 2024-09-12T00:39:34.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.981+0000 7fe1917fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+root2.client.0 info.flags=0x17 2024-09-12T00:39:34.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.981+0000 7fe1917fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+root2.client.0 to cache LRU end 2024-09-12T00:39:34.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.985+0000 7fe0e3fff640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:39:34.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.989+0000 7fe2b079c9c0 20 remove_watcher() i=0 2024-09-12T00:39:34.986 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.989+0000 7fe2b079c9c0 2 removed watcher, disabling cache 2024-09-12T00:39:34.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.989+0000 7fe2b079c9c0 20 remove_watcher() i=1 2024-09-12T00:39:34.990 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.993+0000 7fe2b079c9c0 20 remove_watcher() i=2 2024-09-12T00:39:34.992 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.993+0000 7fe2b079c9c0 20 remove_watcher() i=3 2024-09-12T00:39:34.994 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.997+0000 7fe2b079c9c0 20 remove_watcher() i=4 2024-09-12T00:39:34.996 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:34.997+0000 7fe2b079c9c0 20 remove_watcher() i=5 2024-09-12T00:39:34.998 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:35.001+0000 7fe2b079c9c0 20 remove_watcher() i=6 2024-09-12T00:39:35.001 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:39:35.005+0000 7fe2b079c9c0 20 remove_watcher() i=7 2024-09-12T00:39:35.016 INFO:tasks.s3tests:Configuring s3-tests... 2024-09-12T00:39:35.017 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:39:35.017 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf 2024-09-12T00:39:35.022 INFO:tasks.s3tests:Configuring boto... 2024-09-12T00:39:35.022 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:39:35.022 DEBUG:teuthology.orchestra.run.smithi078:> dd of=/home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:39:35.073 DEBUG:teuthology.orchestra.run.smithi078:s3 tests against rgw> source /home/ubuntu/cephtest/tox-venv/bin/activate && cd /home/ubuntu/cephtest/s3-tests-client.0 && S3TEST_CONF=/home/ubuntu/cephtest/archive/s3-tests.client.0.conf BOTO_CONFIG=/home/ubuntu/cephtest/boto-client.0.cfg REQUESTS_CA_BUNDLE=/etc/ssl/certs/ca-certificates.crt tox -- -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:39:35.249 INFO:teuthology.orchestra.run.smithi078.stdout:GLOB sdist-make: /home/ubuntu/cephtest/s3-tests-client.0/setup.py 2024-09-12T00:39:35.444 INFO:teuthology.orchestra.run.smithi078.stdout:py create: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py 2024-09-12T00:39:35.772 INFO:teuthology.orchestra.run.smithi078.stdout:py installdeps: -rrequirements.txt 2024-09-12T00:41:42.683 INFO:teuthology.orchestra.run.smithi078.stdout:py inst: /home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip 2024-09-12T00:41:44.556 INFO:teuthology.orchestra.run.smithi078.stdout:py installed: boto==2.49.0,boto3==1.24.96,botocore==1.27.96,cachetools==5.5.0,certifi==2024.8.30,chardet==5.2.0,charset-normalizer==3.3.2,colorama==0.4.6,distlib==0.3.8,exceptiongroup==1.2.2,filelock==3.16.0,gevent==24.2.1,greenlet==3.1.0,httplib2==0.22.0,idna==3.8,iniconfig==2.0.0,isodate==0.6.1,jmespath==1.0.1,lxml==5.3.0,munch==4.0.0,packaging==24.1,platformdirs==4.3.2,pluggy==1.5.0,pyparsing==3.1.4,pyproject-api==1.7.1,pytest==8.3.3,python-dateutil==2.9.0.post0,pytz==2024.2,PyYAML==6.0.2,requests==2.32.3,s3tests @ file:///home/ubuntu/cephtest/s3-tests-client.0/.tox/.tmp/package/1/s3tests-0.0.1.zip#sha256=96605b5186a005f6a0162575eef19e2bf2a7831831adfb7df56d348f50659e13,s3transfer==0.6.2,six==1.16.0,tomli==2.0.1,tox==4.18.1,urllib3==1.26.20,virtualenv==20.26.4,zope.event==5.0,zope.interface==7.0.3 2024-09-12T00:41:44.557 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test-pre: PYTHONHASHSEED='1264874392' 2024-09-12T00:41:44.557 INFO:teuthology.orchestra.run.smithi078.stdout:py run-test: commands[0] | pytest -v -m 'not fails_on_rgw and not lifecycle_expiration and not lifecycle_transition and not cloud_transition and not test_of_sts and not webidentity_test and not fails_with_subdomain and not sse_s3' 2024-09-12T00:41:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:============================= test session starts ============================== 2024-09-12T00:41:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:platform linux -- Python 3.10.6, pytest-8.3.3, pluggy-1.5.0 -- /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/bin/python 2024-09-12T00:41:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:cachedir: .tox/py/.pytest_cache 2024-09-12T00:41:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:rootdir: /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:41:44.742 INFO:teuthology.orchestra.run.smithi078.stdout:configfile: pytest.ini 2024-09-12T00:41:46.571 INFO:teuthology.orchestra.run.smithi078.stdout:collecting ... collected 872 items / 126 deselected / 746 selected 2024-09-12T00:41:46.571 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:41:46.768 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_none PASSED [ 0%] 2024-09-12T00:41:46.966 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_empty PASSED [ 0%] 2024-09-12T00:41:47.222 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_date_and_amz_date PASSED [ 0%] 2024-09-12T00:41:47.476 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_amz_date_and_no_date PASSED [ 0%] 2024-09-12T00:41:47.671 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_none PASSED [ 0%] 2024-09-12T00:41:47.863 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_contentlength_none PASSED [ 0%] 2024-09-12T00:41:48.126 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_acl_create_contentlength_none PASSED [ 0%] 2024-09-12T00:41:48.320 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_contentlength_none PASSED [ 1%] 2024-09-12T00:41:48.419 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_empty PASSED [ 1%] 2024-09-12T00:41:48.515 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_none PASSED [ 1%] 2024-09-12T00:41:48.717 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws2 PASSED [ 1%] 2024-09-12T00:41:49.131 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws2 PASSED [ 1%] 2024-09-12T00:41:49.329 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws2 PASSED [ 1%] 2024-09-12T00:41:49.528 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws2 PASSED [ 1%] 2024-09-12T00:41:49.623 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws2 PASSED [ 2%] 2024-09-12T00:41:49.719 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws2 PASSED [ 2%] 2024-09-12T00:41:49.774 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws4 SKIPPED [ 2%] 2024-09-12T00:41:49.826 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_contentlength_mismatch_below_aws4 SKIPPED [ 2%] 2024-09-12T00:41:49.879 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_incorrect_aws4 SKIPPED [ 2%] 2024-09-12T00:41:49.931 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_authorization_invalid_aws4 SKIPPED [ 2%] 2024-09-12T00:41:49.987 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_empty_aws4 SKIPPED [ 2%] 2024-09-12T00:41:50.043 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_ua_none_aws4 SKIPPED [ 2%] 2024-09-12T00:41:50.099 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:41:50.155 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_invalid_aws4 SKIPPED [ 3%] 2024-09-12T00:41:50.207 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:41:50.262 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_empty_aws4 SKIPPED [ 3%] 2024-09-12T00:41:50.315 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:41:50.366 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_none_aws4 SKIPPED [ 3%] 2024-09-12T00:41:50.418 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_today_aws4 SKIPPED [ 3%] 2024-09-12T00:41:50.471 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_today_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.523 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.574 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_today_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.626 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.678 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.731 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.785 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_bad_amz_date_after_end_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.839 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_custom_header_aws4 SKIPPED [ 4%] 2024-09-12T00:41:50.896 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_object_create_missing_signed_header_aws4 SKIPPED [ 5%] 2024-09-12T00:41:50.951 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_authorization_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:41:51.005 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:41:51.055 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_ua_none_aws4 SKIPPED [ 5%] 2024-09-12T00:41:51.107 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:41:51.159 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_invalid_aws4 SKIPPED [ 5%] 2024-09-12T00:41:51.211 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_empty_aws4 SKIPPED [ 5%] 2024-09-12T00:41:51.263 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_empty_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.315 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.367 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_none_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.419 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.471 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.526 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.579 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_after_today_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.631 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws4 SKIPPED [ 6%] 2024-09-12T00:41:51.687 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py::test_bucket_create_bad_amz_date_before_epoch_aws4 SKIPPED [ 7%] 2024-09-12T00:41:52.084 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_versioning_obj_read_not_exist_null PASSED [ 7%] 2024-09-12T00:41:53.056 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class PASSED [ 7%] 2024-09-12T00:41:54.824 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class_multipart PASSED [ 7%] 2024-09-12T00:41:56.334 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class PASSED [ 7%] 2024-09-12T00:41:58.957 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_modify_storage_class_multipart PASSED [ 7%] 2024-09-12T00:41:59.892 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy PASSED [ 7%] 2024-09-12T00:42:00.956 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_object_storage_class_copy_multipart PASSED [ 8%] 2024-09-12T00:42:01.333 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_atomic_dual_conditional_write_1mb PASSED [ 8%] 2024-09-12T00:42:01.495 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_atomic_write_bucket_gone PASSED [ 8%] 2024-09-12T00:42:01.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_1 PASSED [ 8%] 2024-09-12T00:42:02.083 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_encryption_sse_c_multipart_invalid_chunks_2 PASSED [ 8%] 2024-09-12T00:42:02.376 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_bucket_policy_set_condition_operator_end_with_IfExists PASSED [ 8%] 2024-09-12T00:42:02.607 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py::test_bucket_policy_put_obj_request_obj_tag PASSED [ 8%] 2024-09-12T00:42:02.772 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_nonexistant_bucket_rgw SKIPPED [ 8%] 2024-09-12T00:42:02.775 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:42:02.777 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_public_index SKIPPED [ 9%] 2024-09-12T00:42:02.779 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:42:02.781 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty SKIPPED [ 9%] 2024-09-12T00:42:02.784 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:42:02.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index SKIPPED [ 9%] 2024-09-12T00:42:02.789 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_missingerrordoc SKIPPED [ 9%] 2024-09-12T00:42:02.791 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:42:02.793 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:42:02.796 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_missingerrordoc SKIPPED [ 10%] 2024-09-12T00:42:02.798 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:02.800 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_pubilc_errordoc SKIPPED [ 10%] 2024-09-12T00:42:02.803 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:02.805 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:02.807 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_blockederrordoc SKIPPED [ 10%] 2024-09-12T00:42:02.809 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:02.810 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_empty_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:02.812 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_public_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:02.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_private_bucket_list_private_index_gooderrordoc SKIPPED [ 11%] 2024-09-12T00:42:02.816 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_base SKIPPED [ 11%] 2024-09-12T00:42:02.817 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path SKIPPED [ 11%] 2024-09-12T00:42:02.819 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_bucket_private_redirectall_path_upgrade SKIPPED [ 11%] 2024-09-12T00:42:02.821 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_nonwebsite SKIPPED [ 12%] 2024-09-12T00:42:02.822 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_relative SKIPPED [ 12%] 2024-09-12T00:42:02.824 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_public_abs SKIPPED [ 12%] 2024-09-12T00:42:02.825 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_relative SKIPPED [ 12%] 2024-09-12T00:42:02.827 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_website_xredirect_private_abs SKIPPED [ 12%] 2024-09-12T00:42:02.929 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py::test_routing_generator XFAIL [ 12%] 2024-09-12T00:42:02.941 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_utils.py::test_generate PASSED [ 12%] 2024-09-12T00:42:03.419 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_short PASSED [ 13%] 2024-09-12T00:42:08.095 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_bad PASSED [ 13%] 2024-09-12T00:42:08.443 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_empty PASSED [ 13%] 2024-09-12T00:42:08.892 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_none PASSED [ 13%] 2024-09-12T00:42:09.327 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_mismatch PASSED [ 13%] 2024-09-12T00:42:09.759 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_empty PASSED [ 13%] 2024-09-12T00:42:10.179 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_expect_none PASSED [ 13%] 2024-09-12T00:42:10.523 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contentlength_negative PASSED [ 13%] 2024-09-12T00:42:11.003 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_invalid PASSED [ 14%] 2024-09-12T00:42:11.407 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_empty PASSED [ 14%] 2024-09-12T00:42:11.815 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_contenttype_none PASSED [ 14%] 2024-09-12T00:42:12.171 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_put_bad_canned_acl PASSED [ 14%] 2024-09-12T00:42:12.503 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_mismatch PASSED [ 14%] 2024-09-12T00:42:12.831 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_expect_empty PASSED [ 14%] 2024-09-12T00:42:13.011 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_contentlength_negative PASSED [ 14%] 2024-09-12T00:42:13.351 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_md5_invalid_garbage_aws2 PASSED [ 15%] 2024-09-12T00:42:13.835 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_empty_aws2 PASSED [ 15%] 2024-09-12T00:42:14.443 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_ua_none_aws2 PASSED [ 15%] 2024-09-12T00:42:14.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_invalid_aws2 PASSED [ 15%] 2024-09-12T00:42:15.139 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_empty_aws2 PASSED [ 15%] 2024-09-12T00:42:15.479 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_today_aws2 PASSED [ 15%] 2024-09-12T00:42:15.819 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_before_epoch_aws2 PASSED [ 15%] 2024-09-12T00:42:16.175 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_object_create_bad_date_after_end_aws2 PASSED [ 15%] 2024-09-12T00:42:16.511 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_empty_aws2 PASSED [ 16%] 2024-09-12T00:42:16.839 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_ua_none_aws2 PASSED [ 16%] 2024-09-12T00:42:17.019 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_invalid_aws2 PASSED [ 16%] 2024-09-12T00:42:17.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_empty_aws2 PASSED [ 16%] 2024-09-12T00:42:17.395 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_today_aws2 PASSED [ 16%] 2024-09-12T00:42:17.571 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_after_today_aws2 PASSED [ 16%] 2024-09-12T00:42:17.751 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_headers.py::test_bucket_create_bad_date_before_epoch_aws2 PASSED [ 16%] 2024-09-12T00:42:18.067 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy PASSED [ 17%] 2024-09-12T00:42:18.251 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:42:18.447 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_user_policy_parameter_limit PASSED [ 17%] 2024-09-12T00:42:18.763 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_put_existing_user_policy PASSED [ 17%] 2024-09-12T00:42:19.075 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy PASSED [ 17%] 2024-09-12T00:42:19.287 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_list_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:42:19.595 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy PASSED [ 17%] 2024-09-12T00:42:19.903 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_invalid_user PASSED [ 17%] 2024-09-12T00:42:20.339 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_get_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:42:20.599 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy PASSED [ 18%] 2024-09-12T00:42:20.915 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_user PASSED [ 18%] 2024-09-12T00:42:21.227 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_invalid_policy_name PASSED [ 18%] 2024-09-12T00:42:21.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_delete_user_policy_from_multiple_policies PASSED [ 18%] 2024-09-12T00:42:22.179 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:42:22.643 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_bucket_actions_in_user_policy PASSED [ 18%] 2024-09-12T00:42:23.071 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:42:23.671 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_object_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:42:24.259 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:42:24.939 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_multipart_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:42:25.439 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_allow_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:42:25.991 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_deny_tagging_actions_in_user_policy PASSED [ 19%] 2024-09-12T00:42:26.479 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policy_statements PASSED [ 19%] 2024-09-12T00:42:27.027 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_conflicting_user_policies PASSED [ 19%] 2024-09-12T00:42:27.355 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_allow_iam_actions PASSED [ 20%] 2024-09-12T00:42:28.343 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_create PASSED [ 20%] 2024-09-12T00:42:29.007 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_case_insensitive_name PASSED [ 20%] 2024-09-12T00:42:29.839 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_delete PASSED [ 20%] 2024-09-12T00:42:31.615 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list PASSED [ 20%] 2024-09-12T00:42:34.010 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_list_path_prefix PASSED [ 20%] 2024-09-12T00:42:35.331 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_name PASSED [ 20%] 2024-09-12T00:42:36.499 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_update_path PASSED [ 21%] 2024-09-12T00:42:37.339 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_create PASSED [ 21%] 2024-09-12T00:42:37.855 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_create PASSED [ 21%] 2024-09-12T00:42:38.883 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_update PASSED [ 21%] 2024-09-12T00:42:39.607 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_update PASSED [ 21%] 2024-09-12T00:42:40.596 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_delete PASSED [ 21%] 2024-09-12T00:42:41.263 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_current_user_access_key_delete PASSED [ 21%] 2024-09-12T00:42:42.615 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_access_key_list PASSED [ 21%] 2024-09-12T00:42:43.539 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_bucket_policy_allow PASSED [ 22%] 2024-09-12T00:42:44.943 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy PASSED [ 22%] 2024-09-12T00:42:46.323 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_managed PASSED [ 22%] 2024-09-12T00:42:47.259 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_user_policy_allow PASSED [ 22%] 2024-09-12T00:42:48.083 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_create PASSED [ 22%] 2024-09-12T00:42:48.759 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_case_insensitive_name PASSED [ 22%] 2024-09-12T00:42:50.531 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_list PASSED [ 22%] 2024-09-12T00:42:51.791 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_group_update PASSED [ 23%] 2024-09-12T00:42:53.239 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy PASSED [ 23%] 2024-09-12T00:42:54.587 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy PASSED [ 23%] 2024-09-12T00:42:55.831 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_inline_group_policy_allow PASSED [ 23%] 2024-09-12T00:42:57.092 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_managed_group_policy_allow PASSED [ 23%] 2024-09-12T00:42:58.071 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_create PASSED [ 23%] 2024-09-12T00:42:58.767 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_case_insensitive_name PASSED [ 23%] 2024-09-12T00:42:59.567 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_delete PASSED [ 23%] 2024-09-12T00:43:01.183 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list PASSED [ 24%] 2024-09-12T00:43:03.267 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_list_path_prefix PASSED [ 24%] 2024-09-12T00:43:04.087 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_update PASSED [ 24%] 2024-09-12T00:43:05.383 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy PASSED [ 24%] 2024-09-12T00:43:06.691 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_managed PASSED [ 24%] 2024-09-12T00:43:07.807 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:43:08.983 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_same_account_role_policy_allow PASSED [ 24%] 2024-09-12T00:43:10.259 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_role_policy_allow PASSED [ 25%] 2024-09-12T00:43:11.403 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_create_bucket PASSED [ 25%] 2024-09-12T00:43:12.547 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_role_policy_allow_get_role PASSED [ 25%] 2024-09-12T00:43:13.355 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_account_oidc_provider PASSED [ 25%] 2024-09-12T00:43:14.012 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_new_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:43:14.667 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_add_existing_client_id_to_oidc PASSED [ 25%] 2024-09-12T00:43:15.323 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_verify_update_thumbprintlist_of_oidc PASSED [ 25%] 2024-09-12T00:43:16.423 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:43:17.551 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_user_arn PASSED [ 26%] 2024-09-12T00:43:18.691 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:43:19.787 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_arn PASSED [ 26%] 2024-09-12T00:43:20.896 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_bucket_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:43:22.043 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_user_policy_allow_account_id PASSED [ 26%] 2024-09-12T00:43:23.136 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_user_id PASSED [ 26%] 2024-09-12T00:43:24.268 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_user_id PASSED [ 26%] 2024-09-12T00:43:25.351 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_canonical_id PASSED [ 27%] 2024-09-12T00:43:26.479 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:43:27.611 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_bucket_acl_user_policy_grant_account_email PASSED [ 27%] 2024-09-12T00:43:28.740 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_user_policy_bucket_acl_grant_account_email PASSED [ 27%] 2024-09-12T00:43:29.423 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_arn PASSED [ 27%] 2024-09-12T00:43:30.107 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_policy_allow_account_id PASSED [ 27%] 2024-09-12T00:43:30.731 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_canonical_id PASSED [ 27%] 2024-09-12T00:43:31.355 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_iam.py::test_cross_account_root_bucket_acl_grant_account_email PASSED [ 28%] 2024-09-12T00:43:31.839 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_empty PASSED [ 28%] 2024-09-12T00:43:32.471 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_distinct PASSED [ 28%] 2024-09-12T00:43:32.978 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_many PASSED [ 28%] 2024-09-12T00:43:33.491 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_many PASSED [ 28%] 2024-09-12T00:43:34.002 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_basic_key_count PASSED [ 28%] 2024-09-12T00:43:34.482 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_basic PASSED [ 28%] 2024-09-12T00:43:34.942 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_basic PASSED [ 28%] 2024-09-12T00:43:35.466 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_encoding_basic PASSED [ 29%] 2024-09-12T00:43:35.943 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_encoding_basic PASSED [ 29%] 2024-09-12T00:43:36.534 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix PASSED [ 29%] 2024-09-12T00:43:37.140 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix PASSED [ 29%] 2024-09-12T00:43:37.563 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:43:38.032 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_ends_with_delimiter PASSED [ 29%] 2024-09-12T00:43:38.506 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_alt PASSED [ 29%] 2024-09-12T00:43:38.978 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_alt PASSED [ 30%] 2024-09-12T00:43:39.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:43:40.177 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_prefix_underscore PASSED [ 30%] 2024-09-12T00:43:40.659 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_percentage PASSED [ 30%] 2024-09-12T00:43:41.167 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_percentage PASSED [ 30%] 2024-09-12T00:43:41.638 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:43:42.115 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_whitespace PASSED [ 30%] 2024-09-12T00:43:42.582 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_dot PASSED [ 30%] 2024-09-12T00:43:43.055 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_dot PASSED [ 31%] 2024-09-12T00:43:43.527 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:43:44.066 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_unreadable PASSED [ 31%] 2024-09-12T00:43:44.526 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_empty PASSED [ 31%] 2024-09-12T00:43:44.994 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_empty PASSED [ 31%] 2024-09-12T00:43:45.470 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_none PASSED [ 31%] 2024-09-12T00:43:45.938 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_none PASSED [ 31%] 2024-09-12T00:43:46.402 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_notempty PASSED [ 32%] 2024-09-12T00:43:46.855 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_defaultempty PASSED [ 32%] 2024-09-12T00:43:47.358 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_fetchowner_empty PASSED [ 32%] 2024-09-12T00:43:47.835 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:43:48.298 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_delimiter_not_exist PASSED [ 32%] 2024-09-12T00:44:06.838 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_delimiter_not_skip_special PASSED [ 32%] 2024-09-12T00:44:07.312 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_basic PASSED [ 32%] 2024-09-12T00:44:07.746 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_basic PASSED [ 32%] 2024-09-12T00:44:08.186 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_alt PASSED [ 33%] 2024-09-12T00:44:08.638 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_alt PASSED [ 33%] 2024-09-12T00:44:09.087 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_empty PASSED [ 33%] 2024-09-12T00:44:09.583 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_empty PASSED [ 33%] 2024-09-12T00:44:10.071 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_none PASSED [ 33%] 2024-09-12T00:44:10.526 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_none PASSED [ 33%] 2024-09-12T00:44:10.982 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_not_exist PASSED [ 33%] 2024-09-12T00:44:11.434 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_not_exist PASSED [ 34%] 2024-09-12T00:44:11.890 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_unreadable PASSED [ 34%] 2024-09-12T00:44:12.354 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_unreadable PASSED [ 34%] 2024-09-12T00:44:12.886 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:44:13.358 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_basic PASSED [ 34%] 2024-09-12T00:44:13.831 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:44:14.298 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_alt PASSED [ 34%] 2024-09-12T00:44:14.774 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_not_exist PASSED [ 34%] 2024-09-12T00:44:15.242 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_not_exist PASSED [ 35%] 2024-09-12T00:44:15.718 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:44:16.218 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:44:16.686 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:44:17.154 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_prefix_delimiter_prefix_delimiter_not_exist PASSED [ 35%] 2024-09-12T00:44:17.682 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_one PASSED [ 35%] 2024-09-12T00:44:18.214 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_one PASSED [ 35%] 2024-09-12T00:44:18.690 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_zero PASSED [ 36%] 2024-09-12T00:44:19.222 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_zero PASSED [ 36%] 2024-09-12T00:44:19.690 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_none PASSED [ 36%] 2024-09-12T00:44:20.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_maxkeys_none PASSED [ 36%] 2024-09-12T00:44:20.358 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_account_usage PASSED [ 36%] 2024-09-12T00:44:20.782 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_head_bucket_usage PASSED [ 36%] 2024-09-12T00:44:21.886 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_unordered PASSED [ 36%] 2024-09-12T00:44:23.007 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_unordered PASSED [ 36%] 2024-09-12T00:44:23.482 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_maxkeys_invalid PASSED [ 37%] 2024-09-12T00:44:23.959 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_none PASSED [ 37%] 2024-09-12T00:44:24.434 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_empty PASSED [ 37%] 2024-09-12T00:44:24.910 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken_empty PASSED [ 37%] 2024-09-12T00:44:25.446 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_continuationtoken PASSED [ 37%] 2024-09-12T00:44:26.023 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_both_continuationtoken_startafter PASSED [ 37%] 2024-09-12T00:44:26.494 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_unreadable PASSED [ 37%] 2024-09-12T00:44:26.978 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_unreadable PASSED [ 38%] 2024-09-12T00:44:27.450 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_not_in_list PASSED [ 38%] 2024-09-12T00:44:27.918 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_not_in_list PASSED [ 38%] 2024-09-12T00:44:28.395 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_marker_after_list PASSED [ 38%] 2024-09-12T00:44:28.870 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_startafter_after_list PASSED [ 38%] 2024-09-12T00:44:29.578 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data PASSED [ 38%] 2024-09-12T00:44:30.426 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_return_data_versioning PASSED [ 38%] 2024-09-12T00:44:30.798 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous PASSED [ 39%] 2024-09-12T00:44:31.174 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous PASSED [ 39%] 2024-09-12T00:44:31.522 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:44:31.878 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_listv2_objects_anonymous_fail PASSED [ 39%] 2024-09-12T00:44:32.067 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_notexist PASSED [ 39%] 2024-09-12T00:44:32.250 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_notexist PASSED [ 39%] 2024-09-12T00:44:32.434 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_notexist PASSED [ 39%] 2024-09-12T00:44:32.935 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_delete_nonempty PASSED [ 39%] 2024-09-12T00:44:33.319 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_concurrent_set_canned_acl PASSED [ 40%] 2024-09-12T00:44:33.498 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_to_nonexist_bucket PASSED [ 40%] 2024-09-12T00:44:33.910 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_with_chunked_transfer_encoding PASSED [ 40%] 2024-09-12T00:44:34.262 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_delete PASSED [ 40%] 2024-09-12T00:44:34.614 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_read_not_exist PASSED [ 40%] 2024-09-12T00:44:34.962 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_requestid_matches_header_on_error PASSED [ 40%] 2024-09-12T00:44:35.783 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_concurrent_multi_object_delete PASSED [ 40%] 2024-09-12T00:44:36.390 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete PASSED [ 41%] 2024-09-12T00:44:37.058 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete PASSED [ 41%] 2024-09-12T00:44:56.061 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_object_delete_key_limit PASSED [ 41%] 2024-09-12T00:45:14.470 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multi_objectv2_delete_key_limit PASSED [ 41%] 2024-09-12T00:45:14.890 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_head_zero_bytes PASSED [ 41%] 2024-09-12T00:45:15.302 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_check_etag PASSED [ 41%] 2024-09-12T00:45:15.731 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_cache_control PASSED [ 41%] 2024-09-12T00:45:16.154 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_expires PASSED [ 41%] 2024-09-12T00:45:16.654 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_read_update_read_delete PASSED [ 42%] 2024-09-12T00:45:17.079 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_good PASSED [ 42%] 2024-09-12T00:45:17.498 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_none_to_empty PASSED [ 42%] 2024-09-12T00:45:18.026 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_set_get_metadata_overwrite_to_empty PASSED [ 42%] 2024-09-12T00:45:18.442 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_metadata_replaced_on_put PASSED [ 42%] 2024-09-12T00:45:18.910 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_write_file PASSED [ 42%] 2024-09-12T00:45:19.370 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_anonymous_request PASSED [ 42%] 2024-09-12T00:45:19.790 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request PASSED [ 43%] 2024-09-12T00:45:20.238 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_no_content_type PASSED [ 43%] 2024-09-12T00:45:20.582 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_authenticated_request_bad_access_key PASSED [ 43%] 2024-09-12T00:45:20.978 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_success_code PASSED [ 43%] 2024-09-12T00:45:21.382 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_invalid_success_code PASSED [ 43%] 2024-09-12T00:45:21.862 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_larger_than_chunk PASSED [ 43%] 2024-09-12T00:45:22.330 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_set_key_from_filename PASSED [ 43%] 2024-09-12T00:45:22.730 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_ignored_header PASSED [ 43%] 2024-09-12T00:45:23.134 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_case_insensitive_condition_fields PASSED [ 44%] 2024-09-12T00:45:23.546 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_escaped_field_values PASSED [ 44%] 2024-09-12T00:45:24.010 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_success_redirect_action PASSED [ 44%] 2024-09-12T00:45:24.354 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_signature PASSED [ 44%] 2024-09-12T00:45:24.698 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_access_key PASSED [ 44%] 2024-09-12T00:45:25.050 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_date_format PASSED [ 44%] 2024-09-12T00:45:25.402 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_no_key_specified PASSED [ 44%] 2024-09-12T00:45:25.794 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_signature PASSED [ 45%] 2024-09-12T00:45:26.146 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_policy_condition PASSED [ 45%] 2024-09-12T00:45:26.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_user_specified_header PASSED [ 45%] 2024-09-12T00:45:26.918 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_request_missing_policy_specified_field PASSED [ 45%] 2024-09-12T00:45:27.266 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_condition_is_case_sensitive PASSED [ 45%] 2024-09-12T00:45:27.610 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expires_is_case_sensitive PASSED [ 45%] 2024-09-12T00:45:27.958 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_expired_policy PASSED [ 45%] 2024-09-12T00:45:28.474 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_wrong_bucket PASSED [ 45%] 2024-09-12T00:45:28.818 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_request_field_value PASSED [ 46%] 2024-09-12T00:45:29.202 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_expires_condition PASSED [ 46%] 2024-09-12T00:45:29.554 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_conditions_list PASSED [ 46%] 2024-09-12T00:45:29.902 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_limit_exceeded PASSED [ 46%] 2024-09-12T00:45:30.238 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_missing_content_length_argument PASSED [ 46%] 2024-09-12T00:45:30.586 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_invalid_content_length_argument PASSED [ 46%] 2024-09-12T00:45:30.938 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_below_minimum PASSED [ 46%] 2024-09-12T00:45:31.430 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_size_rgw_chunk_size_bug PASSED [ 47%] 2024-09-12T00:45:31.778 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_empty_conditions PASSED [ 47%] 2024-09-12T00:45:32.246 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_good PASSED [ 47%] 2024-09-12T00:45:32.762 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmatch_failed PASSED [ 47%] 2024-09-12T00:45:33.186 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_good PASSED [ 47%] 2024-09-12T00:45:33.650 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifnonematch_failed PASSED [ 47%] 2024-09-12T00:45:34.122 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_good PASSED [ 47%] 2024-09-12T00:45:35.554 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifmodifiedsince_failed PASSED [ 47%] 2024-09-12T00:45:36.026 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_good PASSED [ 48%] 2024-09-12T00:45:36.498 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_ifunmodifiedsince_failed PASSED [ 48%] 2024-09-12T00:45:37.034 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_good PASSED [ 48%] 2024-09-12T00:45:37.658 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_failed PASSED [ 48%] 2024-09-12T00:45:38.194 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_overwrite_existed_good PASSED [ 48%] 2024-09-12T00:45:38.654 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifmatch_nonexisted_failed PASSED [ 48%] 2024-09-12T00:45:39.178 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_good PASSED [ 48%] 2024-09-12T00:45:39.746 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_failed PASSED [ 49%] 2024-09-12T00:45:40.222 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_nonexisted_good PASSED [ 49%] 2024-09-12T00:45:40.794 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_object_ifnonmatch_overwrite_existed_failed PASSED [ 49%] 2024-09-12T00:45:41.210 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get PASSED [ 49%] 2024-09-12T00:45:41.598 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_gone PASSED [ 49%] 2024-09-12T00:45:41.930 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_delete_key_bucket_gone PASSED [ 49%] 2024-09-12T00:45:42.326 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_gone PASSED [ 49%] 2024-09-12T00:45:42.721 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head PASSED [ 50%] 2024-09-12T00:45:42.906 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_notexist PASSED [ 50%] 2024-09-12T00:45:43.430 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_head_extended PASSED [ 50%] 2024-09-12T00:45:43.846 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_bucket_acl PASSED [ 50%] 2024-09-12T00:45:44.270 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_object_acl PASSED [ 50%] 2024-09-12T00:45:47.010 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_acl_mtime PASSED [ 50%] 2024-09-12T00:45:47.434 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated PASSED [ 50%] 2024-09-12T00:45:47.886 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_response_headers PASSED [ 50%] 2024-09-12T00:45:48.310 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_acl PASSED [ 51%] 2024-09-12T00:45:48.730 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_acl PASSED [ 51%] 2024-09-12T00:45:49.118 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_bucket_gone PASSED [ 51%] 2024-09-12T00:45:49.546 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_authenticated_object_gone PASSED [ 51%] 2024-09-12T00:45:49.966 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired PASSED [ 51%] 2024-09-12T00:45:50.390 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_not_expired_tenant PASSED [ 51%] 2024-09-12T00:45:50.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_range_zero PASSED [ 51%] 2024-09-12T00:45:51.274 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_max_range PASSED [ 52%] 2024-09-12T00:45:51.686 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_get_x_amz_expires_out_positive_range PASSED [ 52%] 2024-09-12T00:45:52.114 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put PASSED [ 52%] 2024-09-12T00:45:52.562 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_anon_put_write_access PASSED [ 52%] 2024-09-12T00:45:52.982 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_put_authenticated PASSED [ 52%] 2024-09-12T00:45:53.394 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl PASSED [ 52%] 2024-09-12T00:45:53.810 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_presigned_put_object_with_acl_tenant PASSED [ 52%] 2024-09-12T00:45:54.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_raw_put_authenticated_expired PASSED [ 52%] 2024-09-12T00:45:54.418 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_starts_nonalpha PASSED [ 53%] 2024-09-12T00:45:54.602 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_one PASSED [ 53%] 2024-09-12T00:45:54.826 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_short_two PASSED [ 53%] 2024-09-12T00:45:55.158 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_60 PASSED [ 53%] 2024-09-12T00:45:55.494 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_61 PASSED [ 53%] 2024-09-12T00:45:55.826 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_62 PASSED [ 53%] 2024-09-12T00:45:56.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_long_63 PASSED [ 53%] 2024-09-12T00:45:56.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_long_name PASSED [ 54%] 2024-09-12T00:45:56.754 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_bad_ip PASSED [ 54%] 2024-09-12T00:45:56.942 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_underscore PASSED [ 54%] 2024-09-12T00:45:57.274 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_long PASSED [ 54%] 2024-09-12T00:45:57.466 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_at_end PASSED [ 54%] 2024-09-12T00:45:57.694 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dot PASSED [ 54%] 2024-09-12T00:45:57.870 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dot_dash PASSED [ 54%] 2024-09-12T00:45:58.054 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_dns_dash_dot PASSED [ 54%] 2024-09-12T00:45:58.426 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists PASSED [ 55%] 2024-09-12T00:45:58.818 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_get_location PASSED [ 55%] 2024-09-12T00:45:59.178 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_exists_nonowner PASSED [ 55%] 2024-09-12T00:45:59.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_overwrite_acl PASSED [ 55%] 2024-09-12T00:45:59.954 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_new_acl PASSED [ 55%] 2024-09-12T00:46:00.290 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_default PASSED [ 55%] 2024-09-12T00:46:00.678 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_during_create PASSED [ 55%] 2024-09-12T00:46:01.138 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned PASSED [ 56%] 2024-09-12T00:46:01.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:46:01.962 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:46:02.442 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_default PASSED [ 56%] 2024-09-12T00:46:02.910 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_during_create PASSED [ 56%] 2024-09-12T00:46:03.430 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned PASSED [ 56%] 2024-09-12T00:46:03.890 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_publicreadwrite PASSED [ 56%] 2024-09-12T00:46:04.350 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_authenticatedread PASSED [ 56%] 2024-09-12T00:46:04.878 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerread PASSED [ 57%] 2024-09-12T00:46:05.465 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_canned_bucketownerfullcontrol PASSED [ 57%] 2024-09-12T00:46:05.950 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_owner PASSED [ 57%] 2024-09-12T00:46:06.422 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_full_control_verify_attributes PASSED [ 57%] 2024-09-12T00:46:06.774 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_canned_private_to_private PASSED [ 57%] 2024-09-12T00:46:07.306 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl PASSED [ 57%] 2024-09-12T00:46:07.846 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_write PASSED [ 57%] 2024-09-12T00:46:08.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_writeacp PASSED [ 58%] 2024-09-12T00:46:09.102 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_read PASSED [ 58%] 2024-09-12T00:46:09.630 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_acl_readacp PASSED [ 58%] 2024-09-12T00:46:10.190 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_fullcontrol PASSED [ 58%] 2024-09-12T00:46:10.674 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_read PASSED [ 58%] 2024-09-12T00:46:11.162 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_readacp PASSED [ 58%] 2024-09-12T00:46:11.706 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_write PASSED [ 58%] 2024-09-12T00:46:12.254 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_userid_writeacp PASSED [ 58%] 2024-09-12T00:46:12.622 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_nonexist_user PASSED [ 59%] 2024-09-12T00:46:13.086 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_header_acl_grants PASSED [ 59%] 2024-09-12T00:46:13.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_header_acl_grants PASSED [ 59%] 2024-09-12T00:46:13.986 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email PASSED [ 59%] 2024-09-12T00:46:14.358 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_grant_email_not_exist PASSED [ 59%] 2024-09-12T00:46:14.890 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_acl_revoke_all PASSED [ 59%] 2024-09-12T00:46:15.554 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_private PASSED [ 59%] 2024-09-12T00:46:16.274 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_private PASSED [ 60%] 2024-09-12T00:46:16.950 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicread PASSED [ 60%] 2024-09-12T00:46:17.634 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicread PASSED [ 60%] 2024-09-12T00:46:18.306 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:46:18.978 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_private_objectv2_publicreadwrite PASSED [ 60%] 2024-09-12T00:46:19.698 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_private PASSED [ 60%] 2024-09-12T00:46:20.358 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicread PASSED [ 60%] 2024-09-12T00:46:21.038 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicread_object_publicreadwrite PASSED [ 60%] 2024-09-12T00:46:21.686 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_private PASSED [ 61%] 2024-09-12T00:46:22.326 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicread PASSED [ 61%] 2024-09-12T00:46:22.975 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_access_bucket_publicreadwrite_object_publicreadwrite PASSED [ 61%] 2024-09-12T00:46:24.026 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_create_then_list PASSED [ 61%] 2024-09-12T00:46:25.014 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_buckets_list_ctime PASSED [ 61%] 2024-09-12T00:46:25.198 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_anonymous PASSED [ 61%] 2024-09-12T00:46:25.382 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_invalid_auth PASSED [ 61%] 2024-09-12T00:46:25.566 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_buckets_bad_auth PASSED [ 62%] 2024-09-12T00:46:25.934 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_alpha PASSED [ 62%] 2024-09-12T00:46:26.310 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_starts_digit PASSED [ 62%] 2024-09-12T00:46:26.650 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_period PASSED [ 62%] 2024-09-12T00:46:26.986 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_naming_good_contains_hyphen PASSED [ 62%] 2024-09-12T00:46:27.498 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_recreate_not_overriding PASSED [ 62%] 2024-09-12T00:46:28.846 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_create_special_key_names PASSED [ 62%] 2024-09-12T00:46:29.410 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_list_special_prefix PASSED [ 63%] 2024-09-12T00:46:29.926 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_zero_size PASSED [ 63%] 2024-09-12T00:46:30.762 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_16m PASSED [ 63%] 2024-09-12T00:46:31.294 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_same_bucket PASSED [ 63%] 2024-09-12T00:46:31.826 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_verify_contenttype PASSED [ 63%] 2024-09-12T00:46:32.310 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself PASSED [ 63%] 2024-09-12T00:46:32.798 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_to_itself_with_metadata PASSED [ 63%] 2024-09-12T00:46:33.594 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_diff_bucket PASSED [ 63%] 2024-09-12T00:46:34.178 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_bucket PASSED [ 64%] 2024-09-12T00:46:34.742 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_not_owned_object_bucket PASSED [ 64%] 2024-09-12T00:46:35.314 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_canned_acl PASSED [ 64%] 2024-09-12T00:46:36.202 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_retaining_metadata PASSED [ 64%] 2024-09-12T00:46:37.030 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_replacing_metadata PASSED [ 64%] 2024-09-12T00:46:37.445 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_bucket_not_found PASSED [ 64%] 2024-09-12T00:46:37.778 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_key_not_found PASSED [ 64%] 2024-09-12T00:46:39.270 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_bucket PASSED [ 65%] 2024-09-12T00:46:39.858 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioned_url_encoding PASSED [ 65%] 2024-09-12T00:46:42.378 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_copy_versioning_multipart_upload PASSED [ 65%] 2024-09-12T00:46:42.774 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_empty PASSED [ 65%] 2024-09-12T00:46:43.274 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_small PASSED [ 65%] 2024-09-12T00:46:44.390 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_small PASSED [ 65%] 2024-09-12T00:46:44.906 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_invalid_range PASSED [ 65%] 2024-09-12T00:46:45.798 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_without_range PASSED [ 65%] 2024-09-12T00:46:48.266 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_special_names PASSED [ 66%] 2024-09-12T00:46:50.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload PASSED [ 66%] 2024-09-12T00:46:53.404 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_versioned PASSED [ 66%] 2024-09-12T00:47:03.702 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_resend_part PASSED [ 66%] 2024-09-12T00:47:05.882 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_multiple_sizes PASSED [ 66%] 2024-09-12T00:47:09.010 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_copy_multiple_sizes PASSED [ 66%] 2024-09-12T00:47:09.698 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_size_too_small PASSED [ 66%] 2024-09-12T00:47:10.738 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_contents PASSED [ 67%] 2024-09-12T00:47:11.738 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_overwrite_existing_object PASSED [ 67%] 2024-09-12T00:47:12.482 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload PASSED [ 67%] 2024-09-12T00:47:12.950 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_abort_multipart_upload_not_found PASSED [ 67%] 2024-09-12T00:47:14.011 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload PASSED [ 67%] 2024-09-12T00:47:14.542 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_list_multipart_upload_owner PASSED [ 67%] 2024-09-12T00:47:15.010 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_missing_part PASSED [ 67%] 2024-09-12T00:47:15.482 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_incorrect_etag PASSED [ 67%] 2024-09-12T00:47:29.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_get_part PASSED [ 68%] 2024-09-12T00:47:31.974 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_single_get_part PASSED [ 68%] 2024-09-12T00:47:32.490 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_non_multipart_get_part PASSED [ 68%] 2024-09-12T00:47:32.850 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_100_continue PASSED [ 68%] 2024-09-12T00:47:33.338 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_set_cors PASSED [ 68%] 2024-09-12T00:47:36.850 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_response PASSED [ 68%] 2024-09-12T00:47:40.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_origin_wildcard PASSED [ 68%] 2024-09-12T00:47:43.614 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_header_option PASSED [ 69%] 2024-09-12T00:47:44.042 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object PASSED [ 69%] 2024-09-12T00:47:44.470 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_get_object_tenant PASSED [ 69%] 2024-09-12T00:47:44.898 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object PASSED [ 69%] 2024-09-12T00:47:45.330 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_with_acl PASSED [ 69%] 2024-09-12T00:47:45.758 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant PASSED [ 69%] 2024-09-12T00:47:46.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_cors_presigned_put_object_tenant_with_acl PASSED [ 69%] 2024-09-12T00:47:46.698 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_set_bucket_tagging PASSED [ 69%] 2024-09-12T00:47:47.214 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_1mb PASSED [ 70%] 2024-09-12T00:47:47.898 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_4mb PASSED [ 70%] 2024-09-12T00:47:48.762 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_read_8mb PASSED [ 70%] 2024-09-12T00:47:49.386 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_1mb PASSED [ 70%] 2024-09-12T00:47:50.234 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_4mb PASSED [ 70%] 2024-09-12T00:47:51.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_write_8mb PASSED [ 70%] 2024-09-12T00:47:51.878 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_1mb PASSED [ 70%] 2024-09-12T00:47:52.798 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_4mb PASSED [ 71%] 2024-09-12T00:47:54.110 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_dual_write_8mb PASSED [ 71%] 2024-09-12T00:47:54.726 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_conditional_write_1mb PASSED [ 71%] 2024-09-12T00:47:55.310 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_atomic_multipart_upload_write PASSED [ 71%] 2024-09-12T00:47:56.151 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_resend_first_finishes_last PASSED [ 71%] 2024-09-12T00:47:56.618 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_response_code PASSED [ 71%] 2024-09-12T00:48:01.198 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_big_request_response_code PASSED [ 71%] 2024-09-12T00:48:01.662 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_skip_leading_bytes_response_code PASSED [ 71%] 2024-09-12T00:48:02.134 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_return_trailing_bytes_response_code PASSED [ 72%] 2024-09-12T00:48:02.610 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_invalid_range PASSED [ 72%] 2024-09-12T00:48:03.086 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ranged_request_empty_object PASSED [ 72%] 2024-09-12T00:48:03.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_create_suspend PASSED [ 72%] 2024-09-12T00:48:11.866 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove PASSED [ 72%] 2024-09-12T00:48:12.639 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_read_remove_head PASSED [ 72%] 2024-09-12T00:48:13.230 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_removal PASSED [ 72%] 2024-09-12T00:48:13.986 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite PASSED [ 73%] 2024-09-12T00:48:14.778 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_plain_null_version_overwrite_suspended PASSED [ 73%] 2024-09-12T00:48:18.218 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspend_versions PASSED [ 73%] 2024-09-12T00:48:19.006 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_suspended_copy PASSED [ 73%] 2024-09-12T00:48:23.178 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_all PASSED [ 73%] 2024-09-12T00:48:38.574 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_versions_remove_special_names PASSED [ 73%] 2024-09-12T00:48:42.031 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_create_overwrite_multipart PASSED [ 73%] 2024-09-12T00:48:43.406 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_obj_list_marker PASSED [ 73%] 2024-09-12T00:48:44.978 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_copy_obj_version PASSED [ 74%] 2024-09-12T00:48:45.710 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete PASSED [ 74%] 2024-09-12T00:48:46.426 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker PASSED [ 74%] 2024-09-12T00:48:46.962 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_multi_object_delete_with_marker_create PASSED [ 74%] 2024-09-12T00:48:47.758 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl PASSED [ 74%] 2024-09-12T00:48:48.434 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_object_acl_no_version_specified PASSED [ 74%] 2024-09-12T00:48:49.194 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioned_concurrent_object_create_and_remove PASSED [ 74%] 2024-09-12T00:48:49.542 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set PASSED [ 75%] 2024-09-12T00:48:49.970 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get PASSED [ 75%] 2024-09-12T00:48:50.454 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_get_no_id PASSED [ 75%] 2024-09-12T00:48:50.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_id_too_long PASSED [ 75%] 2024-09-12T00:48:51.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_same_id PASSED [ 75%] 2024-09-12T00:48:51.630 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_invalid_status PASSED [ 75%] 2024-09-12T00:48:52.015 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_date PASSED [ 75%] 2024-09-12T00:48:52.379 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_invalid_date PASSED [ 76%] 2024-09-12T00:48:52.850 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_noncurrent PASSED [ 76%] 2024-09-12T00:48:53.226 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_deletemarker PASSED [ 76%] 2024-09-12T00:48:53.622 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_filter PASSED [ 76%] 2024-09-12T00:48:54.058 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_empty_filter PASSED [ 76%] 2024-09-12T00:48:54.426 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_set_multipart PASSED [ 76%] 2024-09-12T00:48:54.782 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_lifecycle_transition_set_invalid_date PASSED [ 76%] 2024-09-12T00:48:55.250 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1b PASSED [ 76%] 2024-09-12T00:48:55.722 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1kb PASSED [ 77%] 2024-09-12T00:48:56.194 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_1MB PASSED [ 77%] 2024-09-12T00:48:56.666 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encrypted_transfer_13b PASSED [ 77%] 2024-09-12T00:48:57.114 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_method_head PASSED [ 77%] 2024-09-12T00:48:57.582 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_present PASSED [ 77%] 2024-09-12T00:48:58.054 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_other_key PASSED [ 77%] 2024-09-12T00:48:58.442 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_invalid_md5 PASSED [ 77%] 2024-09-12T00:48:58.842 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_md5 PASSED [ 78%] 2024-09-12T00:48:59.246 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_no_key PASSED [ 78%] 2024-09-12T00:48:59.650 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_key_no_sse_c PASSED [ 78%] 2024-09-12T00:49:02.606 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_upload PASSED [ 78%] 2024-09-12T00:49:05.754 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_unaligned_multipart_upload PASSED [ 78%] 2024-09-12T00:49:07.426 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_multipart_bad_download PASSED [ 78%] 2024-09-12T00:49:07.846 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_post_object_authenticated_request PASSED [ 78%] 2024-09-12T00:50:08.974 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_enforced_with_bucket_policy PASSED [ 78%] 2024-09-12T00:51:10.018 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_encryption_sse_c_deny_algo_with_bucket_policy PASSED [ 79%] 2024-09-12T00:51:10.450 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_method_head PASSED [ 79%] 2024-09-12T00:51:10.926 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_present PASSED [ 79%] 2024-09-12T00:51:11.334 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_no_key PASSED [ 79%] 2024-09-12T00:51:11.690 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_not_declared PASSED [ 79%] 2024-09-12T00:51:14.055 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_upload PASSED [ 79%] 2024-09-12T00:51:15.526 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_1 PASSED [ 79%] 2024-09-12T00:51:17.118 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_multipart_invalid_chunks_2 PASSED [ 80%] 2024-09-12T00:51:17.546 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_post_object_authenticated_request PASSED [ 80%] 2024-09-12T00:51:18.018 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1b PASSED [ 80%] 2024-09-12T00:51:18.494 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1kb PASSED [ 80%] 2024-09-12T00:51:18.970 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_1MB PASSED [ 80%] 2024-09-12T00:51:19.443 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_transfer_13b PASSED [ 80%] 2024-09-12T00:51:19.914 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_read_declare PASSED [ 80%] 2024-09-12T00:51:20.366 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy PASSED [ 80%] 2024-09-12T00:51:20.859 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy PASSED [ 81%] 2024-09-12T00:51:21.338 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_acl PASSED [ 81%] 2024-09-12T00:51:21.819 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_acl PASSED [ 81%] 2024-09-12T00:51:22.270 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_different_tenant PASSED [ 81%] 2024-09-12T00:51:22.702 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_tenanted_bucket PASSED [ 81%] 2024-09-12T00:51:23.450 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_another_bucket PASSED [ 81%] 2024-09-12T00:51:24.206 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucketv2_policy_another_bucket PASSED [ 81%] 2024-09-12T00:51:24.879 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_tagging PASSED [ 82%] 2024-09-12T00:51:25.518 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_obj_head_tagging PASSED [ 82%] 2024-09-12T00:51:26.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_tags PASSED [ 82%] 2024-09-12T00:51:26.826 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_tags PASSED [ 82%] 2024-09-12T00:51:27.454 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_max_kvsize_tags PASSED [ 82%] 2024-09-12T00:51:28.138 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_key_tags PASSED [ 82%] 2024-09-12T00:51:28.802 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_excess_val_tags PASSED [ 82%] 2024-09-12T00:51:29.530 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_modify_tags PASSED [ 82%] 2024-09-12T00:51:30.310 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_delete_tags PASSED [ 83%] 2024-09-12T00:51:30.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_anonymous_request PASSED [ 83%] 2024-09-12T00:51:31.246 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_tags_authenticated_request PASSED [ 83%] 2024-09-12T00:51:31.766 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_with_tags PASSED [ 83%] 2024-09-12T00:51:32.390 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_tags_acl_public PASSED [ 83%] 2024-09-12T00:51:33.038 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_tags_acl_public PASSED [ 83%] 2024-09-12T00:51:33.750 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_delete_tags_obj_public PASSED [ 83%] 2024-09-12T00:51:34.898 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_atomic_upload_return_version_id PASSED [ 84%] 2024-09-12T00:51:38.695 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_versioning_bucket_multipart_upload_return_version_id PASSED [ 84%] 2024-09-12T00:51:39.298 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_existing_tag PASSED [ 84%] 2024-09-12T00:51:39.983 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T00:51:40.626 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_tagging_existing_tag PASSED [ 84%] 2024-09-12T00:51:41.570 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source PASSED [ 84%] 2024-09-12T00:51:42.430 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_copy_source_meta PASSED [ 84%] 2024-09-12T00:51:42.922 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_acl PASSED [ 84%] 2024-09-12T00:51:43.670 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_grant PASSED [ 85%] 2024-09-12T00:51:44.030 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_s3 PASSED [ 85%] 2024-09-12T00:51:44.394 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_c_kms PASSED [ 85%] 2024-09-12T00:51:44.746 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_s3_kms PASSED [ 85%] 2024-09-12T00:51:45.102 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_obj_enc_conflict_bad_enc_kms PASSED [ 85%] 2024-09-12T00:51:45.641 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_noenc PASSED [ 85%] 2024-09-12T00:51:46.043 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_put_obj_kms_s3 PASSED [ 85%] 2024-09-12T00:51:46.734 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_get_obj_acl_existing_tag PASSED [ 86%] 2024-09-12T00:51:47.146 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock PASSED [ 86%] 2024-09-12T00:51:47.542 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_bucket PASSED [ 86%] 2024-09-12T00:51:47.934 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_with_days_and_years PASSED [ 86%] 2024-09-12T00:51:48.334 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_days PASSED [ 86%] 2024-09-12T00:51:48.734 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_years PASSED [ 86%] 2024-09-12T00:51:49.186 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_mode PASSED [ 86%] 2024-09-12T00:51:49.638 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_lock_invalid_status PASSED [ 86%] 2024-09-12T00:51:50.030 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_suspend_versioning PASSED [ 87%] 2024-09-12T00:51:50.430 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock PASSED [ 87%] 2024-09-12T00:51:50.831 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_lock_invalid_bucket PASSED [ 87%] 2024-09-12T00:51:51.310 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention PASSED [ 87%] 2024-09-12T00:51:51.778 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_bucket PASSED [ 87%] 2024-09-12T00:51:52.322 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_invalid_mode PASSED [ 87%] 2024-09-12T00:51:52.806 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention PASSED [ 87%] 2024-09-12T00:51:53.254 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_iso8601 PASSED [ 88%] 2024-09-12T00:51:53.714 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_retention_invalid_bucket PASSED [ 88%] 2024-09-12T00:51:54.318 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_versionid PASSED [ 88%] 2024-09-12T00:51:54.810 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_override_default_retention PASSED [ 88%] 2024-09-12T00:51:55.298 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_increase_period PASSED [ 88%] 2024-09-12T00:51:55.786 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period PASSED [ 88%] 2024-09-12T00:51:56.274 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_obj_retention_shorten_period_bypass PASSED [ 88%] 2024-09-12T00:51:56.758 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention PASSED [ 89%] 2024-09-12T00:51:57.370 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_retention PASSED [ 89%] 2024-09-12T00:51:57.946 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_retention_and_marker PASSED [ 89%] 2024-09-12T00:51:58.471 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_multi_delete_object_with_retention PASSED [ 89%] 2024-09-12T00:51:58.986 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold PASSED [ 89%] 2024-09-12T00:51:59.458 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_bucket PASSED [ 89%] 2024-09-12T00:51:59.943 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_put_legal_hold_invalid_status PASSED [ 89%] 2024-09-12T00:52:00.502 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold PASSED [ 89%] 2024-09-12T00:52:00.990 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_legal_hold_invalid_bucket PASSED [ 90%] 2024-09-12T00:52:01.494 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T00:52:02.139 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_multipart_object_with_legal_hold_on PASSED [ 90%] 2024-09-12T00:52:02.578 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_delete_object_with_legal_hold_off PASSED [ 90%] 2024-09-12T00:52:03.062 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_get_obj_metadata PASSED [ 90%] 2024-09-12T00:52:03.506 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_uploading_obj PASSED [ 90%] 2024-09-12T00:52:13.894 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_with_bypass PASSED [ 90%] 2024-09-12T00:52:14.362 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_governance_without_bypass PASSED [ 91%] 2024-09-12T00:52:24.271 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_lock_changing_mode_from_compliance PASSED [ 91%] 2024-09-12T00:52:24.792 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifmatch_good PASSED [ 91%] 2024-09-12T00:52:25.322 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_copy_object_ifnonematch_failed PASSED [ 91%] 2024-09-12T00:52:25.678 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_policy_status PASSED [ 91%] 2024-09-12T00:52:26.102 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:52:26.514 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_authpublic_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:52:26.930 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_publicpolicy_acl_bucket_policy_status PASSED [ 91%] 2024-09-12T00:52:27.626 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_acl_bucket_policy_status PASSED [ 92%] 2024-09-12T00:52:28.026 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_nonpublicpolicy_principal_bucket_policy_status PASSED [ 92%] 2024-09-12T00:52:28.386 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_bucket_policy_allow_notprincipal PASSED [ 92%] 2024-09-12T00:52:28.806 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_undefined_public_block PASSED [ 92%] 2024-09-12T00:52:29.282 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_public_block_deny_bucket_policy PASSED [ 92%] 2024-09-12T00:52:29.694 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_public_block PASSED [ 92%] 2024-09-12T00:52:30.246 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_put_bucket_acls PASSED [ 92%] 2024-09-12T00:52:30.758 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_object_canned_acls PASSED [ 93%] 2024-09-12T00:52:31.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy PASSED [ 93%] 2024-09-12T00:52:31.590 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_block_public_policy_with_principal PASSED [ 93%] 2024-09-12T00:52:32.206 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_ignore_public_acls PASSED [ 93%] 2024-09-12T00:52:34.270 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_upload_on_a_bucket_with_policy PASSED [ 93%] 2024-09-12T00:52:34.634 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_put_bucket_encryption_kms PASSED [ 93%] 2024-09-12T00:52:35.054 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_bucket_encryption_kms PASSED [ 93%] 2024-09-12T00:52:35.486 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_delete_bucket_encryption_kms PASSED [ 93%] 2024-09-12T00:52:35.966 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_sse_kms_default_post_object_authenticated_request PASSED [ 94%] 2024-09-12T00:52:36.538 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_get_object_torrent PASSED [ 94%] 2024-09-12T00:52:37.030 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_object_checksum_sha256 PASSED [ 94%] 2024-09-12T00:52:37.914 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_sha256 PASSED [ 94%] 2024-09-12T00:52:38.955 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_multipart_checksum_3parts PASSED [ 94%] 2024-09-12T00:52:39.455 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py::test_post_object_upload_checksum PASSED [ 94%] 2024-09-12T00:52:41.057 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_where_clause PASSED [ 94%] 2024-09-12T00:52:42.429 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_generate_projection PASSED [ 95%] 2024-09-12T00:52:42.746 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_count_operation PASSED [ 95%] 2024-09-12T00:52:43.122 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_count_json_operation PASSED [ 95%] 2024-09-12T00:52:44.550 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_json_column_sum_min_max PASSED [ 95%] 2024-09-12T00:52:46.254 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_json_nullif_expressions PASSED [ 95%] 2024-09-12T00:52:47.066 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_column_sum_min_max PASSED [ 95%] 2024-09-12T00:52:47.665 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_nullif_expressions PASSED [ 95%] 2024-09-12T00:52:48.170 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_nulliftrue_expressions PASSED [ 95%] 2024-09-12T00:52:48.602 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_is_not_null_expressions PASSED [ 96%] 2024-09-12T00:52:48.874 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_lowerupper_expressions PASSED [ 96%] 2024-09-12T00:52:49.526 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_in_expressions PASSED [ 96%] 2024-09-12T00:52:50.562 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_in_expressions PASSED [ 96%] 2024-09-12T00:52:52.957 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_like_expressions PASSED [ 96%] 2024-09-12T00:52:53.486 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalselike_expressions PASSED [ 96%] 2024-09-12T00:52:54.110 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_complex_expressions PASSED [ 96%] 2024-09-12T00:52:54.538 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_alias PASSED [ 97%] 2024-09-12T00:52:54.890 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_alias_cyclic_refernce PASSED [ 97%] 2024-09-12T00:52:55.470 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_datetime PASSED [ 97%] 2024-09-12T00:52:56.058 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_true_false_datetime PASSED [ 97%] 2024-09-12T00:52:56.394 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_parser PASSED [ 97%] 2024-09-12T00:52:56.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_csv_definition PASSED [ 97%] 2024-09-12T00:52:57.374 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_schema_definition PASSED [ 97%] 2024-09-12T00:52:57.886 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_when_then_else_expressions PASSED [ 97%] 2024-09-12T00:52:58.458 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_coalesce_expressions PASSED [ 98%] 2024-09-12T00:52:58.934 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_cast_expressions PASSED [ 98%] 2024-09-12T00:52:59.106 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_version PASSED [ 98%] 2024-09-12T00:53:00.096 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_trim_expressions PASSED [ 98%] 2024-09-12T00:53:00.746 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_truefalse_trim_expressions PASSED [ 98%] 2024-09-12T00:53:01.354 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_escape_expressions PASSED [ 98%] 2024-09-12T00:53:01.814 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_case_value_expressions PASSED [ 98%] 2024-09-12T00:53:02.218 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_bool_cast_expressions PASSED [ 99%] 2024-09-12T00:53:11.986 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_progress_expressions PASSED [ 99%] 2024-09-12T00:53:12.166 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3select.py::test_output_serial_expressions PASSED [ 99%] 2024-09-12T00:53:12.850 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic PASSED [ 99%] 2024-09-12T00:53:13.478 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic PASSED [ 99%] 2024-09-12T00:53:14.006 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_account_topic_publish PASSED [ 99%] 2024-09-12T00:53:14.679 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_sns.py::test_cross_account_topic_publish PASSED [ 99%] 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_utils.py::test_generate PASSED [100%] 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout:=============================== warnings summary =============================== 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout:.tox/py/lib/python3.10/site-packages/boto/plugin.py:40 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/.tox/py/lib/python3.10/site-packages/boto/plugin.py:40: DeprecationWarning: the imp module is deprecated in favour of importlib and slated for removal in Python 3.12; see the module's documentation for alternative uses 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout: import imp 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py:120 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:120: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T00:53:14.721 INFO:teuthology.orchestra.run.smithi078.stdout: if boto_type is 'S3Connection': 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_headers.py:124 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_headers.py:124: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: elif boto_type is 'HTTPRequest': 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3.py:359 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3.py:359: DeprecationWarning: invalid escape sequence '\W' 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: extra_sc = re.split('\W+', config['main']['storage_classes']) 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py:176 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:176: SyntaxWarning: "is" with a literal. Did you mean "=="? 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: if k is 'BucketName': 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.722 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py:253 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests/functional/test_s3_website.py:253: PytestUnknownMarkWarning: Unknown pytest.mark.timeout - is this a typo? You can register custom marks to avoid this warning - for details, see https://docs.pytest.org/en/stable/how-to/mark.html 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.timeout(10) 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests/functional/test_s3_website.py:1077 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: s3tests/functional/test_s3_website.py:1077: PytestCollectionWarning: yield tests were removed in pytest 4.0 - test_routing_generator will be ignored 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: @pytest.mark.s3website_routing_rules 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2214 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2214: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2229 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2229: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.723 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2235 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2235: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: response = client.get_object(Bucket=bucket_name, Key='\$foo.txt') 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2292 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2292: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2307 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2307: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.724 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2325 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2325: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2340 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2340: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id[::-1]),\ 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2358 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2358: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2373 2024-09-12T00:53:14.725 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2373: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: payload = OrderedDict([ ("key" , "\$foo.txt"),("AWSAccessKeyId" , aws_access_key_id),\ 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2423 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2423: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout:s3tests_boto3/functional/test_s3.py:2455 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: /home/ubuntu/cephtest/s3-tests-client.0/s3tests_boto3/functional/test_s3.py:2455: DeprecationWarning: invalid escape sequence '\$' 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: ["starts-with", "$key", "\$foo"],\ 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout:-- Docs: https://docs.pytest.org/en/stable/how-to/capture-warnings.html 2024-09-12T00:53:14.726 INFO:teuthology.orchestra.run.smithi078.stdout:= 680 passed, 65 skipped, 126 deselected, 1 xfailed, 18 warnings in 689.98s (0:11:29) = 2024-09-12T00:53:14.891 INFO:teuthology.orchestra.run.smithi078.stdout:___________________________________ summary ____________________________________ 2024-09-12T00:53:14.891 INFO:teuthology.orchestra.run.smithi078.stdout: py: commands succeeded 2024-09-12T00:53:14.891 INFO:teuthology.orchestra.run.smithi078.stdout: congratulations :) 2024-09-12T00:53:14.910 DEBUG:tasks.s3tests:Scanning radosgw logs for leaked encryption keys... 2024-09-12T00:53:14.911 DEBUG:teuthology.orchestra.run.smithi078:> grep --binary-files=text pO3upElrwuEXSoFwCfnZPdSsmt/xWeFa0N9KgDijwVs= /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T00:53:15.012 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:53:15.013 INFO:tasks.s3tests:Cleaning up boto... 2024-09-12T00:53:15.013 DEBUG:teuthology.orchestra.run.smithi078:> rm /home/ubuntu/cephtest/boto-client.0.cfg 2024-09-12T00:53:15.018 INFO:tasks.s3tests:Removing s3-tests... 2024-09-12T00:53:15.019 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/s3-tests-client.0 2024-09-12T00:53:15.202 INFO:teuthology.run_tasks:Running task workunit... 2024-09-12T00:53:15.218 INFO:tasks.workunit:Pulling workunits from ref 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:53:15.218 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-12T00:53:15.218 DEBUG:teuthology.orchestra.run.smithi078:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:53:15.224 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:53:15.225 INFO:teuthology.orchestra.run.smithi078.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-09-12T00:53:15.225 DEBUG:teuthology.orchestra.run.smithi078:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:53:15.272 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-09-12T00:53:15.272 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-09-12T00:53:15.320 INFO:tasks.workunit:timeout=3h 2024-09-12T00:53:15.320 INFO:tasks.workunit:cleanup=True 2024-09-12T00:53:15.321 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/cbodley/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6a169fc940965ab446a63954fde870aa497efde7 2024-09-12T00:53:15.371 INFO:tasks.workunit.client.0.smithi078.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-12T00:53:58.702 INFO:tasks.workunit.client.0.smithi078.stderr:Note: switching to '6a169fc940965ab446a63954fde870aa497efde7'. 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr:state without impacting any branches by switching back to a branch. 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:53:58.703 INFO:tasks.workunit.client.0.smithi078.stderr: git switch -c 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr:Or undo this operation with: 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr: git switch - 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:53:58.704 INFO:tasks.workunit.client.0.smithi078.stderr:HEAD is now at 6a169fc9409 DNM: qa/rgw: point at ragweed branch wip-67986 2024-09-12T00:53:58.709 DEBUG:teuthology.orchestra.run.smithi078:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-12T00:53:58.756 INFO:tasks.workunit.client.0.smithi078.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-12T00:53:58.759 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:53:58.759 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-12T00:53:58.814 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-12T00:53:58.869 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-12T00:53:58.912 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-12T00:53:58.913 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:53:58.913 INFO:tasks.workunit.client.0.smithi078.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-12T00:53:58.954 INFO:tasks.workunit.client.0.smithi078.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-12T00:53:58.958 DEBUG:teuthology.orchestra.run.smithi078:> set -ex 2024-09-12T00:53:58.958 DEBUG:teuthology.orchestra.run.smithi078:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-12T00:53:59.008 INFO:tasks.workunit:Running workunits matching rgw/run-versioning.sh on client.0... 2024-09-12T00:53:59.009 INFO:tasks.workunit:Running workunit rgw/run-versioning.sh... 2024-09-12T00:53:59.009 DEBUG:teuthology.orchestra.run.smithi078:workunit test rgw/run-versioning.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6a169fc940965ab446a63954fde870aa497efde7 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T00:53:59.061 INFO:tasks.workunit.client.0.smithi078.stderr:++ dirname /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/run-versioning.sh 2024-09-12T00:53:59.061 INFO:tasks.workunit.client.0.smithi078.stderr:+ mydir=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:53:59.061 INFO:tasks.workunit.client.0.smithi078.stderr:+ python3 -m venv /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:54:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:+ source /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/activate 2024-09-12T00:54:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:++ deactivate nondestructive 2024-09-12T00:54:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:54:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:54:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:54:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-12T00:54:01.902 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' '!' nondestructive = nondestructive ']' 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ PATH=/home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PATH 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n '' ']' 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -z '' ']' 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ _OLD_VIRTUAL_PS1= 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ PS1='(rgw) ' 2024-09-12T00:54:01.903 INFO:tasks.workunit.client.0.smithi078.stderr:++ export PS1 2024-09-12T00:54:01.904 INFO:tasks.workunit.client.0.smithi078.stderr:++ VIRTUAL_ENV_PROMPT='(rgw) ' 2024-09-12T00:54:01.904 INFO:tasks.workunit.client.0.smithi078.stderr:++ export VIRTUAL_ENV_PROMPT 2024-09-12T00:54:01.904 INFO:tasks.workunit.client.0.smithi078.stderr:++ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:54:01.904 INFO:tasks.workunit.client.0.smithi078.stderr:++ hash -r 2024-09-12T00:54:01.904 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install pip --upgrade 2024-09-12T00:54:02.272 INFO:tasks.workunit.client.0.smithi078.stdout:Requirement already satisfied: pip in /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/lib/python3.10/site-packages (22.0.2) 2024-09-12T00:54:02.485 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting pip 2024-09-12T00:54:02.490 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached pip-24.2-py3-none-any.whl (1.8 MB) 2024-09-12T00:54:02.524 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: pip 2024-09-12T00:54:02.524 INFO:tasks.workunit.client.0.smithi078.stdout: Attempting uninstall: pip 2024-09-12T00:54:02.525 INFO:tasks.workunit.client.0.smithi078.stdout: Found existing installation: pip 22.0.2 2024-09-12T00:54:02.785 INFO:tasks.workunit.client.0.smithi078.stdout: Uninstalling pip-22.0.2: 2024-09-12T00:54:02.791 INFO:tasks.workunit.client.0.smithi078.stdout: Successfully uninstalled pip-22.0.2 2024-09-12T00:54:03.537 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed pip-24.2 2024-09-12T00:54:03.597 INFO:tasks.workunit.client.0.smithi078.stderr:+ pip install boto3 2024-09-12T00:54:04.631 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting boto3 2024-09-12T00:54:04.632 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached boto3-1.35.17-py3-none-any.whl.metadata (6.6 kB) 2024-09-12T00:54:05.153 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting botocore<1.36.0,>=1.35.17 (from boto3) 2024-09-12T00:54:05.155 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached botocore-1.35.17-py3-none-any.whl.metadata (5.7 kB) 2024-09-12T00:54:05.221 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting jmespath<2.0.0,>=0.7.1 (from boto3) 2024-09-12T00:54:05.222 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached jmespath-1.0.1-py3-none-any.whl.metadata (7.6 kB) 2024-09-12T00:54:05.276 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting s3transfer<0.11.0,>=0.10.0 (from boto3) 2024-09-12T00:54:05.277 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached s3transfer-0.10.2-py3-none-any.whl.metadata (1.7 kB) 2024-09-12T00:54:05.318 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting python-dateutil<3.0.0,>=2.1 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:54:05.319 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl.metadata (8.4 kB) 2024-09-12T00:54:05.390 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting urllib3!=2.2.0,<3,>=1.25.4 (from botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:54:05.391 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached urllib3-2.2.2-py3-none-any.whl.metadata (6.4 kB) 2024-09-12T00:54:05.524 INFO:tasks.workunit.client.0.smithi078.stdout:Collecting six>=1.5 (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.17->boto3) 2024-09-12T00:54:05.525 INFO:tasks.workunit.client.0.smithi078.stdout: Using cached six-1.16.0-py2.py3-none-any.whl.metadata (1.8 kB) 2024-09-12T00:54:05.528 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached boto3-1.35.17-py3-none-any.whl (139 kB) 2024-09-12T00:54:05.529 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached botocore-1.35.17-py3-none-any.whl (12.5 MB) 2024-09-12T00:54:05.538 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached jmespath-1.0.1-py3-none-any.whl (20 kB) 2024-09-12T00:54:05.540 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached s3transfer-0.10.2-py3-none-any.whl (82 kB) 2024-09-12T00:54:05.541 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2024-09-12T00:54:05.542 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached urllib3-2.2.2-py3-none-any.whl (121 kB) 2024-09-12T00:54:05.544 INFO:tasks.workunit.client.0.smithi078.stdout:Using cached six-1.16.0-py2.py3-none-any.whl (11 kB) 2024-09-12T00:54:05.610 INFO:tasks.workunit.client.0.smithi078.stdout:Installing collected packages: urllib3, six, jmespath, python-dateutil, botocore, s3transfer, boto3 2024-09-12T00:54:06.679 INFO:tasks.workunit.client.0.smithi078.stdout:Successfully installed boto3-1.35.17 botocore-1.35.17 jmespath-1.0.1 python-dateutil-2.9.0.post0 s3transfer-0.10.2 six-1.16.0 urllib3-2.2.2 2024-09-12T00:54:06.874 INFO:tasks.workunit.client.0.smithi078.stderr:+ /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/bin/python3 /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/test_rgw_versioning.py 2024-09-12T00:54:07.009 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin user create --uid versioning-tester --display-name "Versioning Testing" --access-key LTA662PVVDTDWX6M2AB0 --secret pvtchqajgzqx5581t6qbddbkj0bgf3a69qdkjcea 2024-09-12T00:54:07.047 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:07.047 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:07.089 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.092+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.091 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 realm 2024-09-12T00:54:07.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:07.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.092 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.093 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:07.094 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.096+0000 7f87eb9019c0 20 searching for the correct realm 2024-09-12T00:54:07.098 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.100+0000 7f87e9c08640 0 -- 172.21.15.78:0/31420013 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f87dc0d2900 msgr2=0x7f87dc0b73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.311 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.312+0000 7f87e9407640 0 -- 172.21.15.78:0/31420013 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x557cb1bcde90 msgr2=0x557cb1bd0350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.324+0000 7f87eb9019c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:54:07.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.324+0000 7f87eb9019c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:07.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.324+0000 7f87eb9019c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:07.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.324+0000 7f87eb9019c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:54:07.322 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.324+0000 7f87eb9019c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.324+0000 7f87eb9019c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.324+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.323 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.324 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:07.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 zone default found 2024-09-12T00:54:07.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 4 Realm: () 2024-09-12T00:54:07.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:54:07.325 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:54:07.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:07.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 zonegroup default 2024-09-12T00:54:07.326 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.327 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 started sync module instance, tier type = 2024-09-12T00:54:07.328 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.328+0000 7f87eb9019c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:54:07.352 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.352+0000 7f87eb9019c0 20 add_watcher() i=0 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.352+0000 7f87eb9019c0 20 add_watcher() i=1 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.352+0000 7f87eb9019c0 20 add_watcher() i=2 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.352+0000 7f87eb9019c0 20 add_watcher() i=3 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.352+0000 7f87eb9019c0 20 add_watcher() i=4 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.352+0000 7f87eb9019c0 20 add_watcher() i=5 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.352+0000 7f87eb9019c0 20 add_watcher() i=6 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.356+0000 7f87eb9019c0 20 add_watcher() i=7 2024-09-12T00:54:07.353 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.356+0000 7f87eb9019c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:07.355 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f869ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:07.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:07.356 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 5 note: GC not initialized 2024-09-12T00:54:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f869efe5640 20 reqs_thread_entry: start 2024-09-12T00:54:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 init_complete bucket index max shards: 11 2024-09-12T00:54:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 Filter name: none 2024-09-12T00:54:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f869cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 cache get: name=default.rgw.meta+users.uid+versioning-tester : miss 2024-09-12T00:54:07.358 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x0 2024-09-12T00:54:07.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 adding default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T00:54:07.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : miss 2024-09-12T00:54:07.359 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x0 2024-09-12T00:54:07.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 adding default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T00:54:07.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T00:54:07.360 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.360+0000 7f87eb9019c0 10 cache get: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 : hit (negative entry) 2024-09-12T00:54:07.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.364+0000 7f87eb9019c0 10 cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T00:54:07.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.364+0000 7f87eb9019c0 10 moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T00:54:07.361 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.364+0000 7f87eb9019c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:versioning-tester, ofs0, ns] 2024-09-12T00:54:07.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.364+0000 7f86ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302540 cookie 93994046333648 notifier 8723 bl.length()=613 2024-09-12T00:54:07.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.364+0000 7f86ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+versioning-tester info.flags=0x17 2024-09-12T00:54:07.362 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.364+0000 7f86ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+versioning-tester to cache LRU end 2024-09-12T00:54:07.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.372+0000 7f87eb9019c0 10 cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T00:54:07.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.372+0000 7f87eb9019c0 10 moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T00:54:07.367 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.372+0000 7f87eb9019c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:users.keys:LTA662PVVDTDWX6M2AB0, ofs0, ns] 2024-09-12T00:54:07.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.372+0000 7f86ccff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302541 cookie 93994046329680 notifier 8723 bl.length()=191 2024-09-12T00:54:07.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.372+0000 7f86ccff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 info.flags=0x7 2024-09-12T00:54:07.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.372+0000 7f86ccff9640 10 rgw watcher librados: moving default.rgw.meta+users.keys+LTA662PVVDTDWX6M2AB0 to cache LRU end 2024-09-12T00:54:07.370 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.372+0000 7f869ffe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.376+0000 7f87eb9019c0 20 remove_watcher() i=0 2024-09-12T00:54:07.374 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.376+0000 7f87eb9019c0 2 removed watcher, disabling cache 2024-09-12T00:54:07.376 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.380+0000 7f87eb9019c0 20 remove_watcher() i=1 2024-09-12T00:54:07.378 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.380+0000 7f87eb9019c0 20 remove_watcher() i=2 2024-09-12T00:54:07.380 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.384+0000 7f87eb9019c0 20 remove_watcher() i=3 2024-09-12T00:54:07.382 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.384+0000 7f87eb9019c0 20 remove_watcher() i=4 2024-09-12T00:54:07.385 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.388+0000 7f87eb9019c0 20 remove_watcher() i=5 2024-09-12T00:54:07.388 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.392+0000 7f87eb9019c0 20 remove_watcher() i=6 2024-09-12T00:54:07.390 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.392+0000 7f87eb9019c0 20 remove_watcher() i=7 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that index entries and OLH objects are cleaned up after redundant deletes 2024-09-12T00:54:07.598 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:54:07.665 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T00:54:07.699 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:07.699 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:07.742 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.744+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 20 realm 2024-09-12T00:54:07.745 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.746 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.748+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.752+0000 7f1bd3c259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.747 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.752+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.752+0000 7f1bd3c259c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:07.748 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.752+0000 7f1bd3c259c0 20 searching for the correct realm 2024-09-12T00:54:07.753 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.756+0000 7f1bd1f2c640 0 -- 172.21.15.78:0/3927468077 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f1bc40c4910 msgr2=0x7f1bc40eb3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:07.967 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.968+0000 7f1bd172b640 0 -- 172.21.15.78:0/3927468077 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x557ac2b594b0 msgr2=0x557ac2b5b8a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:07.978 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.979 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.980+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:07.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:07.980 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 zone default found 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 4 Realm: () 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 zonegroup default 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.981 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.982 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.984+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:07.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.988+0000 7f1bd3c259c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:07.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.988+0000 7f1bd3c259c0 20 started sync module instance, tier type = 2024-09-12T00:54:07.983 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:07.988+0000 7f1bd3c259c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:54:08.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.008+0000 7f1bd3c259c0 20 add_watcher() i=0 2024-09-12T00:54:08.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.008+0000 7f1bd3c259c0 20 add_watcher() i=1 2024-09-12T00:54:08.005 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.008+0000 7f1bd3c259c0 20 add_watcher() i=2 2024-09-12T00:54:08.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.008+0000 7f1bd3c259c0 20 add_watcher() i=3 2024-09-12T00:54:08.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.008+0000 7f1bd3c259c0 20 add_watcher() i=4 2024-09-12T00:54:08.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.008+0000 7f1bd3c259c0 20 add_watcher() i=5 2024-09-12T00:54:08.006 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.008+0000 7f1bd3c259c0 20 add_watcher() i=6 2024-09-12T00:54:08.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.012+0000 7f1bd3c259c0 20 add_watcher() i=7 2024-09-12T00:54:08.008 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.012+0000 7f1bd3c259c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:08.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1a877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:08.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:08.012 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:08.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 5 note: GC not initialized 2024-09-12T00:54:08.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1a867e4640 20 reqs_thread_entry: start 2024-09-12T00:54:08.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 20 init_complete bucket index max shards: 11 2024-09-12T00:54:08.013 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 20 Filter name: none 2024-09-12T00:54:08.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f19f7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:08.014 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T00:54:08.015 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.016+0000 7f1bd3c259c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:08.016 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T00:54:08.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:08.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:54:08.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: starting shard=0 2024-09-12T00:54:08.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.0 2024-09-12T00:54:08.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.017 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: starting shard=1 2024-09-12T00:54:08.018 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.1 2024-09-12T00:54:08.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: starting shard=2 2024-09-12T00:54:08.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.2 2024-09-12T00:54:08.019 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: starting shard=3 2024-09-12T00:54:08.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.3 2024-09-12T00:54:08.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.020 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 INFO: main: starting shard=4 2024-09-12T00:54:08.021 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.020+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.4 2024-09-12T00:54:08.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: starting shard=5 2024-09-12T00:54:08.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.5 2024-09-12T00:54:08.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.022 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: starting shard=6 2024-09-12T00:54:08.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.6 2024-09-12T00:54:08.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: starting shard=7 2024-09-12T00:54:08.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.7 2024-09-12T00:54:08.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: starting shard=8 2024-09-12T00:54:08.023 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.8 2024-09-12T00:54:08.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 INFO: main: starting shard=9 2024-09-12T00:54:08.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.024+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.9 2024-09-12T00:54:08.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.028+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.028+0000 7f1bd3c259c0 20 INFO: main: starting shard=10 2024-09-12T00:54:08.024 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.028+0000 7f1bd3c259c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.10 2024-09-12T00:54:08.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.028+0000 7f1bd3c259c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:08.025 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.028+0000 7f1bd3c259c0 20 INFO: main: done 2024-09-12T00:54:08.026 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.028+0000 7f1a877e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:08.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.032+0000 7f1bd3c259c0 20 remove_watcher() i=0 2024-09-12T00:54:08.030 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.032+0000 7f1bd3c259c0 2 removed watcher, disabling cache 2024-09-12T00:54:08.032 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.036+0000 7f1bd3c259c0 20 remove_watcher() i=1 2024-09-12T00:54:08.034 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.036+0000 7f1bd3c259c0 20 remove_watcher() i=2 2024-09-12T00:54:08.036 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.040+0000 7f1bd3c259c0 20 remove_watcher() i=3 2024-09-12T00:54:08.038 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.040+0000 7f1bd3c259c0 20 remove_watcher() i=4 2024-09-12T00:54:08.041 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.044+0000 7f1bd3c259c0 20 remove_watcher() i=5 2024-09-12T00:54:08.043 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.048+0000 7f1bd3c259c0 20 remove_watcher() i=6 2024-09-12T00:54:08.046 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.048+0000 7f1bd3c259c0 20 remove_watcher() i=7 2024-09-12T00:54:08.062 INFO:tasks.workunit.client.0.smithi078.stderr:rados -p default.rgw.buckets.data ls | grep a384bac1-cce3-4c7e-baaa-ceee04e6e10d 2024-09-12T00:54:08.088 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:08.088 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:08.368 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:08.372+0000 7f379a25a640 0 -- 172.21.15.78:0/1308216376 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7f379001c3c0 msgr2=0x7f379001c7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:08.399 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that index entries and OLH objects are cleaned up after index linking error 2024-09-12T00:54:08.399 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:54:08.399 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:54:09.888 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:54:10.325 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bi list --bucket versioning-bucket 2024-09-12T00:54:10.354 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:10.354 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:10.396 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.400+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.400+0000 7fafb960e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.400+0000 7fafb960e9c0 20 realm 2024-09-12T00:54:10.398 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.400+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:10.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.399 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:10.400 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:10.401 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.404+0000 7fafb960e9c0 20 searching for the correct realm 2024-09-12T00:54:10.404 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.408+0000 7fafb6913640 0 -- 172.21.15.78:0/463429027 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x5560fce42550 msgr2=0x5560fce44a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:10.411 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.412+0000 7fafb6913640 0 -- 172.21.15.78:0/463429027 >> [v2:172.21.15.78:6800/3497928690,v1:172.21.15.78:6801/3497928690] conn(0x7fafb00ec900 msgr2=0x7fafb00a93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:10.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:54:10.628 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.629 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:10.630 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 zone default found 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 4 Realm: () 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 zonegroup default 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.632+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.631 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.636+0000 7fafb960e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.636+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.632 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.636+0000 7fafb960e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.636+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.636+0000 7fafb960e9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:10.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.636+0000 7fafb960e9c0 20 started sync module instance, tier type = 2024-09-12T00:54:10.633 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.636+0000 7fafb960e9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:54:10.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=0 2024-09-12T00:54:10.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=1 2024-09-12T00:54:10.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=2 2024-09-12T00:54:10.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=3 2024-09-12T00:54:10.656 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=4 2024-09-12T00:54:10.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=5 2024-09-12T00:54:10.657 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=6 2024-09-12T00:54:10.658 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 20 add_watcher() i=7 2024-09-12T00:54:10.659 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.660+0000 7fafb960e9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:10.663 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.664+0000 7fae6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:10.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:10.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:10.664 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 5 note: GC not initialized 2024-09-12T00:54:10.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fae6cfe1640 20 reqs_thread_entry: start 2024-09-12T00:54:10.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:54:10.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 Filter name: none 2024-09-12T00:54:10.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fade67fc640 20 reqs_thread_entry: start 2024-09-12T00:54:10.665 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T00:54:10.666 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:10.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T00:54:10.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-12T00:54:10.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 INFO: main: max_entries=1000, index=gen=0, max_shards=11 2024-09-12T00:54:10.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 INFO: main: starting shard=0 2024-09-12T00:54:10.667 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.668+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.0 2024-09-12T00:54:10.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: starting shard=1 2024-09-12T00:54:10.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.1 2024-09-12T00:54:10.668 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: starting shard=2 2024-09-12T00:54:10.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.2 2024-09-12T00:54:10.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: starting shard=3 2024-09-12T00:54:10.669 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.3 2024-09-12T00:54:10.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 INFO: main: starting shard=4 2024-09-12T00:54:10.670 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.672+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.4 2024-09-12T00:54:10.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.671 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: starting shard=5 2024-09-12T00:54:10.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.5 2024-09-12T00:54:10.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: starting shard=6 2024-09-12T00:54:10.672 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.6 2024-09-12T00:54:10.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: starting shard=7 2024-09-12T00:54:10.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.7 2024-09-12T00:54:10.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: starting shard=8 2024-09-12T00:54:10.673 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.8 2024-09-12T00:54:10.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: starting shard=9 2024-09-12T00:54:10.674 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.9 2024-09-12T00:54:10.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 INFO: main: starting shard=10 2024-09-12T00:54:10.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.676+0000 7fafb960e9c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.10 2024-09-12T00:54:10.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.680+0000 7fafb960e9c0 20 INFO: main: bi_list() returned without error; entries.size()=0, is_truncated=0, marker= 2024-09-12T00:54:10.675 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.680+0000 7fafb960e9c0 20 INFO: main: done 2024-09-12T00:54:10.677 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.680+0000 7fae6dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:10.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.684+0000 7fafb960e9c0 20 remove_watcher() i=0 2024-09-12T00:54:10.681 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.684+0000 7fafb960e9c0 2 removed watcher, disabling cache 2024-09-12T00:54:10.683 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.688+0000 7fafb960e9c0 20 remove_watcher() i=1 2024-09-12T00:54:10.686 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.688+0000 7fafb960e9c0 20 remove_watcher() i=2 2024-09-12T00:54:10.688 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.692+0000 7fafb960e9c0 20 remove_watcher() i=3 2024-09-12T00:54:10.690 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.692+0000 7fafb960e9c0 20 remove_watcher() i=4 2024-09-12T00:54:10.692 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.696+0000 7fafb960e9c0 20 remove_watcher() i=5 2024-09-12T00:54:10.694 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.696+0000 7fafb960e9c0 20 remove_watcher() i=6 2024-09-12T00:54:10.697 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.700+0000 7fafb960e9c0 20 remove_watcher() i=7 2024-09-12T00:54:10.710 INFO:tasks.workunit.client.0.smithi078.stderr:rados -p default.rgw.buckets.data ls | grep bc856583-d3ec-470e-8903-177484f09f6c 2024-09-12T00:54:10.733 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:10.734 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:10.799 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:10.804+0000 7f4bbb754640 0 -- 172.21.15.78:0/2611110672 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x560476395d00 msgr2=0x5604764417f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:10.809 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that original null object version is intact after failed olh upgrade 2024-09-12T00:54:10.809 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:54:10.827 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_set_olh_err 2 2024-09-12T00:54:12.292 INFO:tasks.workunit.client.0.smithi078.stderr:An error occurred (NoSuchKey) when calling the PutObject operation: None 2024-09-12T00:54:12.293 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_set_olh_err 2024-09-12T00:54:12.745 INFO:tasks.workunit.client.0.smithi078.stderr:TEST: verify that concurrent delete requests do not leave behind olh entries 2024-09-12T00:54:12.745 INFO:tasks.workunit.client.0.smithi078.stderr: 2024-09-12T00:54:12.862 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config set client rgw_debug_inject_latency_bi_unlink 2 2024-09-12T00:54:16.336 INFO:tasks.workunit.client.0.smithi078.stderr:ceph config rm client rgw_debug_inject_latency_bi_unlink 2024-09-12T00:54:16.775 INFO:tasks.workunit.client.0.smithi078.stderr:radosgw-admin bucket check olh --bucket versioning-bucket --dump-keys 2024-09-12T00:54:16.802 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:16.802 INFO:tasks.workunit.client.0.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:16.844 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.848+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:16.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.848+0000 7f846bd449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:16.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.848+0000 7f846bd449c0 20 realm 2024-09-12T00:54:16.846 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.848+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:16.847 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.848+0000 7f846bd449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:16.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.848+0000 7f846bd449c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:16.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.848+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:16.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.852+0000 7f846bd449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:16.848 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.852+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:16.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.852+0000 7f846bd449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:16.849 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.852+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:16.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.852+0000 7f846bd449c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:16.850 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.852+0000 7f846bd449c0 20 searching for the correct realm 2024-09-12T00:54:16.854 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:16.856+0000 7f846a04b640 0 -- 172.21.15.78:0/1077101146 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f845c06cb10 msgr2=0x7f845c076a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:17.067 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.068+0000 7f846a04b640 0 -- 172.21.15.78:0/1077101146 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x55a44b1d1fd0 msgr2=0x55a44b1d4440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:17.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.080+0000 7f846bd449c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:54:17.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.080+0000 7f846bd449c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:17.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.080+0000 7f846bd449c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:17.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.080+0000 7f846bd449c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:54:17.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.080+0000 7f846bd449c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:17.078 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.080+0000 7f846bd449c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:17.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.080+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:17.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.079 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:17.080 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 zone default found 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 4 Realm: () 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 zonegroup default 2024-09-12T00:54:17.081 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:17.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:17.082 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:17.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 started sync module instance, tier type = 2024-09-12T00:54:17.083 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.084+0000 7f846bd449c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:54:17.105 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.108+0000 7f846bd449c0 20 add_watcher() i=0 2024-09-12T00:54:17.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.108+0000 7f846bd449c0 20 add_watcher() i=1 2024-09-12T00:54:17.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.108+0000 7f846bd449c0 20 add_watcher() i=2 2024-09-12T00:54:17.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.108+0000 7f846bd449c0 20 add_watcher() i=3 2024-09-12T00:54:17.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.108+0000 7f846bd449c0 20 add_watcher() i=4 2024-09-12T00:54:17.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.108+0000 7f846bd449c0 20 add_watcher() i=5 2024-09-12T00:54:17.106 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.108+0000 7f846bd449c0 20 add_watcher() i=6 2024-09-12T00:54:17.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.112+0000 7f846bd449c0 20 add_watcher() i=7 2024-09-12T00:54:17.108 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.112+0000 7f846bd449c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:17.112 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f831b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:17.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:17.113 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 5 note: GC not initialized 2024-09-12T00:54:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f831a7fc640 20 reqs_thread_entry: start 2024-09-12T00:54:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 20 init_complete bucket index max shards: 11 2024-09-12T00:54:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 20 Filter name: none 2024-09-12T00:54:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f828bfff640 20 reqs_thread_entry: start 2024-09-12T00:54:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 10 cache get: name=default.rgw.meta+root+versioning-bucket : miss 2024-09-12T00:54:17.114 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 20 rados_obj.operate() r=0 bl.length=209 2024-09-12T00:54:17.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 10 cache put: name=default.rgw.meta+root+versioning-bucket info.flags=0x11 2024-09-12T00:54:17.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 10 adding default.rgw.meta+root+versioning-bucket to cache LRU end 2024-09-12T00:54:17.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 10 cache get: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782 : miss 2024-09-12T00:54:17.115 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.116+0000 7f846bd449c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 20 rados_obj.operate() r=0 bl.length=431 2024-09-12T00:54:17.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 10 cache put: name=default.rgw.meta+root+.bucket.meta.versioning-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782 info.flags=0x17 2024-09-12T00:54:17.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 10 adding default.rgw.meta+root+.bucket.meta.versioning-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782 to cache LRU end 2024-09-12T00:54:17.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:17.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 10 updating xattr: name=user.rgw.acl bl.length()=209 2024-09-12T00:54:17.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.versioning-bucket:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782 2024-09-12T00:54:17.116 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.0 2024-09-12T00:54:17.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 1 NOTICE: finished shard 0 (0 entries found) 2024-09-12T00:54:17.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.1 2024-09-12T00:54:17.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 1 NOTICE: finished shard 1 (0 entries found) 2024-09-12T00:54:17.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.2 2024-09-12T00:54:17.117 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 1 NOTICE: finished shard 2 (0 entries found) 2024-09-12T00:54:17.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.3 2024-09-12T00:54:17.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 1 NOTICE: finished shard 3 (0 entries found) 2024-09-12T00:54:17.118 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.120+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.4 2024-09-12T00:54:17.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 1 NOTICE: finished shard 4 (0 entries found) 2024-09-12T00:54:17.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.5 2024-09-12T00:54:17.119 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 1 NOTICE: finished shard 5 (0 entries found) 2024-09-12T00:54:17.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.6 2024-09-12T00:54:17.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 1 NOTICE: finished shard 6 (0 entries found) 2024-09-12T00:54:17.120 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.7 2024-09-12T00:54:17.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 1 NOTICE: finished shard 7 (0 entries found) 2024-09-12T00:54:17.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.8 2024-09-12T00:54:17.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 1 NOTICE: finished shard 8 (0 entries found) 2024-09-12T00:54:17.122 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.124+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.9 2024-09-12T00:54:17.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.128+0000 7f846bd449c0 1 NOTICE: finished shard 9 (0 entries found) 2024-09-12T00:54:17.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.128+0000 7f846bd449c0 20 bucket index object: :.dir.88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.782.10 2024-09-12T00:54:17.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.128+0000 7f846bd449c0 1 NOTICE: finished shard 10 (0 entries found) 2024-09-12T00:54:17.123 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.128+0000 7f846bd449c0 1 NOTICE: finished all shards (0 entries found) 2024-09-12T00:54:17.125 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.128+0000 7f831b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:17.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.132+0000 7f846bd449c0 20 remove_watcher() i=0 2024-09-12T00:54:17.129 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.132+0000 7f846bd449c0 2 removed watcher, disabling cache 2024-09-12T00:54:17.131 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.136+0000 7f846bd449c0 20 remove_watcher() i=1 2024-09-12T00:54:17.133 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.136+0000 7f846bd449c0 20 remove_watcher() i=2 2024-09-12T00:54:17.136 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.140+0000 7f846bd449c0 20 remove_watcher() i=3 2024-09-12T00:54:17.138 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.140+0000 7f846bd449c0 20 remove_watcher() i=4 2024-09-12T00:54:17.140 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.144+0000 7f846bd449c0 20 remove_watcher() i=5 2024-09-12T00:54:17.143 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.144+0000 7f846bd449c0 20 remove_watcher() i=6 2024-09-12T00:54:17.145 INFO:tasks.workunit.client.0.smithi078.stderr:2024-09-12T00:54:17.148+0000 7f846bd449c0 20 remove_watcher() i=7 2024-09-12T00:54:17.161 INFO:tasks.workunit.client.0.smithi078.stderr:Deleting bucket versioning-bucket 2024-09-12T00:54:17.211 INFO:tasks.workunit.client.0.smithi078.stderr:Completed bucket versioning tests 2024-09-12T00:54:17.211 INFO:tasks.workunit.client.0.smithi078.stdout:connected to http://localhost:80 2024-09-12T00:54:17.281 INFO:tasks.workunit.client.0.smithi078.stderr:+ deactivate 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin ']' 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ PATH=/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin:/usr/sbin 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ export PATH 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset _OLD_VIRTUAL_PATH 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n /usr/bin/bash -o -n '' ']' 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ hash -r 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' -n '' ']' 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset VIRTUAL_ENV_PROMPT 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ '[' '!' '' = nondestructive ']' 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ unset -f deactivate 2024-09-12T00:54:17.282 INFO:tasks.workunit.client.0.smithi078.stderr:+ echo OK. 2024-09-12T00:54:17.283 INFO:tasks.workunit.client.0.smithi078.stdout:OK. 2024-09-12T00:54:17.284 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-12T00:54:17.284 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-12T00:54:17.344 INFO:tasks.workunit:Stopping ['rgw/run-versioning.sh'] on client.0... 2024-09-12T00:54:17.344 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-12T00:54:17.756 DEBUG:teuthology.parallel:result is None 2024-09-12T00:54:17.756 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:54:17.769 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:54:17.769 DEBUG:teuthology.orchestra.run.smithi078:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-09-12T00:54:17.815 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-09-12T00:54:17.815 DEBUG:teuthology.run_tasks:Unwinding manager s3tests 2024-09-12T00:54:17.827 DEBUG:teuthology.run_tasks:Unwinding manager s3tests-java 2024-09-12T00:54:17.848 DEBUG:tasks.s3tests_java:S3 Tests Java: END 2024-09-12T00:54:17.849 INFO:tasks.s3tests_java:S3 Tests Java: Cleaning up s3-tests-java... 2024-09-12T00:54:17.849 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/s3-tests-java 2024-09-12T00:54:17.907 INFO:tasks.s3tests_java:S3 Tests Java: Deleting S3 users... 2024-09-12T00:54:17.908 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin -n client.0 user rm --uid tester.client.0 --purge-data --cluster ceph 2024-09-12T00:54:17.938 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:17.938 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:17.977 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.980+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:17.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 realm 2024-09-12T00:54:17.979 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:17.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:17.981 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:17.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:17.985 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.984+0000 7f75360db9c0 20 searching for the correct realm 2024-09-12T00:54:17.987 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:17.992+0000 7f75343e2640 0 -- 172.21.15.78:0/1148323231 >> [v2:172.21.15.171:6800/4023521963,v1:172.21.15.171:6801/4023521963] conn(0x7f752c108e10 msgr2=0x7f752c1074f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:18.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.208+0000 7f75343e2640 0 -- 172.21.15.78:0/1148323231 >> [v2:172.21.15.171:6816/997797030,v1:172.21.15.171:6817/997797030] conn(0x563971d09a30 msgr2=0x563971d0be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:54:18.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:54:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:18.216 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:18.217 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 zone default found 2024-09-12T00:54:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 4 Realm: () 2024-09-12T00:54:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:54:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:54:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 zonegroup default 2024-09-12T00:54:18.218 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:18.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:18.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:18.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:18.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.220+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.224+0000 7f75360db9c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.224+0000 7f75360db9c0 20 started sync module instance, tier type = 2024-09-12T00:54:18.220 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.224+0000 7f75360db9c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:54:18.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.244+0000 7f75360db9c0 20 add_watcher() i=0 2024-09-12T00:54:18.241 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.244+0000 7f75360db9c0 20 add_watcher() i=1 2024-09-12T00:54:18.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.244+0000 7f75360db9c0 20 add_watcher() i=2 2024-09-12T00:54:18.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.244+0000 7f75360db9c0 20 add_watcher() i=3 2024-09-12T00:54:18.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.244+0000 7f75360db9c0 20 add_watcher() i=4 2024-09-12T00:54:18.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.244+0000 7f75360db9c0 20 add_watcher() i=5 2024-09-12T00:54:18.242 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.244+0000 7f75360db9c0 20 add_watcher() i=6 2024-09-12T00:54:18.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.248+0000 7f75360db9c0 20 add_watcher() i=7 2024-09-12T00:54:18.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.248+0000 7f75360db9c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:18.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.252+0000 7f73e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:18.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.252+0000 7f75360db9c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:18.248 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.252+0000 7f75360db9c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:18.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f73e8fe1640 20 reqs_thread_entry: start 2024-09-12T00:54:18.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 20 init_complete bucket index max shards: 11 2024-09-12T00:54:18.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 20 Filter name: none 2024-09-12T00:54:18.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f73627fc640 20 reqs_thread_entry: start 2024-09-12T00:54:18.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 10 cache get: name=default.rgw.meta+users.uid+tester.client.0 : miss 2024-09-12T00:54:18.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:18.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 20 rados_obj.operate() r=0 bl.length=482 2024-09-12T00:54:18.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 10 cache put: name=default.rgw.meta+users.uid+tester.client.0 info.flags=0x13 2024-09-12T00:54:18.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 10 adding default.rgw.meta+users.uid+tester.client.0 to cache LRU end 2024-09-12T00:54:18.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.336+0000 7f75360db9c0 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-12T00:54:18.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.340+0000 7f75360db9c0 10 removing key index: QQWYWBRBNIPBIYHOPNXY 2024-09-12T00:54:18.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.340+0000 7f75360db9c0 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.keys:QQWYWBRBNIPBIYHOPNXY, ofs0, ns] 2024-09-12T00:54:18.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.340+0000 7f7412ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301044 cookie 94804722629152 notifier 8837 bl.length()=170 2024-09-12T00:54:18.338 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.340+0000 7f75360db9c0 10 removing email index: tester.client.0_test@test.test 2024-09-12T00:54:18.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.344+0000 7f75360db9c0 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:tester.client.0_test@test.test, ofs0, ns] 2024-09-12T00:54:18.342 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.344+0000 7f7412ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461301979 cookie 94804722693296 notifier 8837 bl.length()=181 2024-09-12T00:54:18.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.348+0000 7f75360db9c0 10 removing user buckets index 2024-09-12T00:54:18.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.348+0000 7f75360db9c0 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0.buckets, ofs0, ns] 2024-09-12T00:54:18.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.348+0000 7f7412ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302544 cookie 94804722703008 notifier 8837 bl.length()=172 2024-09-12T00:54:18.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.348+0000 7f75360db9c0 10 removing user index: tester.client.0 2024-09-12T00:54:18.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.352+0000 7f75360db9c0 10 removing default.rgw.meta+users.uid+tester.client.0 from cache 2024-09-12T00:54:18.348 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.352+0000 7f75360db9c0 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:tester.client.0, ofs0, ns] 2024-09-12T00:54:18.349 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.352+0000 7f7412ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 1142461302545 cookie 94804722700208 notifier 8837 bl.length()=164 2024-09-12T00:54:18.351 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.356+0000 7f73e9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:18.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.360+0000 7f75360db9c0 20 remove_watcher() i=0 2024-09-12T00:54:18.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.360+0000 7f75360db9c0 2 removed watcher, disabling cache 2024-09-12T00:54:18.358 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.360+0000 7f75360db9c0 20 remove_watcher() i=1 2024-09-12T00:54:18.360 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.364+0000 7f75360db9c0 20 remove_watcher() i=2 2024-09-12T00:54:18.362 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.364+0000 7f75360db9c0 20 remove_watcher() i=3 2024-09-12T00:54:18.364 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.368+0000 7f75360db9c0 20 remove_watcher() i=4 2024-09-12T00:54:18.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.368+0000 7f75360db9c0 20 remove_watcher() i=5 2024-09-12T00:54:18.370 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.372+0000 7f75360db9c0 20 remove_watcher() i=6 2024-09-12T00:54:18.372 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:18.376+0000 7f75360db9c0 20 remove_watcher() i=7 2024-09-12T00:54:18.388 DEBUG:teuthology.run_tasks:Unwinding manager ragweed 2024-09-12T00:54:18.399 DEBUG:teuthology.run_tasks:Unwinding manager tox 2024-09-12T00:54:18.411 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf /home/ubuntu/cephtest/tox-venv 2024-09-12T00:54:18.475 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-12T00:54:18.487 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-12T00:54:18.487 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:54:18.520 INFO:tasks.rgw.client.0.smithi078.stdout:2024-09-12T00:54:18.524+0000 7ff38fd55640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 38127) UID: 0 2024-09-12T00:54:18.520 INFO:tasks.rgw.client.0.smithi078.stdout:2024-09-12T00:54:18.524+0000 7ff39359da40 -1 shutting down 2024-09-12T00:54:28.152 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-12T00:54:30.692 INFO:tasks.rgw.client.0:Stopped 2024-09-12T00:54:30.693 DEBUG:teuthology.orchestra.run.smithi078:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-12T00:54:30.700 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /etc/ceph/vault-root-token 2024-09-12T00:54:30.755 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-12T00:54:30.811 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-12T00:54:30.811 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-12T00:54:30.812 DEBUG:teuthology.orchestra.run.smithi078:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-12T00:54:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setuser ceph since I am not root 2024-09-12T00:54:30.890 INFO:teuthology.orchestra.run.smithi078.stderr:ignoring --setgroup ceph since I am not root 2024-09-12T00:54:30.932 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 realm 2024-09-12T00:54:30.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.934 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-12T00:54:30.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.935 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.936+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.940+0000 7fb7a39719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:30.936 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.940+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.940+0000 7fb7a39719c0 20 rados_obj.operate() r=0 bl.length=1139 2024-09-12T00:54:30.937 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.940+0000 7fb7a39719c0 20 searching for the correct realm 2024-09-12T00:54:30.940 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.944+0000 7fb7a0c76640 0 -- 172.21.15.78:0/3563851606 >> [v2:172.21.15.78:6808/1578510999,v1:172.21.15.78:6809/1578510999] conn(0x7fb66c081a70 msgr2=0x7fb66c083ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1)._try_send injecting socket failure 2024-09-12T00:54:30.947 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.948+0000 7fb7a1477640 0 -- 172.21.15.78:0/3563851606 >> [v2:172.21.15.171:6824/2486579375,v1:172.21.15.171:6825/2486579375] conn(0x7fb78c0a00b0 msgr2=0x7fb78c002940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until injecting socket failure 2024-09-12T00:54:30.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 RGWRados::pool_iterate: got zone_info.88185928-eed4-4ed7-91c9-ccae30f6e5e2 2024-09-12T00:54:30.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-12T00:54:30.956 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 RGWRados::pool_iterate: got default.zone. 2024-09-12T00:54:30.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 RGWRados::pool_iterate: got zonegroup_info.8591b6fb-6b11-454f-9af8-6d56deab00ba 2024-09-12T00:54:30.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 RGWRados::pool_iterate: got zone_names.default 2024-09-12T00:54:30.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-12T00:54:30.957 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados_obj.operate() r=0 bl.length=46 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados_obj.operate() r=0 bl.length=470 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 zone default found 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 4 Realm: () 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 4 ZoneGroup: default (8591b6fb-6b11-454f-9af8-6d56deab00ba) 2024-09-12T00:54:30.958 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 4 Zone: default (88185928-eed4-4ed7-91c9-ccae30f6e5e2) 2024-09-12T00:54:30.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-12T00:54:30.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 zonegroup default 2024-09-12T00:54:30.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.959 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.960+0000 7fb7a39719c0 20 rados->read ofs=0 len=0 2024-09-12T00:54:30.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.964+0000 7fb7a39719c0 20 rados_obj.operate() r=-2 bl.length=0 2024-09-12T00:54:30.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.964+0000 7fb7a39719c0 20 started sync module instance, tier type = 2024-09-12T00:54:30.960 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.964+0000 7fb7a39719c0 20 started zone id=88185928-eed4-4ed7-91c9-ccae30f6e5e2 (name=default) with tier type = 2024-09-12T00:54:30.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.980+0000 7fb7a39719c0 20 add_watcher() i=0 2024-09-12T00:54:30.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.980+0000 7fb7a39719c0 20 add_watcher() i=1 2024-09-12T00:54:30.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.980+0000 7fb7a39719c0 20 add_watcher() i=2 2024-09-12T00:54:30.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.980+0000 7fb7a39719c0 20 add_watcher() i=3 2024-09-12T00:54:30.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.980+0000 7fb7a39719c0 20 add_watcher() i=4 2024-09-12T00:54:30.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.980+0000 7fb7a39719c0 20 add_watcher() i=5 2024-09-12T00:54:30.978 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.980+0000 7fb7a39719c0 20 add_watcher() i=6 2024-09-12T00:54:30.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.984+0000 7fb7a39719c0 20 add_watcher() i=7 2024-09-12T00:54:30.980 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.984+0000 7fb7a39719c0 2 all 8 watchers are set, enabling cache 2024-09-12T00:54:30.983 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.988+0000 7fb6577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.988+0000 7fb7a39719c0 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-12T00:54:30.984 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:30.988+0000 7fb7a39719c0 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-12T00:54:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.068+0000 7fb6567e4640 20 reqs_thread_entry: start 2024-09-12T00:54:31.066 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.068+0000 7fb7a39719c0 20 init_complete bucket index max shards: 11 2024-09-12T00:54:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.068+0000 7fb7a39719c0 20 Filter name: none 2024-09-12T00:54:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.068+0000 7fb5c7fff640 20 reqs_thread_entry: start 2024-09-12T00:54:31.067 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.068+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-12T00:54:31.070 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.072+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.072 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.073 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.446444631564190983', time=2024-09-12T02:46:47.619918+0000, chain.objs.size()=1 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.518__multipart_mymultipart.2~glvBC25yZAWAf6PLdi3_DHGDRr8P6oW.1 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17151219117393655185', time=2024-09-12T02:46:58.246036+0000, chain.objs.size()=6 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~hZAt4ZMkbdF1fSm3x0psIIsIybPkGAy.1 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.txqx7bT9NgsPGuN1nMInGZcM_GIwSoXy.2 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~hZAt4ZMkbdF1fSm3x0psIIsIybPkGAy.3 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~hZAt4ZMkbdF1fSm3x0psIIsIybPkGAy.4 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~hZAt4ZMkbdF1fSm3x0psIIsIybPkGAy.5 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~hZAt4ZMkbdF1fSm3x0psIIsIybPkGAy.6 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2863722342314835463', time=2024-09-12T02:51:38.282369+0000, chain.objs.size()=6 2024-09-12T00:54:31.074 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.661__multipart_baz.2~PO8YsNXZARXObw5mMga0TZNBwKcXCMX.1 2024-09-12T00:54:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.661__multipart_baz.2~PO8YsNXZARXObw5mMga0TZNBwKcXCMX.2 2024-09-12T00:54:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.661__multipart_baz.2~PO8YsNXZARXObw5mMga0TZNBwKcXCMX.3 2024-09-12T00:54:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.661__multipart_baz.2~PO8YsNXZARXObw5mMga0TZNBwKcXCMX.4 2024-09-12T00:54:31.075 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.076+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.661__multipart_baz.2~PO8YsNXZARXObw5mMga0TZNBwKcXCMX.5 2024-09-12T00:54:31.080 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.084+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.661__multipart_baz.2~PO8YsNXZARXObw5mMga0TZNBwKcXCMX.6 2024-09-12T00:54:31.086 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.088+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.093 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.096+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-12T00:54:31.097 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.100+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.100+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.100+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.100+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_aAvroLDnGbAW1Oeten7Zb9HvV4Mjm39', time=2024-09-12T02:42:00.863867+0000, chain.objs.size()=1 2024-09-12T00:54:31.101 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.100+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.165__shadow_.qu4M9l8swxQgsV5kHBmPhgQEywB7Bv__0 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP', time=2024-09-12T02:51:16.948429+0000, chain.objs.size()=12 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__multipart_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.1 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__shadow_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.1_1 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__multipart_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.2 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__shadow_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.2_1 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__multipart_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.3 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__shadow_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.3_1 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__multipart_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.4 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__shadow_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.4_1 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__multipart_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.5 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__shadow_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.5_1 2024-09-12T00:54:31.102 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.104+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__multipart_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.6 2024-09-12T00:54:31.104 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.108+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.625__shadow_multipart_enc.2~U8fYAOMhRHIXk6lfMsIzNd7z82PjMbP.6_1 2024-09-12T00:54:31.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.112+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ZXP-GKI_aZt8nPdzILF1Z8oGE20ggus', time=2024-09-12T02:52:37.731654+0000, chain.objs.size()=1 2024-09-12T00:54:31.107 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.112+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.742__multipart_mymultipart2.2~ZXP-GKI_aZt8nPdzILF1Z8oGE20ggus.1 2024-09-12T00:54:31.112 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.116+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.119 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.124+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-12T00:54:31.122 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.124+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.123 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:31.124 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15061753605572737037', time=2024-09-12T02:46:41.809998+0000, chain.objs.size()=6 2024-09-12T00:54:31.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.1 2024-09-12T00:54:31.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.2 2024-09-12T00:54:31.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.3 2024-09-12T00:54:31.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.4 2024-09-12T00:54:31.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.5 2024-09-12T00:54:31.125 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.128+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.6 2024-09-12T00:54:31.131 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.132+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.135 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.140+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-12T00:54:31.138 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.140+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.139 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=6, truncated=0, next_marker='' 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11644818731037741139', time=2024-09-12T02:41:54.720368+0000, chain.objs.size()=5 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-FROZEN.2~-4FdFJgyTsynrlNfUoRpsDthelZrBe4.1 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__shadow_mymultipart-FROZEN.2~-4FdFJgyTsynrlNfUoRpsDthelZrBe4.1_1 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-FROZEN.2~-4FdFJgyTsynrlNfUoRpsDthelZrBe4.2 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__shadow_mymultipart-FROZEN.2~-4FdFJgyTsynrlNfUoRpsDthelZrBe4.2_1 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-FROZEN.2~-4FdFJgyTsynrlNfUoRpsDthelZrBe4.3 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14368630774580936449', time=2024-09-12T02:41:55.461681+0000, chain.objs.size()=3 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.Ayhk9DwyurJaY2D5Dw0acLIKfMvUVsR_0 2024-09-12T00:54:31.142 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.Ayhk9DwyurJaY2D5Dw0acLIKfMvUVsR_1 2024-09-12T00:54:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.Ayhk9DwyurJaY2D5Dw0acLIKfMvUVsR_2 2024-09-12T00:54:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_k-96EMcl2iHB4h6N8CmrcTiz4UyMdf6', time=2024-09-12T02:41:56.246379+0000, chain.objs.size()=3 2024-09-12T00:54:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.6dbQDK1TrZ6h5Zdgb_anIRk95Z3xFO7_0 2024-09-12T00:54:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.6dbQDK1TrZ6h5Zdgb_anIRk95Z3xFO7_1 2024-09-12T00:54:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.6dbQDK1TrZ6h5Zdgb_anIRk95Z3xFO7_2 2024-09-12T00:54:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_c7vdcFuHWOjBGQ8kkP1XmKhDQfbfgsu', time=2024-09-12T02:41:58.864687+0000, chain.objs.size()=3 2024-09-12T00:54:31.143 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.144+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.pMPk96TrE8zxegRZY9z98NPDAOSQi1J_0 2024-09-12T00:54:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.pMPk96TrE8zxegRZY9z98NPDAOSQi1J_1 2024-09-12T00:54:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.pMPk96TrE8zxegRZY9z98NPDAOSQi1J_2 2024-09-12T00:54:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_LaATcaGE3wFxB590mPf5fhWY_PRKlxS', time=2024-09-12T02:41:59.818062+0000, chain.objs.size()=3 2024-09-12T00:54:31.151 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.163__shadow_.KAdes0rmxg4IQvSYuMnZE0N22-4kCPK_0 2024-09-12T00:54:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.163__shadow_.KAdes0rmxg4IQvSYuMnZE0N22-4kCPK_1 2024-09-12T00:54:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.163__shadow_.KAdes0rmxg4IQvSYuMnZE0N22-4kCPK_2 2024-09-12T00:54:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17691441170262759383', time=2024-09-12T02:46:42.142936+0000, chain.objs.size()=6 2024-09-12T00:54:31.152 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.1 2024-09-12T00:54:31.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.2 2024-09-12T00:54:31.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.3 2024-09-12T00:54:31.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.4 2024-09-12T00:54:31.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.5 2024-09-12T00:54:31.153 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.156+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.6 2024-09-12T00:54:31.162 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.164+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.167 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.172+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-12T00:54:31.170 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.172+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.171 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:54:31.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12747207151761291729', time=2024-09-12T02:41:55.952108+0000, chain.objs.size()=3 2024-09-12T00:54:31.172 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.0mwU1_9-KInShrqjr6mtc1fwrTR8OfK_0 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.0mwU1_9-KInShrqjr6mtc1fwrTR8OfK_1 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.0mwU1_9-KInShrqjr6mtc1fwrTR8OfK_2 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_81eU--oc2RFM3iJEcOq-m1ahWZbH7_P', time=2024-09-12T02:41:57.826460+0000, chain.objs.size()=2 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.myaNIDWB6S5GM6KuJQfnflQC9SDdvuQ_1 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.myaNIDWB6S5GM6KuJQfnflQC9SDdvuQ_2 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_QUkCXhdy8xtABf6iUR6SlwYpCOiBJ_c', time=2024-09-12T02:41:59.803761+0000, chain.objs.size()=3 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.163__shadow_.85RdhRL2wlRr8VwOcFH6soW4c53Pn_a_0 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.163__shadow_.85RdhRL2wlRr8VwOcFH6soW4c53Pn_a_1 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.163__shadow_.85RdhRL2wlRr8VwOcFH6soW4c53Pn_a_2 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5056367687412144008', time=2024-09-12T02:47:06.734457+0000, chain.objs.size()=1 2024-09-12T00:54:31.173 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.176+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~2TCGht5kVYF_SIRG97Wxb-oIPO-ieK2.1 2024-09-12T00:54:31.179 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.184+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.183 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.188+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-12T00:54:31.186 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.188+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.187 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:54:31.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_8xOyrkastlrkYlMhYVLCjKnlwPAJUtC', time=2024-09-12T02:41:55.152748+0000, chain.objs.size()=1 2024-09-12T00:54:31.188 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.GIt6CULjx1G6YD0ZIcKv9WSLduE1t4J_0 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4797239377729998810', time=2024-09-12T02:46:43.040036+0000, chain.objs.size()=1 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.511__multipart_mymultipart.2~kf7RbzWHNu2XleFTVbkkHLWHCem61-z.1 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12968429456347614586', time=2024-09-12T02:46:53.158562+0000, chain.objs.size()=3 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~RMJqzlrEWlDubOwMHjIEeeziSyjyPPQ.1 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~RMJqzlrEWlDubOwMHjIEeeziSyjyPPQ.2 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~RMJqzlrEWlDubOwMHjIEeeziSyjyPPQ.3 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5514960746219682273', time=2024-09-12T02:47:08.027004+0000, chain.objs.size()=3 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~pji-cEOug5tOpWIyrV4ooBUO_fvL0tu.1 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~pji-cEOug5tOpWIyrV4ooBUO_fvL0tu.2 2024-09-12T00:54:31.189 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.192+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~pji-cEOug5tOpWIyrV4ooBUO_fvL0tu.3 2024-09-12T00:54:31.193 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.196+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.198 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.200+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-12T00:54:31.200 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.201 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=8, truncated=0, next_marker='' 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O', time=2024-09-12T02:47:02.788955+0000, chain.objs.size()=1 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O.1 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O', time=2024-09-12T02:47:02.792474+0000, chain.objs.size()=1 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O.2 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O', time=2024-09-12T02:47:02.795837+0000, chain.objs.size()=1 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O.3 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O', time=2024-09-12T02:47:02.799010+0000, chain.objs.size()=1 2024-09-12T00:54:31.203 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O.4 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O', time=2024-09-12T02:47:02.802371+0000, chain.objs.size()=1 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O.5 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O', time=2024-09-12T02:47:02.806040+0000, chain.objs.size()=1 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RJ6-AqCspIB64UjUO6WBr2m1PlvVa0O.6 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12430081329553919454', time=2024-09-12T02:47:02.820344+0000, chain.objs.size()=6 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~N6cYktBPtXOhXQIFiTt0ovov850i1e2.1 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.Cb-qAjtuUOz-qeHvMTrSmfzUcJdEJRRP.2 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.U9bt1lBXExN9Rf58Q5276jFlp9QKidoB.3 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~N6cYktBPtXOhXQIFiTt0ovov850i1e2.4 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~N6cYktBPtXOhXQIFiTt0ovov850i1e2.5 2024-09-12T00:54:31.204 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.204+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~N6cYktBPtXOhXQIFiTt0ovov850i1e2.6 2024-09-12T00:54:31.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.212+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11933239125143142178', time=2024-09-12T02:47:53.868363+0000, chain.objs.size()=1 2024-09-12T00:54:31.209 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.212+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.558__shadow_.L2AWW5GVSQ-jfgPZLS9l5YIqr1xE3rm_1 2024-09-12T00:54:31.215 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.220+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.219 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.220+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-12T00:54:31.221 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.224+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.222 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.224+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_4GkUEO-N-F0TI-xbgPRGnCLNug67NDS', time=2024-09-12T02:41:56.076164+0000, chain.objs.size()=2 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.YwY9xoovAoIoFN25QsJq_yz9k1PNzIR_1 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.YwY9xoovAoIoFN25QsJq_yz9k1PNzIR_2 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17868636711206759533', time=2024-09-12T02:46:56.642346+0000, chain.objs.size()=6 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.vUwlesD8DuwkmlMAI4xRjbYCkQkv6UMJ.1 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~600fQS4USbvSgMK58ejj1Nyb7O84l9J.2 2024-09-12T00:54:31.224 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~600fQS4USbvSgMK58ejj1Nyb7O84l9J.3 2024-09-12T00:54:31.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~600fQS4USbvSgMK58ejj1Nyb7O84l9J.4 2024-09-12T00:54:31.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~600fQS4USbvSgMK58ejj1Nyb7O84l9J.5 2024-09-12T00:54:31.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~600fQS4USbvSgMK58ejj1Nyb7O84l9J.6 2024-09-12T00:54:31.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.332886493390448904', time=2024-09-12T02:47:50.989413+0000, chain.objs.size()=1 2024-09-12T00:54:31.225 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.228+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.555__shadow_.36Hp5ld5IyZFAEYLkqRLpvwRh_0m9vD_1 2024-09-12T00:54:31.230 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.232+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.235 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.240+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-12T00:54:31.237 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.240+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.238 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.240+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:54:31.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3170498159385808883', time=2024-09-12T02:46:41.974925+0000, chain.objs.size()=6 2024-09-12T00:54:31.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.1 2024-09-12T00:54:31.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.2 2024-09-12T00:54:31.239 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.3 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.4 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.5 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.6 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf', time=2024-09-12T02:47:09.509805+0000, chain.objs.size()=10 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.1 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.2 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.3 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.4 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.5 2024-09-12T00:54:31.240 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.244+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.6 2024-09-12T00:54:31.244 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.7 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.8 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.9 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.526__multipart_mymultipart.2~3tkY5QLjsqKjEqaGrqLXAMf-FsAuobf.10 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ueNon0koweyO7LWiGVyVGQiAab5zKOG', time=2024-09-12T02:47:13.645782+0000, chain.objs.size()=2 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.531__multipart_mymultipart.2~ueNon0koweyO7LWiGVyVGQiAab5zKOG.1 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.531__multipart_mymultipart.2~ueNon0koweyO7LWiGVyVGQiAab5zKOG.2 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12536639236878075494', time=2024-09-12T02:51:13.819352+0000, chain.objs.size()=12 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__multipart_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.1 2024-09-12T00:54:31.246 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.248+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__shadow_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.1_1 2024-09-12T00:54:31.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.252+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__multipart_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.2 2024-09-12T00:54:31.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.252+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__shadow_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.2_1 2024-09-12T00:54:31.249 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.252+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__multipart_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.3 2024-09-12T00:54:31.253 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.256+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__shadow_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.3_1 2024-09-12T00:54:31.256 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__multipart_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.4 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__shadow_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.4_1 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__multipart_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.5 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__shadow_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.5_1 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__multipart_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.6 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.623__shadow_multipart_enc.2~Achj5f5OFD54x1_nDaPN18aVkFlstch.6_1 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9522652295654295022', time=2024-09-12T02:51:38.126717+0000, chain.objs.size()=6 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.660__multipart_bar.2~2C7pAv0Akc5QKDb5ec0jmgYvK4Jmegx.1 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.660__multipart_bar.2~2C7pAv0Akc5QKDb5ec0jmgYvK4Jmegx.2 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.660__multipart_bar.2~2C7pAv0Akc5QKDb5ec0jmgYvK4Jmegx.3 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.660__multipart_bar.2~2C7pAv0Akc5QKDb5ec0jmgYvK4Jmegx.4 2024-09-12T00:54:31.257 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.260+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.660__multipart_bar.2~2C7pAv0Akc5QKDb5ec0jmgYvK4Jmegx.5 2024-09-12T00:54:31.263 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.264+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.660__multipart_bar.2~2C7pAv0Akc5QKDb5ec0jmgYvK4Jmegx.6 2024-09-12T00:54:31.267 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.272+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.270 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.272+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-12T00:54:31.272 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.273 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_1Ot3UNkRreXog_-_q6IJGIDJ_RVR5Jp', time=2024-09-12T02:41:58.673862+0000, chain.objs.size()=2 2024-09-12T00:54:31.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.iyo58RQlF-hhAxOYa8wZj_Os46dzIZo_1 2024-09-12T00:54:31.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.iyo58RQlF-hhAxOYa8wZj_Os46dzIZo_2 2024-09-12T00:54:31.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13585767625566039447', time=2024-09-12T02:47:55.905004+0000, chain.objs.size()=1 2024-09-12T00:54:31.274 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.276+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.561__multipart_mymultipart.6HMwbnKh-Lherhk-ORdq9zhzOwze69Ec.1 2024-09-12T00:54:31.276 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.280+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.280 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-12T00:54:31.281 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.282 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_LjVV1RBxgvlnphh-DF7-o9JkciV6GnD', time=2024-09-12T02:42:00.879957+0000, chain.objs.size()=1 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.165__shadow_.mi0bxgjTqF6bjq0UCFooIXfBmC8pgY3_0 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4250233194834393509', time=2024-09-12T02:46:45.560838+0000, chain.objs.size()=1 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.516__multipart_mymultipartcopy.2~ACceIWDkuIhSzQW4dNJwKn-K5MwR4Cm.1 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4375689606513714712', time=2024-09-12T02:46:47.845587+0000, chain.objs.size()=1 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.517__shadow_._vP-J7HqkDoAVDXbwGTY-r7iMgbFixZ_1 2024-09-12T00:54:31.283 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~Ga15bdpfPgfsa1WUAhXGTv1c1ooGTdh', time=2024-09-12T02:47:13.663723+0000, chain.objs.size()=2 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.531__multipart_mymultipart2.2~Ga15bdpfPgfsa1WUAhXGTv1c1ooGTdh.1 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.531__shadow_mymultipart2.2~Ga15bdpfPgfsa1WUAhXGTv1c1ooGTdh.1_1 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~MWIIYzu8xGI3RPkqwONcVnuI4hsBlE4', time=2024-09-12T02:47:14.827074+0000, chain.objs.size()=1 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.533__multipart_mymultipart.2~MWIIYzu8xGI3RPkqwONcVnuI4hsBlE4.1 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1415398502477484497', time=2024-09-12T02:47:48.391637+0000, chain.objs.size()=1 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.552__shadow_.FR2AJvH7zxNmGgNqhDPZA9iIjaY72j5_1 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.3523766732049456594', time=2024-09-12T02:48:00.963848+0000, chain.objs.size()=1 2024-09-12T00:54:31.284 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.284+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.563__shadow_.ivk4MXCk81V1Pvttctm_LpQBD1jDxMO_1 2024-09-12T00:54:31.288 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.292+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.291 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-12T00:54:31.293 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.294 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13205166423055103398', time=2024-09-12T02:41:59.669833+0000, chain.objs.size()=2 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.162__shadow_.r-IRUyyWzlhKegkb3A9rTdhPh45Zlj-_1 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.162__shadow_.r-IRUyyWzlhKegkb3A9rTdhPh45Zlj-_2 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11114491634401529649', time=2024-09-12T02:46:47.156132+0000, chain.objs.size()=1 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.518__multipart_mymultipart.2~ylYUrPeGAx-lPUSpc-DohZG5zLdNWvv.1 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1008628761394867332', time=2024-09-12T02:47:07.058569+0000, chain.objs.size()=2 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~QQA6-yf1TColyCifVKY1Cou10X7QZ4n.1 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~QQA6-yf1TColyCifVKY1Cou10X7QZ4n.2 2024-09-12T00:54:31.295 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~xe2Vker5vV2kpZLwpyuvFjF9_shO10p', time=2024-09-12T02:47:15.298980+0000, chain.objs.size()=1 2024-09-12T00:54:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.534__multipart_mymultipart.2~xe2Vker5vV2kpZLwpyuvFjF9_shO10p.1 2024-09-12T00:54:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16615426288504133289', time=2024-09-12T02:47:29.601179+0000, chain.objs.size()=4 2024-09-12T00:54:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.535__multipart_mymultipart.2~czY76-NfPDFTux1fEDUPRUe8qGqgy1N.1 2024-09-12T00:54:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.535__multipart_mymultipart.2~czY76-NfPDFTux1fEDUPRUe8qGqgy1N.2 2024-09-12T00:54:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.535__multipart_mymultipart.9wUEsFC_K-DZuOh3A5u7gXzVtkLMlEuw.3 2024-09-12T00:54:31.296 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.296+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.535__multipart_mymultipart.2~czY76-NfPDFTux1fEDUPRUe8qGqgy1N.4 2024-09-12T00:54:31.300 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.304+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.304 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.308+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-12T00:54:31.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.308+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.306 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.308+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.312+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:31.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.312+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8319780282160774920', time=2024-09-12T02:41:52.960238+0000, chain.objs.size()=3 2024-09-12T00:54:31.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.312+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.158__shadow_.tdObUEN2G413l_CyFlELHmWh6HddpH7_0 2024-09-12T00:54:31.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.312+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.158__shadow_.tdObUEN2G413l_CyFlELHmWh6HddpH7_1 2024-09-12T00:54:31.307 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.312+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.158__shadow_.tdObUEN2G413l_CyFlELHmWh6HddpH7_2 2024-09-12T00:54:31.310 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.312+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.313 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.316+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-12T00:54:31.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.316 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=3, truncated=0, next_marker='' 2024-09-12T00:54:31.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~EaGWwMyCWkJ4h6YYtU6Oki6HkOXwSV3', time=2024-09-12T02:42:24.700358+0000, chain.objs.size()=1 2024-09-12T00:54:31.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.202__multipart_mymultipart.2~EaGWwMyCWkJ4h6YYtU6Oki6HkOXwSV3.1 2024-09-12T00:54:31.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11834867420826311822', time=2024-09-12T02:47:11.497060+0000, chain.objs.size()=2 2024-09-12T00:54:31.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.528__multipart_mymultipart.2~snNzBgc-0aXMJf7MnXSR44NhLQZcGoM.1 2024-09-12T00:54:31.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.528__multipart_mymultipart.2~snNzBgc-0aXMJf7MnXSR44NhLQZcGoM.2 2024-09-12T00:54:31.317 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17221327029224224626', time=2024-09-12T02:47:55.547019+0000, chain.objs.size()=1 2024-09-12T00:54:31.318 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.320+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.561__multipart_mymultipart.2~s3EWKHddfrho1da9jgl1K34wElBE2bw.1 2024-09-12T00:54:31.319 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.324+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.323 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.328+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-12T00:54:31.325 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.328+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.328+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.326 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.328+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:31.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.328+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2569593713762469899', time=2024-09-12T02:47:31.764717+0000, chain.objs.size()=1 2024-09-12T00:54:31.327 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.328+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.536__multipart_mymultipart.2~dK6OHkjxQQL4RH7xZVZr3sSNXPga8Y8.1 2024-09-12T00:54:31.328 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.332+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.331 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.336+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-12T00:54:31.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.336+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.334 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.336+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.340+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.340+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13751463647331091678', time=2024-09-12T02:46:46.653098+0000, chain.objs.size()=1 2024-09-12T00:54:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.340+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.518__multipart_mymultipart.2~f-32ArffHm03dtOhj1eHEekDCJ6rYC1.1 2024-09-12T00:54:31.335 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.340+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6691249113598923652', time=2024-09-12T02:51:57.051595+0000, chain.objs.size()=1 2024-09-12T00:54:31.336 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.340+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.702__multipart_file1.2~_9PQ9rnRJw07Kb9WmHFuKiUbPc02bDS.1 2024-09-12T00:54:31.337 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.340+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.341 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.344+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-12T00:54:31.343 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.344 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9849586478286276427', time=2024-09-12T02:46:50.040835+0000, chain.objs.size()=6 2024-09-12T00:54:31.345 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.519__multipart_mymultipart.2~Hv_ErEoDCwmwMw5w3CrfJqBhOaJgMCq.1 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.519__multipart_mymultipart.2~Hv_ErEoDCwmwMw5w3CrfJqBhOaJgMCq.2 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.519__multipart_mymultipart.2~Hv_ErEoDCwmwMw5w3CrfJqBhOaJgMCq.3 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.519__multipart_mymultipart.2~Hv_ErEoDCwmwMw5w3CrfJqBhOaJgMCq.4 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.519__multipart_mymultipart.2~Hv_ErEoDCwmwMw5w3CrfJqBhOaJgMCq.5 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.519__multipart_mymultipart.2~Hv_ErEoDCwmwMw5w3CrfJqBhOaJgMCq.6 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~uKP3sBAM_Ov4M9JLfegeg7h1GaCNOj1', time=2024-09-12T02:47:12.126475+0000, chain.objs.size()=2 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.529__multipart_mymultipart.2~uKP3sBAM_Ov4M9JLfegeg7h1GaCNOj1.1 2024-09-12T00:54:31.346 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.348+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.529__multipart_mymultipart.2~uKP3sBAM_Ov4M9JLfegeg7h1GaCNOj1.2 2024-09-12T00:54:31.350 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.352+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.353 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.356+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-12T00:54:31.355 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.356 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2141010955872223766', time=2024-09-12T02:46:44.152683+0000, chain.objs.size()=1 2024-09-12T00:54:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.513__multipart_mymultipart.2~Jqr-sQQsSollb7NwchVFniisYAQuCdc.1 2024-09-12T00:54:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1159029986430166266', time=2024-09-12T02:47:05.526771+0000, chain.objs.size()=3 2024-09-12T00:54:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~IYQL_KYOiGmyAyE30s1kKIqRmkJM7ON.1 2024-09-12T00:54:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~IYQL_KYOiGmyAyE30s1kKIqRmkJM7ON.2 2024-09-12T00:54:31.357 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.360+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~IYQL_KYOiGmyAyE30s1kKIqRmkJM7ON.3 2024-09-12T00:54:31.359 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.364+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.363 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-12T00:54:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.365 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~N6cYktBPtXOhXQIFiTt0ovov850i1e2', time=2024-09-12T02:47:00.045501+0000, chain.objs.size()=1 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~N6cYktBPtXOhXQIFiTt0ovov850i1e2.2 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~N6cYktBPtXOhXQIFiTt0ovov850i1e2', time=2024-09-12T02:47:00.048784+0000, chain.objs.size()=1 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~N6cYktBPtXOhXQIFiTt0ovov850i1e2.3 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7563394956880334160', time=2024-09-12T02:47:04.161155+0000, chain.objs.size()=1 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~YQ1YBj_9Gr78Mnuf4xMI5ReTrGk4ZES.1 2024-09-12T00:54:31.366 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.695995226665396963', time=2024-09-12T02:51:38.473516+0000, chain.objs.size()=6 2024-09-12T00:54:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.662__multipart_foo.2~nnqs3SZ6KWfqvfcgETCsfrwot_Ft-yj.1 2024-09-12T00:54:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.662__multipart_foo.2~nnqs3SZ6KWfqvfcgETCsfrwot_Ft-yj.2 2024-09-12T00:54:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.662__multipart_foo.2~nnqs3SZ6KWfqvfcgETCsfrwot_Ft-yj.3 2024-09-12T00:54:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.662__multipart_foo.2~nnqs3SZ6KWfqvfcgETCsfrwot_Ft-yj.4 2024-09-12T00:54:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.662__multipart_foo.2~nnqs3SZ6KWfqvfcgETCsfrwot_Ft-yj.5 2024-09-12T00:54:31.367 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.368+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.662__multipart_foo.2~nnqs3SZ6KWfqvfcgETCsfrwot_Ft-yj.6 2024-09-12T00:54:31.371 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.376+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.375 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.376+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-12T00:54:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.380+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.377 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.380+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.380+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-12T00:54:31.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.380+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.11901401024312670967', time=2024-09-12T02:51:28.564910+0000, chain.objs.size()=1 2024-09-12T00:54:31.378 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.380+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.648__shadow_.pp1-cl7vAk15ctqIlDUkPt3DsvJnm3c_1 2024-09-12T00:54:31.380 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.384+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.383 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-12T00:54:31.385 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~600fQS4USbvSgMK58ejj1Nyb7O84l9J', time=2024-09-12T02:46:54.612824+0000, chain.objs.size()=1 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~600fQS4USbvSgMK58ejj1Nyb7O84l9J.1 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18343587068363262311', time=2024-09-12T02:47:08.423695+0000, chain.objs.size()=5 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~QTs7rB_951RAGyWsq1sgsRtCIp3jNd3.1 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__shadow_mymultipart.2~QTs7rB_951RAGyWsq1sgsRtCIp3jNd3.1_1 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~QTs7rB_951RAGyWsq1sgsRtCIp3jNd3.2 2024-09-12T00:54:31.387 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__shadow_mymultipart.2~QTs7rB_951RAGyWsq1sgsRtCIp3jNd3.2_1 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~QTs7rB_951RAGyWsq1sgsRtCIp3jNd3.3 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8284488253271520393', time=2024-09-12T02:51:25.283219+0000, chain.objs.size()=1 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.643__shadow_.ZCPeFab44-E1ldeKJjwbDynj0sZVIPK_1 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12967430860046900550', time=2024-09-12T02:52:34.042211+0000, chain.objs.size()=10 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.1 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.2 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.3 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.4 2024-09-12T00:54:31.388 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.388+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.5 2024-09-12T00:54:31.389 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.392+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.6 2024-09-12T00:54:31.392 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.396+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.7 2024-09-12T00:54:31.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.396+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.8 2024-09-12T00:54:31.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.396+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.9 2024-09-12T00:54:31.393 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.396+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.735__multipart_foo.2~_u5AiBT0sVSlVnaYIcJ6mSFMtMotLGT.10 2024-09-12T00:54:31.398 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.400+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.401 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.404+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-12T00:54:31.403 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.404 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9315628332048885475', time=2024-09-12T02:46:41.807210+0000, chain.objs.size()=6 2024-09-12T00:54:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.1 2024-09-12T00:54:31.405 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.2 2024-09-12T00:54:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.3 2024-09-12T00:54:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.4 2024-09-12T00:54:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.5 2024-09-12T00:54:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.6 2024-09-12T00:54:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10581603308464860125', time=2024-09-12T02:46:48.022931+0000, chain.objs.size()=1 2024-09-12T00:54:31.406 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.408+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.518__multipart_mymultipart.2~qm7IzgsI-SOAo8osJEhxmF0BhH0RGiF.1 2024-09-12T00:54:31.410 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.412+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.413 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.416+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-12T00:54:31.415 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.416 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.417 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7640973926149823978', time=2024-09-12T02:41:52.974254+0000, chain.objs.size()=3 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.158__shadow_.NIg2nK5hpXdupMvoX22NTS_QPbIHQDY_0 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.158__shadow_.NIg2nK5hpXdupMvoX22NTS_QPbIHQDY_1 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.158__shadow_.NIg2nK5hpXdupMvoX22NTS_QPbIHQDY_2 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7596302618163988792', time=2024-09-12T02:47:04.447910+0000, chain.objs.size()=2 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~LVRxGHznME6iEEArutPZmKkD7Z23gue.1 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~LVRxGHznME6iEEArutPZmKkD7Z23gue.2 2024-09-12T00:54:31.418 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.15542796402187266470', time=2024-09-12T02:48:41.241136+0000, chain.objs.size()=4 2024-09-12T00:54:31.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~qH6VNOP1toMjpTS7uHOnSu8OR0AeG7S.1 2024-09-12T00:54:31.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~qH6VNOP1toMjpTS7uHOnSu8OR0AeG7S.2 2024-09-12T00:54:31.419 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~qH6VNOP1toMjpTS7uHOnSu8OR0AeG7S.3 2024-09-12T00:54:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~qH6VNOP1toMjpTS7uHOnSu8OR0AeG7S.4 2024-09-12T00:54:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1067979995928236502', time=2024-09-12T02:52:38.715465+0000, chain.objs.size()=3 2024-09-12T00:54:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.743__multipart_mymultipart3.2~uTcM5sAfERQ6Q2dgYQXYkQ5SsqD4wvK.1 2024-09-12T00:54:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.743__multipart_mymultipart3.2~uTcM5sAfERQ6Q2dgYQXYkQ5SsqD4wvK.2 2024-09-12T00:54:31.420 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.420+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.743__multipart_mymultipart3.2~uTcM5sAfERQ6Q2dgYQXYkQ5SsqD4wvK.3 2024-09-12T00:54:31.425 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.428+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.428 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.432+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-12T00:54:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.432+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.430 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.432+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.431 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.432+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.432+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2278926319065445563', time=2024-09-12T02:41:56.946387+0000, chain.objs.size()=3 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-STANDARD.2~X9ugV2IVl7z3weTWeIsIW_Jxfp_LD64.1 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-STANDARD.2~X9ugV2IVl7z3weTWeIsIW_Jxfp_LD64.2 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-STANDARD.2~X9ugV2IVl7z3weTWeIsIW_Jxfp_LD64.3 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.4011155721070556874', time=2024-09-12T02:41:58.526963+0000, chain.objs.size()=5 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-FROZEN.2~cHXRb9qrmITsxjbd_Wo2JEybnBVgjyq.1 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_foo-FROZEN.2~cHXRb9qrmITsxjbd_Wo2JEybnBVgjyq.1_1 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-FROZEN.2~cHXRb9qrmITsxjbd_Wo2JEybnBVgjyq.2 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_foo-FROZEN.2~cHXRb9qrmITsxjbd_Wo2JEybnBVgjyq.2_1 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-FROZEN.2~cHXRb9qrmITsxjbd_Wo2JEybnBVgjyq.3 2024-09-12T00:54:31.432 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~mpKaqnmhJhAEmUKLyjwvmnjomcVCX7b', time=2024-09-12T02:42:23.992609+0000, chain.objs.size()=1 2024-09-12T00:54:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.201__multipart_mymultipart.2~mpKaqnmhJhAEmUKLyjwvmnjomcVCX7b.1 2024-09-12T00:54:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~RBbCB6hzKnnBMVbeIQUuIzzeuVlH181', time=2024-09-12T02:46:58.234862+0000, chain.objs.size()=1 2024-09-12T00:54:31.433 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.436+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RBbCB6hzKnnBMVbeIQUuIzzeuVlH181.3 2024-09-12T00:54:31.436 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.440+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.439 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-12T00:54:31.441 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.442 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~hZAt4ZMkbdF1fSm3x0psIIsIybPkGAy', time=2024-09-12T02:46:56.627108+0000, chain.objs.size()=1 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~hZAt4ZMkbdF1fSm3x0psIIsIybPkGAy.2 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.6283096506779533537', time=2024-09-12T02:48:41.495252+0000, chain.objs.size()=7 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~15QmqUwm2BsF-2I8nQW-1BFOMXT2QGK.1 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__shadow_testobj.2~15QmqUwm2BsF-2I8nQW-1BFOMXT2QGK.1_1 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~15QmqUwm2BsF-2I8nQW-1BFOMXT2QGK.2 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__shadow_testobj.2~15QmqUwm2BsF-2I8nQW-1BFOMXT2QGK.2_1 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~15QmqUwm2BsF-2I8nQW-1BFOMXT2QGK.3 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__shadow_testobj.2~15QmqUwm2BsF-2I8nQW-1BFOMXT2QGK.3_1 2024-09-12T00:54:31.443 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.444+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~15QmqUwm2BsF-2I8nQW-1BFOMXT2QGK.4 2024-09-12T00:54:31.447 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.452+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.453 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.456+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-12T00:54:31.454 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.456+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.455 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=4, truncated=0, next_marker='' 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_X7DiRLq9mU8DxgH5bZAvZFB92IFNvVH', time=2024-09-12T02:41:57.024398+0000, chain.objs.size()=1 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.GomuqT6H8ve_Lp_e3Ei6Se-9pdVG7_N_0 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13107967610470753464', time=2024-09-12T02:47:04.771273+0000, chain.objs.size()=2 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~BrijXC4mXD1pzgEVEaYBh4oDCziClMB.1 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~BrijXC4mXD1pzgEVEaYBh4oDCziClMB.2 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.12321876499837255972', time=2024-09-12T02:47:05.124134+0000, chain.objs.size()=3 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~cgmP8x2glcj6vj707RFWrBekcu4MAA8.1 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~cgmP8x2glcj6vj707RFWrBekcu4MAA8.2 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~cgmP8x2glcj6vj707RFWrBekcu4MAA8.3 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16309014378269957049', time=2024-09-12T02:47:08.777283+0000, chain.objs.size()=2 2024-09-12T00:54:31.456 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~iszcaefzJfYjr0f_bYYCr5AcnuPOwdh.1 2024-09-12T00:54:31.457 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.460+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~iszcaefzJfYjr0f_bYYCr5AcnuPOwdh.2 2024-09-12T00:54:31.459 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.464+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.462 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.464+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-12T00:54:31.464 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.465 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.8955168918542927091', time=2024-09-12T02:46:52.214693+0000, chain.objs.size()=3 2024-09-12T00:54:31.466 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~GU0MPzIObpj-dg_iiXE_iu1TIVyg2-K.1 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~GU0MPzIObpj-dg_iiXE_iu1TIVyg2-K.2 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~GU0MPzIObpj-dg_iiXE_iu1TIVyg2-K.3 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7778164729132654516', time=2024-09-12T02:49:07.184094+0000, chain.objs.size()=12 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__multipart_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.1 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__shadow_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.1_1 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__multipart_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.2 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__shadow_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.2_1 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__multipart_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.3 2024-09-12T00:54:31.467 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__shadow_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.3_1 2024-09-12T00:54:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__multipart_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.4 2024-09-12T00:54:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__shadow_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.4_1 2024-09-12T00:54:31.468 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.468+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__multipart_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.5 2024-09-12T00:54:31.470 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.472+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__shadow_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.5_1 2024-09-12T00:54:31.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.476+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__multipart_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.6 2024-09-12T00:54:31.474 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.476+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.615__shadow_multipart_enc.2~olFwPJdKGBTVOlStzl8mu6BncmyCyJC.6_1 2024-09-12T00:54:31.477 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.480+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.480 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.484+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-12T00:54:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.484+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.482 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.484+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.483 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=7, truncated=0, next_marker='' 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_dFqD6UtyNXOmyLsuMY7JU9Yho3RG6aZ', time=2024-09-12T02:41:56.260231+0000, chain.objs.size()=1 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.sybYA7zaIFzlegA4QG30DW-vmfxzohg_0 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_W9WWx2j2CYcPhyttxEYYogKqOUvFfGh', time=2024-09-12T02:41:58.878299+0000, chain.objs.size()=1 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.frozen:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.oQxMzpiB-x0KhzsqRNa3mcu3B48soAj_0 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9793950458191840695', time=2024-09-12T02:46:41.809196+0000, chain.objs.size()=6 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.1 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.2 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.3 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.4 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.5 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.6 2024-09-12T00:54:31.484 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~ESn-sG6dIaIOAk10R8PtUv7--GRNGoP', time=2024-09-12T02:47:13.623327+0000, chain.objs.size()=2 2024-09-12T00:54:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.531__multipart_mymultipart.2~ESn-sG6dIaIOAk10R8PtUv7--GRNGoP.1 2024-09-12T00:54:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.531__shadow_mymultipart.2~ESn-sG6dIaIOAk10R8PtUv7--GRNGoP.1_1 2024-09-12T00:54:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1536769283807218845', time=2024-09-12T02:48:41.717942+0000, chain.objs.size()=4 2024-09-12T00:54:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~mtzfu_8Y4yFkVWZXM6nR9ijkxy-5gJD.1 2024-09-12T00:54:31.485 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~mtzfu_8Y4yFkVWZXM6nR9ijkxy-5gJD.2 2024-09-12T00:54:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~mtzfu_8Y4yFkVWZXM6nR9ijkxy-5gJD.3 2024-09-12T00:54:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.578__multipart_testobj.2~mtzfu_8Y4yFkVWZXM6nR9ijkxy-5gJD.4 2024-09-12T00:54:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN', time=2024-09-12T02:51:15.346404+0000, chain.objs.size()=12 2024-09-12T00:54:31.486 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.488+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__multipart_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.1 2024-09-12T00:54:31.487 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__shadow_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.1_1 2024-09-12T00:54:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__multipart_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.2 2024-09-12T00:54:31.488 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__shadow_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.2_1 2024-09-12T00:54:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__multipart_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.3 2024-09-12T00:54:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__shadow_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.3_1 2024-09-12T00:54:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__multipart_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.4 2024-09-12T00:54:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__shadow_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.4_1 2024-09-12T00:54:31.490 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.492+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__multipart_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.5 2024-09-12T00:54:31.493 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.496+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__shadow_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.5_1 2024-09-12T00:54:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.496+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__multipart_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.6 2024-09-12T00:54:31.494 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.496+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.624__shadow_multipart_enc.2~-ZBaI4XqFyUhrfhxSDMAL_HGqmAtnYN.6_1 2024-09-12T00:54:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.496+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1053466724005873936', time=2024-09-12T02:52:37.648029+0000, chain.objs.size()=1 2024-09-12T00:54:31.495 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.496+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.742__multipart_mymultipart3.2~uEv-rnNqLk5MA-V0MRxpsdlowNugERz.1 2024-09-12T00:54:31.498 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.500+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.501 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.504+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-12T00:54:31.502 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.504+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.503 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=9, truncated=0, next_marker='' 2024-09-12T00:54:31.504 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16503278871295573635', time=2024-09-12T02:41:54.749344+0000, chain.objs.size()=5 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-STANDARD.2~n2JdpOPcEvXi9VHZv-tvFhiAg7HaZ3p.1 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__shadow_mymultipart-STANDARD.2~n2JdpOPcEvXi9VHZv-tvFhiAg7HaZ3p.1_1 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-STANDARD.2~n2JdpOPcEvXi9VHZv-tvFhiAg7HaZ3p.2 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__shadow_mymultipart-STANDARD.2~n2JdpOPcEvXi9VHZv-tvFhiAg7HaZ3p.2_1 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-STANDARD.2~n2JdpOPcEvXi9VHZv-tvFhiAg7HaZ3p.3 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_tOT02FnvP-HAzZV9nxkmHMZOJCM2PUv', time=2024-09-12T02:41:55.591246+0000, chain.objs.size()=2 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.q4qhrqEduskFMQuhAatPo_Qr0Mz2f8H_1 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.q4qhrqEduskFMQuhAatPo_Qr0Mz2f8H_2 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_POIrWo-0z8pfQjNzEEJJWZQVYjjsqlk', time=2024-09-12T02:41:56.231879+0000, chain.objs.size()=3 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.dmIYLKZU8Jtpkbo3ggM0BUeh_ODepAg_0 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.dmIYLKZU8Jtpkbo3ggM0BUeh_ODepAg_1 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.160__shadow_.dmIYLKZU8Jtpkbo3ggM0BUeh_ODepAg_2 2024-09-12T00:54:31.505 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='_0E5uUxvlv1gIfudzZFzlly5VTI4ZDSb', time=2024-09-12T02:41:58.850957+0000, chain.objs.size()=3 2024-09-12T00:54:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.DLFy-ZwWXc5fwewsKijRvyhNfGMIbzZ_0 2024-09-12T00:54:31.506 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.508+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.DLFy-ZwWXc5fwewsKijRvyhNfGMIbzZ_1 2024-09-12T00:54:31.508 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_.DLFy-ZwWXc5fwewsKijRvyhNfGMIbzZ_2 2024-09-12T00:54:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13928396630574707143', time=2024-09-12T02:42:00.724002+0000, chain.objs.size()=2 2024-09-12T00:54:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.164__multipart_foo.2~7hfajyKoHCEXeHsErdy1qgdVbYgg-dF.1 2024-09-12T00:54:31.509 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.164__multipart_foo.2~7hfajyKoHCEXeHsErdy1qgdVbYgg-dF.2 2024-09-12T00:54:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.18119888079421832383', time=2024-09-12T02:47:10.496706+0000, chain.objs.size()=4 2024-09-12T00:54:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.527__multipart_mymultipart.2~7zEAePunLzQCvMSEJ3sSLkxPLxuek95.1 2024-09-12T00:54:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.527__multipart_mymultipart.2~7zEAePunLzQCvMSEJ3sSLkxPLxuek95.2 2024-09-12T00:54:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.527__multipart_mymultipart.2~7zEAePunLzQCvMSEJ3sSLkxPLxuek95.3 2024-09-12T00:54:31.510 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.527__multipart_mymultipart.2~7zEAePunLzQCvMSEJ3sSLkxPLxuek95.4 2024-09-12T00:54:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~czY76-NfPDFTux1fEDUPRUe8qGqgy1N', time=2024-09-12T02:47:16.185782+0000, chain.objs.size()=1 2024-09-12T00:54:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.535__multipart_mymultipart.2~czY76-NfPDFTux1fEDUPRUe8qGqgy1N.3 2024-09-12T00:54:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.17321088565769314270', time=2024-09-12T02:49:02.360301+0000, chain.objs.size()=12 2024-09-12T00:54:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__multipart_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.1 2024-09-12T00:54:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__shadow_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.1_1 2024-09-12T00:54:31.511 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.512+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__multipart_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.2 2024-09-12T00:54:31.514 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.516+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__shadow_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.2_1 2024-09-12T00:54:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.516+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__multipart_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.3 2024-09-12T00:54:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.516+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__shadow_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.3_1 2024-09-12T00:54:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.516+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__multipart_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.4 2024-09-12T00:54:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.520+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__shadow_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.4_1 2024-09-12T00:54:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.520+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__multipart_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.5 2024-09-12T00:54:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.520+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__shadow_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.5_1 2024-09-12T00:54:31.515 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.520+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__multipart_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.6 2024-09-12T00:54:31.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.520+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.613__shadow_multipart_enc.2~YRXuUEpJsGb50KSkOVzGaaSYARzT3eA.6_1 2024-09-12T00:54:31.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.520+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.9013623870139664504', time=2024-09-12T02:52:01.894634+0000, chain.objs.size()=1 2024-09-12T00:54:31.516 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.520+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.711__multipart_file1.2~argHIhmtlxK9ADIieMIxWMWI_S9SeVk.1 2024-09-12T00:54:31.523 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.528+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.526 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.528+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-12T00:54:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.527 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14969465969757167542', time=2024-09-12T02:41:57.687439+0000, chain.objs.size()=5 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-LUKEWARM.2~J4HzAB-xq1zT3D178g3m039cE-pIPBX.1 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_foo-LUKEWARM.2~J4HzAB-xq1zT3D178g3m039cE-pIPBX.1_1 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-LUKEWARM.2~J4HzAB-xq1zT3D178g3m039cE-pIPBX.2 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__shadow_foo-LUKEWARM.2~J4HzAB-xq1zT3D178g3m039cE-pIPBX.2_1 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.161__multipart_foo-LUKEWARM.2~J4HzAB-xq1zT3D178g3m039cE-pIPBX.3 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.14880438252514439631', time=2024-09-12T02:46:42.146347+0000, chain.objs.size()=6 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.1 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.2 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.3 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.4 2024-09-12T00:54:31.529 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.5 2024-09-12T00:54:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.507__multipart_srcmultipart.2~q-AChKpK0m7nYYlggyFAsKYClYQ3HgA.6 2024-09-12T00:54:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.2169166434878153526', time=2024-09-12T02:47:00.065258+0000, chain.objs.size()=6 2024-09-12T00:54:31.530 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.532+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RBbCB6hzKnnBMVbeIQUuIzzeuVlH181.1 2024-09-12T00:54:31.532 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RBbCB6hzKnnBMVbeIQUuIzzeuVlH181.2 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.OYK-VFSBEkYZ_AHo1V_Ks-BVizay6Dxs.3 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RBbCB6hzKnnBMVbeIQUuIzzeuVlH181.4 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RBbCB6hzKnnBMVbeIQUuIzzeuVlH181.5 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.2~RBbCB6hzKnnBMVbeIQUuIzzeuVlH181.6 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5247677007211702881', time=2024-09-12T02:47:07.513155+0000, chain.objs.size()=2 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~5P3ZTIOGOuptEy00_vZu8Gw7avGXhHz.1 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.525__multipart_mymultipart.2~5P3ZTIOGOuptEy00_vZu8Gw7avGXhHz.2 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.7479694056529096638', time=2024-09-12T02:49:05.518933+0000, chain.objs.size()=12 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__multipart_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.1 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__shadow_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.1_1 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__multipart_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.2 2024-09-12T00:54:31.533 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__shadow_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.2_1 2024-09-12T00:54:31.535 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.536+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__multipart_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.3 2024-09-12T00:54:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.540+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__shadow_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.3_1 2024-09-12T00:54:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.540+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__multipart_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.4 2024-09-12T00:54:31.537 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.540+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__shadow_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.4_1 2024-09-12T00:54:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.540+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__multipart_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.5 2024-09-12T00:54:31.538 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.540+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__shadow_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.5_1 2024-09-12T00:54:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.540+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__multipart_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.6 2024-09-12T00:54:31.539 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.540+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.614__shadow_multipart_enc.2~AaCKNWSaSWw9hYz4Ni3GiyFJt6Fq3zY.6_1 2024-09-12T00:54:31.545 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.548+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.547 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-12T00:54:31.549 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=2, truncated=0, next_marker='' 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.5404571090344510750', time=2024-09-12T02:46:52.747204+0000, chain.objs.size()=3 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~nYDQ7hq87pTXs_ASdKzme6Vqc5z_6_y.1 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~nYDQ7hq87pTXs_ASdKzme6Vqc5z_6_y.2 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.521__multipart_mymultipart.2~nYDQ7hq87pTXs_ASdKzme6Vqc5z_6_y.3 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.16821774992067067904', time=2024-09-12T02:47:03.454789+0000, chain.objs.size()=6 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.hyQ4mI0nznL3e_Ngx7s2WOYFfxUVB93X.1 2024-09-12T00:54:31.551 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.5aDrcQIt-Lr3LOrvu041L95hkDCZAjVH.2 2024-09-12T00:54:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.UrErufsYh1hWixh87v9jkUxrV3YMhTGM.3 2024-09-12T00:54:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.WN2DlbYrE_q_o2uk0RhBEEi-g4czl6xh.4 2024-09-12T00:54:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.w18ocDq9cTLZC0MB3zkZdZONdNPdHUTY.5 2024-09-12T00:54:31.552 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.552+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.522__multipart_mymultipart.taIAV2hm6qE10CbFEDAJ-weqRfvgLHiB.6 2024-09-12T00:54:31.555 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.556+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.557 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.560+0000 7fb7a39719c0 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-12T00:54:31.558 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.560+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-12T00:54:31.559 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-12T00:54:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=5, truncated=0, next_marker='' 2024-09-12T00:54:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.13099879872506698283', time=2024-09-12T02:41:54.736838+0000, chain.objs.size()=5 2024-09-12T00:54:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-LUKEWARM.2~iQpDl4Q-CPH7b2Xxdh1vE0Q7C7H0b-V.1 2024-09-12T00:54:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__shadow_mymultipart-LUKEWARM.2~iQpDl4Q-CPH7b2Xxdh1vE0Q7C7H0b-V.1_1 2024-09-12T00:54:31.560 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-LUKEWARM.2~iQpDl4Q-CPH7b2Xxdh1vE0Q7C7H0b-V.2 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__shadow_mymultipart-LUKEWARM.2~iQpDl4Q-CPH7b2Xxdh1vE0Q7C7H0b-V.2_1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data.lukewarm:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.159__multipart_mymultipart-LUKEWARM.2~iQpDl4Q-CPH7b2Xxdh1vE0Q7C7H0b-V.3 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.1752796026729755479', time=2024-09-12T02:46:43.981885+0000, chain.objs.size()=1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.512__shadow_.rda8LPqdB6PbmWlS9yRAFXmPBDULHPf_1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.10383039474434575936', time=2024-09-12T02:47:05.638914+0000, chain.objs.size()=4 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~Em3hB4j9x428-5zQfUZw4C-hFnZV1D5.1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__shadow_mymultipart.2~Em3hB4j9x428-5zQfUZw4C-hFnZV1D5.1_1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__multipart_mymultipart.2~Em3hB4j9x428-5zQfUZw4C-hFnZV1D5.2 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.523__shadow_mymultipart.2~Em3hB4j9x428-5zQfUZw4C-hFnZV1D5.2_1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~QM9dfg11LslL8zl7xouSoYA2zRIoTJZ', time=2024-09-12T02:47:55.668603+0000, chain.objs.size()=1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.561__multipart_mymultipart.2~QM9dfg11LslL8zl7xouSoYA2zRIoTJZ.1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 20 garbage collection: RGWGC::process iterating over entry tag='2~o2ZiX7V7YYKYlypFHkdYqrW2jESWhc7', time=2024-09-12T02:52:37.721954+0000, chain.objs.size()=1 2024-09-12T00:54:31.561 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.564+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:88185928-eed4-4ed7-91c9-ccae30f6e5e2.4550.742__multipart_mymultipart.2~o2ZiX7V7YYKYlypFHkdYqrW2jESWhc7.1 2024-09-12T00:54:31.565 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.568+0000 7fb7a39719c0 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-12T00:54:31.568 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.572+0000 7fb6577e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-12T00:54:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.576+0000 7fb7a39719c0 20 remove_watcher() i=0 2024-09-12T00:54:31.571 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.576+0000 7fb7a39719c0 2 removed watcher, disabling cache 2024-09-12T00:54:31.572 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.576+0000 7fb7a39719c0 20 remove_watcher() i=1 2024-09-12T00:54:31.573 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.576+0000 7fb7a39719c0 20 remove_watcher() i=2 2024-09-12T00:54:31.574 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.576+0000 7fb7a39719c0 20 remove_watcher() i=3 2024-09-12T00:54:31.575 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.580+0000 7fb7a39719c0 20 remove_watcher() i=4 2024-09-12T00:54:31.576 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.580+0000 7fb7a39719c0 20 remove_watcher() i=5 2024-09-12T00:54:31.578 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.580+0000 7fb7a39719c0 20 remove_watcher() i=6 2024-09-12T00:54:31.579 INFO:teuthology.orchestra.run.smithi078.stderr:2024-09-12T00:54:31.584+0000 7fb7a39719c0 20 remove_watcher() i=7 2024-09-12T00:54:31.592 DEBUG:teuthology.run_tasks:Unwinding manager openssl_keys 2024-09-12T00:54:31.603 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-12T00:54:31.613 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-12T00:54:31.613 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:54:31.970 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:54:31.985 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:54:31.988 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1552,"stamp":"2024-09-12T00:54:31.351387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":557765235,"num_objects":1060,"num_object_clones":0,"num_object_copies":2639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1060,"num_whiteouts":0,"num_read":277489,"num_read_kb":2585916,"num_write":143116,"num_write_kb":2344217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13931,"ondisk_log_size":13931,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2256428,"kb_used_data":943660,"kb_used_omap":12,"kb_used_meta":1312627,"kb_avail":752718292,"statfs":{"total":773094113280,"available":770783531008,"internally_reserved":0,"allocated":966307840,"data_stored":949974726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1344130610},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12467169,"num_objects":-27,"num_object_clones":0,"num_object_copies":-62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":276,"num_read_kb":270,"num_write":52,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007887"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934222+0000","last_change":"2024-09-12T00:39:28.138350+0000","last_active":"2024-09-12T00:52:00.934222+0000","last_peered":"2024-09-12T00:52:00.934222+0000","last_clean":"2024-09-12T00:52:00.934222+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:52:00.934222+0000","last_undegraded":"2024-09-12T00:52:00.934222+0000","last_fullsized":"2024-09-12T00:52:00.934222+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:55.798857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092228+0000","last_change":"2024-09-12T00:28:17.047281+0000","last_active":"2024-09-12T00:50:51.092228+0000","last_peered":"2024-09-12T00:50:51.092228+0000","last_clean":"2024-09-12T00:50:51.092228+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:50:51.092228+0000","last_undegraded":"2024-09-12T00:50:51.092228+0000","last_fullsized":"2024-09-12T00:50:51.092228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:27.659088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915451+0000","last_change":"2024-09-12T00:28:14.033426+0000","last_active":"2024-09-12T00:50:45.915451+0000","last_peered":"2024-09-12T00:50:45.915451+0000","last_clean":"2024-09-12T00:50:45.915451+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:50:45.915451+0000","last_undegraded":"2024-09-12T00:50:45.915451+0000","last_fullsized":"2024-09-12T00:50:45.915451+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:32.619191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931203+0000","last_change":"2024-09-12T00:26:48.570033+0000","last_active":"2024-09-12T00:51:50.931203+0000","last_peered":"2024-09-12T00:51:50.931203+0000","last_clean":"2024-09-12T00:51:50.931203+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:51:50.931203+0000","last_undegraded":"2024-09-12T00:51:50.931203+0000","last_fullsized":"2024-09-12T00:51:50.931203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.353377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928588+0000","last_change":"2024-09-12T00:39:28.129464+0000","last_active":"2024-09-12T00:52:00.928588+0000","last_peered":"2024-09-12T00:52:00.928588+0000","last_clean":"2024-09-12T00:52:00.928588+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:52:00.928588+0000","last_undegraded":"2024-09-12T00:52:00.928588+0000","last_fullsized":"2024-09-12T00:52:00.928588+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:48.897603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113095+0000","last_change":"2024-09-12T00:28:17.071932+0000","last_active":"2024-09-12T00:50:51.113095+0000","last_peered":"2024-09-12T00:50:51.113095+0000","last_clean":"2024-09-12T00:50:51.113095+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:50:51.113095+0000","last_undegraded":"2024-09-12T00:50:51.113095+0000","last_fullsized":"2024-09-12T00:50:51.113095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.458170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921118+0000","last_change":"2024-09-12T00:28:14.053061+0000","last_active":"2024-09-12T00:50:44.921118+0000","last_peered":"2024-09-12T00:50:44.921118+0000","last_clean":"2024-09-12T00:50:44.921118+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:50:44.921118+0000","last_undegraded":"2024-09-12T00:50:44.921118+0000","last_fullsized":"2024-09-12T00:50:44.921118+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.764170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":162,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.061737+0000","last_change":"2024-09-12T00:26:48.579305+0000","last_active":"2024-09-12T00:51:36.061737+0000","last_peered":"2024-09-12T00:51:36.061737+0000","last_clean":"2024-09-12T00:51:36.061737+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:51:36.061737+0000","last_undegraded":"2024-09-12T00:51:36.061737+0000","last_fullsized":"2024-09-12T00:51:36.061737+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:50.899850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.103970+0000","last_change":"2024-09-12T00:39:28.122188+0000","last_active":"2024-09-12T00:51:36.103970+0000","last_peered":"2024-09-12T00:51:36.103970+0000","last_clean":"2024-09-12T00:51:36.103970+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:51:36.103970+0000","last_undegraded":"2024-09-12T00:51:36.103970+0000","last_fullsized":"2024-09-12T00:51:36.103970+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.982189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928491+0000","last_change":"2024-09-12T00:28:17.054566+0000","last_active":"2024-09-12T00:51:14.928491+0000","last_peered":"2024-09-12T00:51:14.928491+0000","last_clean":"2024-09-12T00:51:14.928491+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:51:14.928491+0000","last_undegraded":"2024-09-12T00:51:14.928491+0000","last_fullsized":"2024-09-12T00:51:14.928491+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.840405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:20.935927+0000","last_change":"2024-09-12T00:28:14.047435+0000","last_active":"2024-09-12T00:52:20.935927+0000","last_peered":"2024-09-12T00:52:20.935927+0000","last_clean":"2024-09-12T00:52:20.935927+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:52:20.935927+0000","last_undegraded":"2024-09-12T00:52:20.935927+0000","last_fullsized":"2024-09-12T00:52:20.935927+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:59.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.669268+0000","last_change":"2024-09-12T00:26:48.580614+0000","last_active":"2024-09-12T00:52:01.669268+0000","last_peered":"2024-09-12T00:52:01.669268+0000","last_clean":"2024-09-12T00:52:01.669268+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:52:01.669268+0000","last_undegraded":"2024-09-12T00:52:01.669268+0000","last_fullsized":"2024-09-12T00:52:01.669268+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:44.366801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934194+0000","last_change":"2024-09-12T00:39:28.125516+0000","last_active":"2024-09-12T00:51:39.934194+0000","last_peered":"2024-09-12T00:51:39.934194+0000","last_clean":"2024-09-12T00:51:39.934194+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:51:39.934194+0000","last_undegraded":"2024-09-12T00:51:39.934194+0000","last_fullsized":"2024-09-12T00:51:39.934194+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:50.627744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'4","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.944822+0000","last_change":"2024-09-12T00:28:17.052788+0000","last_active":"2024-09-12T00:52:24.944822+0000","last_peered":"2024-09-12T00:52:24.944822+0000","last_clean":"2024-09-12T00:52:24.944822+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:52:24.944822+0000","last_undegraded":"2024-09-12T00:52:24.944822+0000","last_fullsized":"2024-09-12T00:52:24.944822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.537154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096647+0000","last_change":"2024-09-12T00:28:14.043102+0000","last_active":"2024-09-12T00:51:11.096647+0000","last_peered":"2024-09-12T00:51:11.096647+0000","last_clean":"2024-09-12T00:51:11.096647+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:51:11.096647+0000","last_undegraded":"2024-09-12T00:51:11.096647+0000","last_fullsized":"2024-09-12T00:51:11.096647+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.118617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926319+0000","last_change":"2024-09-12T00:26:48.582273+0000","last_active":"2024-09-12T00:51:50.926319+0000","last_peered":"2024-09-12T00:51:50.926319+0000","last_clean":"2024-09-12T00:51:50.926319+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:51:50.926319+0000","last_undegraded":"2024-09-12T00:51:50.926319+0000","last_fullsized":"2024-09-12T00:51:50.926319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.447704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926457+0000","last_change":"2024-09-12T00:39:28.140327+0000","last_active":"2024-09-12T00:51:35.926457+0000","last_peered":"2024-09-12T00:51:35.926457+0000","last_clean":"2024-09-12T00:51:35.926457+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:51:35.926457+0000","last_undegraded":"2024-09-12T00:51:35.926457+0000","last_fullsized":"2024-09-12T00:51:35.926457+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:53.703852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'1","reported_seq":32,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.910206+0000","last_change":"2024-09-12T00:28:17.062001+0000","last_active":"2024-09-12T00:50:10.910206+0000","last_peered":"2024-09-12T00:50:10.910206+0000","last_clean":"2024-09-12T00:50:10.910206+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:50:10.910206+0000","last_undegraded":"2024-09-12T00:50:10.910206+0000","last_fullsized":"2024-09-12T00:50:10.910206+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.953980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:49:59.910445+0000","last_change":"2024-09-12T00:28:14.043324+0000","last_active":"2024-09-12T00:49:59.910445+0000","last_peered":"2024-09-12T00:49:59.910445+0000","last_clean":"2024-09-12T00:49:59.910445+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:49:59.910445+0000","last_undegraded":"2024-09-12T00:49:59.910445+0000","last_fullsized":"2024-09-12T00:49:59.910445+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:29.585815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926176+0000","last_change":"2024-09-12T00:26:48.586853+0000","last_active":"2024-09-12T00:51:50.926176+0000","last_peered":"2024-09-12T00:51:50.926176+0000","last_clean":"2024-09-12T00:51:50.926176+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:51:50.926176+0000","last_undegraded":"2024-09-12T00:51:50.926176+0000","last_fullsized":"2024-09-12T00:51:50.926176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:56.028583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933422+0000","last_change":"2024-09-12T00:39:28.107499+0000","last_active":"2024-09-12T00:52:00.933422+0000","last_peered":"2024-09-12T00:52:00.933422+0000","last_clean":"2024-09-12T00:52:00.933422+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:52:00.933422+0000","last_undegraded":"2024-09-12T00:52:00.933422+0000","last_fullsized":"2024-09-12T00:52:00.933422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:42.987392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'4","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924539+0000","last_change":"2024-09-12T00:28:17.080528+0000","last_active":"2024-09-12T00:50:05.924539+0000","last_peered":"2024-09-12T00:50:05.924539+0000","last_clean":"2024-09-12T00:50:05.924539+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:50:05.924539+0000","last_undegraded":"2024-09-12T00:50:05.924539+0000","last_fullsized":"2024-09-12T00:50:05.924539+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:57.273734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4818812,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":651,"num_write":9,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'1","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924641+0000","last_change":"2024-09-12T00:28:14.045269+0000","last_active":"2024-09-12T00:50:05.924641+0000","last_peered":"2024-09-12T00:50:05.924641+0000","last_clean":"2024-09-12T00:50:05.924641+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:50:05.924641+0000","last_undegraded":"2024-09-12T00:50:05.924641+0000","last_fullsized":"2024-09-12T00:50:05.924641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:05.105429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":698,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.892906+0000","last_change":"2024-09-12T00:26:48.573856+0000","last_active":"2024-09-12T00:52:33.892906+0000","last_peered":"2024-09-12T00:52:33.892906+0000","last_clean":"2024-09-12T00:52:33.892906+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:52:33.892906+0000","last_undegraded":"2024-09-12T00:52:33.892906+0000","last_fullsized":"2024-09-12T00:52:33.892906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:49.201091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.128901+0000","last_change":"2024-09-12T00:39:28.140779+0000","last_active":"2024-09-12T00:52:01.128901+0000","last_peered":"2024-09-12T00:52:01.128901+0000","last_clean":"2024-09-12T00:52:01.128901+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:52:01.128901+0000","last_undegraded":"2024-09-12T00:52:01.128901+0000","last_fullsized":"2024-09-12T00:52:01.128901+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.223046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113042+0000","last_change":"2024-09-12T00:28:17.073306+0000","last_active":"2024-09-12T00:50:51.113042+0000","last_peered":"2024-09-12T00:50:51.113042+0000","last_clean":"2024-09-12T00:50:51.113042+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:50:51.113042+0000","last_undegraded":"2024-09-12T00:50:51.113042+0000","last_fullsized":"2024-09-12T00:50:51.113042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.616512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917468+0000","last_change":"2024-09-12T00:28:14.036590+0000","last_active":"2024-09-12T00:50:45.917468+0000","last_peered":"2024-09-12T00:50:45.917468+0000","last_clean":"2024-09-12T00:50:45.917468+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:50:45.917468+0000","last_undegraded":"2024-09-12T00:50:45.917468+0000","last_fullsized":"2024-09-12T00:50:45.917468+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.374471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.485163+0000","last_change":"2024-09-12T00:26:48.567960+0000","last_active":"2024-09-12T00:52:37.485163+0000","last_peered":"2024-09-12T00:52:37.485163+0000","last_clean":"2024-09-12T00:52:37.485163+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:52:37.485163+0000","last_undegraded":"2024-09-12T00:52:37.485163+0000","last_fullsized":"2024-09-12T00:52:37.485163+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.486007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934433+0000","last_change":"2024-09-12T00:39:28.125474+0000","last_active":"2024-09-12T00:52:00.934433+0000","last_peered":"2024-09-12T00:52:00.934433+0000","last_clean":"2024-09-12T00:52:00.934433+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:52:00.934433+0000","last_undegraded":"2024-09-12T00:52:00.934433+0000","last_fullsized":"2024-09-12T00:52:00.934433+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:45.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916437+0000","last_change":"2024-09-12T00:28:17.074749+0000","last_active":"2024-09-12T00:50:50.916437+0000","last_peered":"2024-09-12T00:50:50.916437+0000","last_clean":"2024-09-12T00:50:50.916437+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:50:50.916437+0000","last_undegraded":"2024-09-12T00:50:50.916437+0000","last_fullsized":"2024-09-12T00:50:50.916437+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:59.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.911641+0000","last_change":"2024-09-12T00:28:14.050432+0000","last_active":"2024-09-12T00:50:45.911641+0000","last_peered":"2024-09-12T00:50:45.911641+0000","last_clean":"2024-09-12T00:50:45.911641+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:50:45.911641+0000","last_undegraded":"2024-09-12T00:50:45.911641+0000","last_fullsized":"2024-09-12T00:50:45.911641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:50.652868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914915+0000","last_change":"2024-09-12T00:26:48.576457+0000","last_active":"2024-09-12T00:51:00.914915+0000","last_peered":"2024-09-12T00:51:00.914915+0000","last_clean":"2024-09-12T00:51:00.914915+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:51:00.914915+0000","last_undegraded":"2024-09-12T00:51:00.914915+0000","last_fullsized":"2024-09-12T00:51:00.914915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:50.385760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927145+0000","last_change":"2024-09-12T00:39:28.133363+0000","last_active":"2024-09-12T00:51:09.927145+0000","last_peered":"2024-09-12T00:51:09.927145+0000","last_clean":"2024-09-12T00:51:09.927145+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:51:09.927145+0000","last_undegraded":"2024-09-12T00:51:09.927145+0000","last_fullsized":"2024-09-12T00:51:09.927145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:45.885764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'8","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.906908+0000","last_change":"2024-09-12T00:28:17.078258+0000","last_active":"2024-09-12T00:50:05.906908+0000","last_peered":"2024-09-12T00:50:05.906908+0000","last_clean":"2024-09-12T00:50:05.906908+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:50:05.906908+0000","last_undegraded":"2024-09-12T00:50:05.906908+0000","last_fullsized":"2024-09-12T00:50:05.906908+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:26.373864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":12306,"num_write":8,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947884+0000","last_change":"2024-09-12T00:28:14.046080+0000","last_active":"2024-09-12T00:51:40.947884+0000","last_peered":"2024-09-12T00:51:40.947884+0000","last_clean":"2024-09-12T00:51:40.947884+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:51:40.947884+0000","last_undegraded":"2024-09-12T00:51:40.947884+0000","last_fullsized":"2024-09-12T00:51:40.947884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.783103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":201,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.951659+0000","last_change":"2024-09-12T00:26:48.572423+0000","last_active":"2024-09-12T00:51:36.951659+0000","last_peered":"2024-09-12T00:51:36.951659+0000","last_clean":"2024-09-12T00:51:36.951659+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:51:36.951659+0000","last_undegraded":"2024-09-12T00:51:36.951659+0000","last_fullsized":"2024-09-12T00:51:36.951659+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:03.523286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917174+0000","last_change":"2024-09-12T00:39:28.115704+0000","last_active":"2024-09-12T00:51:10.917174+0000","last_peered":"2024-09-12T00:51:10.917174+0000","last_clean":"2024-09-12T00:51:10.917174+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:51:10.917174+0000","last_undegraded":"2024-09-12T00:51:10.917174+0000","last_fullsized":"2024-09-12T00:51:10.917174+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.301433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:44.935398+0000","last_change":"2024-09-12T00:28:17.068407+0000","last_active":"2024-09-12T00:51:44.935398+0000","last_peered":"2024-09-12T00:51:44.935398+0000","last_clean":"2024-09-12T00:51:44.935398+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:51:44.935398+0000","last_undegraded":"2024-09-12T00:51:44.935398+0000","last_fullsized":"2024-09-12T00:51:44.935398+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:04.370003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:00.907982+0000","last_change":"2024-09-12T00:28:14.033635+0000","last_active":"2024-09-12T00:50:00.907982+0000","last_peered":"2024-09-12T00:50:00.907982+0000","last_clean":"2024-09-12T00:50:00.907982+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:50:00.907982+0000","last_undegraded":"2024-09-12T00:50:00.907982+0000","last_fullsized":"2024-09-12T00:50:00.907982+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:21.430932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.729092+0000","last_change":"2024-09-12T00:26:48.579143+0000","last_active":"2024-09-12T00:52:37.729092+0000","last_peered":"2024-09-12T00:52:37.729092+0000","last_clean":"2024-09-12T00:52:37.729092+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:52:37.729092+0000","last_undegraded":"2024-09-12T00:52:37.729092+0000","last_fullsized":"2024-09-12T00:52:37.729092+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:58.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.117359+0000","last_change":"2024-09-12T00:39:28.143755+0000","last_active":"2024-09-12T00:51:11.117359+0000","last_peered":"2024-09-12T00:51:11.117359+0000","last_clean":"2024-09-12T00:51:11.117359+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:51:11.117359+0000","last_undegraded":"2024-09-12T00:51:11.117359+0000","last_fullsized":"2024-09-12T00:51:11.117359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:42.065287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.907031+0000","last_change":"2024-09-12T00:28:17.072223+0000","last_active":"2024-09-12T00:50:05.907031+0000","last_peered":"2024-09-12T00:50:05.907031+0000","last_clean":"2024-09-12T00:50:05.907031+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:50:05.907031+0000","last_undegraded":"2024-09-12T00:50:05.907031+0000","last_fullsized":"2024-09-12T00:50:05.907031+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:56.304323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'3","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:00.905773+0000","last_change":"2024-09-12T00:28:14.051773+0000","last_active":"2024-09-12T00:50:00.905773+0000","last_peered":"2024-09-12T00:50:00.905773+0000","last_clean":"2024-09-12T00:50:00.905773+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:50:00.905773+0000","last_undegraded":"2024-09-12T00:50:00.905773+0000","last_fullsized":"2024-09-12T00:50:00.905773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:12.527606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.918732+0000","last_change":"2024-09-12T00:26:48.566905+0000","last_active":"2024-09-12T00:51:00.918732+0000","last_peered":"2024-09-12T00:51:00.918732+0000","last_clean":"2024-09-12T00:51:00.918732+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:51:00.918732+0000","last_undegraded":"2024-09-12T00:51:00.918732+0000","last_fullsized":"2024-09-12T00:51:00.918732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.878822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.923092+0000","last_change":"2024-09-12T00:39:28.130382+0000","last_active":"2024-09-12T00:51:10.923092+0000","last_peered":"2024-09-12T00:51:10.923092+0000","last_clean":"2024-09-12T00:51:10.923092+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:51:10.923092+0000","last_undegraded":"2024-09-12T00:51:10.923092+0000","last_fullsized":"2024-09-12T00:51:10.923092+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:27.073020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'3","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.909253+0000","last_change":"2024-09-12T00:28:17.073824+0000","last_active":"2024-09-12T00:50:05.909253+0000","last_peered":"2024-09-12T00:50:05.909253+0000","last_clean":"2024-09-12T00:50:05.909253+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:50:05.909253+0000","last_undegraded":"2024-09-12T00:50:05.909253+0000","last_fullsized":"2024-09-12T00:50:05.909253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.923969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:49:59.910715+0000","last_change":"2024-09-12T00:28:14.044796+0000","last_active":"2024-09-12T00:49:59.910715+0000","last_peered":"2024-09-12T00:49:59.910715+0000","last_clean":"2024-09-12T00:49:59.910715+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:49:59.910715+0000","last_undegraded":"2024-09-12T00:49:59.910715+0000","last_fullsized":"2024-09-12T00:49:59.910715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:13.669602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'113","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.539168+0000","last_change":"2024-09-12T00:26:48.578346+0000","last_active":"2024-09-12T00:52:38.539168+0000","last_peered":"2024-09-12T00:52:38.539168+0000","last_clean":"2024-09-12T00:52:38.539168+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:52:38.539168+0000","last_undegraded":"2024-09-12T00:52:38.539168+0000","last_fullsized":"2024-09-12T00:52:38.539168+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:52.917481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933259+0000","last_change":"2024-09-12T00:39:28.130268+0000","last_active":"2024-09-12T00:51:34.933259+0000","last_peered":"2024-09-12T00:51:34.933259+0000","last_clean":"2024-09-12T00:51:34.933259+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:51:34.933259+0000","last_undegraded":"2024-09-12T00:51:34.933259+0000","last_fullsized":"2024-09-12T00:51:34.933259+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:22.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'3","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934267+0000","last_change":"2024-09-12T00:28:17.046685+0000","last_active":"2024-09-12T00:51:39.934267+0000","last_peered":"2024-09-12T00:51:39.934267+0000","last_clean":"2024-09-12T00:51:39.934267+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:51:39.934267+0000","last_undegraded":"2024-09-12T00:51:39.934267+0000","last_fullsized":"2024-09-12T00:51:39.934267+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:31.104948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4468,"num_write":3,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104004+0000","last_change":"2024-09-12T00:28:14.032537+0000","last_active":"2024-09-12T00:51:36.104004+0000","last_peered":"2024-09-12T00:51:36.104004+0000","last_clean":"2024-09-12T00:51:36.104004+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:51:36.104004+0000","last_undegraded":"2024-09-12T00:51:36.104004+0000","last_fullsized":"2024-09-12T00:51:36.104004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.020093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'133","reported_seq":449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.925949+0000","last_change":"2024-09-12T00:26:48.579290+0000","last_active":"2024-09-12T00:50:10.925949+0000","last_peered":"2024-09-12T00:50:10.925949+0000","last_clean":"2024-09-12T00:50:10.925949+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:50:10.925949+0000","last_undegraded":"2024-09-12T00:50:10.925949+0000","last_fullsized":"2024-09-12T00:50:10.925949+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.084724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922871+0000","last_change":"2024-09-12T00:39:28.116214+0000","last_active":"2024-09-12T00:51:35.922871+0000","last_peered":"2024-09-12T00:51:35.922871+0000","last_clean":"2024-09-12T00:51:35.922871+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:51:35.922871+0000","last_undegraded":"2024-09-12T00:51:35.922871+0000","last_fullsized":"2024-09-12T00:51:35.922871+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.593460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934132+0000","last_change":"2024-09-12T00:28:17.059604+0000","last_active":"2024-09-12T00:51:39.934132+0000","last_peered":"2024-09-12T00:51:39.934132+0000","last_clean":"2024-09-12T00:51:39.934132+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:51:39.934132+0000","last_undegraded":"2024-09-12T00:51:39.934132+0000","last_fullsized":"2024-09-12T00:51:39.934132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:54.283922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933089+0000","last_change":"2024-09-12T00:28:14.043789+0000","last_active":"2024-09-12T00:51:34.933089+0000","last_peered":"2024-09-12T00:51:34.933089+0000","last_clean":"2024-09-12T00:51:34.933089+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:51:34.933089+0000","last_undegraded":"2024-09-12T00:51:34.933089+0000","last_fullsized":"2024-09-12T00:51:34.933089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.842950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.908002+0000","last_change":"2024-09-12T00:26:48.587469+0000","last_active":"2024-09-12T00:50:10.908002+0000","last_peered":"2024-09-12T00:50:10.908002+0000","last_clean":"2024-09-12T00:50:10.908002+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:50:10.908002+0000","last_undegraded":"2024-09-12T00:50:10.908002+0000","last_fullsized":"2024-09-12T00:50:10.908002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.099773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923180+0000","last_change":"2024-09-12T00:39:28.116113+0000","last_active":"2024-09-12T00:51:15.923180+0000","last_peered":"2024-09-12T00:51:15.923180+0000","last_clean":"2024-09-12T00:51:15.923180+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:51:15.923180+0000","last_undegraded":"2024-09-12T00:51:15.923180+0000","last_fullsized":"2024-09-12T00:51:15.923180+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'5","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927361+0000","last_change":"2024-09-12T00:28:17.077838+0000","last_active":"2024-09-12T00:51:40.927361+0000","last_peered":"2024-09-12T00:51:40.927361+0000","last_clean":"2024-09-12T00:51:40.927361+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:51:40.927361+0000","last_undegraded":"2024-09-12T00:51:40.927361+0000","last_fullsized":"2024-09-12T00:51:40.927361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.840518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104119+0000","last_change":"2024-09-12T00:28:14.041233+0000","last_active":"2024-09-12T00:51:36.104119+0000","last_peered":"2024-09-12T00:51:36.104119+0000","last_clean":"2024-09-12T00:51:36.104119+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:51:36.104119+0000","last_undegraded":"2024-09-12T00:51:36.104119+0000","last_fullsized":"2024-09-12T00:51:36.104119+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:48.566724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104059+0000","last_change":"2024-09-12T00:26:48.563874+0000","last_active":"2024-09-12T00:50:11.104059+0000","last_peered":"2024-09-12T00:50:11.104059+0000","last_clean":"2024-09-12T00:50:11.104059+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:50:11.104059+0000","last_undegraded":"2024-09-12T00:50:11.104059+0000","last_fullsized":"2024-09-12T00:50:11.104059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.613469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922823+0000","last_change":"2024-09-12T00:39:28.107803+0000","last_active":"2024-09-12T00:51:35.922823+0000","last_peered":"2024-09-12T00:51:35.922823+0000","last_clean":"2024-09-12T00:51:35.922823+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:51:35.922823+0000","last_undegraded":"2024-09-12T00:51:35.922823+0000","last_fullsized":"2024-09-12T00:51:35.922823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.925644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947791+0000","last_change":"2024-09-12T00:28:17.071725+0000","last_active":"2024-09-12T00:51:40.947791+0000","last_peered":"2024-09-12T00:51:40.947791+0000","last_clean":"2024-09-12T00:51:40.947791+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:51:40.947791+0000","last_undegraded":"2024-09-12T00:51:40.947791+0000","last_fullsized":"2024-09-12T00:51:40.947791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:28.212664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'8","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:56.131231+0000","last_change":"2024-09-12T00:28:14.033365+0000","last_active":"2024-09-12T00:53:56.131231+0000","last_peered":"2024-09-12T00:53:56.131231+0000","last_clean":"2024-09-12T00:53:56.131231+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:53:56.131231+0000","last_undegraded":"2024-09-12T00:53:56.131231+0000","last_fullsized":"2024-09-12T00:53:56.131231+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:07.863908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":21053,"num_write":13,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:37.957887+0000","last_change":"2024-09-12T00:26:48.584004+0000","last_active":"2024-09-12T00:51:37.957887+0000","last_peered":"2024-09-12T00:51:37.957887+0000","last_clean":"2024-09-12T00:51:37.957887+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:51:37.957887+0000","last_undegraded":"2024-09-12T00:51:37.957887+0000","last_fullsized":"2024-09-12T00:51:37.957887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:52.685965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:24.916370+0000","last_change":"2024-09-12T00:39:28.127905+0000","last_active":"2024-09-12T00:50:24.916370+0000","last_peered":"2024-09-12T00:50:24.916370+0000","last_clean":"2024-09-12T00:50:24.916370+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:50:24.916370+0000","last_undegraded":"2024-09-12T00:50:24.916370+0000","last_fullsized":"2024-09-12T00:50:24.916370+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:42.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916546+0000","last_change":"2024-09-12T00:28:17.075169+0000","last_active":"2024-09-12T00:50:50.916546+0000","last_peered":"2024-09-12T00:50:50.916546+0000","last_clean":"2024-09-12T00:50:50.916546+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:50:50.916546+0000","last_undegraded":"2024-09-12T00:50:50.916546+0000","last_fullsized":"2024-09-12T00:50:50.916546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:26.934607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111806+0000","last_change":"2024-09-12T00:28:14.015676+0000","last_active":"2024-09-12T00:50:46.111806+0000","last_peered":"2024-09-12T00:50:46.111806+0000","last_clean":"2024-09-12T00:50:46.111806+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:50:46.111806+0000","last_undegraded":"2024-09-12T00:50:46.111806+0000","last_fullsized":"2024-09-12T00:50:46.111806+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:53.120779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927494+0000","last_change":"2024-09-12T00:26:48.573048+0000","last_active":"2024-09-12T00:51:40.927494+0000","last_peered":"2024-09-12T00:51:40.927494+0000","last_clean":"2024-09-12T00:51:40.927494+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:51:40.927494+0000","last_undegraded":"2024-09-12T00:51:40.927494+0000","last_fullsized":"2024-09-12T00:51:40.927494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.722904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.091062+0000","last_change":"2024-09-12T00:39:28.121616+0000","last_active":"2024-09-12T00:50:46.091062+0000","last_peered":"2024-09-12T00:50:46.091062+0000","last_clean":"2024-09-12T00:50:46.091062+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:50:46.091062+0000","last_undegraded":"2024-09-12T00:50:46.091062+0000","last_fullsized":"2024-09-12T00:50:46.091062+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:15.863877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916508+0000","last_change":"2024-09-12T00:28:17.074710+0000","last_active":"2024-09-12T00:50:50.916508+0000","last_peered":"2024-09-12T00:50:50.916508+0000","last_clean":"2024-09-12T00:50:50.916508+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:50:50.916508+0000","last_undegraded":"2024-09-12T00:50:50.916508+0000","last_fullsized":"2024-09-12T00:50:50.916508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:00.241439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'10","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.911762+0000","last_change":"2024-09-12T00:28:14.040584+0000","last_active":"2024-09-12T00:50:45.911762+0000","last_peered":"2024-09-12T00:50:45.911762+0000","last_clean":"2024-09-12T00:50:45.911762+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:50:45.911762+0000","last_undegraded":"2024-09-12T00:50:45.911762+0000","last_fullsized":"2024-09-12T00:50:45.911762+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:08.411307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":15,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.946780+0000","last_change":"2024-09-12T00:26:48.585190+0000","last_active":"2024-09-12T00:51:35.946780+0000","last_peered":"2024-09-12T00:51:35.946780+0000","last_clean":"2024-09-12T00:51:35.946780+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:51:35.946780+0000","last_undegraded":"2024-09-12T00:51:35.946780+0000","last_fullsized":"2024-09-12T00:51:35.946780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:29.090617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.928152+0000","last_change":"2024-09-12T00:39:28.136382+0000","last_active":"2024-09-12T00:50:20.928152+0000","last_peered":"2024-09-12T00:50:20.928152+0000","last_clean":"2024-09-12T00:50:20.928152+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:50:20.928152+0000","last_undegraded":"2024-09-12T00:50:20.928152+0000","last_fullsized":"2024-09-12T00:50:20.928152+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.917696+0000","last_change":"2024-09-12T00:28:17.077942+0000","last_active":"2024-09-12T00:50:55.917696+0000","last_peered":"2024-09-12T00:50:55.917696+0000","last_clean":"2024-09-12T00:50:55.917696+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:50:55.917696+0000","last_undegraded":"2024-09-12T00:50:55.917696+0000","last_fullsized":"2024-09-12T00:50:55.917696+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:31.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'4","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915561+0000","last_change":"2024-09-12T00:28:14.053908+0000","last_active":"2024-09-12T00:50:45.915561+0000","last_peered":"2024-09-12T00:50:45.915561+0000","last_clean":"2024-09-12T00:50:45.915561+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:50:45.915561+0000","last_undegraded":"2024-09-12T00:50:45.915561+0000","last_fullsized":"2024-09-12T00:50:45.915561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:56.421414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104215+0000","last_change":"2024-09-12T00:26:48.567108+0000","last_active":"2024-09-12T00:51:36.104215+0000","last_peered":"2024-09-12T00:51:36.104215+0000","last_clean":"2024-09-12T00:51:36.104215+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:51:36.104215+0000","last_undegraded":"2024-09-12T00:51:36.104215+0000","last_fullsized":"2024-09-12T00:51:36.104215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:04.721131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:21.085319+0000","last_change":"2024-09-12T00:39:28.116516+0000","last_active":"2024-09-12T00:50:21.085319+0000","last_peered":"2024-09-12T00:50:21.085319+0000","last_clean":"2024-09-12T00:50:21.085319+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:50:21.085319+0000","last_undegraded":"2024-09-12T00:50:21.085319+0000","last_fullsized":"2024-09-12T00:50:21.085319+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:59.615039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:49.922385+0000","last_change":"2024-09-12T00:28:17.060880+0000","last_active":"2024-09-12T00:50:49.922385+0000","last_peered":"2024-09-12T00:50:49.922385+0000","last_clean":"2024-09-12T00:50:49.922385+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:50:49.922385+0000","last_undegraded":"2024-09-12T00:50:49.922385+0000","last_fullsized":"2024-09-12T00:50:49.922385+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:02.004120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'5","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916667+0000","last_change":"2024-09-12T00:28:14.053133+0000","last_active":"2024-09-12T00:50:50.916667+0000","last_peered":"2024-09-12T00:50:50.916667+0000","last_clean":"2024-09-12T00:50:50.916667+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:50:50.916667+0000","last_undegraded":"2024-09-12T00:50:50.916667+0000","last_fullsized":"2024-09-12T00:50:50.916667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:48.456675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922780+0000","last_change":"2024-09-12T00:26:48.590043+0000","last_active":"2024-09-12T00:51:35.922780+0000","last_peered":"2024-09-12T00:51:35.922780+0000","last_clean":"2024-09-12T00:51:35.922780+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:51:35.922780+0000","last_undegraded":"2024-09-12T00:51:35.922780+0000","last_fullsized":"2024-09-12T00:51:35.922780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.146720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921176+0000","last_change":"2024-09-12T00:39:28.133468+0000","last_active":"2024-09-12T00:50:44.921176+0000","last_peered":"2024-09-12T00:50:44.921176+0000","last_clean":"2024-09-12T00:50:44.921176+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:50:44.921176+0000","last_undegraded":"2024-09-12T00:50:44.921176+0000","last_fullsized":"2024-09-12T00:50:44.921176+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.124886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'1","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955663+0000","last_change":"2024-09-12T00:28:17.078262+0000","last_active":"2024-09-12T00:52:10.955663+0000","last_peered":"2024-09-12T00:52:10.955663+0000","last_clean":"2024-09-12T00:52:10.955663+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:52:10.955663+0000","last_undegraded":"2024-09-12T00:52:10.955663+0000","last_fullsized":"2024-09-12T00:52:10.955663+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:56.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932572+0000","last_change":"2024-09-12T00:28:14.039832+0000","last_active":"2024-09-12T00:52:05.932572+0000","last_peered":"2024-09-12T00:52:05.932572+0000","last_clean":"2024-09-12T00:52:05.932572+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:52:05.932572+0000","last_undegraded":"2024-09-12T00:52:05.932572+0000","last_fullsized":"2024-09-12T00:52:05.932572+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.914782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922721+0000","last_change":"2024-09-12T00:26:48.586236+0000","last_active":"2024-09-12T00:51:35.922721+0000","last_peered":"2024-09-12T00:51:35.922721+0000","last_clean":"2024-09-12T00:51:35.922721+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:51:35.922721+0000","last_undegraded":"2024-09-12T00:51:35.922721+0000","last_fullsized":"2024-09-12T00:51:35.922721+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:36.773801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113170+0000","last_change":"2024-09-12T00:39:28.126995+0000","last_active":"2024-09-12T00:50:51.113170+0000","last_peered":"2024-09-12T00:50:51.113170+0000","last_clean":"2024-09-12T00:50:51.113170+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:50:51.113170+0000","last_undegraded":"2024-09-12T00:50:51.113170+0000","last_fullsized":"2024-09-12T00:50:51.113170+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.631391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:21.158401+0000","last_change":"2024-09-12T00:28:17.067864+0000","last_active":"2024-09-12T00:54:21.158401+0000","last_peered":"2024-09-12T00:54:21.158401+0000","last_clean":"2024-09-12T00:54:21.158401+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:54:21.158401+0000","last_undegraded":"2024-09-12T00:54:21.158401+0000","last_fullsized":"2024-09-12T00:54:21.158401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.110223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'3","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:04.940068+0000","last_change":"2024-09-12T00:28:14.042940+0000","last_active":"2024-09-12T00:52:04.940068+0000","last_peered":"2024-09-12T00:52:04.940068+0000","last_clean":"2024-09-12T00:52:04.940068+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:52:04.940068+0000","last_undegraded":"2024-09-12T00:52:04.940068+0000","last_fullsized":"2024-09-12T00:52:04.940068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:51.011440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111675+0000","last_change":"2024-09-12T00:26:48.568729+0000","last_active":"2024-09-12T00:50:46.111675+0000","last_peered":"2024-09-12T00:50:46.111675+0000","last_clean":"2024-09-12T00:50:46.111675+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:50:46.111675+0000","last_undegraded":"2024-09-12T00:50:46.111675+0000","last_fullsized":"2024-09-12T00:50:46.111675+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:40.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917549+0000","last_change":"2024-09-12T00:39:28.130189+0000","last_active":"2024-09-12T00:50:45.917549+0000","last_peered":"2024-09-12T00:50:45.917549+0000","last_clean":"2024-09-12T00:50:45.917549+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:50:45.917549+0000","last_undegraded":"2024-09-12T00:50:45.917549+0000","last_fullsized":"2024-09-12T00:50:45.917549+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.938677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912817+0000","last_change":"2024-09-12T00:28:17.080617+0000","last_active":"2024-09-12T00:50:50.912817+0000","last_peered":"2024-09-12T00:50:50.912817+0000","last_clean":"2024-09-12T00:50:50.912817+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:50:50.912817+0000","last_undegraded":"2024-09-12T00:50:50.912817+0000","last_fullsized":"2024-09-12T00:50:50.912817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.933670+0000","last_change":"2024-09-12T00:28:14.047276+0000","last_active":"2024-09-12T00:52:10.933670+0000","last_peered":"2024-09-12T00:52:10.933670+0000","last_clean":"2024-09-12T00:52:10.933670+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:52:10.933670+0000","last_undegraded":"2024-09-12T00:52:10.933670+0000","last_fullsized":"2024-09-12T00:52:10.933670+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:28.302616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:39.919900+0000","last_change":"2024-09-12T00:26:48.570384+0000","last_active":"2024-09-12T00:50:39.919900+0000","last_peered":"2024-09-12T00:50:39.919900+0000","last_clean":"2024-09-12T00:50:39.919900+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:50:39.919900+0000","last_undegraded":"2024-09-12T00:50:39.919900+0000","last_fullsized":"2024-09-12T00:50:39.919900+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.851801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915515+0000","last_change":"2024-09-12T00:39:28.139264+0000","last_active":"2024-09-12T00:50:45.915515+0000","last_peered":"2024-09-12T00:50:45.915515+0000","last_clean":"2024-09-12T00:50:45.915515+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:50:45.915515+0000","last_undegraded":"2024-09-12T00:50:45.915515+0000","last_fullsized":"2024-09-12T00:50:45.915515+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:33.394535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'2","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:15.937612+0000","last_change":"2024-09-12T00:28:17.064501+0000","last_active":"2024-09-12T00:52:15.937612+0000","last_peered":"2024-09-12T00:52:15.937612+0000","last_clean":"2024-09-12T00:52:15.937612+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:52:15.937612+0000","last_undegraded":"2024-09-12T00:52:15.937612+0000","last_fullsized":"2024-09-12T00:52:15.937612+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:53.028265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934413+0000","last_change":"2024-09-12T00:28:14.045720+0000","last_active":"2024-09-12T00:50:45.934413+0000","last_peered":"2024-09-12T00:50:45.934413+0000","last_clean":"2024-09-12T00:50:45.934413+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:50:45.934413+0000","last_undegraded":"2024-09-12T00:50:45.934413+0000","last_fullsized":"2024-09-12T00:50:45.934413+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.935181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.916225+0000","last_change":"2024-09-12T00:26:48.572885+0000","last_active":"2024-09-12T00:50:40.916225+0000","last_peered":"2024-09-12T00:50:40.916225+0000","last_clean":"2024-09-12T00:50:40.916225+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:50:40.916225+0000","last_undegraded":"2024-09-12T00:50:40.916225+0000","last_fullsized":"2024-09-12T00:50:40.916225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:04.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934275+0000","last_change":"2024-09-12T00:39:28.125866+0000","last_active":"2024-09-12T00:52:00.934275+0000","last_peered":"2024-09-12T00:52:00.934275+0000","last_clean":"2024-09-12T00:52:00.934275+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:52:00.934275+0000","last_undegraded":"2024-09-12T00:52:00.934275+0000","last_fullsized":"2024-09-12T00:52:00.934275+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.504703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:19.929554+0000","last_change":"2024-09-12T00:28:17.054632+0000","last_active":"2024-09-12T00:51:19.929554+0000","last_peered":"2024-09-12T00:51:19.929554+0000","last_clean":"2024-09-12T00:51:19.929554+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:51:19.929554+0000","last_undegraded":"2024-09-12T00:51:19.929554+0000","last_fullsized":"2024-09-12T00:51:19.929554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:40.665178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'6","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940366+0000","last_change":"2024-09-12T00:28:14.035922+0000","last_active":"2024-09-12T00:51:10.940366+0000","last_peered":"2024-09-12T00:51:10.940366+0000","last_clean":"2024-09-12T00:51:10.940366+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:51:10.940366+0000","last_undegraded":"2024-09-12T00:51:10.940366+0000","last_fullsized":"2024-09-12T00:51:10.940366+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:49.298722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.959193+0000","last_change":"2024-09-12T00:26:48.586797+0000","last_active":"2024-09-12T00:51:16.959193+0000","last_peered":"2024-09-12T00:51:16.959193+0000","last_clean":"2024-09-12T00:51:16.959193+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:51:16.959193+0000","last_undegraded":"2024-09-12T00:51:16.959193+0000","last_fullsized":"2024-09-12T00:51:16.959193+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.109038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934301+0000","last_change":"2024-09-12T00:39:28.120562+0000","last_active":"2024-09-12T00:52:00.934301+0000","last_peered":"2024-09-12T00:52:00.934301+0000","last_clean":"2024-09-12T00:52:00.934301+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:52:00.934301+0000","last_undegraded":"2024-09-12T00:52:00.934301+0000","last_fullsized":"2024-09-12T00:52:00.934301+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.131360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928367+0000","last_change":"2024-09-12T00:28:17.068535+0000","last_active":"2024-09-12T00:51:14.928367+0000","last_peered":"2024-09-12T00:51:14.928367+0000","last_clean":"2024-09-12T00:51:14.928367+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:51:14.928367+0000","last_undegraded":"2024-09-12T00:51:14.928367+0000","last_fullsized":"2024-09-12T00:51:14.928367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.915337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923221+0000","last_change":"2024-09-12T00:28:14.046616+0000","last_active":"2024-09-12T00:51:15.923221+0000","last_peered":"2024-09-12T00:51:15.923221+0000","last_clean":"2024-09-12T00:51:15.923221+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:51:15.923221+0000","last_undegraded":"2024-09-12T00:51:15.923221+0000","last_fullsized":"2024-09-12T00:51:15.923221+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.933281+0000","last_change":"2024-09-12T00:26:48.580888+0000","last_active":"2024-09-12T00:50:40.933281+0000","last_peered":"2024-09-12T00:50:40.933281+0000","last_clean":"2024-09-12T00:50:40.933281+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:50:40.933281+0000","last_undegraded":"2024-09-12T00:50:40.933281+0000","last_fullsized":"2024-09-12T00:50:40.933281+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:20.695674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.932994+0000","last_change":"2024-09-12T00:39:28.111443+0000","last_active":"2024-09-12T00:51:34.932994+0000","last_peered":"2024-09-12T00:51:34.932994+0000","last_clean":"2024-09-12T00:51:34.932994+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:51:34.932994+0000","last_undegraded":"2024-09-12T00:51:34.932994+0000","last_fullsized":"2024-09-12T00:51:34.932994+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:45.919919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'9","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.936631+0000","last_change":"2024-09-12T00:28:17.064371+0000","last_active":"2024-09-12T00:52:10.936631+0000","last_peered":"2024-09-12T00:52:10.936631+0000","last_clean":"2024-09-12T00:52:10.936631+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:52:10.936631+0000","last_undegraded":"2024-09-12T00:52:10.936631+0000","last_fullsized":"2024-09-12T00:52:10.936631+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:33.177694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":28674,"num_write":19,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:06.130194+0000","last_change":"2024-09-12T00:28:14.038263+0000","last_active":"2024-09-12T00:52:06.130194+0000","last_peered":"2024-09-12T00:52:06.130194+0000","last_clean":"2024-09-12T00:52:06.130194+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:52:06.130194+0000","last_undegraded":"2024-09-12T00:52:06.130194+0000","last_fullsized":"2024-09-12T00:52:06.130194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:11.087385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.931038+0000","last_change":"2024-09-12T00:26:48.578925+0000","last_active":"2024-09-12T00:51:56.931038+0000","last_peered":"2024-09-12T00:51:56.931038+0000","last_clean":"2024-09-12T00:51:56.931038+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:51:56.931038+0000","last_undegraded":"2024-09-12T00:51:56.931038+0000","last_fullsized":"2024-09-12T00:51:56.931038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:28.812698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.952894+0000","last_change":"2024-09-12T00:39:28.134519+0000","last_active":"2024-09-12T00:52:00.952894+0000","last_peered":"2024-09-12T00:52:00.952894+0000","last_clean":"2024-09-12T00:52:00.952894+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:52:00.952894+0000","last_undegraded":"2024-09-12T00:52:00.952894+0000","last_fullsized":"2024-09-12T00:52:00.952894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.950649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955943+0000","last_change":"2024-09-12T00:28:17.073665+0000","last_active":"2024-09-12T00:52:10.955943+0000","last_peered":"2024-09-12T00:52:10.955943+0000","last_clean":"2024-09-12T00:52:10.955943+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:52:10.955943+0000","last_undegraded":"2024-09-12T00:52:10.955943+0000","last_fullsized":"2024-09-12T00:52:10.955943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.110456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954576+0000","last_change":"2024-09-12T00:28:14.044717+0000","last_active":"2024-09-12T00:52:05.954576+0000","last_peered":"2024-09-12T00:52:05.954576+0000","last_clean":"2024-09-12T00:52:05.954576+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:52:05.954576+0000","last_undegraded":"2024-09-12T00:52:05.954576+0000","last_fullsized":"2024-09-12T00:52:05.954576+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:17.236547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.929500+0000","last_change":"2024-09-12T00:26:48.578631+0000","last_active":"2024-09-12T00:51:50.929500+0000","last_peered":"2024-09-12T00:51:50.929500+0000","last_clean":"2024-09-12T00:51:50.929500+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:51:50.929500+0000","last_undegraded":"2024-09-12T00:51:50.929500+0000","last_fullsized":"2024-09-12T00:51:50.929500+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.001351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910185+0000","last_change":"2024-09-12T00:39:28.145050+0000","last_active":"2024-09-12T00:50:20.910185+0000","last_peered":"2024-09-12T00:50:20.910185+0000","last_clean":"2024-09-12T00:50:20.910185+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:50:20.910185+0000","last_undegraded":"2024-09-12T00:50:20.910185+0000","last_fullsized":"2024-09-12T00:50:20.910185+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:20.809036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923080+0000","last_change":"2024-09-12T00:28:17.061641+0000","last_active":"2024-09-12T00:51:15.923080+0000","last_peered":"2024-09-12T00:51:15.923080+0000","last_clean":"2024-09-12T00:51:15.923080+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:51:15.923080+0000","last_undegraded":"2024-09-12T00:51:15.923080+0000","last_fullsized":"2024-09-12T00:51:15.923080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:36.317632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:21.133487+0000","last_change":"2024-09-12T00:28:14.038655+0000","last_active":"2024-09-12T00:52:21.133487+0000","last_peered":"2024-09-12T00:52:21.133487+0000","last_clean":"2024-09-12T00:52:21.133487+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:52:21.133487+0000","last_undegraded":"2024-09-12T00:52:21.133487+0000","last_fullsized":"2024-09-12T00:52:21.133487+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:19.550915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126487+0000","last_change":"2024-09-12T00:26:48.570084+0000","last_active":"2024-09-12T00:51:51.126487+0000","last_peered":"2024-09-12T00:51:51.126487+0000","last_clean":"2024-09-12T00:51:51.126487+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:51:51.126487+0000","last_undegraded":"2024-09-12T00:51:51.126487+0000","last_fullsized":"2024-09-12T00:51:51.126487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.533768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910538+0000","last_change":"2024-09-12T00:39:28.134280+0000","last_active":"2024-09-12T00:50:20.910538+0000","last_peered":"2024-09-12T00:50:20.910538+0000","last_clean":"2024-09-12T00:50:20.910538+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:50:20.910538+0000","last_undegraded":"2024-09-12T00:50:20.910538+0000","last_fullsized":"2024-09-12T00:50:20.910538+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.467826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'6","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:25.959578+0000","last_change":"2024-09-12T00:28:17.078304+0000","last_active":"2024-09-12T00:52:25.959578+0000","last_peered":"2024-09-12T00:52:25.959578+0000","last_clean":"2024-09-12T00:52:25.959578+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:52:25.959578+0000","last_undegraded":"2024-09-12T00:52:25.959578+0000","last_fullsized":"2024-09-12T00:52:25.959578+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.775329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'3","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940141+0000","last_change":"2024-09-12T00:28:14.051795+0000","last_active":"2024-09-12T00:51:10.940141+0000","last_peered":"2024-09-12T00:51:10.940141+0000","last_clean":"2024-09-12T00:51:10.940141+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:51:10.940141+0000","last_undegraded":"2024-09-12T00:51:10.940141+0000","last_fullsized":"2024-09-12T00:51:10.940141+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950431+0000","last_change":"2024-09-12T00:26:48.572457+0000","last_active":"2024-09-12T00:51:50.950431+0000","last_peered":"2024-09-12T00:51:50.950431+0000","last_clean":"2024-09-12T00:51:50.950431+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:51:50.950431+0000","last_undegraded":"2024-09-12T00:51:50.950431+0000","last_fullsized":"2024-09-12T00:51:50.950431+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:54.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.938985+0000","last_change":"2024-09-12T00:39:28.125155+0000","last_active":"2024-09-12T00:51:59.938985+0000","last_peered":"2024-09-12T00:51:59.938985+0000","last_clean":"2024-09-12T00:51:59.938985+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:51:59.938985+0000","last_undegraded":"2024-09-12T00:51:59.938985+0000","last_fullsized":"2024-09-12T00:51:59.938985+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:43.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'1","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.118652+0000","last_change":"2024-09-12T00:28:17.074251+0000","last_active":"2024-09-12T00:51:16.118652+0000","last_peered":"2024-09-12T00:51:16.118652+0000","last_clean":"2024-09-12T00:51:16.118652+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:51:16.118652+0000","last_undegraded":"2024-09-12T00:51:16.118652+0000","last_fullsized":"2024-09-12T00:51:16.118652+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:25.385818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'18","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917089+0000","last_change":"2024-09-12T00:28:14.035208+0000","last_active":"2024-09-12T00:51:10.917089+0000","last_peered":"2024-09-12T00:51:10.917089+0000","last_clean":"2024-09-12T00:51:10.917089+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:51:10.917089+0000","last_undegraded":"2024-09-12T00:51:10.917089+0000","last_fullsized":"2024-09-12T00:51:10.917089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.116394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30726,"num_write":23,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950319+0000","last_change":"2024-09-12T00:26:48.568293+0000","last_active":"2024-09-12T00:51:50.950319+0000","last_peered":"2024-09-12T00:51:50.950319+0000","last_clean":"2024-09-12T00:51:50.950319+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:51:50.950319+0000","last_undegraded":"2024-09-12T00:51:50.950319+0000","last_fullsized":"2024-09-12T00:51:50.950319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:56.992825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954372+0000","last_change":"2024-09-12T00:39:28.135750+0000","last_active":"2024-09-12T00:52:05.954372+0000","last_peered":"2024-09-12T00:52:05.954372+0000","last_clean":"2024-09-12T00:52:05.954372+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:52:05.954372+0000","last_undegraded":"2024-09-12T00:52:05.954372+0000","last_fullsized":"2024-09-12T00:52:05.954372+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.659110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'3","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.118588+0000","last_change":"2024-09-12T00:28:17.067509+0000","last_active":"2024-09-12T00:51:16.118588+0000","last_peered":"2024-09-12T00:51:16.118588+0000","last_clean":"2024-09-12T00:51:16.118588+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:51:16.118588+0000","last_undegraded":"2024-09-12T00:51:16.118588+0000","last_fullsized":"2024-09-12T00:51:16.118588+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:22.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'4","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096562+0000","last_change":"2024-09-12T00:28:14.047213+0000","last_active":"2024-09-12T00:51:11.096562+0000","last_peered":"2024-09-12T00:51:11.096562+0000","last_clean":"2024-09-12T00:51:11.096562+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:51:11.096562+0000","last_undegraded":"2024-09-12T00:51:11.096562+0000","last_fullsized":"2024-09-12T00:51:11.096562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:39.487908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":9,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:56.114009+0000","last_change":"2024-09-12T00:26:48.572978+0000","last_active":"2024-09-12T00:50:56.114009+0000","last_peered":"2024-09-12T00:50:56.114009+0000","last_clean":"2024-09-12T00:50:56.114009+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:50:56.114009+0000","last_undegraded":"2024-09-12T00:50:56.114009+0000","last_fullsized":"2024-09-12T00:50:56.114009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'258","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.538178+0000","last_change":"2024-09-12T00:11:45.934895+0000","last_active":"2024-09-12T00:51:51.538178+0000","last_peered":"2024-09-12T00:51:51.538178+0000","last_clean":"2024-09-12T00:51:51.538178+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:51:51.538178+0000","last_undegraded":"2024-09-12T00:51:51.538178+0000","last_fullsized":"2024-09-12T00:51:51.538178+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:30.942936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4225013,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":615,"num_read_kb":2922,"num_write":1051,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1205","reported_seq":2896,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.210228+0000","last_change":"2024-09-12T00:11:47.923845+0000","last_active":"2024-09-12T00:54:17.210228+0000","last_peered":"2024-09-12T00:54:17.210228+0000","last_clean":"2024-09-12T00:54:17.210228+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:17.210228+0000","last_undegraded":"2024-09-12T00:54:17.210228+0000","last_fullsized":"2024-09-12T00:54:17.210228+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:37.116342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'222","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.218128+0000","last_change":"2024-09-12T00:11:45.957898+0000","last_active":"2024-09-12T00:52:57.218128+0000","last_peered":"2024-09-12T00:52:57.218128+0000","last_clean":"2024-09-12T00:52:57.218128+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:52:57.218128+0000","last_undegraded":"2024-09-12T00:52:57.218128+0000","last_fullsized":"2024-09-12T00:52:57.218128+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:15.924735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446871,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":450,"num_read_kb":8607,"num_write":1037,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'455","reported_seq":2037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.541162+0000","last_change":"2024-09-12T00:11:47.930458+0000","last_active":"2024-09-12T00:52:57.541162+0000","last_peered":"2024-09-12T00:52:57.541162+0000","last_clean":"2024-09-12T00:52:57.541162+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:52:57.541162+0000","last_undegraded":"2024-09-12T00:52:57.541162+0000","last_fullsized":"2024-09-12T00:52:57.541162+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.070919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'195","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.508381+0000","last_change":"2024-09-12T00:11:45.962948+0000","last_active":"2024-09-12T00:52:32.508381+0000","last_peered":"2024-09-12T00:52:32.508381+0000","last_clean":"2024-09-12T00:52:32.508381+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:52:32.508381+0000","last_undegraded":"2024-09-12T00:52:32.508381+0000","last_fullsized":"2024-09-12T00:52:32.508381+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.772276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":9697,"num_write":932,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'469","reported_seq":2018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.750311+0000","last_change":"2024-09-12T00:11:47.929458+0000","last_active":"2024-09-12T00:53:13.750311+0000","last_peered":"2024-09-12T00:53:13.750311+0000","last_clean":"2024-09-12T00:53:13.750311+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:53:13.750311+0000","last_undegraded":"2024-09-12T00:53:13.750311+0000","last_fullsized":"2024-09-12T00:53:13.750311+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:37.545862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'170","reported_seq":792,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.732405+0000","last_change":"2024-09-12T00:11:45.918049+0000","last_active":"2024-09-12T00:52:00.732405+0000","last_peered":"2024-09-12T00:52:00.732405+0000","last_clean":"2024-09-12T00:52:00.732405+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:52:00.732405+0000","last_undegraded":"2024-09-12T00:52:00.732405+0000","last_fullsized":"2024-09-12T00:52:00.732405+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:52.132957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5820542,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":16186,"num_write":897,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'822","reported_seq":2408,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.959350+0000","last_change":"2024-09-12T00:11:47.934714+0000","last_active":"2024-09-12T00:52:56.959350+0000","last_peered":"2024-09-12T00:52:56.959350+0000","last_clean":"2024-09-12T00:52:56.959350+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:52:56.959350+0000","last_undegraded":"2024-09-12T00:52:56.959350+0000","last_fullsized":"2024-09-12T00:52:56.959350+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'188","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.366493+0000","last_change":"2024-09-12T00:11:45.949664+0000","last_active":"2024-09-12T00:52:49.366493+0000","last_peered":"2024-09-12T00:52:49.366493+0000","last_clean":"2024-09-12T00:52:49.366493+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:52:49.366493+0000","last_undegraded":"2024-09-12T00:52:49.366493+0000","last_fullsized":"2024-09-12T00:52:49.366493+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:02.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1645466,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":16314,"num_write":908,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'799","reported_seq":2283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.596547+0000","last_change":"2024-09-12T00:11:47.930048+0000","last_active":"2024-09-12T00:52:55.596547+0000","last_peered":"2024-09-12T00:52:55.596547+0000","last_clean":"2024-09-12T00:52:55.596547+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:52:55.596547+0000","last_undegraded":"2024-09-12T00:52:55.596547+0000","last_fullsized":"2024-09-12T00:52:55.596547+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.783185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'174","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.157353+0000","last_change":"2024-09-12T00:11:45.916383+0000","last_active":"2024-09-12T00:54:16.157353+0000","last_peered":"2024-09-12T00:54:16.157353+0000","last_clean":"2024-09-12T00:54:16.157353+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:16.157353+0000","last_undegraded":"2024-09-12T00:54:16.157353+0000","last_fullsized":"2024-09-12T00:54:16.157353+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.552714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4239606,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":30215,"num_write":843,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'391","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.368436+0000","last_change":"2024-09-12T00:11:47.942397+0000","last_active":"2024-09-12T00:53:14.368436+0000","last_peered":"2024-09-12T00:53:14.368436+0000","last_clean":"2024-09-12T00:53:14.368436+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:53:14.368436+0000","last_undegraded":"2024-09-12T00:53:14.368436+0000","last_fullsized":"2024-09-12T00:53:14.368436+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:36.328976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'223","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.416294+0000","last_change":"2024-09-12T00:11:45.935583+0000","last_active":"2024-09-12T00:53:11.416294+0000","last_peered":"2024-09-12T00:53:11.416294+0000","last_clean":"2024-09-12T00:53:11.416294+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:53:11.416294+0000","last_undegraded":"2024-09-12T00:53:11.416294+0000","last_fullsized":"2024-09-12T00:53:11.416294+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.329848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10185441,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":409,"num_read_kb":17813,"num_write":1026,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'990","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.505994+0000","last_change":"2024-09-12T00:11:47.923621+0000","last_active":"2024-09-12T00:53:10.505994+0000","last_peered":"2024-09-12T00:53:10.505994+0000","last_clean":"2024-09-12T00:53:10.505994+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:53:10.505994+0000","last_undegraded":"2024-09-12T00:53:10.505994+0000","last_fullsized":"2024-09-12T00:53:10.505994+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":900,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:15.959935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'178","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.174408+0000","last_change":"2024-09-12T00:12:19.246741+0000","last_active":"2024-09-12T00:52:38.174408+0000","last_peered":"2024-09-12T00:52:38.174408+0000","last_clean":"2024-09-12T00:52:38.174408+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:52:38.174408+0000","last_undegraded":"2024-09-12T00:52:38.174408+0000","last_fullsized":"2024-09-12T00:52:38.174408+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.798814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8656926,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":20841,"num_write":797,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2401,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749106+0000","last_change":"2024-09-12T00:11:47.945525+0000","last_active":"2024-09-12T00:53:13.749106+0000","last_peered":"2024-09-12T00:53:13.749106+0000","last_clean":"2024-09-12T00:53:13.749106+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:53:13.749106+0000","last_undegraded":"2024-09-12T00:53:13.749106+0000","last_fullsized":"2024-09-12T00:53:13.749106+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:16.688767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'810","reported_seq":2356,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.198693+0000","last_change":"2024-09-12T00:11:47.933883+0000","last_active":"2024-09-12T00:54:17.198693+0000","last_peered":"2024-09-12T00:54:17.198693+0000","last_clean":"2024-09-12T00:54:17.198693+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:17.198693+0000","last_undegraded":"2024-09-12T00:54:17.198693+0000","last_fullsized":"2024-09-12T00:54:17.198693+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.403220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'274","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.850453+0000","last_change":"2024-09-12T00:11:45.960039+0000","last_active":"2024-09-12T00:52:55.850453+0000","last_peered":"2024-09-12T00:52:55.850453+0000","last_clean":"2024-09-12T00:52:55.850453+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:52:55.850453+0000","last_undegraded":"2024-09-12T00:52:55.850453+0000","last_fullsized":"2024-09-12T00:52:55.850453+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:20.482316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2536787,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":924,"num_read_kb":25081,"num_write":1223,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2586,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199630+0000","last_change":"2024-09-12T00:11:47.935606+0000","last_active":"2024-09-12T00:54:17.199630+0000","last_peered":"2024-09-12T00:54:17.199630+0000","last_clean":"2024-09-12T00:54:17.199630+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:17.199630+0000","last_undegraded":"2024-09-12T00:54:17.199630+0000","last_fullsized":"2024-09-12T00:54:17.199630+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:09.287342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'181","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.336408+0000","last_change":"2024-09-12T00:11:45.920735+0000","last_active":"2024-09-12T00:54:16.336408+0000","last_peered":"2024-09-12T00:54:16.336408+0000","last_clean":"2024-09-12T00:54:16.336408+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:16.336408+0000","last_undegraded":"2024-09-12T00:54:16.336408+0000","last_fullsized":"2024-09-12T00:54:16.336408+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:08.846428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22688,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":439,"num_read_kb":23009,"num_write":866,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'439","reported_seq":2004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.211419+0000","last_change":"2024-09-12T00:11:47.940868+0000","last_active":"2024-09-12T00:54:17.211419+0000","last_peered":"2024-09-12T00:54:17.211419+0000","last_clean":"2024-09-12T00:54:17.211419+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:17.211419+0000","last_undegraded":"2024-09-12T00:54:17.211419+0000","last_fullsized":"2024-09-12T00:54:17.211419+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:23.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'189","reported_seq":811,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:48.027510+0000","last_change":"2024-09-12T00:11:45.925804+0000","last_active":"2024-09-12T00:52:48.027510+0000","last_peered":"2024-09-12T00:52:48.027510+0000","last_clean":"2024-09-12T00:52:48.027510+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:52:48.027510+0000","last_undegraded":"2024-09-12T00:52:48.027510+0000","last_fullsized":"2024-09-12T00:52:48.027510+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:55.107812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778905,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":15824,"num_write":916,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'552","reported_seq":2152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.505098+0000","last_change":"2024-09-12T00:11:47.949066+0000","last_active":"2024-09-12T00:53:01.505098+0000","last_peered":"2024-09-12T00:53:01.505098+0000","last_clean":"2024-09-12T00:53:01.505098+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:53:01.505098+0000","last_undegraded":"2024-09-12T00:53:01.505098+0000","last_fullsized":"2024-09-12T00:53:01.505098+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'209","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:02.043040+0000","last_change":"2024-09-12T00:11:45.937137+0000","last_active":"2024-09-12T00:53:02.043040+0000","last_peered":"2024-09-12T00:53:02.043040+0000","last_clean":"2024-09-12T00:53:02.043040+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:53:02.043040+0000","last_undegraded":"2024-09-12T00:53:02.043040+0000","last_fullsized":"2024-09-12T00:53:02.043040+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:36.986793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":974316,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":26404,"num_write":989,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'628","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.967393+0000","last_change":"2024-09-12T00:11:47.924685+0000","last_active":"2024-09-12T00:53:01.967393+0000","last_peered":"2024-09-12T00:53:01.967393+0000","last_clean":"2024-09-12T00:53:01.967393+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:53:01.967393+0000","last_undegraded":"2024-09-12T00:53:01.967393+0000","last_fullsized":"2024-09-12T00:53:01.967393+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:06.368642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'182","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.242410+0000","last_change":"2024-09-12T00:11:45.950496+0000","last_active":"2024-09-12T00:53:11.242410+0000","last_peered":"2024-09-12T00:53:11.242410+0000","last_clean":"2024-09-12T00:53:11.242410+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:53:11.242410+0000","last_undegraded":"2024-09-12T00:53:11.242410+0000","last_fullsized":"2024-09-12T00:53:11.242410+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:36.187975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18534561,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":19556,"num_write":887,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1215","reported_seq":2911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.201094+0000","last_change":"2024-09-12T00:11:47.925124+0000","last_active":"2024-09-12T00:54:17.201094+0000","last_peered":"2024-09-12T00:54:17.201094+0000","last_clean":"2024-09-12T00:54:17.201094+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:17.201094+0000","last_undegraded":"2024-09-12T00:54:17.201094+0000","last_fullsized":"2024-09-12T00:54:17.201094+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:30.824531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'203","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.659905+0000","last_change":"2024-09-12T00:11:45.938512+0000","last_active":"2024-09-12T00:54:07.659905+0000","last_peered":"2024-09-12T00:54:07.659905+0000","last_clean":"2024-09-12T00:54:07.659905+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:07.659905+0000","last_undegraded":"2024-09-12T00:54:07.659905+0000","last_fullsized":"2024-09-12T00:54:07.659905+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:43.280807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437213,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":569,"num_read_kb":13603,"num_write":996,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'158","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.440855+0000","last_change":"2024-09-12T00:11:55.962848+0000","last_active":"2024-09-12T00:53:14.440855+0000","last_peered":"2024-09-12T00:53:14.440855+0000","last_clean":"2024-09-12T00:53:14.440855+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:53:14.440855+0000","last_undegraded":"2024-09-12T00:53:14.440855+0000","last_fullsized":"2024-09-12T00:53:14.440855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:04.549126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'428","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.365744+0000","last_change":"2024-09-12T00:11:47.957238+0000","last_active":"2024-09-12T00:53:14.365744+0000","last_peered":"2024-09-12T00:53:14.365744+0000","last_clean":"2024-09-12T00:53:14.365744+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:53:14.365744+0000","last_undegraded":"2024-09-12T00:53:14.365744+0000","last_fullsized":"2024-09-12T00:53:14.365744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:35.988751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'193","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:13.592676+0000","last_change":"2024-09-12T00:12:19.243333+0000","last_active":"2024-09-12T00:52:13.592676+0000","last_peered":"2024-09-12T00:52:13.592676+0000","last_clean":"2024-09-12T00:52:13.592676+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:52:13.592676+0000","last_undegraded":"2024-09-12T00:52:13.592676+0000","last_fullsized":"2024-09-12T00:52:13.592676+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:21.362685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291438,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":1948,"num_write":1007,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930718+0000","last_change":"2024-09-12T00:11:49.940927+0000","last_active":"2024-09-12T00:50:30.930718+0000","last_peered":"2024-09-12T00:50:30.930718+0000","last_clean":"2024-09-12T00:50:30.930718+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:50:30.930718+0000","last_undegraded":"2024-09-12T00:50:30.930718+0000","last_fullsized":"2024-09-12T00:50:30.930718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:54.486050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'196","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.946114+0000","last_change":"2024-09-12T00:11:51.947651+0000","last_active":"2024-09-12T00:53:00.946114+0000","last_peered":"2024-09-12T00:53:00.946114+0000","last_clean":"2024-09-12T00:53:00.946114+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:53:00.946114+0000","last_undegraded":"2024-09-12T00:53:00.946114+0000","last_fullsized":"2024-09-12T00:53:00.946114+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:29.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11858,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":263,"num_read_kb":317,"num_write":156,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089124+0000","last_change":"2024-09-12T00:11:53.948633+0000","last_active":"2024-09-12T00:50:36.089124+0000","last_peered":"2024-09-12T00:50:36.089124+0000","last_clean":"2024-09-12T00:50:36.089124+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:50:36.089124+0000","last_undegraded":"2024-09-12T00:50:36.089124+0000","last_fullsized":"2024-09-12T00:50:36.089124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:09.362747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2472","reported_seq":4364,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.220805+0000","last_change":"2024-09-12T00:11:55.974612+0000","last_active":"2024-09-12T00:53:59.220805+0000","last_peered":"2024-09-12T00:53:59.220805+0000","last_clean":"2024-09-12T00:53:59.220805+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:53:59.220805+0000","last_undegraded":"2024-09-12T00:53:59.220805+0000","last_fullsized":"2024-09-12T00:53:59.220805+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:50.591689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'463","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.197150+0000","last_change":"2024-09-12T00:11:47.930826+0000","last_active":"2024-09-12T00:54:17.197150+0000","last_peered":"2024-09-12T00:54:17.197150+0000","last_clean":"2024-09-12T00:54:17.197150+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:17.197150+0000","last_undegraded":"2024-09-12T00:54:17.197150+0000","last_fullsized":"2024-09-12T00:54:17.197150+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:30.387857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'239","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.576017+0000","last_change":"2024-09-12T00:11:45.930202+0000","last_active":"2024-09-12T00:53:00.576017+0000","last_peered":"2024-09-12T00:53:00.576017+0000","last_clean":"2024-09-12T00:53:00.576017+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:53:00.576017+0000","last_undegraded":"2024-09-12T00:53:00.576017+0000","last_fullsized":"2024-09-12T00:53:00.576017+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:48.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9488471,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":589,"num_read_kb":71900,"num_write":1163,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.928736+0000","last_change":"2024-09-12T00:11:49.928414+0000","last_active":"2024-09-12T00:51:40.928736+0000","last_peered":"2024-09-12T00:51:40.928736+0000","last_clean":"2024-09-12T00:51:40.928736+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:51:40.928736+0000","last_undegraded":"2024-09-12T00:51:40.928736+0000","last_fullsized":"2024-09-12T00:51:40.928736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.325652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'91","reported_seq":624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.782442+0000","last_change":"2024-09-12T00:11:51.929989+0000","last_active":"2024-09-12T00:52:37.782442+0000","last_peered":"2024-09-12T00:52:37.782442+0000","last_clean":"2024-09-12T00:52:37.782442+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:52:37.782442+0000","last_undegraded":"2024-09-12T00:52:37.782442+0000","last_fullsized":"2024-09-12T00:52:37.782442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:18.143324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089023+0000","last_change":"2024-09-12T00:11:53.948950+0000","last_active":"2024-09-12T00:50:36.089023+0000","last_peered":"2024-09-12T00:50:36.089023+0000","last_clean":"2024-09-12T00:50:36.089023+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:50:36.089023+0000","last_undegraded":"2024-09-12T00:50:36.089023+0000","last_fullsized":"2024-09-12T00:50:36.089023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:44.328086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'155","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.554087+0000","last_change":"2024-09-12T00:11:55.974329+0000","last_active":"2024-09-12T00:52:56.554087+0000","last_peered":"2024-09-12T00:52:56.554087+0000","last_clean":"2024-09-12T00:52:56.554087+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:52:56.554087+0000","last_undegraded":"2024-09-12T00:52:56.554087+0000","last_fullsized":"2024-09-12T00:52:56.554087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:22.758032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'565","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.733246+0000","last_change":"2024-09-12T00:11:47.935137+0000","last_active":"2024-09-12T00:53:13.733246+0000","last_peered":"2024-09-12T00:53:13.733246+0000","last_clean":"2024-09-12T00:53:13.733246+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:53:13.733246+0000","last_undegraded":"2024-09-12T00:53:13.733246+0000","last_fullsized":"2024-09-12T00:53:13.733246+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.622836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'223","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.284615+0000","last_change":"2024-09-12T00:11:45.920772+0000","last_active":"2024-09-12T00:52:00.284615+0000","last_peered":"2024-09-12T00:52:00.284615+0000","last_clean":"2024-09-12T00:52:00.284615+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:52:00.284615+0000","last_undegraded":"2024-09-12T00:52:00.284615+0000","last_fullsized":"2024-09-12T00:52:00.284615+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:51.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064999,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":463,"num_read_kb":11763,"num_write":999,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.912975+0000","last_change":"2024-09-12T00:11:49.946026+0000","last_active":"2024-09-12T00:50:30.912975+0000","last_peered":"2024-09-12T00:50:30.912975+0000","last_clean":"2024-09-12T00:50:30.912975+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:50:30.912975+0000","last_undegraded":"2024-09-12T00:50:30.912975+0000","last_fullsized":"2024-09-12T00:50:30.912975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.002432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'128","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:34.133774+0000","last_change":"2024-09-12T00:11:51.952490+0000","last_active":"2024-09-12T00:52:34.133774+0000","last_peered":"2024-09-12T00:52:34.133774+0000","last_clean":"2024-09-12T00:52:34.133774+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:52:34.133774+0000","last_undegraded":"2024-09-12T00:52:34.133774+0000","last_fullsized":"2024-09-12T00:52:34.133774+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:12.676121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'778","reported_seq":2215,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.972496+0000","last_change":"2024-09-12T00:11:53.963903+0000","last_active":"2024-09-12T00:54:30.972496+0000","last_peered":"2024-09-12T00:54:30.972496+0000","last_clean":"2024-09-12T00:54:30.972496+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:54:30.972496+0000","last_undegraded":"2024-09-12T00:54:30.972496+0000","last_fullsized":"2024-09-12T00:54:30.972496+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:11.131097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'218","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.508260+0000","last_change":"2024-09-12T00:11:55.967351+0000","last_active":"2024-09-12T00:53:14.508260+0000","last_peered":"2024-09-12T00:53:14.508260+0000","last_clean":"2024-09-12T00:53:14.508260+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:53:14.508260+0000","last_undegraded":"2024-09-12T00:53:14.508260+0000","last_fullsized":"2024-09-12T00:53:14.508260+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:31.864573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'339","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.748057+0000","last_change":"2024-09-12T00:11:47.931389+0000","last_active":"2024-09-12T00:53:13.748057+0000","last_peered":"2024-09-12T00:53:13.748057+0000","last_clean":"2024-09-12T00:53:13.748057+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:53:13.748057+0000","last_undegraded":"2024-09-12T00:53:13.748057+0000","last_fullsized":"2024-09-12T00:53:13.748057+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:39.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'200","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:46.129859+0000","last_change":"2024-09-12T00:11:45.960713+0000","last_active":"2024-09-12T00:53:46.129859+0000","last_peered":"2024-09-12T00:53:46.129859+0000","last_clean":"2024-09-12T00:53:46.129859+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:53:46.129859+0000","last_undegraded":"2024-09-12T00:53:46.129859+0000","last_fullsized":"2024-09-12T00:53:46.129859+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.838856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1075321,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":364,"num_read_kb":5525,"num_write":925,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930757+0000","last_change":"2024-09-12T00:11:49.936925+0000","last_active":"2024-09-12T00:50:30.930757+0000","last_peered":"2024-09-12T00:50:30.930757+0000","last_clean":"2024-09-12T00:50:30.930757+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:50:30.930757+0000","last_undegraded":"2024-09-12T00:50:30.930757+0000","last_fullsized":"2024-09-12T00:50:30.930757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.835956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'118","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.288970+0000","last_change":"2024-09-12T00:11:51.945240+0000","last_active":"2024-09-12T00:54:18.288970+0000","last_peered":"2024-09-12T00:54:18.288970+0000","last_clean":"2024-09-12T00:54:18.288970+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:18.288970+0000","last_undegraded":"2024-09-12T00:54:18.288970+0000","last_fullsized":"2024-09-12T00:54:18.288970+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:43.775349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4460,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":68,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'787","reported_seq":2256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.373943+0000","last_change":"2024-09-12T00:11:53.966127+0000","last_active":"2024-09-12T00:54:18.373943+0000","last_peered":"2024-09-12T00:54:18.373943+0000","last_clean":"2024-09-12T00:54:18.373943+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:54:18.373943+0000","last_undegraded":"2024-09-12T00:54:18.373943+0000","last_fullsized":"2024-09-12T00:54:18.373943+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.057133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'538","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.492338+0000","last_change":"2024-09-12T00:11:47.925552+0000","last_active":"2024-09-12T00:53:10.492338+0000","last_peered":"2024-09-12T00:53:10.492338+0000","last_clean":"2024-09-12T00:53:10.492338+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:53:10.492338+0000","last_undegraded":"2024-09-12T00:53:10.492338+0000","last_fullsized":"2024-09-12T00:53:10.492338+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:35.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'239","reported_seq":895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.324905+0000","last_change":"2024-09-12T00:11:45.936612+0000","last_active":"2024-09-12T00:52:53.324905+0000","last_peered":"2024-09-12T00:52:53.324905+0000","last_clean":"2024-09-12T00:52:53.324905+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:52:53.324905+0000","last_undegraded":"2024-09-12T00:52:53.324905+0000","last_fullsized":"2024-09-12T00:52:53.324905+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:04.380015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13222281,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":589,"num_read_kb":40518,"num_write":1095,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092095+0000","last_change":"2024-09-12T00:11:49.915889+0000","last_active":"2024-09-12T00:50:51.092095+0000","last_peered":"2024-09-12T00:50:51.092095+0000","last_clean":"2024-09-12T00:50:51.092095+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:50:51.092095+0000","last_undegraded":"2024-09-12T00:50:51.092095+0000","last_fullsized":"2024-09-12T00:50:51.092095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:01.391369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'216","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.950080+0000","last_change":"2024-09-12T00:11:51.952724+0000","last_active":"2024-09-12T00:53:15.950080+0000","last_peered":"2024-09-12T00:53:15.950080+0000","last_clean":"2024-09-12T00:53:15.950080+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:53:15.950080+0000","last_undegraded":"2024-09-12T00:53:15.950080+0000","last_fullsized":"2024-09-12T00:53:15.950080+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:30.153282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12559,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":291,"num_read_kb":346,"num_write":174,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.904191+0000","last_change":"2024-09-12T00:11:53.969081+0000","last_active":"2024-09-12T00:50:10.904191+0000","last_peered":"2024-09-12T00:50:10.904191+0000","last_clean":"2024-09-12T00:50:10.904191+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:50:10.904191+0000","last_undegraded":"2024-09-12T00:50:10.904191+0000","last_fullsized":"2024-09-12T00:50:10.904191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:12.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'542","reported_seq":1368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.342188+0000","last_change":"2024-09-12T00:11:55.961717+0000","last_active":"2024-09-12T00:54:18.342188+0000","last_peered":"2024-09-12T00:54:18.342188+0000","last_clean":"2024-09-12T00:54:18.342188+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:54:18.342188+0000","last_undegraded":"2024-09-12T00:54:18.342188+0000","last_fullsized":"2024-09-12T00:54:18.342188+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'843","reported_seq":2486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.493186+0000","last_change":"2024-09-12T00:11:47.924514+0000","last_active":"2024-09-12T00:53:10.493186+0000","last_peered":"2024-09-12T00:53:10.493186+0000","last_clean":"2024-09-12T00:53:10.493186+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:53:10.493186+0000","last_undegraded":"2024-09-12T00:53:10.493186+0000","last_fullsized":"2024-09-12T00:53:10.493186+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:28.061678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'183","reported_seq":993,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.134909+0000","last_change":"2024-09-12T00:11:45.960456+0000","last_active":"2024-09-12T00:54:31.134909+0000","last_peered":"2024-09-12T00:54:31.134909+0000","last_clean":"2024-09-12T00:54:31.134909+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:31.134909+0000","last_undegraded":"2024-09-12T00:54:31.134909+0000","last_fullsized":"2024-09-12T00:54:31.134909+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:26.947144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2527593,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":810,"num_read_kb":32531,"num_write":876,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912730+0000","last_change":"2024-09-12T00:11:49.945091+0000","last_active":"2024-09-12T00:50:50.912730+0000","last_peered":"2024-09-12T00:50:50.912730+0000","last_clean":"2024-09-12T00:50:50.912730+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:50:50.912730+0000","last_undegraded":"2024-09-12T00:50:50.912730+0000","last_fullsized":"2024-09-12T00:50:50.912730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.590584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'125","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.373388+0000","last_change":"2024-09-12T00:11:51.947825+0000","last_active":"2024-09-12T00:53:14.373388+0000","last_peered":"2024-09-12T00:53:14.373388+0000","last_clean":"2024-09-12T00:53:14.373388+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:53:14.373388+0000","last_undegraded":"2024-09-12T00:53:14.373388+0000","last_fullsized":"2024-09-12T00:53:14.373388+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:40.118757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":217,"num_write":84,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:05.920875+0000","last_change":"2024-09-12T00:11:53.971538+0000","last_active":"2024-09-12T00:51:05.920875+0000","last_peered":"2024-09-12T00:51:05.920875+0000","last_clean":"2024-09-12T00:51:05.920875+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:51:05.920875+0000","last_undegraded":"2024-09-12T00:51:05.920875+0000","last_fullsized":"2024-09-12T00:51:05.920875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.262175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'143","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:41.129296+0000","last_change":"2024-09-12T00:11:55.983166+0000","last_active":"2024-09-12T00:53:41.129296+0000","last_peered":"2024-09-12T00:53:41.129296+0000","last_clean":"2024-09-12T00:53:41.129296+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:53:41.129296+0000","last_undegraded":"2024-09-12T00:53:41.129296+0000","last_fullsized":"2024-09-12T00:53:41.129296+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.841060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'471","reported_seq":1963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369406+0000","last_change":"2024-09-12T00:11:47.926269+0000","last_active":"2024-09-12T00:53:14.369406+0000","last_peered":"2024-09-12T00:53:14.369406+0000","last_clean":"2024-09-12T00:53:14.369406+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:53:14.369406+0000","last_undegraded":"2024-09-12T00:53:14.369406+0000","last_fullsized":"2024-09-12T00:53:14.369406+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:55.592362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'164","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:15.957076+0000","last_change":"2024-09-12T00:11:45.932385+0000","last_active":"2024-09-12T00:52:15.957076+0000","last_peered":"2024-09-12T00:52:15.957076+0000","last_clean":"2024-09-12T00:52:15.957076+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:52:15.957076+0000","last_undegraded":"2024-09-12T00:52:15.957076+0000","last_fullsized":"2024-09-12T00:52:15.957076+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.293210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13921921,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":351,"num_read_kb":53604,"num_write":793,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:04.911798+0000","last_change":"2024-09-12T00:11:49.936538+0000","last_active":"2024-09-12T00:50:04.911798+0000","last_peered":"2024-09-12T00:50:04.911798+0000","last_clean":"2024-09-12T00:50:04.911798+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:50:04.911798+0000","last_undegraded":"2024-09-12T00:50:04.911798+0000","last_fullsized":"2024-09-12T00:50:04.911798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'161","reported_seq":752,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.968254+0000","last_change":"2024-09-12T00:11:51.935323+0000","last_active":"2024-09-12T00:53:05.968254+0000","last_peered":"2024-09-12T00:53:05.968254+0000","last_clean":"2024-09-12T00:53:05.968254+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:53:05.968254+0000","last_undegraded":"2024-09-12T00:53:05.968254+0000","last_fullsized":"2024-09-12T00:53:05.968254+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.661049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13243,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":276,"num_write":122,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'786","reported_seq":4494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.376700+0000","last_change":"2024-09-12T00:11:53.965915+0000","last_active":"2024-09-12T00:54:18.376700+0000","last_peered":"2024-09-12T00:54:18.376700+0000","last_clean":"2024-09-12T00:54:18.376700+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:54:18.376700+0000","last_undegraded":"2024-09-12T00:54:18.376700+0000","last_fullsized":"2024-09-12T00:54:18.376700+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.284890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'110","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.118486+0000","last_change":"2024-09-12T00:11:55.974936+0000","last_active":"2024-09-12T00:54:17.118486+0000","last_peered":"2024-09-12T00:54:17.118486+0000","last_clean":"2024-09-12T00:54:17.118486+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:54:17.118486+0000","last_undegraded":"2024-09-12T00:54:17.118486+0000","last_fullsized":"2024-09-12T00:54:17.118486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.341303+0000","last_change":"2024-09-12T00:11:47.936806+0000","last_active":"2024-09-12T00:53:14.341303+0000","last_peered":"2024-09-12T00:53:14.341303+0000","last_clean":"2024-09-12T00:53:14.341303+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:53:14.341303+0000","last_undegraded":"2024-09-12T00:53:14.341303+0000","last_fullsized":"2024-09-12T00:53:14.341303+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.241629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'202","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.186525+0000","last_change":"2024-09-12T00:11:45.924370+0000","last_active":"2024-09-12T00:52:37.186525+0000","last_peered":"2024-09-12T00:52:37.186525+0000","last_clean":"2024-09-12T00:52:37.186525+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:52:37.186525+0000","last_undegraded":"2024-09-12T00:52:37.186525+0000","last_fullsized":"2024-09-12T00:52:37.186525+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.161944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1636479,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":351,"num_read_kb":7228,"num_write":901,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914998+0000","last_change":"2024-09-12T00:11:49.935933+0000","last_active":"2024-09-12T00:51:00.914998+0000","last_peered":"2024-09-12T00:51:00.914998+0000","last_clean":"2024-09-12T00:51:00.914998+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:51:00.914998+0000","last_undegraded":"2024-09-12T00:51:00.914998+0000","last_fullsized":"2024-09-12T00:51:00.914998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:55.844937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'213","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.268340+0000","last_change":"2024-09-12T00:11:51.953736+0000","last_active":"2024-09-12T00:54:18.268340+0000","last_peered":"2024-09-12T00:54:18.268340+0000","last_clean":"2024-09-12T00:54:18.268340+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:54:18.268340+0000","last_undegraded":"2024-09-12T00:54:18.268340+0000","last_fullsized":"2024-09-12T00:54:18.268340+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:45.844572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27898,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":285,"num_read_kb":405,"num_write":152,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923531+0000","last_change":"2024-09-12T00:11:53.953180+0000","last_active":"2024-09-12T00:50:54.923531+0000","last_peered":"2024-09-12T00:50:54.923531+0000","last_clean":"2024-09-12T00:50:54.923531+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:50:54.923531+0000","last_undegraded":"2024-09-12T00:50:54.923531+0000","last_fullsized":"2024-09-12T00:50:54.923531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.341688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'167","reported_seq":695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.573638+0000","last_change":"2024-09-12T00:11:55.974975+0000","last_active":"2024-09-12T00:53:13.573638+0000","last_peered":"2024-09-12T00:53:13.573638+0000","last_clean":"2024-09-12T00:53:13.573638+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:53:13.573638+0000","last_undegraded":"2024-09-12T00:53:13.573638+0000","last_fullsized":"2024-09-12T00:53:13.573638+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:59.474049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'471","reported_seq":1903,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.691464+0000","last_change":"2024-09-12T00:11:47.940887+0000","last_active":"2024-09-12T00:52:54.691464+0000","last_peered":"2024-09-12T00:52:54.691464+0000","last_clean":"2024-09-12T00:52:54.691464+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:52:54.691464+0000","last_undegraded":"2024-09-12T00:52:54.691464+0000","last_fullsized":"2024-09-12T00:52:54.691464+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:51.522432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'209","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.037175+0000","last_change":"2024-09-12T00:11:45.943857+0000","last_active":"2024-09-12T00:52:24.037175+0000","last_peered":"2024-09-12T00:52:24.037175+0000","last_clean":"2024-09-12T00:52:24.037175+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:52:24.037175+0000","last_undegraded":"2024-09-12T00:52:24.037175+0000","last_fullsized":"2024-09-12T00:52:24.037175+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:43.419673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553739,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":429,"num_read_kb":1957,"num_write":997,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"37'3","reported_seq":972,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.927575+0000","last_change":"2024-09-12T00:11:49.937297+0000","last_active":"2024-09-12T00:54:30.927575+0000","last_peered":"2024-09-12T00:54:30.927575+0000","last_clean":"2024-09-12T00:54:30.927575+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:30.927575+0000","last_undegraded":"2024-09-12T00:54:30.927575+0000","last_fullsized":"2024-09-12T00:54:30.927575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:00.946216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'161","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.273607+0000","last_change":"2024-09-12T00:11:51.927031+0000","last_active":"2024-09-12T00:54:18.273607+0000","last_peered":"2024-09-12T00:54:18.273607+0000","last_clean":"2024-09-12T00:54:18.273607+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:18.273607+0000","last_undegraded":"2024-09-12T00:54:18.273607+0000","last_fullsized":"2024-09-12T00:54:18.273607+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:02.672539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18135,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":213,"num_read_kb":238,"num_write":170,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910347+0000","last_change":"2024-09-12T00:11:53.968094+0000","last_active":"2024-09-12T00:50:20.910347+0000","last_peered":"2024-09-12T00:50:20.910347+0000","last_clean":"2024-09-12T00:50:20.910347+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:50:20.910347+0000","last_undegraded":"2024-09-12T00:50:20.910347+0000","last_fullsized":"2024-09-12T00:50:20.910347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.434778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'111","reported_seq":608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.371379+0000","last_change":"2024-09-12T00:11:55.962445+0000","last_active":"2024-09-12T00:54:07.371379+0000","last_peered":"2024-09-12T00:54:07.371379+0000","last_clean":"2024-09-12T00:54:07.371379+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:54:07.371379+0000","last_undegraded":"2024-09-12T00:54:07.371379+0000","last_fullsized":"2024-09-12T00:54:07.371379+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.195407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'357","reported_seq":1761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.492153+0000","last_change":"2024-09-12T00:11:47.927194+0000","last_active":"2024-09-12T00:53:10.492153+0000","last_peered":"2024-09-12T00:53:10.492153+0000","last_clean":"2024-09-12T00:53:10.492153+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:53:10.492153+0000","last_undegraded":"2024-09-12T00:53:10.492153+0000","last_fullsized":"2024-09-12T00:53:10.492153+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:01.220441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'177","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:46.022553+0000","last_change":"2024-09-12T00:11:45.917052+0000","last_active":"2024-09-12T00:52:46.022553+0000","last_peered":"2024-09-12T00:52:46.022553+0000","last_clean":"2024-09-12T00:52:46.022553+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:52:46.022553+0000","last_undegraded":"2024-09-12T00:52:46.022553+0000","last_fullsized":"2024-09-12T00:52:46.022553+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:13.426346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266715,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":98751,"num_write":849,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:04.911850+0000","last_change":"2024-09-12T00:11:49.929321+0000","last_active":"2024-09-12T00:50:04.911850+0000","last_peered":"2024-09-12T00:50:04.911850+0000","last_clean":"2024-09-12T00:50:04.911850+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:50:04.911850+0000","last_undegraded":"2024-09-12T00:50:04.911850+0000","last_fullsized":"2024-09-12T00:50:04.911850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:41.401304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'142","reported_seq":720,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.734321+0000","last_change":"2024-09-12T00:11:51.944644+0000","last_active":"2024-09-12T00:52:37.734321+0000","last_peered":"2024-09-12T00:52:37.734321+0000","last_clean":"2024-09-12T00:52:37.734321+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:52:37.734321+0000","last_undegraded":"2024-09-12T00:52:37.734321+0000","last_fullsized":"2024-09-12T00:52:37.734321+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.228465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8597,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":190,"num_read_kb":228,"num_write":104,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'757","reported_seq":4268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.366563+0000","last_change":"2024-09-12T00:11:53.952899+0000","last_active":"2024-09-12T00:54:18.366563+0000","last_peered":"2024-09-12T00:54:18.366563+0000","last_clean":"2024-09-12T00:54:18.366563+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:18.366563+0000","last_undegraded":"2024-09-12T00:54:18.366563+0000","last_fullsized":"2024-09-12T00:54:18.366563+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:12.752310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'131","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.447365+0000","last_change":"2024-09-12T00:11:55.980382+0000","last_active":"2024-09-12T00:53:14.447365+0000","last_peered":"2024-09-12T00:53:14.447365+0000","last_clean":"2024-09-12T00:53:14.447365+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:53:14.447365+0000","last_undegraded":"2024-09-12T00:53:14.447365+0000","last_fullsized":"2024-09-12T00:53:14.447365+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:00.118353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'421","reported_seq":1948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.492491+0000","last_change":"2024-09-12T00:11:47.929290+0000","last_active":"2024-09-12T00:53:01.492491+0000","last_peered":"2024-09-12T00:53:01.492491+0000","last_clean":"2024-09-12T00:53:01.492491+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:53:01.492491+0000","last_undegraded":"2024-09-12T00:53:01.492491+0000","last_fullsized":"2024-09-12T00:53:01.492491+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:17.558291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'200","reported_seq":955,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:44.180384+0000","last_change":"2024-09-12T00:11:45.934214+0000","last_active":"2024-09-12T00:52:44.180384+0000","last_peered":"2024-09-12T00:52:44.180384+0000","last_clean":"2024-09-12T00:52:44.180384+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:52:44.180384+0000","last_undegraded":"2024-09-12T00:52:44.180384+0000","last_fullsized":"2024-09-12T00:52:44.180384+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:16.412728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7523936,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":763,"num_read_kb":199371,"num_write":986,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.943149+0000","last_change":"2024-09-12T00:11:49.916557+0000","last_active":"2024-09-12T00:54:30.943149+0000","last_peered":"2024-09-12T00:54:30.943149+0000","last_clean":"2024-09-12T00:54:30.943149+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:30.943149+0000","last_undegraded":"2024-09-12T00:54:30.943149+0000","last_fullsized":"2024-09-12T00:54:30.943149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:21.916420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'72","reported_seq":590,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.752832+0000","last_change":"2024-09-12T00:11:51.935418+0000","last_active":"2024-09-12T00:53:13.752832+0000","last_peered":"2024-09-12T00:53:13.752832+0000","last_clean":"2024-09-12T00:53:13.752832+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:53:13.752832+0000","last_undegraded":"2024-09-12T00:53:13.752832+0000","last_fullsized":"2024-09-12T00:53:13.752832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:51.747263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'797","reported_seq":2240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.976636+0000","last_change":"2024-09-12T00:11:53.957570+0000","last_active":"2024-09-12T00:54:30.976636+0000","last_peered":"2024-09-12T00:54:30.976636+0000","last_clean":"2024-09-12T00:54:30.976636+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:30.976636+0000","last_undegraded":"2024-09-12T00:54:30.976636+0000","last_fullsized":"2024-09-12T00:54:30.976636+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:04.088118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.135829+0000","last_change":"2024-09-12T00:11:55.975495+0000","last_active":"2024-09-12T00:52:29.135829+0000","last_peered":"2024-09-12T00:52:29.135829+0000","last_clean":"2024-09-12T00:52:29.135829+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:52:29.135829+0000","last_undegraded":"2024-09-12T00:52:29.135829+0000","last_fullsized":"2024-09-12T00:52:29.135829+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.293878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'759","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.232523+0000","last_change":"2024-09-12T00:11:47.955610+0000","last_active":"2024-09-12T00:53:00.232523+0000","last_peered":"2024-09-12T00:53:00.232523+0000","last_clean":"2024-09-12T00:53:00.232523+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:53:00.232523+0000","last_undegraded":"2024-09-12T00:53:00.232523+0000","last_fullsized":"2024-09-12T00:53:00.232523+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:19.656190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'213","reported_seq":859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:52.093662+0000","last_change":"2024-09-12T00:11:45.929866+0000","last_active":"2024-09-12T00:51:52.093662+0000","last_peered":"2024-09-12T00:51:52.093662+0000","last_clean":"2024-09-12T00:51:52.093662+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:51:52.093662+0000","last_undegraded":"2024-09-12T00:51:52.093662+0000","last_fullsized":"2024-09-12T00:51:52.093662+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:51.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5562540,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":31245,"num_write":949,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924891+0000","last_change":"2024-09-12T00:11:49.941210+0000","last_active":"2024-09-12T00:50:05.924891+0000","last_peered":"2024-09-12T00:50:05.924891+0000","last_clean":"2024-09-12T00:50:05.924891+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:50:05.924891+0000","last_undegraded":"2024-09-12T00:50:05.924891+0000","last_fullsized":"2024-09-12T00:50:05.924891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:16.438093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'219","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.305281+0000","last_change":"2024-09-12T00:11:51.947561+0000","last_active":"2024-09-12T00:54:18.305281+0000","last_peered":"2024-09-12T00:54:18.305281+0000","last_clean":"2024-09-12T00:54:18.305281+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:18.305281+0000","last_undegraded":"2024-09-12T00:54:18.305281+0000","last_fullsized":"2024-09-12T00:54:18.305281+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:33.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12252,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":862,"num_read_kb":913,"num_write":1358,"num_write_kb":1231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104173+0000","last_change":"2024-09-12T00:11:53.957928+0000","last_active":"2024-09-12T00:50:11.104173+0000","last_peered":"2024-09-12T00:50:11.104173+0000","last_clean":"2024-09-12T00:50:11.104173+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:50:11.104173+0000","last_undegraded":"2024-09-12T00:50:11.104173+0000","last_fullsized":"2024-09-12T00:50:11.104173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:26.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'106","reported_seq":598,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.427213+0000","last_change":"2024-09-12T00:11:55.978414+0000","last_active":"2024-09-12T00:53:12.427213+0000","last_peered":"2024-09-12T00:53:12.427213+0000","last_clean":"2024-09-12T00:53:12.427213+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:53:12.427213+0000","last_undegraded":"2024-09-12T00:53:12.427213+0000","last_fullsized":"2024-09-12T00:53:12.427213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.992033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'786","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217623+0000","last_change":"2024-09-12T00:11:47.926128+0000","last_active":"2024-09-12T00:53:59.217623+0000","last_peered":"2024-09-12T00:53:59.217623+0000","last_clean":"2024-09-12T00:53:59.217623+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:53:59.217623+0000","last_undegraded":"2024-09-12T00:53:59.217623+0000","last_fullsized":"2024-09-12T00:53:59.217623+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:22.256949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104029+0000","last_change":"2024-09-12T00:11:27.569428+0000","last_active":"2024-09-12T00:51:36.104029+0000","last_peered":"2024-09-12T00:51:36.104029+0000","last_clean":"2024-09-12T00:51:36.104029+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:51:36.104029+0000","last_undegraded":"2024-09-12T00:51:36.104029+0000","last_fullsized":"2024-09-12T00:51:36.104029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_clean_scrub_stamp":"2024-09-12T00:11:26.525321+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.325099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940331+0000","last_change":"2024-09-12T00:11:34.617900+0000","last_active":"2024-09-12T00:51:10.940331+0000","last_peered":"2024-09-12T00:51:10.940331+0000","last_clean":"2024-09-12T00:51:10.940331+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:51:10.940331+0000","last_undegraded":"2024-09-12T00:51:10.940331+0000","last_fullsized":"2024-09-12T00:51:10.940331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'185","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.414785+0000","last_change":"2024-09-12T00:12:19.244194+0000","last_active":"2024-09-12T00:53:11.414785+0000","last_peered":"2024-09-12T00:53:11.414785+0000","last_clean":"2024-09-12T00:53:11.414785+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:53:11.414785+0000","last_undegraded":"2024-09-12T00:53:11.414785+0000","last_fullsized":"2024-09-12T00:53:11.414785+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:17.759014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7853940,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":394,"num_read_kb":15296,"num_write":919,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"37'4","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.927996+0000","last_change":"2024-09-12T00:11:49.928011+0000","last_active":"2024-09-12T00:54:30.927996+0000","last_peered":"2024-09-12T00:54:30.927996+0000","last_clean":"2024-09-12T00:54:30.927996+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:30.927996+0000","last_undegraded":"2024-09-12T00:54:30.927996+0000","last_fullsized":"2024-09-12T00:54:30.927996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:42.062220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'291","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.310659+0000","last_change":"2024-09-12T00:11:51.936332+0000","last_active":"2024-09-12T00:54:18.310659+0000","last_peered":"2024-09-12T00:54:18.310659+0000","last_clean":"2024-09-12T00:54:18.310659+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:54:18.310659+0000","last_undegraded":"2024-09-12T00:54:18.310659+0000","last_fullsized":"2024-09-12T00:54:18.310659+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:22.288477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46469,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":529,"num_read_kb":753,"num_write":440,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923847+0000","last_change":"2024-09-12T00:11:53.937970+0000","last_active":"2024-09-12T00:50:54.923847+0000","last_peered":"2024-09-12T00:50:54.923847+0000","last_clean":"2024-09-12T00:50:54.923847+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:50:54.923847+0000","last_undegraded":"2024-09-12T00:50:54.923847+0000","last_fullsized":"2024-09-12T00:50:54.923847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:32.585484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'188","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.171716+0000","last_change":"2024-09-12T00:11:55.972904+0000","last_active":"2024-09-12T00:53:13.171716+0000","last_peered":"2024-09-12T00:53:13.171716+0000","last_clean":"2024-09-12T00:53:13.171716+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:53:13.171716+0000","last_undegraded":"2024-09-12T00:53:13.171716+0000","last_fullsized":"2024-09-12T00:53:13.171716+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:08.248837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'454","reported_seq":1917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.540410+0000","last_change":"2024-09-12T00:11:47.933958+0000","last_active":"2024-09-12T00:52:57.540410+0000","last_peered":"2024-09-12T00:52:57.540410+0000","last_clean":"2024-09-12T00:52:57.540410+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:52:57.540410+0000","last_undegraded":"2024-09-12T00:52:57.540410+0000","last_fullsized":"2024-09-12T00:52:57.540410+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:36.317791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:45.949008+0000","last_change":"2024-09-12T00:11:34.617340+0000","last_active":"2024-09-12T00:51:45.949008+0000","last_peered":"2024-09-12T00:51:45.949008+0000","last_clean":"2024-09-12T00:51:45.949008+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:51:45.949008+0000","last_undegraded":"2024-09-12T00:51:45.949008+0000","last_fullsized":"2024-09-12T00:51:45.949008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:34.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'193","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.361471+0000","last_change":"2024-09-12T00:11:45.952012+0000","last_active":"2024-09-12T00:52:54.361471+0000","last_peered":"2024-09-12T00:52:54.361471+0000","last_clean":"2024-09-12T00:52:54.361471+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:52:54.361471+0000","last_undegraded":"2024-09-12T00:52:54.361471+0000","last_fullsized":"2024-09-12T00:52:54.361471+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:30.524961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5606791,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":6575,"num_write":978,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.935730+0000","last_change":"2024-09-12T00:11:49.935780+0000","last_active":"2024-09-12T00:50:50.935730+0000","last_peered":"2024-09-12T00:50:50.935730+0000","last_clean":"2024-09-12T00:50:50.935730+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:50:50.935730+0000","last_undegraded":"2024-09-12T00:50:50.935730+0000","last_fullsized":"2024-09-12T00:50:50.935730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.785961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'831","reported_seq":2271,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.358125+0000","last_change":"2024-09-12T00:11:51.943417+0000","last_active":"2024-09-12T00:54:18.358125+0000","last_peered":"2024-09-12T00:54:18.358125+0000","last_clean":"2024-09-12T00:54:18.358125+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:18.358125+0000","last_undegraded":"2024-09-12T00:54:18.358125+0000","last_fullsized":"2024-09-12T00:54:18.358125+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:34.607897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72884,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1145,"num_read_kb":1408,"num_write":274,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947961+0000","last_change":"2024-09-12T00:11:53.962102+0000","last_active":"2024-09-12T00:51:40.947961+0000","last_peered":"2024-09-12T00:51:40.947961+0000","last_clean":"2024-09-12T00:51:40.947961+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:51:40.947961+0000","last_undegraded":"2024-09-12T00:51:40.947961+0000","last_fullsized":"2024-09-12T00:51:40.947961+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:40.329220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'206","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:31.450664+0000","last_change":"2024-09-12T00:11:55.982765+0000","last_active":"2024-09-12T00:52:31.450664+0000","last_peered":"2024-09-12T00:52:31.450664+0000","last_clean":"2024-09-12T00:52:31.450664+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:52:31.450664+0000","last_undegraded":"2024-09-12T00:52:31.450664+0000","last_fullsized":"2024-09-12T00:52:31.450664+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.734557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'992","reported_seq":2842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.297386+0000","last_change":"2024-09-12T00:11:47.941493+0000","last_active":"2024-09-12T00:52:59.297386+0000","last_peered":"2024-09-12T00:52:59.297386+0000","last_clean":"2024-09-12T00:52:59.297386+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:52:59.297386+0000","last_undegraded":"2024-09-12T00:52:59.297386+0000","last_fullsized":"2024-09-12T00:52:59.297386+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:06.733191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.920827+0000","last_change":"2024-09-12T00:11:34.731346+0000","last_active":"2024-09-12T00:51:10.920827+0000","last_peered":"2024-09-12T00:51:10.920827+0000","last_clean":"2024-09-12T00:51:10.920827+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:51:10.920827+0000","last_undegraded":"2024-09-12T00:51:10.920827+0000","last_fullsized":"2024-09-12T00:51:10.920827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:18.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'188","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.758465+0000","last_change":"2024-09-12T00:11:45.963489+0000","last_active":"2024-09-12T00:52:54.758465+0000","last_peered":"2024-09-12T00:52:54.758465+0000","last_clean":"2024-09-12T00:52:54.758465+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:52:54.758465+0000","last_undegraded":"2024-09-12T00:52:54.758465+0000","last_fullsized":"2024-09-12T00:52:54.758465+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:01.526306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5664849,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":16624,"num_write":909,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916628+0000","last_change":"2024-09-12T00:11:49.939428+0000","last_active":"2024-09-12T00:50:50.916628+0000","last_peered":"2024-09-12T00:50:50.916628+0000","last_clean":"2024-09-12T00:50:50.916628+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:50:50.916628+0000","last_undegraded":"2024-09-12T00:50:50.916628+0000","last_fullsized":"2024-09-12T00:50:50.916628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:44.977495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'231","reported_seq":1283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.391143+0000","last_change":"2024-09-12T00:11:51.950048+0000","last_active":"2024-09-12T00:54:15.391143+0000","last_peered":"2024-09-12T00:54:15.391143+0000","last_clean":"2024-09-12T00:54:15.391143+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:15.391143+0000","last_undegraded":"2024-09-12T00:54:15.391143+0000","last_fullsized":"2024-09-12T00:54:15.391143+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:06.199752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926496+0000","last_change":"2024-09-12T00:11:53.968069+0000","last_active":"2024-09-12T00:51:30.926496+0000","last_peered":"2024-09-12T00:51:30.926496+0000","last_clean":"2024-09-12T00:51:30.926496+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:51:30.926496+0000","last_undegraded":"2024-09-12T00:51:30.926496+0000","last_fullsized":"2024-09-12T00:51:30.926496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:02.100203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'312","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.889255+0000","last_change":"2024-09-12T00:11:55.967123+0000","last_active":"2024-09-12T00:53:13.889255+0000","last_peered":"2024-09-12T00:53:13.889255+0000","last_clean":"2024-09-12T00:53:13.889255+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:53:13.889255+0000","last_undegraded":"2024-09-12T00:53:13.889255+0000","last_fullsized":"2024-09-12T00:53:13.889255+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:10.855671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'379","reported_seq":1784,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.948108+0000","last_change":"2024-09-12T00:11:47.943438+0000","last_active":"2024-09-12T00:53:30.948108+0000","last_peered":"2024-09-12T00:53:30.948108+0000","last_clean":"2024-09-12T00:53:30.948108+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:53:30.948108+0000","last_undegraded":"2024-09-12T00:53:30.948108+0000","last_fullsized":"2024-09-12T00:53:30.948108+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:03.957852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940272+0000","last_change":"2024-09-12T00:11:34.618967+0000","last_active":"2024-09-12T00:51:10.940272+0000","last_peered":"2024-09-12T00:51:10.940272+0000","last_clean":"2024-09-12T00:51:10.940272+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:51:10.940272+0000","last_undegraded":"2024-09-12T00:51:10.940272+0000","last_fullsized":"2024-09-12T00:51:10.940272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.762426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'273","reported_seq":946,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.632499+0000","last_change":"2024-09-12T00:11:45.925677+0000","last_active":"2024-09-12T00:52:56.632499+0000","last_peered":"2024-09-12T00:52:56.632499+0000","last_clean":"2024-09-12T00:52:56.632499+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:52:56.632499+0000","last_undegraded":"2024-09-12T00:52:56.632499+0000","last_fullsized":"2024-09-12T00:52:56.632499+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:13.876652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9636774,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":645,"num_read_kb":17781,"num_write":1202,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926404+0000","last_change":"2024-09-12T00:11:49.947103+0000","last_active":"2024-09-12T00:51:35.926404+0000","last_peered":"2024-09-12T00:51:35.926404+0000","last_clean":"2024-09-12T00:51:35.926404+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:51:35.926404+0000","last_undegraded":"2024-09-12T00:51:35.926404+0000","last_fullsized":"2024-09-12T00:51:35.926404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.613882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'109","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.954400+0000","last_change":"2024-09-12T00:11:51.944099+0000","last_active":"2024-09-12T00:53:04.954400+0000","last_peered":"2024-09-12T00:53:04.954400+0000","last_clean":"2024-09-12T00:53:04.954400+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:53:04.954400+0000","last_undegraded":"2024-09-12T00:53:04.954400+0000","last_fullsized":"2024-09-12T00:53:04.954400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:44.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.936964+0000","last_change":"2024-09-12T00:11:53.964265+0000","last_active":"2024-09-12T00:50:55.936964+0000","last_peered":"2024-09-12T00:50:55.936964+0000","last_clean":"2024-09-12T00:50:55.936964+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:50:55.936964+0000","last_undegraded":"2024-09-12T00:50:55.936964+0000","last_fullsized":"2024-09-12T00:50:55.936964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:02.137660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:06.122873+0000","last_change":"2024-09-12T00:11:55.974232+0000","last_active":"2024-09-12T00:53:06.122873+0000","last_peered":"2024-09-12T00:53:06.122873+0000","last_clean":"2024-09-12T00:53:06.122873+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:53:06.122873+0000","last_undegraded":"2024-09-12T00:53:06.122873+0000","last_fullsized":"2024-09-12T00:53:06.122873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:18.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'425","reported_seq":1926,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.195375+0000","last_change":"2024-09-12T00:11:47.950054+0000","last_active":"2024-09-12T00:54:17.195375+0000","last_peered":"2024-09-12T00:54:17.195375+0000","last_clean":"2024-09-12T00:54:17.195375+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:17.195375+0000","last_undegraded":"2024-09-12T00:54:17.195375+0000","last_fullsized":"2024-09-12T00:54:17.195375+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:18.896652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'187","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:09.887862+0000","last_change":"2024-09-12T00:11:45.938174+0000","last_active":"2024-09-12T00:54:09.887862+0000","last_peered":"2024-09-12T00:54:09.887862+0000","last_clean":"2024-09-12T00:54:09.887862+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:09.887862+0000","last_undegraded":"2024-09-12T00:54:09.887862+0000","last_fullsized":"2024-09-12T00:54:09.887862+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:20.890123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6591677,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":910,"num_read_kb":23524,"num_write":937,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927231+0000","last_change":"2024-09-12T00:11:34.874306+0000","last_active":"2024-09-12T00:51:09.927231+0000","last_peered":"2024-09-12T00:51:09.927231+0000","last_clean":"2024-09-12T00:51:09.927231+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:51:09.927231+0000","last_undegraded":"2024-09-12T00:51:09.927231+0000","last_fullsized":"2024-09-12T00:51:09.927231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:04.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.925302+0000","last_change":"2024-09-12T00:11:49.940655+0000","last_active":"2024-09-12T00:51:25.925302+0000","last_peered":"2024-09-12T00:51:25.925302+0000","last_clean":"2024-09-12T00:51:25.925302+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:51:25.925302+0000","last_undegraded":"2024-09-12T00:51:25.925302+0000","last_fullsized":"2024-09-12T00:51:25.925302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:51.772761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'266","reported_seq":932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.288941+0000","last_change":"2024-09-12T00:11:51.951322+0000","last_active":"2024-09-12T00:54:18.288941+0000","last_peered":"2024-09-12T00:54:18.288941+0000","last_clean":"2024-09-12T00:54:18.288941+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:18.288941+0000","last_undegraded":"2024-09-12T00:54:18.288941+0000","last_fullsized":"2024-09-12T00:54:18.288941+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:19.014495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30452,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":374,"num_read_kb":516,"num_write":210,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121823+0000","last_change":"2024-09-12T00:11:53.958248+0000","last_active":"2024-09-12T00:51:31.121823+0000","last_peered":"2024-09-12T00:51:31.121823+0000","last_clean":"2024-09-12T00:51:31.121823+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:51:31.121823+0000","last_undegraded":"2024-09-12T00:51:31.121823+0000","last_fullsized":"2024-09-12T00:51:31.121823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.005296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'149","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.692391+0000","last_change":"2024-09-12T00:11:55.982508+0000","last_active":"2024-09-12T00:52:54.692391+0000","last_peered":"2024-09-12T00:52:54.692391+0000","last_clean":"2024-09-12T00:52:54.692391+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:52:54.692391+0000","last_undegraded":"2024-09-12T00:52:54.692391+0000","last_fullsized":"2024-09-12T00:52:54.692391+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.265884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'457","reported_seq":2076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.193459+0000","last_change":"2024-09-12T00:11:47.941980+0000","last_active":"2024-09-12T00:54:17.193459+0000","last_peered":"2024-09-12T00:54:17.193459+0000","last_clean":"2024-09-12T00:54:17.193459+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:17.193459+0000","last_undegraded":"2024-09-12T00:54:17.193459+0000","last_fullsized":"2024-09-12T00:54:17.193459+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:12.954699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'215","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:13.600648+0000","last_change":"2024-09-12T00:11:45.957384+0000","last_active":"2024-09-12T00:52:13.600648+0000","last_peered":"2024-09-12T00:52:13.600648+0000","last_clean":"2024-09-12T00:52:13.600648+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:52:13.600648+0000","last_undegraded":"2024-09-12T00:52:13.600648+0000","last_fullsized":"2024-09-12T00:52:13.600648+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:27.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244951,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":425,"num_read_kb":4575,"num_write":1016,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:20.943222+0000","last_change":"2024-09-12T00:11:34.617205+0000","last_active":"2024-09-12T00:51:20.943222+0000","last_peered":"2024-09-12T00:51:20.943222+0000","last_clean":"2024-09-12T00:51:20.943222+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:51:20.943222+0000","last_undegraded":"2024-09-12T00:51:20.943222+0000","last_fullsized":"2024-09-12T00:51:20.943222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:51.436105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.926639+0000","last_change":"2024-09-12T00:11:49.929449+0000","last_active":"2024-09-12T00:51:25.926639+0000","last_peered":"2024-09-12T00:51:25.926639+0000","last_clean":"2024-09-12T00:51:25.926639+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:51:25.926639+0000","last_undegraded":"2024-09-12T00:51:25.926639+0000","last_fullsized":"2024-09-12T00:51:25.926639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:39.048491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'179","reported_seq":747,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:29.368057+0000","last_change":"2024-09-12T00:11:51.941186+0000","last_active":"2024-09-12T00:53:29.368057+0000","last_peered":"2024-09-12T00:53:29.368057+0000","last_clean":"2024-09-12T00:53:29.368057+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:53:29.368057+0000","last_undegraded":"2024-09-12T00:53:29.368057+0000","last_fullsized":"2024-09-12T00:53:29.368057+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:41.525044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'799","reported_seq":2666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.970455+0000","last_change":"2024-09-12T00:11:53.946719+0000","last_active":"2024-09-12T00:54:30.970455+0000","last_peered":"2024-09-12T00:54:30.970455+0000","last_clean":"2024-09-12T00:54:30.970455+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:30.970455+0000","last_undegraded":"2024-09-12T00:54:30.970455+0000","last_fullsized":"2024-09-12T00:54:30.970455+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":701,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:54.556954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'113","reported_seq":612,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.080514+0000","last_change":"2024-09-12T00:11:55.974820+0000","last_active":"2024-09-12T00:52:53.080514+0000","last_peered":"2024-09-12T00:52:53.080514+0000","last_clean":"2024-09-12T00:52:53.080514+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:52:53.080514+0000","last_undegraded":"2024-09-12T00:52:53.080514+0000","last_fullsized":"2024-09-12T00:52:53.080514+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:58.128560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'449","reported_seq":1854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.980363+0000","last_change":"2024-09-12T00:11:47.943089+0000","last_active":"2024-09-12T00:53:01.980363+0000","last_peered":"2024-09-12T00:53:01.980363+0000","last_clean":"2024-09-12T00:53:01.980363+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:53:01.980363+0000","last_undegraded":"2024-09-12T00:53:01.980363+0000","last_fullsized":"2024-09-12T00:53:01.980363+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:44.592044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'249","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:58.178304+0000","last_change":"2024-09-12T00:11:45.944133+0000","last_active":"2024-09-12T00:52:58.178304+0000","last_peered":"2024-09-12T00:52:58.178304+0000","last_clean":"2024-09-12T00:52:58.178304+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:52:58.178304+0000","last_undegraded":"2024-09-12T00:52:58.178304+0000","last_fullsized":"2024-09-12T00:52:58.178304+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.226214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2343909,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":627,"num_read_kb":14953,"num_write":1329,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.914062+0000","last_change":"2024-09-12T00:11:34.613977+0000","last_active":"2024-09-12T00:50:35.914062+0000","last_peered":"2024-09-12T00:50:35.914062+0000","last_clean":"2024-09-12T00:50:35.914062+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:50:35.914062+0000","last_undegraded":"2024-09-12T00:50:35.914062+0000","last_fullsized":"2024-09-12T00:50:35.914062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:31.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.944327+0000","last_change":"2024-09-12T00:11:49.929660+0000","last_active":"2024-09-12T00:51:25.944327+0000","last_peered":"2024-09-12T00:51:25.944327+0000","last_clean":"2024-09-12T00:51:25.944327+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:51:25.944327+0000","last_undegraded":"2024-09-12T00:51:25.944327+0000","last_fullsized":"2024-09-12T00:51:25.944327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:57.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'109","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:28.252812+0000","last_change":"2024-09-12T00:11:51.947657+0000","last_active":"2024-09-12T00:52:28.252812+0000","last_peered":"2024-09-12T00:52:28.252812+0000","last_clean":"2024-09-12T00:52:28.252812+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:52:28.252812+0000","last_undegraded":"2024-09-12T00:52:28.252812+0000","last_fullsized":"2024-09-12T00:52:28.252812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:12.346313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'786","reported_seq":2340,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.370733+0000","last_change":"2024-09-12T00:11:53.968955+0000","last_active":"2024-09-12T00:54:18.370733+0000","last_peered":"2024-09-12T00:54:18.370733+0000","last_clean":"2024-09-12T00:54:18.370733+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:54:18.370733+0000","last_undegraded":"2024-09-12T00:54:18.370733+0000","last_fullsized":"2024-09-12T00:54:18.370733+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":701,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:38.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'188","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:47.798689+0000","last_change":"2024-09-12T00:11:55.972707+0000","last_active":"2024-09-12T00:52:47.798689+0000","last_peered":"2024-09-12T00:52:47.798689+0000","last_clean":"2024-09-12T00:52:47.798689+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:52:47.798689+0000","last_undegraded":"2024-09-12T00:52:47.798689+0000","last_fullsized":"2024-09-12T00:52:47.798689+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.070375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'482","reported_seq":2168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199159+0000","last_change":"2024-09-12T00:11:47.920074+0000","last_active":"2024-09-12T00:54:17.199159+0000","last_peered":"2024-09-12T00:54:17.199159+0000","last_clean":"2024-09-12T00:54:17.199159+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:17.199159+0000","last_undegraded":"2024-09-12T00:54:17.199159+0000","last_fullsized":"2024-09-12T00:54:17.199159+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:15.555950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'214","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.190115+0000","last_change":"2024-09-12T00:11:45.934651+0000","last_active":"2024-09-12T00:53:11.190115+0000","last_peered":"2024-09-12T00:53:11.190115+0000","last_clean":"2024-09-12T00:53:11.190115+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:53:11.190115+0000","last_undegraded":"2024-09-12T00:53:11.190115+0000","last_fullsized":"2024-09-12T00:53:11.190115+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:00.165999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14703459,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":60723,"num_write":945,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.932047+0000","last_change":"2024-09-12T00:11:34.618193+0000","last_active":"2024-09-12T00:50:35.932047+0000","last_peered":"2024-09-12T00:50:35.932047+0000","last_clean":"2024-09-12T00:50:35.932047+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:50:35.932047+0000","last_undegraded":"2024-09-12T00:50:35.932047+0000","last_fullsized":"2024-09-12T00:50:35.932047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:18.144454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933247+0000","last_change":"2024-09-12T00:11:49.928566+0000","last_active":"2024-09-12T00:52:00.933247+0000","last_peered":"2024-09-12T00:52:00.933247+0000","last_clean":"2024-09-12T00:52:00.933247+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:52:00.933247+0000","last_undegraded":"2024-09-12T00:52:00.933247+0000","last_fullsized":"2024-09-12T00:52:00.933247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:38.587979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'331","reported_seq":1034,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.283692+0000","last_change":"2024-09-12T00:11:51.944165+0000","last_active":"2024-09-12T00:54:18.283692+0000","last_peered":"2024-09-12T00:54:18.283692+0000","last_clean":"2024-09-12T00:54:18.283692+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:18.283692+0000","last_undegraded":"2024-09-12T00:54:18.283692+0000","last_fullsized":"2024-09-12T00:54:18.283692+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:13.970557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":460,"num_read_kb":648,"num_write":246,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926396+0000","last_change":"2024-09-12T00:11:53.959232+0000","last_active":"2024-09-12T00:51:30.926396+0000","last_peered":"2024-09-12T00:51:30.926396+0000","last_clean":"2024-09-12T00:51:30.926396+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:51:30.926396+0000","last_undegraded":"2024-09-12T00:51:30.926396+0000","last_fullsized":"2024-09-12T00:51:30.926396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:48.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'91","reported_seq":581,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.028563+0000","last_change":"2024-09-12T00:11:55.977283+0000","last_active":"2024-09-12T00:52:49.028563+0000","last_peered":"2024-09-12T00:52:49.028563+0000","last_clean":"2024-09-12T00:52:49.028563+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:52:49.028563+0000","last_undegraded":"2024-09-12T00:52:49.028563+0000","last_fullsized":"2024-09-12T00:52:49.028563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:03.673797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'150","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.512255+0000","last_change":"2024-09-12T00:11:55.987098+0000","last_active":"2024-09-12T00:53:14.512255+0000","last_peered":"2024-09-12T00:53:14.512255+0000","last_clean":"2024-09-12T00:53:14.512255+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:53:14.512255+0000","last_undegraded":"2024-09-12T00:53:14.512255+0000","last_fullsized":"2024-09-12T00:53:14.512255+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:47.859646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'404","reported_seq":1793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:51.152300+0000","last_change":"2024-09-12T00:11:47.921763+0000","last_active":"2024-09-12T00:53:51.152300+0000","last_peered":"2024-09-12T00:53:51.152300+0000","last_clean":"2024-09-12T00:53:51.152300+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:53:51.152300+0000","last_undegraded":"2024-09-12T00:53:51.152300+0000","last_fullsized":"2024-09-12T00:53:51.152300+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'183","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.878375+0000","last_change":"2024-09-12T00:11:45.930485+0000","last_active":"2024-09-12T00:52:59.878375+0000","last_peered":"2024-09-12T00:52:59.878375+0000","last_clean":"2024-09-12T00:52:59.878375+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:52:59.878375+0000","last_undegraded":"2024-09-12T00:52:59.878375+0000","last_fullsized":"2024-09-12T00:52:59.878375+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.242243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":101459,"num_write":842,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.921522+0000","last_change":"2024-09-12T00:11:49.940350+0000","last_active":"2024-09-12T00:51:30.921522+0000","last_peered":"2024-09-12T00:51:30.921522+0000","last_clean":"2024-09-12T00:51:30.921522+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:51:30.921522+0000","last_undegraded":"2024-09-12T00:51:30.921522+0000","last_fullsized":"2024-09-12T00:51:30.921522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:25.951150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'139","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.953227+0000","last_change":"2024-09-12T00:11:51.929179+0000","last_active":"2024-09-12T00:53:55.953227+0000","last_peered":"2024-09-12T00:53:55.953227+0000","last_clean":"2024-09-12T00:53:55.953227+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:53:55.953227+0000","last_undegraded":"2024-09-12T00:53:55.953227+0000","last_fullsized":"2024-09-12T00:53:55.953227+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:47.615364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15370,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926201+0000","last_change":"2024-09-12T00:11:53.965867+0000","last_active":"2024-09-12T00:51:35.926201+0000","last_peered":"2024-09-12T00:51:35.926201+0000","last_clean":"2024-09-12T00:51:35.926201+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:51:35.926201+0000","last_undegraded":"2024-09-12T00:51:35.926201+0000","last_fullsized":"2024-09-12T00:51:35.926201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:46.503762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.778087+0000","last_change":"2024-09-12T00:11:55.975673+0000","last_active":"2024-09-12T00:53:13.778087+0000","last_peered":"2024-09-12T00:53:13.778087+0000","last_clean":"2024-09-12T00:53:13.778087+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:53:13.778087+0000","last_undegraded":"2024-09-12T00:53:13.778087+0000","last_fullsized":"2024-09-12T00:53:13.778087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:53.889300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'348","reported_seq":1863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.366932+0000","last_change":"2024-09-12T00:11:47.935945+0000","last_active":"2024-09-12T00:53:14.366932+0000","last_peered":"2024-09-12T00:53:14.366932+0000","last_clean":"2024-09-12T00:53:14.366932+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:53:14.366932+0000","last_undegraded":"2024-09-12T00:53:14.366932+0000","last_fullsized":"2024-09-12T00:53:14.366932+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'334","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.916821+0000","last_change":"2024-09-12T00:11:45.942994+0000","last_active":"2024-09-12T00:52:32.916821+0000","last_peered":"2024-09-12T00:52:32.916821+0000","last_clean":"2024-09-12T00:52:32.916821+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:52:32.916821+0000","last_undegraded":"2024-09-12T00:52:32.916821+0000","last_fullsized":"2024-09-12T00:52:32.916821+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:36.262305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2700018,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":791,"num_read_kb":9288,"num_write":1285,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926444+0000","last_change":"2024-09-12T00:11:49.942679+0000","last_active":"2024-09-12T00:51:30.926444+0000","last_peered":"2024-09-12T00:51:30.926444+0000","last_clean":"2024-09-12T00:51:30.926444+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:51:30.926444+0000","last_undegraded":"2024-09-12T00:51:30.926444+0000","last_fullsized":"2024-09-12T00:51:30.926444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:19.512522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'54","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.203822+0000","last_change":"2024-09-12T00:11:51.951112+0000","last_active":"2024-09-12T00:52:02.203822+0000","last_peered":"2024-09-12T00:52:02.203822+0000","last_clean":"2024-09-12T00:52:02.203822+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:52:02.203822+0000","last_undegraded":"2024-09-12T00:52:02.203822+0000","last_fullsized":"2024-09-12T00:52:02.203822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.473635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.122929+0000","last_change":"2024-09-12T00:11:53.965509+0000","last_active":"2024-09-12T00:51:36.122929+0000","last_peered":"2024-09-12T00:51:36.122929+0000","last_clean":"2024-09-12T00:51:36.122929+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:51:36.122929+0000","last_undegraded":"2024-09-12T00:51:36.122929+0000","last_fullsized":"2024-09-12T00:51:36.122929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:23.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'192","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.755700+0000","last_change":"2024-09-12T00:11:55.977952+0000","last_active":"2024-09-12T00:53:13.755700+0000","last_peered":"2024-09-12T00:53:13.755700+0000","last_clean":"2024-09-12T00:53:13.755700+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:53:13.755700+0000","last_undegraded":"2024-09-12T00:53:13.755700+0000","last_fullsized":"2024-09-12T00:53:13.755700+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'771","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.245517+0000","last_change":"2024-09-12T00:11:47.926772+0000","last_active":"2024-09-12T00:53:00.245517+0000","last_peered":"2024-09-12T00:53:00.245517+0000","last_clean":"2024-09-12T00:53:00.245517+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:53:00.245517+0000","last_undegraded":"2024-09-12T00:53:00.245517+0000","last_fullsized":"2024-09-12T00:53:00.245517+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'189","reported_seq":830,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.085599+0000","last_change":"2024-09-12T00:11:45.915920+0000","last_active":"2024-09-12T00:54:31.085599+0000","last_peered":"2024-09-12T00:54:31.085599+0000","last_clean":"2024-09-12T00:54:31.085599+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:31.085599+0000","last_undegraded":"2024-09-12T00:54:31.085599+0000","last_fullsized":"2024-09-12T00:54:31.085599+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:59.681239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267641,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":25665,"num_write":919,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121782+0000","last_change":"2024-09-12T00:11:49.923313+0000","last_active":"2024-09-12T00:51:31.121782+0000","last_peered":"2024-09-12T00:51:31.121782+0000","last_clean":"2024-09-12T00:51:31.121782+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:51:31.121782+0000","last_undegraded":"2024-09-12T00:51:31.121782+0000","last_fullsized":"2024-09-12T00:51:31.121782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'173","reported_seq":758,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.956572+0000","last_change":"2024-09-12T00:11:51.938094+0000","last_active":"2024-09-12T00:53:55.956572+0000","last_peered":"2024-09-12T00:53:55.956572+0000","last_clean":"2024-09-12T00:53:55.956572+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:53:55.956572+0000","last_undegraded":"2024-09-12T00:53:55.956572+0000","last_fullsized":"2024-09-12T00:53:55.956572+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":285,"num_write":130,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104093+0000","last_change":"2024-09-12T00:11:53.955154+0000","last_active":"2024-09-12T00:51:36.104093+0000","last_peered":"2024-09-12T00:51:36.104093+0000","last_clean":"2024-09-12T00:51:36.104093+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:51:36.104093+0000","last_undegraded":"2024-09-12T00:51:36.104093+0000","last_fullsized":"2024-09-12T00:51:36.104093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:55.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'104","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.550126+0000","last_change":"2024-09-12T00:11:55.959282+0000","last_active":"2024-09-12T00:52:29.550126+0000","last_peered":"2024-09-12T00:52:29.550126+0000","last_clean":"2024-09-12T00:52:29.550126+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:52:29.550126+0000","last_undegraded":"2024-09-12T00:52:29.550126+0000","last_fullsized":"2024-09-12T00:52:29.550126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:03.301311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'808","reported_seq":2294,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.551364+0000","last_change":"2024-09-12T00:11:47.933067+0000","last_active":"2024-09-12T00:52:56.551364+0000","last_peered":"2024-09-12T00:52:56.551364+0000","last_clean":"2024-09-12T00:52:56.551364+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:52:56.551364+0000","last_undegraded":"2024-09-12T00:52:56.551364+0000","last_fullsized":"2024-09-12T00:52:56.551364+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.114451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'186","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.255863+0000","last_change":"2024-09-12T00:11:45.958369+0000","last_active":"2024-09-12T00:53:11.255863+0000","last_peered":"2024-09-12T00:53:11.255863+0000","last_clean":"2024-09-12T00:53:11.255863+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:53:11.255863+0000","last_undegraded":"2024-09-12T00:53:11.255863+0000","last_fullsized":"2024-09-12T00:53:11.255863+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:06.439973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15390438,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":452,"num_read_kb":36400,"num_write":895,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.945612+0000","last_change":"2024-09-12T00:11:49.928504+0000","last_active":"2024-09-12T00:51:30.945612+0000","last_peered":"2024-09-12T00:51:30.945612+0000","last_clean":"2024-09-12T00:51:30.945612+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:51:30.945612+0000","last_undegraded":"2024-09-12T00:51:30.945612+0000","last_fullsized":"2024-09-12T00:51:30.945612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:00.545918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'127","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.956356+0000","last_change":"2024-09-12T00:11:51.951940+0000","last_active":"2024-09-12T00:53:55.956356+0000","last_peered":"2024-09-12T00:53:55.956356+0000","last_clean":"2024-09-12T00:53:55.956356+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:53:55.956356+0000","last_undegraded":"2024-09-12T00:53:55.956356+0000","last_fullsized":"2024-09-12T00:53:55.956356+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.384189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926323+0000","last_change":"2024-09-12T00:11:53.970031+0000","last_active":"2024-09-12T00:51:35.926323+0000","last_peered":"2024-09-12T00:51:35.926323+0000","last_clean":"2024-09-12T00:51:35.926323+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:51:35.926323+0000","last_undegraded":"2024-09-12T00:51:35.926323+0000","last_fullsized":"2024-09-12T00:51:35.926323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.869156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'722","reported_seq":2103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.974112+0000","last_change":"2024-09-12T00:11:47.944209+0000","last_active":"2024-09-12T00:53:30.974112+0000","last_peered":"2024-09-12T00:53:30.974112+0000","last_clean":"2024-09-12T00:53:30.974112+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:53:30.974112+0000","last_undegraded":"2024-09-12T00:53:30.974112+0000","last_fullsized":"2024-09-12T00:53:30.974112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:07.479060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'183","reported_seq":801,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.111330+0000","last_change":"2024-09-12T00:11:45.967978+0000","last_active":"2024-09-12T00:53:01.111330+0000","last_peered":"2024-09-12T00:53:01.111330+0000","last_clean":"2024-09-12T00:53:01.111330+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:53:01.111330+0000","last_undegraded":"2024-09-12T00:53:01.111330+0000","last_fullsized":"2024-09-12T00:53:01.111330+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:25.205405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7264373,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":379,"num_read_kb":8086,"num_write":857,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928734+0000","last_change":"2024-09-12T00:11:49.940476+0000","last_active":"2024-09-12T00:52:00.928734+0000","last_peered":"2024-09-12T00:52:00.928734+0000","last_clean":"2024-09-12T00:52:00.928734+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:52:00.928734+0000","last_undegraded":"2024-09-12T00:52:00.928734+0000","last_fullsized":"2024-09-12T00:52:00.928734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.808496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'190","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.328604+0000","last_change":"2024-09-12T00:11:51.955207+0000","last_active":"2024-09-12T00:54:18.328604+0000","last_peered":"2024-09-12T00:54:18.328604+0000","last_clean":"2024-09-12T00:54:18.328604+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:54:18.328604+0000","last_undegraded":"2024-09-12T00:54:18.328604+0000","last_fullsized":"2024-09-12T00:54:18.328604+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:43.145562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23262,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":290,"num_read_kb":373,"num_write":186,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.127739+0000","last_change":"2024-09-12T00:11:53.970075+0000","last_active":"2024-09-12T00:51:56.127739+0000","last_peered":"2024-09-12T00:51:56.127739+0000","last_clean":"2024-09-12T00:51:56.127739+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:51:56.127739+0000","last_undegraded":"2024-09-12T00:51:56.127739+0000","last_fullsized":"2024-09-12T00:51:56.127739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.073296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'153","reported_seq":652,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967355+0000","last_change":"2024-09-12T00:11:55.983643+0000","last_active":"2024-09-12T00:53:59.967355+0000","last_peered":"2024-09-12T00:53:59.967355+0000","last_clean":"2024-09-12T00:53:59.967355+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:53:59.967355+0000","last_undegraded":"2024-09-12T00:53:59.967355+0000","last_fullsized":"2024-09-12T00:53:59.967355+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:01.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'499","reported_seq":2219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.214803+0000","last_change":"2024-09-12T00:11:47.931274+0000","last_active":"2024-09-12T00:53:59.214803+0000","last_peered":"2024-09-12T00:53:59.214803+0000","last_clean":"2024-09-12T00:53:59.214803+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:53:59.214803+0000","last_undegraded":"2024-09-12T00:53:59.214803+0000","last_fullsized":"2024-09-12T00:53:59.214803+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:56.542635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'199","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.406760+0000","last_change":"2024-09-12T00:11:45.930986+0000","last_active":"2024-09-12T00:52:33.406760+0000","last_peered":"2024-09-12T00:52:33.406760+0000","last_clean":"2024-09-12T00:52:33.406760+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:52:33.406760+0000","last_undegraded":"2024-09-12T00:52:33.406760+0000","last_fullsized":"2024-09-12T00:52:33.406760+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:07.918577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5315388,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":23120,"num_write":963,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:26.120894+0000","last_change":"2024-09-12T00:11:49.940474+0000","last_active":"2024-09-12T00:51:26.120894+0000","last_peered":"2024-09-12T00:51:26.120894+0000","last_clean":"2024-09-12T00:51:26.120894+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:51:26.120894+0000","last_undegraded":"2024-09-12T00:51:26.120894+0000","last_fullsized":"2024-09-12T00:51:26.120894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:37.832060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'161","reported_seq":738,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.281148+0000","last_change":"2024-09-12T00:11:51.943970+0000","last_active":"2024-09-12T00:54:18.281148+0000","last_peered":"2024-09-12T00:54:18.281148+0000","last_clean":"2024-09-12T00:54:18.281148+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:54:18.281148+0000","last_undegraded":"2024-09-12T00:54:18.281148+0000","last_fullsized":"2024-09-12T00:54:18.281148+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:17.685375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10349,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":272,"num_write":142,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:54.937822+0000","last_change":"2024-09-12T00:11:53.969086+0000","last_active":"2024-09-12T00:51:54.937822+0000","last_peered":"2024-09-12T00:51:54.937822+0000","last_clean":"2024-09-12T00:51:54.937822+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:51:54.937822+0000","last_undegraded":"2024-09-12T00:51:54.937822+0000","last_fullsized":"2024-09-12T00:51:54.937822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.001970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.122045+0000","last_change":"2024-09-12T00:11:55.970975+0000","last_active":"2024-09-12T00:54:17.122045+0000","last_peered":"2024-09-12T00:54:17.122045+0000","last_clean":"2024-09-12T00:54:17.122045+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:54:17.122045+0000","last_undegraded":"2024-09-12T00:54:17.122045+0000","last_fullsized":"2024-09-12T00:54:17.122045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:19.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'810","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749355+0000","last_change":"2024-09-12T00:11:47.946771+0000","last_active":"2024-09-12T00:53:13.749355+0000","last_peered":"2024-09-12T00:53:13.749355+0000","last_clean":"2024-09-12T00:53:13.749355+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:53:13.749355+0000","last_undegraded":"2024-09-12T00:53:13.749355+0000","last_fullsized":"2024-09-12T00:53:13.749355+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:20.616253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'208","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.134591+0000","last_change":"2024-09-12T00:11:45.950887+0000","last_active":"2024-09-12T00:54:16.134591+0000","last_peered":"2024-09-12T00:54:16.134591+0000","last_clean":"2024-09-12T00:54:16.134591+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:16.134591+0000","last_undegraded":"2024-09-12T00:54:16.134591+0000","last_fullsized":"2024-09-12T00:54:16.134591+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.570694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388623,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":378,"num_read_kb":5549,"num_write":1013,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126599+0000","last_change":"2024-09-12T00:11:49.932242+0000","last_active":"2024-09-12T00:51:51.126599+0000","last_peered":"2024-09-12T00:51:51.126599+0000","last_clean":"2024-09-12T00:51:51.126599+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:51:51.126599+0000","last_undegraded":"2024-09-12T00:51:51.126599+0000","last_fullsized":"2024-09-12T00:51:51.126599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:01.572248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'146","reported_seq":723,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:35.949198+0000","last_change":"2024-09-12T00:11:51.947579+0000","last_active":"2024-09-12T00:53:35.949198+0000","last_peered":"2024-09-12T00:53:35.949198+0000","last_clean":"2024-09-12T00:53:35.949198+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:53:35.949198+0000","last_undegraded":"2024-09-12T00:53:35.949198+0000","last_fullsized":"2024-09-12T00:53:35.949198+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:01.742280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13472,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":193,"num_write":100,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932799+0000","last_change":"2024-09-12T00:11:53.966010+0000","last_active":"2024-09-12T00:52:05.932799+0000","last_peered":"2024-09-12T00:52:05.932799+0000","last_clean":"2024-09-12T00:52:05.932799+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:52:05.932799+0000","last_undegraded":"2024-09-12T00:52:05.932799+0000","last_fullsized":"2024-09-12T00:52:05.932799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.714255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'153","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.341421+0000","last_change":"2024-09-12T00:11:55.984385+0000","last_active":"2024-09-12T00:54:18.341421+0000","last_peered":"2024-09-12T00:54:18.341421+0000","last_clean":"2024-09-12T00:54:18.341421+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:54:18.341421+0000","last_undegraded":"2024-09-12T00:54:18.341421+0000","last_fullsized":"2024-09-12T00:54:18.341421+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:18.613083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'789","reported_seq":2425,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981146+0000","last_change":"2024-09-12T00:11:47.953467+0000","last_active":"2024-09-12T00:53:01.981146+0000","last_peered":"2024-09-12T00:53:01.981146+0000","last_clean":"2024-09-12T00:53:01.981146+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:53:01.981146+0000","last_undegraded":"2024-09-12T00:53:01.981146+0000","last_fullsized":"2024-09-12T00:53:01.981146+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.239103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'206","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.045447+0000","last_change":"2024-09-12T00:11:45.933222+0000","last_active":"2024-09-12T00:52:24.045447+0000","last_peered":"2024-09-12T00:52:24.045447+0000","last_clean":"2024-09-12T00:52:24.045447+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:52:24.045447+0000","last_undegraded":"2024-09-12T00:52:24.045447+0000","last_fullsized":"2024-09-12T00:52:24.045447+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:11.850109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6604377,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":521,"num_read_kb":30758,"num_write":1016,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931153+0000","last_change":"2024-09-12T00:11:49.944879+0000","last_active":"2024-09-12T00:51:50.931153+0000","last_peered":"2024-09-12T00:51:50.931153+0000","last_clean":"2024-09-12T00:51:50.931153+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:51:50.931153+0000","last_undegraded":"2024-09-12T00:51:50.931153+0000","last_fullsized":"2024-09-12T00:51:50.931153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.523417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'95","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954504+0000","last_change":"2024-09-12T00:11:51.938728+0000","last_active":"2024-09-12T00:52:05.954504+0000","last_peered":"2024-09-12T00:52:05.954504+0000","last_clean":"2024-09-12T00:52:05.954504+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:52:05.954504+0000","last_undegraded":"2024-09-12T00:52:05.954504+0000","last_fullsized":"2024-09-12T00:52:05.954504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:11.275648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'752","reported_seq":2385,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.362874+0000","last_change":"2024-09-12T00:11:53.945013+0000","last_active":"2024-09-12T00:54:18.362874+0000","last_peered":"2024-09-12T00:54:18.362874+0000","last_clean":"2024-09-12T00:54:18.362874+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:18.362874+0000","last_undegraded":"2024-09-12T00:54:18.362874+0000","last_fullsized":"2024-09-12T00:54:18.362874+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:55.474571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.361616+0000","last_change":"2024-09-12T00:11:55.961931+0000","last_active":"2024-09-12T00:53:14.361616+0000","last_peered":"2024-09-12T00:53:14.361616+0000","last_clean":"2024-09-12T00:53:14.361616+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:53:14.361616+0000","last_undegraded":"2024-09-12T00:53:14.361616+0000","last_fullsized":"2024-09-12T00:53:14.361616+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.615113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'464","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.299711+0000","last_change":"2024-09-12T00:11:47.941918+0000","last_active":"2024-09-12T00:52:59.299711+0000","last_peered":"2024-09-12T00:52:59.299711+0000","last_clean":"2024-09-12T00:52:59.299711+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:52:59.299711+0000","last_undegraded":"2024-09-12T00:52:59.299711+0000","last_fullsized":"2024-09-12T00:52:59.299711+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:21.380303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'212","reported_seq":856,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.134651+0000","last_change":"2024-09-12T00:11:45.950800+0000","last_active":"2024-09-12T00:54:16.134651+0000","last_peered":"2024-09-12T00:54:16.134651+0000","last_clean":"2024-09-12T00:54:16.134651+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:16.134651+0000","last_undegraded":"2024-09-12T00:54:16.134651+0000","last_fullsized":"2024-09-12T00:54:16.134651+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:25.266687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9206037,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":458,"num_read_kb":55718,"num_write":994,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.107449+0000","last_change":"2024-09-12T00:11:49.920143+0000","last_active":"2024-09-12T00:51:51.107449+0000","last_peered":"2024-09-12T00:51:51.107449+0000","last_clean":"2024-09-12T00:51:51.107449+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:51:51.107449+0000","last_undegraded":"2024-09-12T00:51:51.107449+0000","last_fullsized":"2024-09-12T00:51:51.107449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:13.928120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'185","reported_seq":781,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.948913+0000","last_change":"2024-09-12T00:11:51.942692+0000","last_active":"2024-09-12T00:53:10.948913+0000","last_peered":"2024-09-12T00:53:10.948913+0000","last_clean":"2024-09-12T00:53:10.948913+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:53:10.948913+0000","last_undegraded":"2024-09-12T00:53:10.948913+0000","last_fullsized":"2024-09-12T00:53:10.948913+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.066244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":236,"num_read_kb":288,"num_write":136,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.913907+0000","last_change":"2024-09-12T00:11:53.968374+0000","last_active":"2024-09-12T00:50:35.913907+0000","last_peered":"2024-09-12T00:50:35.913907+0000","last_clean":"2024-09-12T00:50:35.913907+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:50:35.913907+0000","last_undegraded":"2024-09-12T00:50:35.913907+0000","last_fullsized":"2024-09-12T00:50:35.913907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:08.048773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'124","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.975045+0000","last_change":"2024-09-12T00:11:55.975761+0000","last_active":"2024-09-12T00:53:01.975045+0000","last_peered":"2024-09-12T00:53:01.975045+0000","last_clean":"2024-09-12T00:53:01.975045+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:53:01.975045+0000","last_undegraded":"2024-09-12T00:53:01.975045+0000","last_fullsized":"2024-09-12T00:53:01.975045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:21.563576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'923","reported_seq":2627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217609+0000","last_change":"2024-09-12T00:11:47.940921+0000","last_active":"2024-09-12T00:53:59.217609+0000","last_peered":"2024-09-12T00:53:59.217609+0000","last_clean":"2024-09-12T00:53:59.217609+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:53:59.217609+0000","last_undegraded":"2024-09-12T00:53:59.217609+0000","last_fullsized":"2024-09-12T00:53:59.217609+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:58.054782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'216","reported_seq":833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.684144+0000","last_change":"2024-09-12T00:11:45.930250+0000","last_active":"2024-09-12T00:52:33.684144+0000","last_peered":"2024-09-12T00:52:33.684144+0000","last_clean":"2024-09-12T00:52:33.684144+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:52:33.684144+0000","last_undegraded":"2024-09-12T00:52:33.684144+0000","last_fullsized":"2024-09-12T00:52:33.684144+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:11.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277951,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":8883,"num_write":985,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126541+0000","last_change":"2024-09-12T00:11:49.932760+0000","last_active":"2024-09-12T00:51:51.126541+0000","last_peered":"2024-09-12T00:51:51.126541+0000","last_clean":"2024-09-12T00:51:51.126541+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:51:51.126541+0000","last_undegraded":"2024-09-12T00:51:51.126541+0000","last_fullsized":"2024-09-12T00:51:51.126541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:03.502198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'128","reported_seq":698,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.945884+0000","last_change":"2024-09-12T00:11:51.948398+0000","last_active":"2024-09-12T00:53:00.945884+0000","last_peered":"2024-09-12T00:53:00.945884+0000","last_clean":"2024-09-12T00:53:00.945884+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:53:00.945884+0000","last_undegraded":"2024-09-12T00:53:00.945884+0000","last_fullsized":"2024-09-12T00:53:00.945884+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:24.018531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15063,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":231,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934303+0000","last_change":"2024-09-12T00:11:53.964372+0000","last_active":"2024-09-12T00:50:45.934303+0000","last_peered":"2024-09-12T00:50:45.934303+0000","last_clean":"2024-09-12T00:50:45.934303+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:50:45.934303+0000","last_undegraded":"2024-09-12T00:50:45.934303+0000","last_fullsized":"2024-09-12T00:50:45.934303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:46.181767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'122","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.250013+0000","last_change":"2024-09-12T00:11:55.983399+0000","last_active":"2024-09-12T00:53:00.250013+0000","last_peered":"2024-09-12T00:53:00.250013+0000","last_clean":"2024-09-12T00:53:00.250013+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:53:00.250013+0000","last_undegraded":"2024-09-12T00:53:00.250013+0000","last_fullsized":"2024-09-12T00:53:00.250013+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.340677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'510","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981820+0000","last_change":"2024-09-12T00:11:47.945866+0000","last_active":"2024-09-12T00:53:01.981820+0000","last_peered":"2024-09-12T00:53:01.981820+0000","last_clean":"2024-09-12T00:53:01.981820+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:53:01.981820+0000","last_undegraded":"2024-09-12T00:53:01.981820+0000","last_fullsized":"2024-09-12T00:53:01.981820+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:11.670029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'211","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.939064+0000","last_change":"2024-09-12T00:11:45.965907+0000","last_active":"2024-09-12T00:51:59.939064+0000","last_peered":"2024-09-12T00:51:59.939064+0000","last_clean":"2024-09-12T00:51:59.939064+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:51:59.939064+0000","last_undegraded":"2024-09-12T00:51:59.939064+0000","last_fullsized":"2024-09-12T00:51:59.939064+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:25.908411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637093,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":6403,"num_write":965,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:31.087675+0000","last_change":"2024-09-12T00:11:49.916956+0000","last_active":"2024-09-12T00:50:31.087675+0000","last_peered":"2024-09-12T00:50:31.087675+0000","last_clean":"2024-09-12T00:50:31.087675+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:50:31.087675+0000","last_undegraded":"2024-09-12T00:50:31.087675+0000","last_fullsized":"2024-09-12T00:50:31.087675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.223448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'98","reported_seq":657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.317551+0000","last_change":"2024-09-12T00:11:51.934188+0000","last_active":"2024-09-12T00:54:18.317551+0000","last_peered":"2024-09-12T00:54:18.317551+0000","last_clean":"2024-09-12T00:54:18.317551+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:18.317551+0000","last_undegraded":"2024-09-12T00:54:18.317551+0000","last_fullsized":"2024-09-12T00:54:18.317551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.730149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":180,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.951806+0000","last_change":"2024-09-12T00:11:53.953440+0000","last_active":"2024-09-12T00:51:55.951806+0000","last_peered":"2024-09-12T00:51:55.951806+0000","last_clean":"2024-09-12T00:51:55.951806+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:51:55.951806+0000","last_undegraded":"2024-09-12T00:51:55.951806+0000","last_fullsized":"2024-09-12T00:51:55.951806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:27.100590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'166","reported_seq":1291,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.040679+0000","last_change":"2024-09-12T00:11:55.977584+0000","last_active":"2024-09-12T00:53:12.040679+0000","last_peered":"2024-09-12T00:53:12.040679+0000","last_clean":"2024-09-12T00:53:12.040679+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:53:12.040679+0000","last_undegraded":"2024-09-12T00:53:12.040679+0000","last_fullsized":"2024-09-12T00:53:12.040679+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:56.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'389","reported_seq":1782,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.983959+0000","last_change":"2024-09-12T00:11:47.935949+0000","last_active":"2024-09-12T00:53:01.983959+0000","last_peered":"2024-09-12T00:53:01.983959+0000","last_clean":"2024-09-12T00:53:01.983959+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:53:01.983959+0000","last_undegraded":"2024-09-12T00:53:01.983959+0000","last_fullsized":"2024-09-12T00:53:01.983959+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:17.556138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'222","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:42.017931+0000","last_change":"2024-09-12T00:11:45.966312+0000","last_active":"2024-09-12T00:51:42.017931+0000","last_peered":"2024-09-12T00:51:42.017931+0000","last_clean":"2024-09-12T00:51:42.017931+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:51:42.017931+0000","last_undegraded":"2024-09-12T00:51:42.017931+0000","last_fullsized":"2024-09-12T00:51:42.017931+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:38.020981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483681,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":20983,"num_write":1043,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.915124+0000","last_change":"2024-09-12T00:11:49.935062+0000","last_active":"2024-09-12T00:50:40.915124+0000","last_peered":"2024-09-12T00:50:40.915124+0000","last_clean":"2024-09-12T00:50:40.915124+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:50:40.915124+0000","last_undegraded":"2024-09-12T00:50:40.915124+0000","last_fullsized":"2024-09-12T00:50:40.915124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:45.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'173","reported_seq":763,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.328228+0000","last_change":"2024-09-12T00:11:51.953534+0000","last_active":"2024-09-12T00:54:18.328228+0000","last_peered":"2024-09-12T00:54:18.328228+0000","last_clean":"2024-09-12T00:54:18.328228+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:54:18.328228+0000","last_undegraded":"2024-09-12T00:54:18.328228+0000","last_fullsized":"2024-09-12T00:54:18.328228+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:08.139733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17971,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":295,"num_write":132,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.932205+0000","last_change":"2024-09-12T00:11:53.964796+0000","last_active":"2024-09-12T00:51:55.932205+0000","last_peered":"2024-09-12T00:51:55.932205+0000","last_clean":"2024-09-12T00:51:55.932205+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:51:55.932205+0000","last_undegraded":"2024-09-12T00:51:55.932205+0000","last_fullsized":"2024-09-12T00:51:55.932205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:35.493703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'120","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.194988+0000","last_change":"2024-09-12T00:11:55.976617+0000","last_active":"2024-09-12T00:54:17.194988+0000","last_peered":"2024-09-12T00:54:17.194988+0000","last_clean":"2024-09-12T00:54:17.194988+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:54:17.194988+0000","last_undegraded":"2024-09-12T00:54:17.194988+0000","last_fullsized":"2024-09-12T00:54:17.194988+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:04.168911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'498","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.933790+0000","last_change":"2024-09-12T00:11:47.934353+0000","last_active":"2024-09-12T00:53:00.933790+0000","last_peered":"2024-09-12T00:53:00.933790+0000","last_clean":"2024-09-12T00:53:00.933790+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:53:00.933790+0000","last_undegraded":"2024-09-12T00:53:00.933790+0000","last_fullsized":"2024-09-12T00:53:00.933790+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:35.038205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'188","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.250021+0000","last_change":"2024-09-12T00:11:45.927795+0000","last_active":"2024-09-12T00:52:56.250021+0000","last_peered":"2024-09-12T00:52:56.250021+0000","last_clean":"2024-09-12T00:52:56.250021+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:52:56.250021+0000","last_undegraded":"2024-09-12T00:52:56.250021+0000","last_fullsized":"2024-09-12T00:52:56.250021+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:34.884235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557112,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":480,"num_read_kb":61937,"num_write":915,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'816","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.944422+0000","last_change":"2024-09-12T00:11:47.956154+0000","last_active":"2024-09-12T00:53:00.944422+0000","last_peered":"2024-09-12T00:53:00.944422+0000","last_clean":"2024-09-12T00:53:00.944422+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:53:00.944422+0000","last_undegraded":"2024-09-12T00:53:00.944422+0000","last_fullsized":"2024-09-12T00:53:00.944422+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:03.574450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'183","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.791802+0000","last_change":"2024-09-12T00:11:45.938208+0000","last_active":"2024-09-12T00:52:32.791802+0000","last_peered":"2024-09-12T00:52:32.791802+0000","last_clean":"2024-09-12T00:52:32.791802+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:52:32.791802+0000","last_undegraded":"2024-09-12T00:52:32.791802+0000","last_fullsized":"2024-09-12T00:52:32.791802+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.569205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6645389,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":18747,"num_write":855,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1200","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.294002+0000","last_change":"2024-09-12T00:11:47.923352+0000","last_active":"2024-09-12T00:53:59.294002+0000","last_peered":"2024-09-12T00:53:59.294002+0000","last_clean":"2024-09-12T00:53:59.294002+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:53:59.294002+0000","last_undegraded":"2024-09-12T00:53:59.294002+0000","last_fullsized":"2024-09-12T00:53:59.294002+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'206","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.402474+0000","last_change":"2024-09-12T00:11:45.955798+0000","last_active":"2024-09-12T00:53:11.402474+0000","last_peered":"2024-09-12T00:53:11.402474+0000","last_clean":"2024-09-12T00:53:11.402474+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:53:11.402474+0000","last_undegraded":"2024-09-12T00:53:11.402474+0000","last_fullsized":"2024-09-12T00:53:11.402474+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:10.064782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14466751,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":35398,"num_write":966,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'471","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.953028+0000","last_change":"2024-09-12T00:11:47.925461+0000","last_active":"2024-09-12T00:52:59.953028+0000","last_peered":"2024-09-12T00:52:59.953028+0000","last_clean":"2024-09-12T00:52:59.953028+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:52:59.953028+0000","last_undegraded":"2024-09-12T00:52:59.953028+0000","last_fullsized":"2024-09-12T00:52:59.953028+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:27.139459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'197","reported_seq":825,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:39.211022+0000","last_change":"2024-09-12T00:11:45.963753+0000","last_active":"2024-09-12T00:52:39.211022+0000","last_peered":"2024-09-12T00:52:39.211022+0000","last_clean":"2024-09-12T00:52:39.211022+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:52:39.211022+0000","last_undegraded":"2024-09-12T00:52:39.211022+0000","last_fullsized":"2024-09-12T00:52:39.211022+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.076031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":421,"num_read_kb":18770,"num_write":977,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'803","reported_seq":2332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:39.962743+0000","last_change":"2024-09-12T00:11:47.933827+0000","last_active":"2024-09-12T00:53:39.962743+0000","last_peered":"2024-09-12T00:53:39.962743+0000","last_clean":"2024-09-12T00:53:39.962743+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:53:39.962743+0000","last_undegraded":"2024-09-12T00:53:39.962743+0000","last_fullsized":"2024-09-12T00:53:39.962743+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:55.730348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'242","reported_seq":913,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:38.480550+0000","last_change":"2024-09-12T00:11:45.938920+0000","last_active":"2024-09-12T00:51:38.480550+0000","last_peered":"2024-09-12T00:51:38.480550+0000","last_clean":"2024-09-12T00:51:38.480550+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:51:38.480550+0000","last_undegraded":"2024-09-12T00:51:38.480550+0000","last_fullsized":"2024-09-12T00:51:38.480550+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:19.946280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6987873,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":608,"num_read_kb":28384,"num_write":1050,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'476","reported_seq":1937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369796+0000","last_change":"2024-09-12T00:11:47.930919+0000","last_active":"2024-09-12T00:53:14.369796+0000","last_peered":"2024-09-12T00:53:14.369796+0000","last_clean":"2024-09-12T00:53:14.369796+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:53:14.369796+0000","last_undegraded":"2024-09-12T00:53:14.369796+0000","last_fullsized":"2024-09-12T00:53:14.369796+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:25.247323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'286","reported_seq":1098,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:40.933503+0000","last_change":"2024-09-12T00:11:45.938219+0000","last_active":"2024-09-12T00:52:40.933503+0000","last_peered":"2024-09-12T00:52:40.933503+0000","last_clean":"2024-09-12T00:52:40.933503+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:52:40.933503+0000","last_undegraded":"2024-09-12T00:52:40.933503+0000","last_fullsized":"2024-09-12T00:52:40.933503+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.279970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277127,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1391,"num_read_kb":1619,"num_write":1270,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'611","reported_seq":2341,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.506794+0000","last_change":"2024-09-12T00:11:47.950515+0000","last_active":"2024-09-12T00:53:10.506794+0000","last_peered":"2024-09-12T00:53:10.506794+0000","last_clean":"2024-09-12T00:53:10.506794+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:53:10.506794+0000","last_undegraded":"2024-09-12T00:53:10.506794+0000","last_fullsized":"2024-09-12T00:53:10.506794+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:14.307717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'226","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.109362+0000","last_change":"2024-09-12T00:11:45.921722+0000","last_active":"2024-09-12T00:54:31.109362+0000","last_peered":"2024-09-12T00:54:31.109362+0000","last_clean":"2024-09-12T00:54:31.109362+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:31.109362+0000","last_undegraded":"2024-09-12T00:54:31.109362+0000","last_fullsized":"2024-09-12T00:54:31.109362+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9289927,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":17177,"num_write":1051,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1255","reported_seq":3015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.372859+0000","last_change":"2024-09-12T00:11:47.924558+0000","last_active":"2024-09-12T00:53:14.372859+0000","last_peered":"2024-09-12T00:53:14.372859+0000","last_clean":"2024-09-12T00:53:14.372859+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:53:14.372859+0000","last_undegraded":"2024-09-12T00:53:14.372859+0000","last_fullsized":"2024-09-12T00:53:14.372859+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:39.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'271","reported_seq":916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:36.782753+0000","last_change":"2024-09-12T00:11:45.965487+0000","last_active":"2024-09-12T00:52:36.782753+0000","last_peered":"2024-09-12T00:52:36.782753+0000","last_clean":"2024-09-12T00:52:36.782753+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:52:36.782753+0000","last_undegraded":"2024-09-12T00:52:36.782753+0000","last_fullsized":"2024-09-12T00:52:36.782753+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:11.343524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5071032,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":15585,"num_write":1261,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'826","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.503633+0000","last_change":"2024-09-12T00:11:47.951105+0000","last_active":"2024-09-12T00:53:10.503633+0000","last_peered":"2024-09-12T00:53:10.503633+0000","last_clean":"2024-09-12T00:53:10.503633+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:53:10.503633+0000","last_undegraded":"2024-09-12T00:53:10.503633+0000","last_fullsized":"2024-09-12T00:53:10.503633+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:49.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'249","reported_seq":890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:52.659064+0000","last_change":"2024-09-12T00:11:45.963287+0000","last_active":"2024-09-12T00:52:52.659064+0000","last_peered":"2024-09-12T00:52:52.659064+0000","last_clean":"2024-09-12T00:52:52.659064+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:52:52.659064+0000","last_undegraded":"2024-09-12T00:52:52.659064+0000","last_fullsized":"2024-09-12T00:52:52.659064+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.996463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14313078,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":58641,"num_write":1116,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1327","reported_seq":2850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:50.955784+0000","last_change":"2024-09-12T00:11:47.934364+0000","last_active":"2024-09-12T00:53:50.955784+0000","last_peered":"2024-09-12T00:53:50.955784+0000","last_clean":"2024-09-12T00:53:50.955784+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:53:50.955784+0000","last_undegraded":"2024-09-12T00:53:50.955784+0000","last_fullsized":"2024-09-12T00:53:50.955784+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'191","reported_seq":810,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:42.943924+0000","last_change":"2024-09-12T00:11:45.963871+0000","last_active":"2024-09-12T00:52:42.943924+0000","last_peered":"2024-09-12T00:52:42.943924+0000","last_clean":"2024-09-12T00:52:42.943924+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:52:42.943924+0000","last_undegraded":"2024-09-12T00:52:42.943924+0000","last_fullsized":"2024-09-12T00:52:42.943924+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.697592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9732406,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":445,"num_read_kb":34280,"num_write":924,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'551","reported_seq":2098,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.490083+0000","last_change":"2024-09-12T00:11:47.935891+0000","last_active":"2024-09-12T00:53:10.490083+0000","last_peered":"2024-09-12T00:53:10.490083+0000","last_clean":"2024-09-12T00:53:10.490083+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:53:10.490083+0000","last_undegraded":"2024-09-12T00:53:10.490083+0000","last_fullsized":"2024-09-12T00:53:10.490083+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:40.527099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'225","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:16.112540+0000","last_change":"2024-09-12T00:11:45.923906+0000","last_active":"2024-09-12T00:52:16.112540+0000","last_peered":"2024-09-12T00:52:16.112540+0000","last_clean":"2024-09-12T00:52:16.112540+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:52:16.112540+0000","last_undegraded":"2024-09-12T00:52:16.112540+0000","last_fullsized":"2024-09-12T00:52:16.112540+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:44.019789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7677221,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":742,"num_read_kb":61726,"num_write":1106,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'700","reported_seq":2496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.504786+0000","last_change":"2024-09-12T00:11:47.936000+0000","last_active":"2024-09-12T00:53:10.504786+0000","last_peered":"2024-09-12T00:53:10.504786+0000","last_clean":"2024-09-12T00:53:10.504786+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:53:10.504786+0000","last_undegraded":"2024-09-12T00:53:10.504786+0000","last_fullsized":"2024-09-12T00:53:10.504786+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.990104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'205","reported_seq":815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.400956+0000","last_change":"2024-09-12T00:11:45.945290+0000","last_active":"2024-09-12T00:53:11.400956+0000","last_peered":"2024-09-12T00:53:11.400956+0000","last_clean":"2024-09-12T00:53:11.400956+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:53:11.400956+0000","last_undegraded":"2024-09-12T00:53:11.400956+0000","last_fullsized":"2024-09-12T00:53:11.400956+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.645752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9737824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":428,"num_read_kb":13749,"num_write":931,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'963","reported_seq":2517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.236155+0000","last_change":"2024-09-12T00:11:47.941903+0000","last_active":"2024-09-12T00:53:00.236155+0000","last_peered":"2024-09-12T00:53:00.236155+0000","last_clean":"2024-09-12T00:53:00.236155+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:53:00.236155+0000","last_undegraded":"2024-09-12T00:53:00.236155+0000","last_fullsized":"2024-09-12T00:53:00.236155+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":900,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:15.435909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:44.299796+0000","last_change":"2024-09-12T00:11:45.937710+0000","last_active":"2024-09-12T00:52:44.299796+0000","last_peered":"2024-09-12T00:52:44.299796+0000","last_clean":"2024-09-12T00:52:44.299796+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:52:44.299796+0000","last_undegraded":"2024-09-12T00:52:44.299796+0000","last_fullsized":"2024-09-12T00:52:44.299796+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:53.751417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2072216,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":584,"num_read_kb":23861,"num_write":1048,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'752","reported_seq":2227,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.968292+0000","last_change":"2024-09-12T00:11:47.940732+0000","last_active":"2024-09-12T00:53:01.968292+0000","last_peered":"2024-09-12T00:53:01.968292+0000","last_clean":"2024-09-12T00:53:01.968292+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:53:01.968292+0000","last_undegraded":"2024-09-12T00:53:01.968292+0000","last_fullsized":"2024-09-12T00:53:01.968292+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.413376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'162","reported_seq":765,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.559498+0000","last_change":"2024-09-12T00:11:45.934430+0000","last_active":"2024-09-12T00:53:01.559498+0000","last_peered":"2024-09-12T00:53:01.559498+0000","last_clean":"2024-09-12T00:53:01.559498+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:53:01.559498+0000","last_undegraded":"2024-09-12T00:53:01.559498+0000","last_fullsized":"2024-09-12T00:53:01.559498+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.951800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470357,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":3653,"num_write":815,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'834","reported_seq":2657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.968223+0000","last_change":"2024-09-12T00:11:47.951096+0000","last_active":"2024-09-12T00:53:01.968223+0000","last_peered":"2024-09-12T00:53:01.968223+0000","last_clean":"2024-09-12T00:53:01.968223+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:53:01.968223+0000","last_undegraded":"2024-09-12T00:53:01.968223+0000","last_fullsized":"2024-09-12T00:53:01.968223+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:06.513554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'211","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.929359+0000","last_change":"2024-09-12T00:11:45.926172+0000","last_active":"2024-09-12T00:52:53.929359+0000","last_peered":"2024-09-12T00:52:53.929359+0000","last_clean":"2024-09-12T00:52:53.929359+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:52:53.929359+0000","last_undegraded":"2024-09-12T00:52:53.929359+0000","last_fullsized":"2024-09-12T00:52:53.929359+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:26.600245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12280161,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":490,"num_read_kb":27002,"num_write":967,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'447","reported_seq":2066,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.036909+0000","last_change":"2024-09-12T00:11:47.941908+0000","last_active":"2024-09-12T00:52:49.036909+0000","last_peered":"2024-09-12T00:52:49.036909+0000","last_clean":"2024-09-12T00:52:49.036909+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:52:49.036909+0000","last_undegraded":"2024-09-12T00:52:49.036909+0000","last_fullsized":"2024-09-12T00:52:49.036909+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.535433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'184","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.273931+0000","last_change":"2024-09-12T00:11:45.964131+0000","last_active":"2024-09-12T00:52:02.273931+0000","last_peered":"2024-09-12T00:52:02.273931+0000","last_clean":"2024-09-12T00:52:02.273931+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:52:02.273931+0000","last_undegraded":"2024-09-12T00:52:02.273931+0000","last_fullsized":"2024-09-12T00:52:02.273931+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:45.901253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049107,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":12744,"num_write":920,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'219","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.499645+0000","last_change":"2024-09-12T00:11:45.935207+0000","last_active":"2024-09-12T00:53:11.499645+0000","last_peered":"2024-09-12T00:53:11.499645+0000","last_clean":"2024-09-12T00:53:11.499645+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:53:11.499645+0000","last_undegraded":"2024-09-12T00:53:11.499645+0000","last_fullsized":"2024-09-12T00:53:11.499645+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:45.585339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17885897,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":71383,"num_write":1065,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.502646+0000","last_change":"2024-09-12T00:11:47.953166+0000","last_active":"2024-09-12T00:53:10.502646+0000","last_peered":"2024-09-12T00:53:10.502646+0000","last_clean":"2024-09-12T00:53:10.502646+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:53:10.502646+0000","last_undegraded":"2024-09-12T00:53:10.502646+0000","last_fullsized":"2024-09-12T00:53:10.502646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:29.576578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'202","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.400938+0000","last_change":"2024-09-12T00:11:45.965734+0000","last_active":"2024-09-12T00:53:11.400938+0000","last_peered":"2024-09-12T00:53:11.400938+0000","last_clean":"2024-09-12T00:53:11.400938+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:53:11.400938+0000","last_undegraded":"2024-09-12T00:53:11.400938+0000","last_fullsized":"2024-09-12T00:53:11.400938+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.306543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9812130,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":704,"num_read_kb":180313,"num_write":957,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'926","reported_seq":2688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.196736+0000","last_change":"2024-09-12T00:11:47.940663+0000","last_active":"2024-09-12T00:54:17.196736+0000","last_peered":"2024-09-12T00:54:17.196736+0000","last_clean":"2024-09-12T00:54:17.196736+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:17.196736+0000","last_undegraded":"2024-09-12T00:54:17.196736+0000","last_fullsized":"2024-09-12T00:54:17.196736+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":959,"ondisk_log_size":959,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1850,"ondisk_log_size":1850,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":639,"ondisk_log_size":639,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":445853,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8289,"num_read_kb":10087,"num_write":5619,"num_write_kb":2639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":222580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1858,"ondisk_log_size":1858,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3935,"ondisk_log_size":3935,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":410963992,"num_objects":519,"num_object_clones":0,"num_object_copies":1557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":0,"num_read":32940,"num_read_kb":1979745,"num_write":63114,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":624386048,"data_stored":624386048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4396,"ondisk_log_size":4396,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72641901,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":145,"num_read_kb":190493,"num_write":161,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146341888,"data_stored":146332378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73106114,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":143,"num_read_kb":189755,"num_write":161,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142610432,"data_stored":142602287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509959,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320248,"kb_used_data":122536,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94051592,"statfs":{"total":96636764160,"available":96308830208,"internally_reserved":0,"allocated":125476864,"data_stored":123457796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509960,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198864,"kb_used_data":131584,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94172976,"statfs":{"total":96636764160,"available":96433127424,"internally_reserved":0,"allocated":134742016,"data_stored":132690622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509961,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288760,"kb_used_data":127144,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94083080,"statfs":{"total":96636764160,"available":96341073920,"internally_reserved":0,"allocated":130195456,"data_stored":128157869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509961,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329136,"kb_used_data":135520,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94042704,"statfs":{"total":96636764160,"available":96299728896,"internally_reserved":0,"allocated":138772480,"data_stored":136734146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509962,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189500,"kb_used_data":108332,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94182340,"statfs":{"total":96636764160,"available":96442716160,"internally_reserved":0,"allocated":110931968,"data_stored":108910447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509961,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368232,"kb_used_data":98264,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94003608,"statfs":{"total":96636764160,"available":96259694592,"internally_reserved":0,"allocated":100622336,"data_stored":98567019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509960,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215332,"kb_used_data":116116,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94156508,"statfs":{"total":96636764160,"available":96416264192,"internally_reserved":0,"allocated":118902784,"data_stored":116838032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542668,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346356,"kb_used_data":104164,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94025484,"statfs":{"total":96636764160,"available":96282095616,"internally_reserved":0,"allocated":106663936,"data_stored":104618795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":247986629},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":79962112,"data_stored":79962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":66723840,"data_stored":66723840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":75902976,"data_stored":75902976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100593664,"data_stored":100593664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98041856,"data_stored":98041856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69595136,"data_stored":69595136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64786432,"data_stored":64786432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":68780032,"data_stored":68780032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":38134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":23391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":33408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":28921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":33829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20680704,"data_stored":20677314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19632128,"data_stored":19628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":716800,"data_stored":714225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14258176,"data_stored":14255996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14345713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39424000,"data_stored":39421820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:54:32.006 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:54:32.350 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:54:32.365 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:54:32.378 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1552,"stamp":"2024-09-12T00:54:31.351387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":557765235,"num_objects":1060,"num_object_clones":0,"num_object_copies":2639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1060,"num_whiteouts":0,"num_read":277489,"num_read_kb":2585916,"num_write":143116,"num_write_kb":2344217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13931,"ondisk_log_size":13931,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2256428,"kb_used_data":943660,"kb_used_omap":12,"kb_used_meta":1312627,"kb_avail":752718292,"statfs":{"total":773094113280,"available":770783531008,"internally_reserved":0,"allocated":966307840,"data_stored":949974726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1344130610},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12467169,"num_objects":-27,"num_object_clones":0,"num_object_copies":-62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":276,"num_read_kb":270,"num_write":52,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007887"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934222+0000","last_change":"2024-09-12T00:39:28.138350+0000","last_active":"2024-09-12T00:52:00.934222+0000","last_peered":"2024-09-12T00:52:00.934222+0000","last_clean":"2024-09-12T00:52:00.934222+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:52:00.934222+0000","last_undegraded":"2024-09-12T00:52:00.934222+0000","last_fullsized":"2024-09-12T00:52:00.934222+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:55.798857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092228+0000","last_change":"2024-09-12T00:28:17.047281+0000","last_active":"2024-09-12T00:50:51.092228+0000","last_peered":"2024-09-12T00:50:51.092228+0000","last_clean":"2024-09-12T00:50:51.092228+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:50:51.092228+0000","last_undegraded":"2024-09-12T00:50:51.092228+0000","last_fullsized":"2024-09-12T00:50:51.092228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:27.659088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915451+0000","last_change":"2024-09-12T00:28:14.033426+0000","last_active":"2024-09-12T00:50:45.915451+0000","last_peered":"2024-09-12T00:50:45.915451+0000","last_clean":"2024-09-12T00:50:45.915451+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:50:45.915451+0000","last_undegraded":"2024-09-12T00:50:45.915451+0000","last_fullsized":"2024-09-12T00:50:45.915451+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:32.619191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931203+0000","last_change":"2024-09-12T00:26:48.570033+0000","last_active":"2024-09-12T00:51:50.931203+0000","last_peered":"2024-09-12T00:51:50.931203+0000","last_clean":"2024-09-12T00:51:50.931203+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:51:50.931203+0000","last_undegraded":"2024-09-12T00:51:50.931203+0000","last_fullsized":"2024-09-12T00:51:50.931203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.353377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928588+0000","last_change":"2024-09-12T00:39:28.129464+0000","last_active":"2024-09-12T00:52:00.928588+0000","last_peered":"2024-09-12T00:52:00.928588+0000","last_clean":"2024-09-12T00:52:00.928588+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:52:00.928588+0000","last_undegraded":"2024-09-12T00:52:00.928588+0000","last_fullsized":"2024-09-12T00:52:00.928588+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:48.897603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113095+0000","last_change":"2024-09-12T00:28:17.071932+0000","last_active":"2024-09-12T00:50:51.113095+0000","last_peered":"2024-09-12T00:50:51.113095+0000","last_clean":"2024-09-12T00:50:51.113095+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:50:51.113095+0000","last_undegraded":"2024-09-12T00:50:51.113095+0000","last_fullsized":"2024-09-12T00:50:51.113095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.458170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921118+0000","last_change":"2024-09-12T00:28:14.053061+0000","last_active":"2024-09-12T00:50:44.921118+0000","last_peered":"2024-09-12T00:50:44.921118+0000","last_clean":"2024-09-12T00:50:44.921118+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:50:44.921118+0000","last_undegraded":"2024-09-12T00:50:44.921118+0000","last_fullsized":"2024-09-12T00:50:44.921118+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.764170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":162,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.061737+0000","last_change":"2024-09-12T00:26:48.579305+0000","last_active":"2024-09-12T00:51:36.061737+0000","last_peered":"2024-09-12T00:51:36.061737+0000","last_clean":"2024-09-12T00:51:36.061737+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:51:36.061737+0000","last_undegraded":"2024-09-12T00:51:36.061737+0000","last_fullsized":"2024-09-12T00:51:36.061737+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:50.899850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.103970+0000","last_change":"2024-09-12T00:39:28.122188+0000","last_active":"2024-09-12T00:51:36.103970+0000","last_peered":"2024-09-12T00:51:36.103970+0000","last_clean":"2024-09-12T00:51:36.103970+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:51:36.103970+0000","last_undegraded":"2024-09-12T00:51:36.103970+0000","last_fullsized":"2024-09-12T00:51:36.103970+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.982189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928491+0000","last_change":"2024-09-12T00:28:17.054566+0000","last_active":"2024-09-12T00:51:14.928491+0000","last_peered":"2024-09-12T00:51:14.928491+0000","last_clean":"2024-09-12T00:51:14.928491+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:51:14.928491+0000","last_undegraded":"2024-09-12T00:51:14.928491+0000","last_fullsized":"2024-09-12T00:51:14.928491+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.840405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:20.935927+0000","last_change":"2024-09-12T00:28:14.047435+0000","last_active":"2024-09-12T00:52:20.935927+0000","last_peered":"2024-09-12T00:52:20.935927+0000","last_clean":"2024-09-12T00:52:20.935927+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:52:20.935927+0000","last_undegraded":"2024-09-12T00:52:20.935927+0000","last_fullsized":"2024-09-12T00:52:20.935927+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:59.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.669268+0000","last_change":"2024-09-12T00:26:48.580614+0000","last_active":"2024-09-12T00:52:01.669268+0000","last_peered":"2024-09-12T00:52:01.669268+0000","last_clean":"2024-09-12T00:52:01.669268+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:52:01.669268+0000","last_undegraded":"2024-09-12T00:52:01.669268+0000","last_fullsized":"2024-09-12T00:52:01.669268+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:44.366801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934194+0000","last_change":"2024-09-12T00:39:28.125516+0000","last_active":"2024-09-12T00:51:39.934194+0000","last_peered":"2024-09-12T00:51:39.934194+0000","last_clean":"2024-09-12T00:51:39.934194+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:51:39.934194+0000","last_undegraded":"2024-09-12T00:51:39.934194+0000","last_fullsized":"2024-09-12T00:51:39.934194+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:50.627744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'4","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.944822+0000","last_change":"2024-09-12T00:28:17.052788+0000","last_active":"2024-09-12T00:52:24.944822+0000","last_peered":"2024-09-12T00:52:24.944822+0000","last_clean":"2024-09-12T00:52:24.944822+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:52:24.944822+0000","last_undegraded":"2024-09-12T00:52:24.944822+0000","last_fullsized":"2024-09-12T00:52:24.944822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.537154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096647+0000","last_change":"2024-09-12T00:28:14.043102+0000","last_active":"2024-09-12T00:51:11.096647+0000","last_peered":"2024-09-12T00:51:11.096647+0000","last_clean":"2024-09-12T00:51:11.096647+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:51:11.096647+0000","last_undegraded":"2024-09-12T00:51:11.096647+0000","last_fullsized":"2024-09-12T00:51:11.096647+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.118617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926319+0000","last_change":"2024-09-12T00:26:48.582273+0000","last_active":"2024-09-12T00:51:50.926319+0000","last_peered":"2024-09-12T00:51:50.926319+0000","last_clean":"2024-09-12T00:51:50.926319+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:51:50.926319+0000","last_undegraded":"2024-09-12T00:51:50.926319+0000","last_fullsized":"2024-09-12T00:51:50.926319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.447704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926457+0000","last_change":"2024-09-12T00:39:28.140327+0000","last_active":"2024-09-12T00:51:35.926457+0000","last_peered":"2024-09-12T00:51:35.926457+0000","last_clean":"2024-09-12T00:51:35.926457+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:51:35.926457+0000","last_undegraded":"2024-09-12T00:51:35.926457+0000","last_fullsized":"2024-09-12T00:51:35.926457+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:53.703852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'1","reported_seq":32,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.910206+0000","last_change":"2024-09-12T00:28:17.062001+0000","last_active":"2024-09-12T00:50:10.910206+0000","last_peered":"2024-09-12T00:50:10.910206+0000","last_clean":"2024-09-12T00:50:10.910206+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:50:10.910206+0000","last_undegraded":"2024-09-12T00:50:10.910206+0000","last_fullsized":"2024-09-12T00:50:10.910206+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.953980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:49:59.910445+0000","last_change":"2024-09-12T00:28:14.043324+0000","last_active":"2024-09-12T00:49:59.910445+0000","last_peered":"2024-09-12T00:49:59.910445+0000","last_clean":"2024-09-12T00:49:59.910445+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:49:59.910445+0000","last_undegraded":"2024-09-12T00:49:59.910445+0000","last_fullsized":"2024-09-12T00:49:59.910445+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:29.585815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926176+0000","last_change":"2024-09-12T00:26:48.586853+0000","last_active":"2024-09-12T00:51:50.926176+0000","last_peered":"2024-09-12T00:51:50.926176+0000","last_clean":"2024-09-12T00:51:50.926176+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:51:50.926176+0000","last_undegraded":"2024-09-12T00:51:50.926176+0000","last_fullsized":"2024-09-12T00:51:50.926176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:56.028583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933422+0000","last_change":"2024-09-12T00:39:28.107499+0000","last_active":"2024-09-12T00:52:00.933422+0000","last_peered":"2024-09-12T00:52:00.933422+0000","last_clean":"2024-09-12T00:52:00.933422+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:52:00.933422+0000","last_undegraded":"2024-09-12T00:52:00.933422+0000","last_fullsized":"2024-09-12T00:52:00.933422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:42.987392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'4","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924539+0000","last_change":"2024-09-12T00:28:17.080528+0000","last_active":"2024-09-12T00:50:05.924539+0000","last_peered":"2024-09-12T00:50:05.924539+0000","last_clean":"2024-09-12T00:50:05.924539+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:50:05.924539+0000","last_undegraded":"2024-09-12T00:50:05.924539+0000","last_fullsized":"2024-09-12T00:50:05.924539+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:57.273734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4818812,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":651,"num_write":9,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'1","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924641+0000","last_change":"2024-09-12T00:28:14.045269+0000","last_active":"2024-09-12T00:50:05.924641+0000","last_peered":"2024-09-12T00:50:05.924641+0000","last_clean":"2024-09-12T00:50:05.924641+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:50:05.924641+0000","last_undegraded":"2024-09-12T00:50:05.924641+0000","last_fullsized":"2024-09-12T00:50:05.924641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:05.105429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":698,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.892906+0000","last_change":"2024-09-12T00:26:48.573856+0000","last_active":"2024-09-12T00:52:33.892906+0000","last_peered":"2024-09-12T00:52:33.892906+0000","last_clean":"2024-09-12T00:52:33.892906+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:52:33.892906+0000","last_undegraded":"2024-09-12T00:52:33.892906+0000","last_fullsized":"2024-09-12T00:52:33.892906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:49.201091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.128901+0000","last_change":"2024-09-12T00:39:28.140779+0000","last_active":"2024-09-12T00:52:01.128901+0000","last_peered":"2024-09-12T00:52:01.128901+0000","last_clean":"2024-09-12T00:52:01.128901+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:52:01.128901+0000","last_undegraded":"2024-09-12T00:52:01.128901+0000","last_fullsized":"2024-09-12T00:52:01.128901+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.223046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113042+0000","last_change":"2024-09-12T00:28:17.073306+0000","last_active":"2024-09-12T00:50:51.113042+0000","last_peered":"2024-09-12T00:50:51.113042+0000","last_clean":"2024-09-12T00:50:51.113042+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:50:51.113042+0000","last_undegraded":"2024-09-12T00:50:51.113042+0000","last_fullsized":"2024-09-12T00:50:51.113042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.616512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917468+0000","last_change":"2024-09-12T00:28:14.036590+0000","last_active":"2024-09-12T00:50:45.917468+0000","last_peered":"2024-09-12T00:50:45.917468+0000","last_clean":"2024-09-12T00:50:45.917468+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:50:45.917468+0000","last_undegraded":"2024-09-12T00:50:45.917468+0000","last_fullsized":"2024-09-12T00:50:45.917468+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.374471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.485163+0000","last_change":"2024-09-12T00:26:48.567960+0000","last_active":"2024-09-12T00:52:37.485163+0000","last_peered":"2024-09-12T00:52:37.485163+0000","last_clean":"2024-09-12T00:52:37.485163+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:52:37.485163+0000","last_undegraded":"2024-09-12T00:52:37.485163+0000","last_fullsized":"2024-09-12T00:52:37.485163+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.486007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934433+0000","last_change":"2024-09-12T00:39:28.125474+0000","last_active":"2024-09-12T00:52:00.934433+0000","last_peered":"2024-09-12T00:52:00.934433+0000","last_clean":"2024-09-12T00:52:00.934433+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:52:00.934433+0000","last_undegraded":"2024-09-12T00:52:00.934433+0000","last_fullsized":"2024-09-12T00:52:00.934433+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:45.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916437+0000","last_change":"2024-09-12T00:28:17.074749+0000","last_active":"2024-09-12T00:50:50.916437+0000","last_peered":"2024-09-12T00:50:50.916437+0000","last_clean":"2024-09-12T00:50:50.916437+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:50:50.916437+0000","last_undegraded":"2024-09-12T00:50:50.916437+0000","last_fullsized":"2024-09-12T00:50:50.916437+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:59.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.911641+0000","last_change":"2024-09-12T00:28:14.050432+0000","last_active":"2024-09-12T00:50:45.911641+0000","last_peered":"2024-09-12T00:50:45.911641+0000","last_clean":"2024-09-12T00:50:45.911641+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:50:45.911641+0000","last_undegraded":"2024-09-12T00:50:45.911641+0000","last_fullsized":"2024-09-12T00:50:45.911641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:50.652868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914915+0000","last_change":"2024-09-12T00:26:48.576457+0000","last_active":"2024-09-12T00:51:00.914915+0000","last_peered":"2024-09-12T00:51:00.914915+0000","last_clean":"2024-09-12T00:51:00.914915+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:51:00.914915+0000","last_undegraded":"2024-09-12T00:51:00.914915+0000","last_fullsized":"2024-09-12T00:51:00.914915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:50.385760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927145+0000","last_change":"2024-09-12T00:39:28.133363+0000","last_active":"2024-09-12T00:51:09.927145+0000","last_peered":"2024-09-12T00:51:09.927145+0000","last_clean":"2024-09-12T00:51:09.927145+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:51:09.927145+0000","last_undegraded":"2024-09-12T00:51:09.927145+0000","last_fullsized":"2024-09-12T00:51:09.927145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:45.885764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'8","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.906908+0000","last_change":"2024-09-12T00:28:17.078258+0000","last_active":"2024-09-12T00:50:05.906908+0000","last_peered":"2024-09-12T00:50:05.906908+0000","last_clean":"2024-09-12T00:50:05.906908+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:50:05.906908+0000","last_undegraded":"2024-09-12T00:50:05.906908+0000","last_fullsized":"2024-09-12T00:50:05.906908+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:26.373864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":12306,"num_write":8,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947884+0000","last_change":"2024-09-12T00:28:14.046080+0000","last_active":"2024-09-12T00:51:40.947884+0000","last_peered":"2024-09-12T00:51:40.947884+0000","last_clean":"2024-09-12T00:51:40.947884+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:51:40.947884+0000","last_undegraded":"2024-09-12T00:51:40.947884+0000","last_fullsized":"2024-09-12T00:51:40.947884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.783103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":201,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.951659+0000","last_change":"2024-09-12T00:26:48.572423+0000","last_active":"2024-09-12T00:51:36.951659+0000","last_peered":"2024-09-12T00:51:36.951659+0000","last_clean":"2024-09-12T00:51:36.951659+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:51:36.951659+0000","last_undegraded":"2024-09-12T00:51:36.951659+0000","last_fullsized":"2024-09-12T00:51:36.951659+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:03.523286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917174+0000","last_change":"2024-09-12T00:39:28.115704+0000","last_active":"2024-09-12T00:51:10.917174+0000","last_peered":"2024-09-12T00:51:10.917174+0000","last_clean":"2024-09-12T00:51:10.917174+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:51:10.917174+0000","last_undegraded":"2024-09-12T00:51:10.917174+0000","last_fullsized":"2024-09-12T00:51:10.917174+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.301433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:44.935398+0000","last_change":"2024-09-12T00:28:17.068407+0000","last_active":"2024-09-12T00:51:44.935398+0000","last_peered":"2024-09-12T00:51:44.935398+0000","last_clean":"2024-09-12T00:51:44.935398+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:51:44.935398+0000","last_undegraded":"2024-09-12T00:51:44.935398+0000","last_fullsized":"2024-09-12T00:51:44.935398+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:04.370003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:00.907982+0000","last_change":"2024-09-12T00:28:14.033635+0000","last_active":"2024-09-12T00:50:00.907982+0000","last_peered":"2024-09-12T00:50:00.907982+0000","last_clean":"2024-09-12T00:50:00.907982+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:50:00.907982+0000","last_undegraded":"2024-09-12T00:50:00.907982+0000","last_fullsized":"2024-09-12T00:50:00.907982+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:21.430932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.729092+0000","last_change":"2024-09-12T00:26:48.579143+0000","last_active":"2024-09-12T00:52:37.729092+0000","last_peered":"2024-09-12T00:52:37.729092+0000","last_clean":"2024-09-12T00:52:37.729092+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:52:37.729092+0000","last_undegraded":"2024-09-12T00:52:37.729092+0000","last_fullsized":"2024-09-12T00:52:37.729092+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:58.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.117359+0000","last_change":"2024-09-12T00:39:28.143755+0000","last_active":"2024-09-12T00:51:11.117359+0000","last_peered":"2024-09-12T00:51:11.117359+0000","last_clean":"2024-09-12T00:51:11.117359+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:51:11.117359+0000","last_undegraded":"2024-09-12T00:51:11.117359+0000","last_fullsized":"2024-09-12T00:51:11.117359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:42.065287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.907031+0000","last_change":"2024-09-12T00:28:17.072223+0000","last_active":"2024-09-12T00:50:05.907031+0000","last_peered":"2024-09-12T00:50:05.907031+0000","last_clean":"2024-09-12T00:50:05.907031+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:50:05.907031+0000","last_undegraded":"2024-09-12T00:50:05.907031+0000","last_fullsized":"2024-09-12T00:50:05.907031+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:56.304323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'3","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:00.905773+0000","last_change":"2024-09-12T00:28:14.051773+0000","last_active":"2024-09-12T00:50:00.905773+0000","last_peered":"2024-09-12T00:50:00.905773+0000","last_clean":"2024-09-12T00:50:00.905773+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:50:00.905773+0000","last_undegraded":"2024-09-12T00:50:00.905773+0000","last_fullsized":"2024-09-12T00:50:00.905773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:12.527606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.918732+0000","last_change":"2024-09-12T00:26:48.566905+0000","last_active":"2024-09-12T00:51:00.918732+0000","last_peered":"2024-09-12T00:51:00.918732+0000","last_clean":"2024-09-12T00:51:00.918732+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:51:00.918732+0000","last_undegraded":"2024-09-12T00:51:00.918732+0000","last_fullsized":"2024-09-12T00:51:00.918732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.878822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.923092+0000","last_change":"2024-09-12T00:39:28.130382+0000","last_active":"2024-09-12T00:51:10.923092+0000","last_peered":"2024-09-12T00:51:10.923092+0000","last_clean":"2024-09-12T00:51:10.923092+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:51:10.923092+0000","last_undegraded":"2024-09-12T00:51:10.923092+0000","last_fullsized":"2024-09-12T00:51:10.923092+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:27.073020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'3","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.909253+0000","last_change":"2024-09-12T00:28:17.073824+0000","last_active":"2024-09-12T00:50:05.909253+0000","last_peered":"2024-09-12T00:50:05.909253+0000","last_clean":"2024-09-12T00:50:05.909253+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:50:05.909253+0000","last_undegraded":"2024-09-12T00:50:05.909253+0000","last_fullsized":"2024-09-12T00:50:05.909253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.923969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:49:59.910715+0000","last_change":"2024-09-12T00:28:14.044796+0000","last_active":"2024-09-12T00:49:59.910715+0000","last_peered":"2024-09-12T00:49:59.910715+0000","last_clean":"2024-09-12T00:49:59.910715+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:49:59.910715+0000","last_undegraded":"2024-09-12T00:49:59.910715+0000","last_fullsized":"2024-09-12T00:49:59.910715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:13.669602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'113","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.539168+0000","last_change":"2024-09-12T00:26:48.578346+0000","last_active":"2024-09-12T00:52:38.539168+0000","last_peered":"2024-09-12T00:52:38.539168+0000","last_clean":"2024-09-12T00:52:38.539168+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:52:38.539168+0000","last_undegraded":"2024-09-12T00:52:38.539168+0000","last_fullsized":"2024-09-12T00:52:38.539168+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:52.917481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933259+0000","last_change":"2024-09-12T00:39:28.130268+0000","last_active":"2024-09-12T00:51:34.933259+0000","last_peered":"2024-09-12T00:51:34.933259+0000","last_clean":"2024-09-12T00:51:34.933259+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:51:34.933259+0000","last_undegraded":"2024-09-12T00:51:34.933259+0000","last_fullsized":"2024-09-12T00:51:34.933259+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:22.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'3","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934267+0000","last_change":"2024-09-12T00:28:17.046685+0000","last_active":"2024-09-12T00:51:39.934267+0000","last_peered":"2024-09-12T00:51:39.934267+0000","last_clean":"2024-09-12T00:51:39.934267+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:51:39.934267+0000","last_undegraded":"2024-09-12T00:51:39.934267+0000","last_fullsized":"2024-09-12T00:51:39.934267+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:31.104948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4468,"num_write":3,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104004+0000","last_change":"2024-09-12T00:28:14.032537+0000","last_active":"2024-09-12T00:51:36.104004+0000","last_peered":"2024-09-12T00:51:36.104004+0000","last_clean":"2024-09-12T00:51:36.104004+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:51:36.104004+0000","last_undegraded":"2024-09-12T00:51:36.104004+0000","last_fullsized":"2024-09-12T00:51:36.104004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.020093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'133","reported_seq":449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.925949+0000","last_change":"2024-09-12T00:26:48.579290+0000","last_active":"2024-09-12T00:50:10.925949+0000","last_peered":"2024-09-12T00:50:10.925949+0000","last_clean":"2024-09-12T00:50:10.925949+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:50:10.925949+0000","last_undegraded":"2024-09-12T00:50:10.925949+0000","last_fullsized":"2024-09-12T00:50:10.925949+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.084724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922871+0000","last_change":"2024-09-12T00:39:28.116214+0000","last_active":"2024-09-12T00:51:35.922871+0000","last_peered":"2024-09-12T00:51:35.922871+0000","last_clean":"2024-09-12T00:51:35.922871+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:51:35.922871+0000","last_undegraded":"2024-09-12T00:51:35.922871+0000","last_fullsized":"2024-09-12T00:51:35.922871+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.593460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934132+0000","last_change":"2024-09-12T00:28:17.059604+0000","last_active":"2024-09-12T00:51:39.934132+0000","last_peered":"2024-09-12T00:51:39.934132+0000","last_clean":"2024-09-12T00:51:39.934132+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:51:39.934132+0000","last_undegraded":"2024-09-12T00:51:39.934132+0000","last_fullsized":"2024-09-12T00:51:39.934132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:54.283922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933089+0000","last_change":"2024-09-12T00:28:14.043789+0000","last_active":"2024-09-12T00:51:34.933089+0000","last_peered":"2024-09-12T00:51:34.933089+0000","last_clean":"2024-09-12T00:51:34.933089+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:51:34.933089+0000","last_undegraded":"2024-09-12T00:51:34.933089+0000","last_fullsized":"2024-09-12T00:51:34.933089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.842950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.908002+0000","last_change":"2024-09-12T00:26:48.587469+0000","last_active":"2024-09-12T00:50:10.908002+0000","last_peered":"2024-09-12T00:50:10.908002+0000","last_clean":"2024-09-12T00:50:10.908002+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:50:10.908002+0000","last_undegraded":"2024-09-12T00:50:10.908002+0000","last_fullsized":"2024-09-12T00:50:10.908002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.099773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923180+0000","last_change":"2024-09-12T00:39:28.116113+0000","last_active":"2024-09-12T00:51:15.923180+0000","last_peered":"2024-09-12T00:51:15.923180+0000","last_clean":"2024-09-12T00:51:15.923180+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:51:15.923180+0000","last_undegraded":"2024-09-12T00:51:15.923180+0000","last_fullsized":"2024-09-12T00:51:15.923180+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'5","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927361+0000","last_change":"2024-09-12T00:28:17.077838+0000","last_active":"2024-09-12T00:51:40.927361+0000","last_peered":"2024-09-12T00:51:40.927361+0000","last_clean":"2024-09-12T00:51:40.927361+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:51:40.927361+0000","last_undegraded":"2024-09-12T00:51:40.927361+0000","last_fullsized":"2024-09-12T00:51:40.927361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.840518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104119+0000","last_change":"2024-09-12T00:28:14.041233+0000","last_active":"2024-09-12T00:51:36.104119+0000","last_peered":"2024-09-12T00:51:36.104119+0000","last_clean":"2024-09-12T00:51:36.104119+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:51:36.104119+0000","last_undegraded":"2024-09-12T00:51:36.104119+0000","last_fullsized":"2024-09-12T00:51:36.104119+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:48.566724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104059+0000","last_change":"2024-09-12T00:26:48.563874+0000","last_active":"2024-09-12T00:50:11.104059+0000","last_peered":"2024-09-12T00:50:11.104059+0000","last_clean":"2024-09-12T00:50:11.104059+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:50:11.104059+0000","last_undegraded":"2024-09-12T00:50:11.104059+0000","last_fullsized":"2024-09-12T00:50:11.104059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.613469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922823+0000","last_change":"2024-09-12T00:39:28.107803+0000","last_active":"2024-09-12T00:51:35.922823+0000","last_peered":"2024-09-12T00:51:35.922823+0000","last_clean":"2024-09-12T00:51:35.922823+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:51:35.922823+0000","last_undegraded":"2024-09-12T00:51:35.922823+0000","last_fullsized":"2024-09-12T00:51:35.922823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.925644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947791+0000","last_change":"2024-09-12T00:28:17.071725+0000","last_active":"2024-09-12T00:51:40.947791+0000","last_peered":"2024-09-12T00:51:40.947791+0000","last_clean":"2024-09-12T00:51:40.947791+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:51:40.947791+0000","last_undegraded":"2024-09-12T00:51:40.947791+0000","last_fullsized":"2024-09-12T00:51:40.947791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:28.212664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'8","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:56.131231+0000","last_change":"2024-09-12T00:28:14.033365+0000","last_active":"2024-09-12T00:53:56.131231+0000","last_peered":"2024-09-12T00:53:56.131231+0000","last_clean":"2024-09-12T00:53:56.131231+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:53:56.131231+0000","last_undegraded":"2024-09-12T00:53:56.131231+0000","last_fullsized":"2024-09-12T00:53:56.131231+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:07.863908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":21053,"num_write":13,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:37.957887+0000","last_change":"2024-09-12T00:26:48.584004+0000","last_active":"2024-09-12T00:51:37.957887+0000","last_peered":"2024-09-12T00:51:37.957887+0000","last_clean":"2024-09-12T00:51:37.957887+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:51:37.957887+0000","last_undegraded":"2024-09-12T00:51:37.957887+0000","last_fullsized":"2024-09-12T00:51:37.957887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:52.685965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:24.916370+0000","last_change":"2024-09-12T00:39:28.127905+0000","last_active":"2024-09-12T00:50:24.916370+0000","last_peered":"2024-09-12T00:50:24.916370+0000","last_clean":"2024-09-12T00:50:24.916370+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:50:24.916370+0000","last_undegraded":"2024-09-12T00:50:24.916370+0000","last_fullsized":"2024-09-12T00:50:24.916370+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:42.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916546+0000","last_change":"2024-09-12T00:28:17.075169+0000","last_active":"2024-09-12T00:50:50.916546+0000","last_peered":"2024-09-12T00:50:50.916546+0000","last_clean":"2024-09-12T00:50:50.916546+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:50:50.916546+0000","last_undegraded":"2024-09-12T00:50:50.916546+0000","last_fullsized":"2024-09-12T00:50:50.916546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:26.934607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111806+0000","last_change":"2024-09-12T00:28:14.015676+0000","last_active":"2024-09-12T00:50:46.111806+0000","last_peered":"2024-09-12T00:50:46.111806+0000","last_clean":"2024-09-12T00:50:46.111806+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:50:46.111806+0000","last_undegraded":"2024-09-12T00:50:46.111806+0000","last_fullsized":"2024-09-12T00:50:46.111806+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:53.120779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927494+0000","last_change":"2024-09-12T00:26:48.573048+0000","last_active":"2024-09-12T00:51:40.927494+0000","last_peered":"2024-09-12T00:51:40.927494+0000","last_clean":"2024-09-12T00:51:40.927494+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:51:40.927494+0000","last_undegraded":"2024-09-12T00:51:40.927494+0000","last_fullsized":"2024-09-12T00:51:40.927494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.722904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.091062+0000","last_change":"2024-09-12T00:39:28.121616+0000","last_active":"2024-09-12T00:50:46.091062+0000","last_peered":"2024-09-12T00:50:46.091062+0000","last_clean":"2024-09-12T00:50:46.091062+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:50:46.091062+0000","last_undegraded":"2024-09-12T00:50:46.091062+0000","last_fullsized":"2024-09-12T00:50:46.091062+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:15.863877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916508+0000","last_change":"2024-09-12T00:28:17.074710+0000","last_active":"2024-09-12T00:50:50.916508+0000","last_peered":"2024-09-12T00:50:50.916508+0000","last_clean":"2024-09-12T00:50:50.916508+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:50:50.916508+0000","last_undegraded":"2024-09-12T00:50:50.916508+0000","last_fullsized":"2024-09-12T00:50:50.916508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:00.241439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'10","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.911762+0000","last_change":"2024-09-12T00:28:14.040584+0000","last_active":"2024-09-12T00:50:45.911762+0000","last_peered":"2024-09-12T00:50:45.911762+0000","last_clean":"2024-09-12T00:50:45.911762+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:50:45.911762+0000","last_undegraded":"2024-09-12T00:50:45.911762+0000","last_fullsized":"2024-09-12T00:50:45.911762+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:08.411307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":15,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.946780+0000","last_change":"2024-09-12T00:26:48.585190+0000","last_active":"2024-09-12T00:51:35.946780+0000","last_peered":"2024-09-12T00:51:35.946780+0000","last_clean":"2024-09-12T00:51:35.946780+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:51:35.946780+0000","last_undegraded":"2024-09-12T00:51:35.946780+0000","last_fullsized":"2024-09-12T00:51:35.946780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:29.090617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.928152+0000","last_change":"2024-09-12T00:39:28.136382+0000","last_active":"2024-09-12T00:50:20.928152+0000","last_peered":"2024-09-12T00:50:20.928152+0000","last_clean":"2024-09-12T00:50:20.928152+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:50:20.928152+0000","last_undegraded":"2024-09-12T00:50:20.928152+0000","last_fullsized":"2024-09-12T00:50:20.928152+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.917696+0000","last_change":"2024-09-12T00:28:17.077942+0000","last_active":"2024-09-12T00:50:55.917696+0000","last_peered":"2024-09-12T00:50:55.917696+0000","last_clean":"2024-09-12T00:50:55.917696+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:50:55.917696+0000","last_undegraded":"2024-09-12T00:50:55.917696+0000","last_fullsized":"2024-09-12T00:50:55.917696+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:31.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'4","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915561+0000","last_change":"2024-09-12T00:28:14.053908+0000","last_active":"2024-09-12T00:50:45.915561+0000","last_peered":"2024-09-12T00:50:45.915561+0000","last_clean":"2024-09-12T00:50:45.915561+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:50:45.915561+0000","last_undegraded":"2024-09-12T00:50:45.915561+0000","last_fullsized":"2024-09-12T00:50:45.915561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:56.421414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104215+0000","last_change":"2024-09-12T00:26:48.567108+0000","last_active":"2024-09-12T00:51:36.104215+0000","last_peered":"2024-09-12T00:51:36.104215+0000","last_clean":"2024-09-12T00:51:36.104215+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:51:36.104215+0000","last_undegraded":"2024-09-12T00:51:36.104215+0000","last_fullsized":"2024-09-12T00:51:36.104215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:04.721131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:21.085319+0000","last_change":"2024-09-12T00:39:28.116516+0000","last_active":"2024-09-12T00:50:21.085319+0000","last_peered":"2024-09-12T00:50:21.085319+0000","last_clean":"2024-09-12T00:50:21.085319+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:50:21.085319+0000","last_undegraded":"2024-09-12T00:50:21.085319+0000","last_fullsized":"2024-09-12T00:50:21.085319+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:59.615039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:49.922385+0000","last_change":"2024-09-12T00:28:17.060880+0000","last_active":"2024-09-12T00:50:49.922385+0000","last_peered":"2024-09-12T00:50:49.922385+0000","last_clean":"2024-09-12T00:50:49.922385+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:50:49.922385+0000","last_undegraded":"2024-09-12T00:50:49.922385+0000","last_fullsized":"2024-09-12T00:50:49.922385+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:02.004120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'5","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916667+0000","last_change":"2024-09-12T00:28:14.053133+0000","last_active":"2024-09-12T00:50:50.916667+0000","last_peered":"2024-09-12T00:50:50.916667+0000","last_clean":"2024-09-12T00:50:50.916667+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:50:50.916667+0000","last_undegraded":"2024-09-12T00:50:50.916667+0000","last_fullsized":"2024-09-12T00:50:50.916667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:48.456675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922780+0000","last_change":"2024-09-12T00:26:48.590043+0000","last_active":"2024-09-12T00:51:35.922780+0000","last_peered":"2024-09-12T00:51:35.922780+0000","last_clean":"2024-09-12T00:51:35.922780+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:51:35.922780+0000","last_undegraded":"2024-09-12T00:51:35.922780+0000","last_fullsized":"2024-09-12T00:51:35.922780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.146720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921176+0000","last_change":"2024-09-12T00:39:28.133468+0000","last_active":"2024-09-12T00:50:44.921176+0000","last_peered":"2024-09-12T00:50:44.921176+0000","last_clean":"2024-09-12T00:50:44.921176+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:50:44.921176+0000","last_undegraded":"2024-09-12T00:50:44.921176+0000","last_fullsized":"2024-09-12T00:50:44.921176+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.124886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'1","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955663+0000","last_change":"2024-09-12T00:28:17.078262+0000","last_active":"2024-09-12T00:52:10.955663+0000","last_peered":"2024-09-12T00:52:10.955663+0000","last_clean":"2024-09-12T00:52:10.955663+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:52:10.955663+0000","last_undegraded":"2024-09-12T00:52:10.955663+0000","last_fullsized":"2024-09-12T00:52:10.955663+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:56.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932572+0000","last_change":"2024-09-12T00:28:14.039832+0000","last_active":"2024-09-12T00:52:05.932572+0000","last_peered":"2024-09-12T00:52:05.932572+0000","last_clean":"2024-09-12T00:52:05.932572+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:52:05.932572+0000","last_undegraded":"2024-09-12T00:52:05.932572+0000","last_fullsized":"2024-09-12T00:52:05.932572+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.914782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922721+0000","last_change":"2024-09-12T00:26:48.586236+0000","last_active":"2024-09-12T00:51:35.922721+0000","last_peered":"2024-09-12T00:51:35.922721+0000","last_clean":"2024-09-12T00:51:35.922721+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:51:35.922721+0000","last_undegraded":"2024-09-12T00:51:35.922721+0000","last_fullsized":"2024-09-12T00:51:35.922721+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:36.773801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113170+0000","last_change":"2024-09-12T00:39:28.126995+0000","last_active":"2024-09-12T00:50:51.113170+0000","last_peered":"2024-09-12T00:50:51.113170+0000","last_clean":"2024-09-12T00:50:51.113170+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:50:51.113170+0000","last_undegraded":"2024-09-12T00:50:51.113170+0000","last_fullsized":"2024-09-12T00:50:51.113170+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.631391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:21.158401+0000","last_change":"2024-09-12T00:28:17.067864+0000","last_active":"2024-09-12T00:54:21.158401+0000","last_peered":"2024-09-12T00:54:21.158401+0000","last_clean":"2024-09-12T00:54:21.158401+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:54:21.158401+0000","last_undegraded":"2024-09-12T00:54:21.158401+0000","last_fullsized":"2024-09-12T00:54:21.158401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.110223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'3","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:04.940068+0000","last_change":"2024-09-12T00:28:14.042940+0000","last_active":"2024-09-12T00:52:04.940068+0000","last_peered":"2024-09-12T00:52:04.940068+0000","last_clean":"2024-09-12T00:52:04.940068+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:52:04.940068+0000","last_undegraded":"2024-09-12T00:52:04.940068+0000","last_fullsized":"2024-09-12T00:52:04.940068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:51.011440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111675+0000","last_change":"2024-09-12T00:26:48.568729+0000","last_active":"2024-09-12T00:50:46.111675+0000","last_peered":"2024-09-12T00:50:46.111675+0000","last_clean":"2024-09-12T00:50:46.111675+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:50:46.111675+0000","last_undegraded":"2024-09-12T00:50:46.111675+0000","last_fullsized":"2024-09-12T00:50:46.111675+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:40.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917549+0000","last_change":"2024-09-12T00:39:28.130189+0000","last_active":"2024-09-12T00:50:45.917549+0000","last_peered":"2024-09-12T00:50:45.917549+0000","last_clean":"2024-09-12T00:50:45.917549+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:50:45.917549+0000","last_undegraded":"2024-09-12T00:50:45.917549+0000","last_fullsized":"2024-09-12T00:50:45.917549+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.938677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912817+0000","last_change":"2024-09-12T00:28:17.080617+0000","last_active":"2024-09-12T00:50:50.912817+0000","last_peered":"2024-09-12T00:50:50.912817+0000","last_clean":"2024-09-12T00:50:50.912817+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:50:50.912817+0000","last_undegraded":"2024-09-12T00:50:50.912817+0000","last_fullsized":"2024-09-12T00:50:50.912817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.933670+0000","last_change":"2024-09-12T00:28:14.047276+0000","last_active":"2024-09-12T00:52:10.933670+0000","last_peered":"2024-09-12T00:52:10.933670+0000","last_clean":"2024-09-12T00:52:10.933670+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:52:10.933670+0000","last_undegraded":"2024-09-12T00:52:10.933670+0000","last_fullsized":"2024-09-12T00:52:10.933670+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:28.302616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:39.919900+0000","last_change":"2024-09-12T00:26:48.570384+0000","last_active":"2024-09-12T00:50:39.919900+0000","last_peered":"2024-09-12T00:50:39.919900+0000","last_clean":"2024-09-12T00:50:39.919900+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:50:39.919900+0000","last_undegraded":"2024-09-12T00:50:39.919900+0000","last_fullsized":"2024-09-12T00:50:39.919900+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.851801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915515+0000","last_change":"2024-09-12T00:39:28.139264+0000","last_active":"2024-09-12T00:50:45.915515+0000","last_peered":"2024-09-12T00:50:45.915515+0000","last_clean":"2024-09-12T00:50:45.915515+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:50:45.915515+0000","last_undegraded":"2024-09-12T00:50:45.915515+0000","last_fullsized":"2024-09-12T00:50:45.915515+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:33.394535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'2","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:15.937612+0000","last_change":"2024-09-12T00:28:17.064501+0000","last_active":"2024-09-12T00:52:15.937612+0000","last_peered":"2024-09-12T00:52:15.937612+0000","last_clean":"2024-09-12T00:52:15.937612+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:52:15.937612+0000","last_undegraded":"2024-09-12T00:52:15.937612+0000","last_fullsized":"2024-09-12T00:52:15.937612+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:53.028265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934413+0000","last_change":"2024-09-12T00:28:14.045720+0000","last_active":"2024-09-12T00:50:45.934413+0000","last_peered":"2024-09-12T00:50:45.934413+0000","last_clean":"2024-09-12T00:50:45.934413+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:50:45.934413+0000","last_undegraded":"2024-09-12T00:50:45.934413+0000","last_fullsized":"2024-09-12T00:50:45.934413+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.935181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.916225+0000","last_change":"2024-09-12T00:26:48.572885+0000","last_active":"2024-09-12T00:50:40.916225+0000","last_peered":"2024-09-12T00:50:40.916225+0000","last_clean":"2024-09-12T00:50:40.916225+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:50:40.916225+0000","last_undegraded":"2024-09-12T00:50:40.916225+0000","last_fullsized":"2024-09-12T00:50:40.916225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:04.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934275+0000","last_change":"2024-09-12T00:39:28.125866+0000","last_active":"2024-09-12T00:52:00.934275+0000","last_peered":"2024-09-12T00:52:00.934275+0000","last_clean":"2024-09-12T00:52:00.934275+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:52:00.934275+0000","last_undegraded":"2024-09-12T00:52:00.934275+0000","last_fullsized":"2024-09-12T00:52:00.934275+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.504703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:19.929554+0000","last_change":"2024-09-12T00:28:17.054632+0000","last_active":"2024-09-12T00:51:19.929554+0000","last_peered":"2024-09-12T00:51:19.929554+0000","last_clean":"2024-09-12T00:51:19.929554+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:51:19.929554+0000","last_undegraded":"2024-09-12T00:51:19.929554+0000","last_fullsized":"2024-09-12T00:51:19.929554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:40.665178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'6","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940366+0000","last_change":"2024-09-12T00:28:14.035922+0000","last_active":"2024-09-12T00:51:10.940366+0000","last_peered":"2024-09-12T00:51:10.940366+0000","last_clean":"2024-09-12T00:51:10.940366+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:51:10.940366+0000","last_undegraded":"2024-09-12T00:51:10.940366+0000","last_fullsized":"2024-09-12T00:51:10.940366+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:49.298722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.959193+0000","last_change":"2024-09-12T00:26:48.586797+0000","last_active":"2024-09-12T00:51:16.959193+0000","last_peered":"2024-09-12T00:51:16.959193+0000","last_clean":"2024-09-12T00:51:16.959193+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:51:16.959193+0000","last_undegraded":"2024-09-12T00:51:16.959193+0000","last_fullsized":"2024-09-12T00:51:16.959193+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.109038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934301+0000","last_change":"2024-09-12T00:39:28.120562+0000","last_active":"2024-09-12T00:52:00.934301+0000","last_peered":"2024-09-12T00:52:00.934301+0000","last_clean":"2024-09-12T00:52:00.934301+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:52:00.934301+0000","last_undegraded":"2024-09-12T00:52:00.934301+0000","last_fullsized":"2024-09-12T00:52:00.934301+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.131360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928367+0000","last_change":"2024-09-12T00:28:17.068535+0000","last_active":"2024-09-12T00:51:14.928367+0000","last_peered":"2024-09-12T00:51:14.928367+0000","last_clean":"2024-09-12T00:51:14.928367+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:51:14.928367+0000","last_undegraded":"2024-09-12T00:51:14.928367+0000","last_fullsized":"2024-09-12T00:51:14.928367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.915337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923221+0000","last_change":"2024-09-12T00:28:14.046616+0000","last_active":"2024-09-12T00:51:15.923221+0000","last_peered":"2024-09-12T00:51:15.923221+0000","last_clean":"2024-09-12T00:51:15.923221+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:51:15.923221+0000","last_undegraded":"2024-09-12T00:51:15.923221+0000","last_fullsized":"2024-09-12T00:51:15.923221+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.933281+0000","last_change":"2024-09-12T00:26:48.580888+0000","last_active":"2024-09-12T00:50:40.933281+0000","last_peered":"2024-09-12T00:50:40.933281+0000","last_clean":"2024-09-12T00:50:40.933281+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:50:40.933281+0000","last_undegraded":"2024-09-12T00:50:40.933281+0000","last_fullsized":"2024-09-12T00:50:40.933281+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:20.695674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.932994+0000","last_change":"2024-09-12T00:39:28.111443+0000","last_active":"2024-09-12T00:51:34.932994+0000","last_peered":"2024-09-12T00:51:34.932994+0000","last_clean":"2024-09-12T00:51:34.932994+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:51:34.932994+0000","last_undegraded":"2024-09-12T00:51:34.932994+0000","last_fullsized":"2024-09-12T00:51:34.932994+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:45.919919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'9","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.936631+0000","last_change":"2024-09-12T00:28:17.064371+0000","last_active":"2024-09-12T00:52:10.936631+0000","last_peered":"2024-09-12T00:52:10.936631+0000","last_clean":"2024-09-12T00:52:10.936631+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:52:10.936631+0000","last_undegraded":"2024-09-12T00:52:10.936631+0000","last_fullsized":"2024-09-12T00:52:10.936631+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:33.177694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":28674,"num_write":19,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:06.130194+0000","last_change":"2024-09-12T00:28:14.038263+0000","last_active":"2024-09-12T00:52:06.130194+0000","last_peered":"2024-09-12T00:52:06.130194+0000","last_clean":"2024-09-12T00:52:06.130194+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:52:06.130194+0000","last_undegraded":"2024-09-12T00:52:06.130194+0000","last_fullsized":"2024-09-12T00:52:06.130194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:11.087385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.931038+0000","last_change":"2024-09-12T00:26:48.578925+0000","last_active":"2024-09-12T00:51:56.931038+0000","last_peered":"2024-09-12T00:51:56.931038+0000","last_clean":"2024-09-12T00:51:56.931038+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:51:56.931038+0000","last_undegraded":"2024-09-12T00:51:56.931038+0000","last_fullsized":"2024-09-12T00:51:56.931038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:28.812698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.952894+0000","last_change":"2024-09-12T00:39:28.134519+0000","last_active":"2024-09-12T00:52:00.952894+0000","last_peered":"2024-09-12T00:52:00.952894+0000","last_clean":"2024-09-12T00:52:00.952894+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:52:00.952894+0000","last_undegraded":"2024-09-12T00:52:00.952894+0000","last_fullsized":"2024-09-12T00:52:00.952894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.950649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955943+0000","last_change":"2024-09-12T00:28:17.073665+0000","last_active":"2024-09-12T00:52:10.955943+0000","last_peered":"2024-09-12T00:52:10.955943+0000","last_clean":"2024-09-12T00:52:10.955943+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:52:10.955943+0000","last_undegraded":"2024-09-12T00:52:10.955943+0000","last_fullsized":"2024-09-12T00:52:10.955943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.110456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954576+0000","last_change":"2024-09-12T00:28:14.044717+0000","last_active":"2024-09-12T00:52:05.954576+0000","last_peered":"2024-09-12T00:52:05.954576+0000","last_clean":"2024-09-12T00:52:05.954576+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:52:05.954576+0000","last_undegraded":"2024-09-12T00:52:05.954576+0000","last_fullsized":"2024-09-12T00:52:05.954576+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:17.236547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.929500+0000","last_change":"2024-09-12T00:26:48.578631+0000","last_active":"2024-09-12T00:51:50.929500+0000","last_peered":"2024-09-12T00:51:50.929500+0000","last_clean":"2024-09-12T00:51:50.929500+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:51:50.929500+0000","last_undegraded":"2024-09-12T00:51:50.929500+0000","last_fullsized":"2024-09-12T00:51:50.929500+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.001351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910185+0000","last_change":"2024-09-12T00:39:28.145050+0000","last_active":"2024-09-12T00:50:20.910185+0000","last_peered":"2024-09-12T00:50:20.910185+0000","last_clean":"2024-09-12T00:50:20.910185+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:50:20.910185+0000","last_undegraded":"2024-09-12T00:50:20.910185+0000","last_fullsized":"2024-09-12T00:50:20.910185+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:20.809036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923080+0000","last_change":"2024-09-12T00:28:17.061641+0000","last_active":"2024-09-12T00:51:15.923080+0000","last_peered":"2024-09-12T00:51:15.923080+0000","last_clean":"2024-09-12T00:51:15.923080+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:51:15.923080+0000","last_undegraded":"2024-09-12T00:51:15.923080+0000","last_fullsized":"2024-09-12T00:51:15.923080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:36.317632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:21.133487+0000","last_change":"2024-09-12T00:28:14.038655+0000","last_active":"2024-09-12T00:52:21.133487+0000","last_peered":"2024-09-12T00:52:21.133487+0000","last_clean":"2024-09-12T00:52:21.133487+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:52:21.133487+0000","last_undegraded":"2024-09-12T00:52:21.133487+0000","last_fullsized":"2024-09-12T00:52:21.133487+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:19.550915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126487+0000","last_change":"2024-09-12T00:26:48.570084+0000","last_active":"2024-09-12T00:51:51.126487+0000","last_peered":"2024-09-12T00:51:51.126487+0000","last_clean":"2024-09-12T00:51:51.126487+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:51:51.126487+0000","last_undegraded":"2024-09-12T00:51:51.126487+0000","last_fullsized":"2024-09-12T00:51:51.126487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.533768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910538+0000","last_change":"2024-09-12T00:39:28.134280+0000","last_active":"2024-09-12T00:50:20.910538+0000","last_peered":"2024-09-12T00:50:20.910538+0000","last_clean":"2024-09-12T00:50:20.910538+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:50:20.910538+0000","last_undegraded":"2024-09-12T00:50:20.910538+0000","last_fullsized":"2024-09-12T00:50:20.910538+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.467826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'6","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:25.959578+0000","last_change":"2024-09-12T00:28:17.078304+0000","last_active":"2024-09-12T00:52:25.959578+0000","last_peered":"2024-09-12T00:52:25.959578+0000","last_clean":"2024-09-12T00:52:25.959578+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:52:25.959578+0000","last_undegraded":"2024-09-12T00:52:25.959578+0000","last_fullsized":"2024-09-12T00:52:25.959578+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.775329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'3","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940141+0000","last_change":"2024-09-12T00:28:14.051795+0000","last_active":"2024-09-12T00:51:10.940141+0000","last_peered":"2024-09-12T00:51:10.940141+0000","last_clean":"2024-09-12T00:51:10.940141+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:51:10.940141+0000","last_undegraded":"2024-09-12T00:51:10.940141+0000","last_fullsized":"2024-09-12T00:51:10.940141+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950431+0000","last_change":"2024-09-12T00:26:48.572457+0000","last_active":"2024-09-12T00:51:50.950431+0000","last_peered":"2024-09-12T00:51:50.950431+0000","last_clean":"2024-09-12T00:51:50.950431+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:51:50.950431+0000","last_undegraded":"2024-09-12T00:51:50.950431+0000","last_fullsized":"2024-09-12T00:51:50.950431+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:54.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.938985+0000","last_change":"2024-09-12T00:39:28.125155+0000","last_active":"2024-09-12T00:51:59.938985+0000","last_peered":"2024-09-12T00:51:59.938985+0000","last_clean":"2024-09-12T00:51:59.938985+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:51:59.938985+0000","last_undegraded":"2024-09-12T00:51:59.938985+0000","last_fullsized":"2024-09-12T00:51:59.938985+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:43.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'1","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.118652+0000","last_change":"2024-09-12T00:28:17.074251+0000","last_active":"2024-09-12T00:51:16.118652+0000","last_peered":"2024-09-12T00:51:16.118652+0000","last_clean":"2024-09-12T00:51:16.118652+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:51:16.118652+0000","last_undegraded":"2024-09-12T00:51:16.118652+0000","last_fullsized":"2024-09-12T00:51:16.118652+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:25.385818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'18","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917089+0000","last_change":"2024-09-12T00:28:14.035208+0000","last_active":"2024-09-12T00:51:10.917089+0000","last_peered":"2024-09-12T00:51:10.917089+0000","last_clean":"2024-09-12T00:51:10.917089+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:51:10.917089+0000","last_undegraded":"2024-09-12T00:51:10.917089+0000","last_fullsized":"2024-09-12T00:51:10.917089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.116394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30726,"num_write":23,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950319+0000","last_change":"2024-09-12T00:26:48.568293+0000","last_active":"2024-09-12T00:51:50.950319+0000","last_peered":"2024-09-12T00:51:50.950319+0000","last_clean":"2024-09-12T00:51:50.950319+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:51:50.950319+0000","last_undegraded":"2024-09-12T00:51:50.950319+0000","last_fullsized":"2024-09-12T00:51:50.950319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:56.992825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954372+0000","last_change":"2024-09-12T00:39:28.135750+0000","last_active":"2024-09-12T00:52:05.954372+0000","last_peered":"2024-09-12T00:52:05.954372+0000","last_clean":"2024-09-12T00:52:05.954372+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:52:05.954372+0000","last_undegraded":"2024-09-12T00:52:05.954372+0000","last_fullsized":"2024-09-12T00:52:05.954372+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.659110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'3","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.118588+0000","last_change":"2024-09-12T00:28:17.067509+0000","last_active":"2024-09-12T00:51:16.118588+0000","last_peered":"2024-09-12T00:51:16.118588+0000","last_clean":"2024-09-12T00:51:16.118588+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:51:16.118588+0000","last_undegraded":"2024-09-12T00:51:16.118588+0000","last_fullsized":"2024-09-12T00:51:16.118588+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:22.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'4","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096562+0000","last_change":"2024-09-12T00:28:14.047213+0000","last_active":"2024-09-12T00:51:11.096562+0000","last_peered":"2024-09-12T00:51:11.096562+0000","last_clean":"2024-09-12T00:51:11.096562+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:51:11.096562+0000","last_undegraded":"2024-09-12T00:51:11.096562+0000","last_fullsized":"2024-09-12T00:51:11.096562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:39.487908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":9,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:56.114009+0000","last_change":"2024-09-12T00:26:48.572978+0000","last_active":"2024-09-12T00:50:56.114009+0000","last_peered":"2024-09-12T00:50:56.114009+0000","last_clean":"2024-09-12T00:50:56.114009+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:50:56.114009+0000","last_undegraded":"2024-09-12T00:50:56.114009+0000","last_fullsized":"2024-09-12T00:50:56.114009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'258","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.538178+0000","last_change":"2024-09-12T00:11:45.934895+0000","last_active":"2024-09-12T00:51:51.538178+0000","last_peered":"2024-09-12T00:51:51.538178+0000","last_clean":"2024-09-12T00:51:51.538178+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:51:51.538178+0000","last_undegraded":"2024-09-12T00:51:51.538178+0000","last_fullsized":"2024-09-12T00:51:51.538178+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:30.942936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4225013,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":615,"num_read_kb":2922,"num_write":1051,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1205","reported_seq":2896,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.210228+0000","last_change":"2024-09-12T00:11:47.923845+0000","last_active":"2024-09-12T00:54:17.210228+0000","last_peered":"2024-09-12T00:54:17.210228+0000","last_clean":"2024-09-12T00:54:17.210228+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:17.210228+0000","last_undegraded":"2024-09-12T00:54:17.210228+0000","last_fullsized":"2024-09-12T00:54:17.210228+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:37.116342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'222","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.218128+0000","last_change":"2024-09-12T00:11:45.957898+0000","last_active":"2024-09-12T00:52:57.218128+0000","last_peered":"2024-09-12T00:52:57.218128+0000","last_clean":"2024-09-12T00:52:57.218128+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:52:57.218128+0000","last_undegraded":"2024-09-12T00:52:57.218128+0000","last_fullsized":"2024-09-12T00:52:57.218128+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:15.924735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446871,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":450,"num_read_kb":8607,"num_write":1037,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'455","reported_seq":2037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.541162+0000","last_change":"2024-09-12T00:11:47.930458+0000","last_active":"2024-09-12T00:52:57.541162+0000","last_peered":"2024-09-12T00:52:57.541162+0000","last_clean":"2024-09-12T00:52:57.541162+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:52:57.541162+0000","last_undegraded":"2024-09-12T00:52:57.541162+0000","last_fullsized":"2024-09-12T00:52:57.541162+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.070919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'195","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.508381+0000","last_change":"2024-09-12T00:11:45.962948+0000","last_active":"2024-09-12T00:52:32.508381+0000","last_peered":"2024-09-12T00:52:32.508381+0000","last_clean":"2024-09-12T00:52:32.508381+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:52:32.508381+0000","last_undegraded":"2024-09-12T00:52:32.508381+0000","last_fullsized":"2024-09-12T00:52:32.508381+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.772276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":9697,"num_write":932,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'469","reported_seq":2018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.750311+0000","last_change":"2024-09-12T00:11:47.929458+0000","last_active":"2024-09-12T00:53:13.750311+0000","last_peered":"2024-09-12T00:53:13.750311+0000","last_clean":"2024-09-12T00:53:13.750311+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:53:13.750311+0000","last_undegraded":"2024-09-12T00:53:13.750311+0000","last_fullsized":"2024-09-12T00:53:13.750311+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:37.545862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'170","reported_seq":792,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.732405+0000","last_change":"2024-09-12T00:11:45.918049+0000","last_active":"2024-09-12T00:52:00.732405+0000","last_peered":"2024-09-12T00:52:00.732405+0000","last_clean":"2024-09-12T00:52:00.732405+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:52:00.732405+0000","last_undegraded":"2024-09-12T00:52:00.732405+0000","last_fullsized":"2024-09-12T00:52:00.732405+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:52.132957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5820542,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":16186,"num_write":897,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'822","reported_seq":2408,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.959350+0000","last_change":"2024-09-12T00:11:47.934714+0000","last_active":"2024-09-12T00:52:56.959350+0000","last_peered":"2024-09-12T00:52:56.959350+0000","last_clean":"2024-09-12T00:52:56.959350+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:52:56.959350+0000","last_undegraded":"2024-09-12T00:52:56.959350+0000","last_fullsized":"2024-09-12T00:52:56.959350+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'188","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.366493+0000","last_change":"2024-09-12T00:11:45.949664+0000","last_active":"2024-09-12T00:52:49.366493+0000","last_peered":"2024-09-12T00:52:49.366493+0000","last_clean":"2024-09-12T00:52:49.366493+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:52:49.366493+0000","last_undegraded":"2024-09-12T00:52:49.366493+0000","last_fullsized":"2024-09-12T00:52:49.366493+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:02.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1645466,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":16314,"num_write":908,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'799","reported_seq":2283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.596547+0000","last_change":"2024-09-12T00:11:47.930048+0000","last_active":"2024-09-12T00:52:55.596547+0000","last_peered":"2024-09-12T00:52:55.596547+0000","last_clean":"2024-09-12T00:52:55.596547+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:52:55.596547+0000","last_undegraded":"2024-09-12T00:52:55.596547+0000","last_fullsized":"2024-09-12T00:52:55.596547+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.783185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'174","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.157353+0000","last_change":"2024-09-12T00:11:45.916383+0000","last_active":"2024-09-12T00:54:16.157353+0000","last_peered":"2024-09-12T00:54:16.157353+0000","last_clean":"2024-09-12T00:54:16.157353+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:16.157353+0000","last_undegraded":"2024-09-12T00:54:16.157353+0000","last_fullsized":"2024-09-12T00:54:16.157353+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.552714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4239606,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":30215,"num_write":843,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'391","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.368436+0000","last_change":"2024-09-12T00:11:47.942397+0000","last_active":"2024-09-12T00:53:14.368436+0000","last_peered":"2024-09-12T00:53:14.368436+0000","last_clean":"2024-09-12T00:53:14.368436+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:53:14.368436+0000","last_undegraded":"2024-09-12T00:53:14.368436+0000","last_fullsized":"2024-09-12T00:53:14.368436+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:36.328976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'223","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.416294+0000","last_change":"2024-09-12T00:11:45.935583+0000","last_active":"2024-09-12T00:53:11.416294+0000","last_peered":"2024-09-12T00:53:11.416294+0000","last_clean":"2024-09-12T00:53:11.416294+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:53:11.416294+0000","last_undegraded":"2024-09-12T00:53:11.416294+0000","last_fullsized":"2024-09-12T00:53:11.416294+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.329848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10185441,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":409,"num_read_kb":17813,"num_write":1026,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'990","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.505994+0000","last_change":"2024-09-12T00:11:47.923621+0000","last_active":"2024-09-12T00:53:10.505994+0000","last_peered":"2024-09-12T00:53:10.505994+0000","last_clean":"2024-09-12T00:53:10.505994+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:53:10.505994+0000","last_undegraded":"2024-09-12T00:53:10.505994+0000","last_fullsized":"2024-09-12T00:53:10.505994+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":900,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:15.959935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'178","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.174408+0000","last_change":"2024-09-12T00:12:19.246741+0000","last_active":"2024-09-12T00:52:38.174408+0000","last_peered":"2024-09-12T00:52:38.174408+0000","last_clean":"2024-09-12T00:52:38.174408+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:52:38.174408+0000","last_undegraded":"2024-09-12T00:52:38.174408+0000","last_fullsized":"2024-09-12T00:52:38.174408+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.798814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8656926,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":20841,"num_write":797,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2401,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749106+0000","last_change":"2024-09-12T00:11:47.945525+0000","last_active":"2024-09-12T00:53:13.749106+0000","last_peered":"2024-09-12T00:53:13.749106+0000","last_clean":"2024-09-12T00:53:13.749106+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:53:13.749106+0000","last_undegraded":"2024-09-12T00:53:13.749106+0000","last_fullsized":"2024-09-12T00:53:13.749106+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:16.688767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'810","reported_seq":2356,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.198693+0000","last_change":"2024-09-12T00:11:47.933883+0000","last_active":"2024-09-12T00:54:17.198693+0000","last_peered":"2024-09-12T00:54:17.198693+0000","last_clean":"2024-09-12T00:54:17.198693+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:17.198693+0000","last_undegraded":"2024-09-12T00:54:17.198693+0000","last_fullsized":"2024-09-12T00:54:17.198693+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.403220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'274","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.850453+0000","last_change":"2024-09-12T00:11:45.960039+0000","last_active":"2024-09-12T00:52:55.850453+0000","last_peered":"2024-09-12T00:52:55.850453+0000","last_clean":"2024-09-12T00:52:55.850453+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:52:55.850453+0000","last_undegraded":"2024-09-12T00:52:55.850453+0000","last_fullsized":"2024-09-12T00:52:55.850453+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:20.482316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2536787,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":924,"num_read_kb":25081,"num_write":1223,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2586,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199630+0000","last_change":"2024-09-12T00:11:47.935606+0000","last_active":"2024-09-12T00:54:17.199630+0000","last_peered":"2024-09-12T00:54:17.199630+0000","last_clean":"2024-09-12T00:54:17.199630+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:17.199630+0000","last_undegraded":"2024-09-12T00:54:17.199630+0000","last_fullsized":"2024-09-12T00:54:17.199630+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:09.287342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'181","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.336408+0000","last_change":"2024-09-12T00:11:45.920735+0000","last_active":"2024-09-12T00:54:16.336408+0000","last_peered":"2024-09-12T00:54:16.336408+0000","last_clean":"2024-09-12T00:54:16.336408+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:16.336408+0000","last_undegraded":"2024-09-12T00:54:16.336408+0000","last_fullsized":"2024-09-12T00:54:16.336408+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:08.846428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22688,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":439,"num_read_kb":23009,"num_write":866,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'439","reported_seq":2004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.211419+0000","last_change":"2024-09-12T00:11:47.940868+0000","last_active":"2024-09-12T00:54:17.211419+0000","last_peered":"2024-09-12T00:54:17.211419+0000","last_clean":"2024-09-12T00:54:17.211419+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:17.211419+0000","last_undegraded":"2024-09-12T00:54:17.211419+0000","last_fullsized":"2024-09-12T00:54:17.211419+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:23.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'189","reported_seq":811,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:48.027510+0000","last_change":"2024-09-12T00:11:45.925804+0000","last_active":"2024-09-12T00:52:48.027510+0000","last_peered":"2024-09-12T00:52:48.027510+0000","last_clean":"2024-09-12T00:52:48.027510+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:52:48.027510+0000","last_undegraded":"2024-09-12T00:52:48.027510+0000","last_fullsized":"2024-09-12T00:52:48.027510+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:55.107812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778905,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":15824,"num_write":916,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'552","reported_seq":2152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.505098+0000","last_change":"2024-09-12T00:11:47.949066+0000","last_active":"2024-09-12T00:53:01.505098+0000","last_peered":"2024-09-12T00:53:01.505098+0000","last_clean":"2024-09-12T00:53:01.505098+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:53:01.505098+0000","last_undegraded":"2024-09-12T00:53:01.505098+0000","last_fullsized":"2024-09-12T00:53:01.505098+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'209","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:02.043040+0000","last_change":"2024-09-12T00:11:45.937137+0000","last_active":"2024-09-12T00:53:02.043040+0000","last_peered":"2024-09-12T00:53:02.043040+0000","last_clean":"2024-09-12T00:53:02.043040+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:53:02.043040+0000","last_undegraded":"2024-09-12T00:53:02.043040+0000","last_fullsized":"2024-09-12T00:53:02.043040+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:36.986793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":974316,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":26404,"num_write":989,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'628","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.967393+0000","last_change":"2024-09-12T00:11:47.924685+0000","last_active":"2024-09-12T00:53:01.967393+0000","last_peered":"2024-09-12T00:53:01.967393+0000","last_clean":"2024-09-12T00:53:01.967393+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:53:01.967393+0000","last_undegraded":"2024-09-12T00:53:01.967393+0000","last_fullsized":"2024-09-12T00:53:01.967393+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:06.368642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'182","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.242410+0000","last_change":"2024-09-12T00:11:45.950496+0000","last_active":"2024-09-12T00:53:11.242410+0000","last_peered":"2024-09-12T00:53:11.242410+0000","last_clean":"2024-09-12T00:53:11.242410+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:53:11.242410+0000","last_undegraded":"2024-09-12T00:53:11.242410+0000","last_fullsized":"2024-09-12T00:53:11.242410+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:36.187975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18534561,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":19556,"num_write":887,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1215","reported_seq":2911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.201094+0000","last_change":"2024-09-12T00:11:47.925124+0000","last_active":"2024-09-12T00:54:17.201094+0000","last_peered":"2024-09-12T00:54:17.201094+0000","last_clean":"2024-09-12T00:54:17.201094+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:17.201094+0000","last_undegraded":"2024-09-12T00:54:17.201094+0000","last_fullsized":"2024-09-12T00:54:17.201094+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:30.824531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'203","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.659905+0000","last_change":"2024-09-12T00:11:45.938512+0000","last_active":"2024-09-12T00:54:07.659905+0000","last_peered":"2024-09-12T00:54:07.659905+0000","last_clean":"2024-09-12T00:54:07.659905+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:07.659905+0000","last_undegraded":"2024-09-12T00:54:07.659905+0000","last_fullsized":"2024-09-12T00:54:07.659905+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:43.280807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437213,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":569,"num_read_kb":13603,"num_write":996,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'158","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.440855+0000","last_change":"2024-09-12T00:11:55.962848+0000","last_active":"2024-09-12T00:53:14.440855+0000","last_peered":"2024-09-12T00:53:14.440855+0000","last_clean":"2024-09-12T00:53:14.440855+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:53:14.440855+0000","last_undegraded":"2024-09-12T00:53:14.440855+0000","last_fullsized":"2024-09-12T00:53:14.440855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:04.549126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'428","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.365744+0000","last_change":"2024-09-12T00:11:47.957238+0000","last_active":"2024-09-12T00:53:14.365744+0000","last_peered":"2024-09-12T00:53:14.365744+0000","last_clean":"2024-09-12T00:53:14.365744+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:53:14.365744+0000","last_undegraded":"2024-09-12T00:53:14.365744+0000","last_fullsized":"2024-09-12T00:53:14.365744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:35.988751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'193","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:13.592676+0000","last_change":"2024-09-12T00:12:19.243333+0000","last_active":"2024-09-12T00:52:13.592676+0000","last_peered":"2024-09-12T00:52:13.592676+0000","last_clean":"2024-09-12T00:52:13.592676+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:52:13.592676+0000","last_undegraded":"2024-09-12T00:52:13.592676+0000","last_fullsized":"2024-09-12T00:52:13.592676+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:21.362685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291438,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":1948,"num_write":1007,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930718+0000","last_change":"2024-09-12T00:11:49.940927+0000","last_active":"2024-09-12T00:50:30.930718+0000","last_peered":"2024-09-12T00:50:30.930718+0000","last_clean":"2024-09-12T00:50:30.930718+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:50:30.930718+0000","last_undegraded":"2024-09-12T00:50:30.930718+0000","last_fullsized":"2024-09-12T00:50:30.930718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:54.486050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'196","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.946114+0000","last_change":"2024-09-12T00:11:51.947651+0000","last_active":"2024-09-12T00:53:00.946114+0000","last_peered":"2024-09-12T00:53:00.946114+0000","last_clean":"2024-09-12T00:53:00.946114+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:53:00.946114+0000","last_undegraded":"2024-09-12T00:53:00.946114+0000","last_fullsized":"2024-09-12T00:53:00.946114+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:29.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11858,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":263,"num_read_kb":317,"num_write":156,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089124+0000","last_change":"2024-09-12T00:11:53.948633+0000","last_active":"2024-09-12T00:50:36.089124+0000","last_peered":"2024-09-12T00:50:36.089124+0000","last_clean":"2024-09-12T00:50:36.089124+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:50:36.089124+0000","last_undegraded":"2024-09-12T00:50:36.089124+0000","last_fullsized":"2024-09-12T00:50:36.089124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:09.362747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2472","reported_seq":4364,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.220805+0000","last_change":"2024-09-12T00:11:55.974612+0000","last_active":"2024-09-12T00:53:59.220805+0000","last_peered":"2024-09-12T00:53:59.220805+0000","last_clean":"2024-09-12T00:53:59.220805+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:53:59.220805+0000","last_undegraded":"2024-09-12T00:53:59.220805+0000","last_fullsized":"2024-09-12T00:53:59.220805+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:50.591689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'463","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.197150+0000","last_change":"2024-09-12T00:11:47.930826+0000","last_active":"2024-09-12T00:54:17.197150+0000","last_peered":"2024-09-12T00:54:17.197150+0000","last_clean":"2024-09-12T00:54:17.197150+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:17.197150+0000","last_undegraded":"2024-09-12T00:54:17.197150+0000","last_fullsized":"2024-09-12T00:54:17.197150+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:30.387857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'239","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.576017+0000","last_change":"2024-09-12T00:11:45.930202+0000","last_active":"2024-09-12T00:53:00.576017+0000","last_peered":"2024-09-12T00:53:00.576017+0000","last_clean":"2024-09-12T00:53:00.576017+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:53:00.576017+0000","last_undegraded":"2024-09-12T00:53:00.576017+0000","last_fullsized":"2024-09-12T00:53:00.576017+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:48.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9488471,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":589,"num_read_kb":71900,"num_write":1163,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.928736+0000","last_change":"2024-09-12T00:11:49.928414+0000","last_active":"2024-09-12T00:51:40.928736+0000","last_peered":"2024-09-12T00:51:40.928736+0000","last_clean":"2024-09-12T00:51:40.928736+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:51:40.928736+0000","last_undegraded":"2024-09-12T00:51:40.928736+0000","last_fullsized":"2024-09-12T00:51:40.928736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.325652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'91","reported_seq":624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.782442+0000","last_change":"2024-09-12T00:11:51.929989+0000","last_active":"2024-09-12T00:52:37.782442+0000","last_peered":"2024-09-12T00:52:37.782442+0000","last_clean":"2024-09-12T00:52:37.782442+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:52:37.782442+0000","last_undegraded":"2024-09-12T00:52:37.782442+0000","last_fullsized":"2024-09-12T00:52:37.782442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:18.143324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089023+0000","last_change":"2024-09-12T00:11:53.948950+0000","last_active":"2024-09-12T00:50:36.089023+0000","last_peered":"2024-09-12T00:50:36.089023+0000","last_clean":"2024-09-12T00:50:36.089023+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:50:36.089023+0000","last_undegraded":"2024-09-12T00:50:36.089023+0000","last_fullsized":"2024-09-12T00:50:36.089023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:44.328086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'155","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.554087+0000","last_change":"2024-09-12T00:11:55.974329+0000","last_active":"2024-09-12T00:52:56.554087+0000","last_peered":"2024-09-12T00:52:56.554087+0000","last_clean":"2024-09-12T00:52:56.554087+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:52:56.554087+0000","last_undegraded":"2024-09-12T00:52:56.554087+0000","last_fullsized":"2024-09-12T00:52:56.554087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:22.758032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'565","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.733246+0000","last_change":"2024-09-12T00:11:47.935137+0000","last_active":"2024-09-12T00:53:13.733246+0000","last_peered":"2024-09-12T00:53:13.733246+0000","last_clean":"2024-09-12T00:53:13.733246+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:53:13.733246+0000","last_undegraded":"2024-09-12T00:53:13.733246+0000","last_fullsized":"2024-09-12T00:53:13.733246+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.622836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'223","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.284615+0000","last_change":"2024-09-12T00:11:45.920772+0000","last_active":"2024-09-12T00:52:00.284615+0000","last_peered":"2024-09-12T00:52:00.284615+0000","last_clean":"2024-09-12T00:52:00.284615+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:52:00.284615+0000","last_undegraded":"2024-09-12T00:52:00.284615+0000","last_fullsized":"2024-09-12T00:52:00.284615+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:51.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064999,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":463,"num_read_kb":11763,"num_write":999,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.912975+0000","last_change":"2024-09-12T00:11:49.946026+0000","last_active":"2024-09-12T00:50:30.912975+0000","last_peered":"2024-09-12T00:50:30.912975+0000","last_clean":"2024-09-12T00:50:30.912975+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:50:30.912975+0000","last_undegraded":"2024-09-12T00:50:30.912975+0000","last_fullsized":"2024-09-12T00:50:30.912975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.002432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'128","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:34.133774+0000","last_change":"2024-09-12T00:11:51.952490+0000","last_active":"2024-09-12T00:52:34.133774+0000","last_peered":"2024-09-12T00:52:34.133774+0000","last_clean":"2024-09-12T00:52:34.133774+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:52:34.133774+0000","last_undegraded":"2024-09-12T00:52:34.133774+0000","last_fullsized":"2024-09-12T00:52:34.133774+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:12.676121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'778","reported_seq":2215,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.972496+0000","last_change":"2024-09-12T00:11:53.963903+0000","last_active":"2024-09-12T00:54:30.972496+0000","last_peered":"2024-09-12T00:54:30.972496+0000","last_clean":"2024-09-12T00:54:30.972496+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:54:30.972496+0000","last_undegraded":"2024-09-12T00:54:30.972496+0000","last_fullsized":"2024-09-12T00:54:30.972496+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:11.131097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'218","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.508260+0000","last_change":"2024-09-12T00:11:55.967351+0000","last_active":"2024-09-12T00:53:14.508260+0000","last_peered":"2024-09-12T00:53:14.508260+0000","last_clean":"2024-09-12T00:53:14.508260+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:53:14.508260+0000","last_undegraded":"2024-09-12T00:53:14.508260+0000","last_fullsized":"2024-09-12T00:53:14.508260+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:31.864573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'339","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.748057+0000","last_change":"2024-09-12T00:11:47.931389+0000","last_active":"2024-09-12T00:53:13.748057+0000","last_peered":"2024-09-12T00:53:13.748057+0000","last_clean":"2024-09-12T00:53:13.748057+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:53:13.748057+0000","last_undegraded":"2024-09-12T00:53:13.748057+0000","last_fullsized":"2024-09-12T00:53:13.748057+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:39.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'200","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:46.129859+0000","last_change":"2024-09-12T00:11:45.960713+0000","last_active":"2024-09-12T00:53:46.129859+0000","last_peered":"2024-09-12T00:53:46.129859+0000","last_clean":"2024-09-12T00:53:46.129859+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:53:46.129859+0000","last_undegraded":"2024-09-12T00:53:46.129859+0000","last_fullsized":"2024-09-12T00:53:46.129859+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.838856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1075321,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":364,"num_read_kb":5525,"num_write":925,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930757+0000","last_change":"2024-09-12T00:11:49.936925+0000","last_active":"2024-09-12T00:50:30.930757+0000","last_peered":"2024-09-12T00:50:30.930757+0000","last_clean":"2024-09-12T00:50:30.930757+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:50:30.930757+0000","last_undegraded":"2024-09-12T00:50:30.930757+0000","last_fullsized":"2024-09-12T00:50:30.930757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.835956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'118","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.288970+0000","last_change":"2024-09-12T00:11:51.945240+0000","last_active":"2024-09-12T00:54:18.288970+0000","last_peered":"2024-09-12T00:54:18.288970+0000","last_clean":"2024-09-12T00:54:18.288970+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:18.288970+0000","last_undegraded":"2024-09-12T00:54:18.288970+0000","last_fullsized":"2024-09-12T00:54:18.288970+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:43.775349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4460,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":68,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'787","reported_seq":2256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.373943+0000","last_change":"2024-09-12T00:11:53.966127+0000","last_active":"2024-09-12T00:54:18.373943+0000","last_peered":"2024-09-12T00:54:18.373943+0000","last_clean":"2024-09-12T00:54:18.373943+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:54:18.373943+0000","last_undegraded":"2024-09-12T00:54:18.373943+0000","last_fullsized":"2024-09-12T00:54:18.373943+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.057133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'538","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.492338+0000","last_change":"2024-09-12T00:11:47.925552+0000","last_active":"2024-09-12T00:53:10.492338+0000","last_peered":"2024-09-12T00:53:10.492338+0000","last_clean":"2024-09-12T00:53:10.492338+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:53:10.492338+0000","last_undegraded":"2024-09-12T00:53:10.492338+0000","last_fullsized":"2024-09-12T00:53:10.492338+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:35.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'239","reported_seq":895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.324905+0000","last_change":"2024-09-12T00:11:45.936612+0000","last_active":"2024-09-12T00:52:53.324905+0000","last_peered":"2024-09-12T00:52:53.324905+0000","last_clean":"2024-09-12T00:52:53.324905+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:52:53.324905+0000","last_undegraded":"2024-09-12T00:52:53.324905+0000","last_fullsized":"2024-09-12T00:52:53.324905+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:04.380015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13222281,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":589,"num_read_kb":40518,"num_write":1095,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092095+0000","last_change":"2024-09-12T00:11:49.915889+0000","last_active":"2024-09-12T00:50:51.092095+0000","last_peered":"2024-09-12T00:50:51.092095+0000","last_clean":"2024-09-12T00:50:51.092095+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:50:51.092095+0000","last_undegraded":"2024-09-12T00:50:51.092095+0000","last_fullsized":"2024-09-12T00:50:51.092095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:01.391369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'216","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.950080+0000","last_change":"2024-09-12T00:11:51.952724+0000","last_active":"2024-09-12T00:53:15.950080+0000","last_peered":"2024-09-12T00:53:15.950080+0000","last_clean":"2024-09-12T00:53:15.950080+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:53:15.950080+0000","last_undegraded":"2024-09-12T00:53:15.950080+0000","last_fullsized":"2024-09-12T00:53:15.950080+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:30.153282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12559,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":291,"num_read_kb":346,"num_write":174,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.904191+0000","last_change":"2024-09-12T00:11:53.969081+0000","last_active":"2024-09-12T00:50:10.904191+0000","last_peered":"2024-09-12T00:50:10.904191+0000","last_clean":"2024-09-12T00:50:10.904191+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:50:10.904191+0000","last_undegraded":"2024-09-12T00:50:10.904191+0000","last_fullsized":"2024-09-12T00:50:10.904191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:12.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'542","reported_seq":1368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.342188+0000","last_change":"2024-09-12T00:11:55.961717+0000","last_active":"2024-09-12T00:54:18.342188+0000","last_peered":"2024-09-12T00:54:18.342188+0000","last_clean":"2024-09-12T00:54:18.342188+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:54:18.342188+0000","last_undegraded":"2024-09-12T00:54:18.342188+0000","last_fullsized":"2024-09-12T00:54:18.342188+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'843","reported_seq":2486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.493186+0000","last_change":"2024-09-12T00:11:47.924514+0000","last_active":"2024-09-12T00:53:10.493186+0000","last_peered":"2024-09-12T00:53:10.493186+0000","last_clean":"2024-09-12T00:53:10.493186+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:53:10.493186+0000","last_undegraded":"2024-09-12T00:53:10.493186+0000","last_fullsized":"2024-09-12T00:53:10.493186+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:28.061678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'183","reported_seq":993,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.134909+0000","last_change":"2024-09-12T00:11:45.960456+0000","last_active":"2024-09-12T00:54:31.134909+0000","last_peered":"2024-09-12T00:54:31.134909+0000","last_clean":"2024-09-12T00:54:31.134909+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:31.134909+0000","last_undegraded":"2024-09-12T00:54:31.134909+0000","last_fullsized":"2024-09-12T00:54:31.134909+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:26.947144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2527593,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":810,"num_read_kb":32531,"num_write":876,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912730+0000","last_change":"2024-09-12T00:11:49.945091+0000","last_active":"2024-09-12T00:50:50.912730+0000","last_peered":"2024-09-12T00:50:50.912730+0000","last_clean":"2024-09-12T00:50:50.912730+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:50:50.912730+0000","last_undegraded":"2024-09-12T00:50:50.912730+0000","last_fullsized":"2024-09-12T00:50:50.912730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.590584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'125","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.373388+0000","last_change":"2024-09-12T00:11:51.947825+0000","last_active":"2024-09-12T00:53:14.373388+0000","last_peered":"2024-09-12T00:53:14.373388+0000","last_clean":"2024-09-12T00:53:14.373388+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:53:14.373388+0000","last_undegraded":"2024-09-12T00:53:14.373388+0000","last_fullsized":"2024-09-12T00:53:14.373388+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:40.118757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":217,"num_write":84,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:05.920875+0000","last_change":"2024-09-12T00:11:53.971538+0000","last_active":"2024-09-12T00:51:05.920875+0000","last_peered":"2024-09-12T00:51:05.920875+0000","last_clean":"2024-09-12T00:51:05.920875+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:51:05.920875+0000","last_undegraded":"2024-09-12T00:51:05.920875+0000","last_fullsized":"2024-09-12T00:51:05.920875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.262175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'143","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:41.129296+0000","last_change":"2024-09-12T00:11:55.983166+0000","last_active":"2024-09-12T00:53:41.129296+0000","last_peered":"2024-09-12T00:53:41.129296+0000","last_clean":"2024-09-12T00:53:41.129296+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:53:41.129296+0000","last_undegraded":"2024-09-12T00:53:41.129296+0000","last_fullsized":"2024-09-12T00:53:41.129296+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.841060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'471","reported_seq":1963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369406+0000","last_change":"2024-09-12T00:11:47.926269+0000","last_active":"2024-09-12T00:53:14.369406+0000","last_peered":"2024-09-12T00:53:14.369406+0000","last_clean":"2024-09-12T00:53:14.369406+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:53:14.369406+0000","last_undegraded":"2024-09-12T00:53:14.369406+0000","last_fullsized":"2024-09-12T00:53:14.369406+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:55.592362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'164","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:15.957076+0000","last_change":"2024-09-12T00:11:45.932385+0000","last_active":"2024-09-12T00:52:15.957076+0000","last_peered":"2024-09-12T00:52:15.957076+0000","last_clean":"2024-09-12T00:52:15.957076+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:52:15.957076+0000","last_undegraded":"2024-09-12T00:52:15.957076+0000","last_fullsized":"2024-09-12T00:52:15.957076+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.293210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13921921,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":351,"num_read_kb":53604,"num_write":793,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:04.911798+0000","last_change":"2024-09-12T00:11:49.936538+0000","last_active":"2024-09-12T00:50:04.911798+0000","last_peered":"2024-09-12T00:50:04.911798+0000","last_clean":"2024-09-12T00:50:04.911798+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:50:04.911798+0000","last_undegraded":"2024-09-12T00:50:04.911798+0000","last_fullsized":"2024-09-12T00:50:04.911798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'161","reported_seq":752,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.968254+0000","last_change":"2024-09-12T00:11:51.935323+0000","last_active":"2024-09-12T00:53:05.968254+0000","last_peered":"2024-09-12T00:53:05.968254+0000","last_clean":"2024-09-12T00:53:05.968254+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:53:05.968254+0000","last_undegraded":"2024-09-12T00:53:05.968254+0000","last_fullsized":"2024-09-12T00:53:05.968254+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.661049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13243,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":276,"num_write":122,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'786","reported_seq":4494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.376700+0000","last_change":"2024-09-12T00:11:53.965915+0000","last_active":"2024-09-12T00:54:18.376700+0000","last_peered":"2024-09-12T00:54:18.376700+0000","last_clean":"2024-09-12T00:54:18.376700+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:54:18.376700+0000","last_undegraded":"2024-09-12T00:54:18.376700+0000","last_fullsized":"2024-09-12T00:54:18.376700+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.284890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'110","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.118486+0000","last_change":"2024-09-12T00:11:55.974936+0000","last_active":"2024-09-12T00:54:17.118486+0000","last_peered":"2024-09-12T00:54:17.118486+0000","last_clean":"2024-09-12T00:54:17.118486+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:54:17.118486+0000","last_undegraded":"2024-09-12T00:54:17.118486+0000","last_fullsized":"2024-09-12T00:54:17.118486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.341303+0000","last_change":"2024-09-12T00:11:47.936806+0000","last_active":"2024-09-12T00:53:14.341303+0000","last_peered":"2024-09-12T00:53:14.341303+0000","last_clean":"2024-09-12T00:53:14.341303+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:53:14.341303+0000","last_undegraded":"2024-09-12T00:53:14.341303+0000","last_fullsized":"2024-09-12T00:53:14.341303+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.241629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'202","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.186525+0000","last_change":"2024-09-12T00:11:45.924370+0000","last_active":"2024-09-12T00:52:37.186525+0000","last_peered":"2024-09-12T00:52:37.186525+0000","last_clean":"2024-09-12T00:52:37.186525+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:52:37.186525+0000","last_undegraded":"2024-09-12T00:52:37.186525+0000","last_fullsized":"2024-09-12T00:52:37.186525+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.161944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1636479,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":351,"num_read_kb":7228,"num_write":901,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914998+0000","last_change":"2024-09-12T00:11:49.935933+0000","last_active":"2024-09-12T00:51:00.914998+0000","last_peered":"2024-09-12T00:51:00.914998+0000","last_clean":"2024-09-12T00:51:00.914998+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:51:00.914998+0000","last_undegraded":"2024-09-12T00:51:00.914998+0000","last_fullsized":"2024-09-12T00:51:00.914998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:55.844937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'213","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.268340+0000","last_change":"2024-09-12T00:11:51.953736+0000","last_active":"2024-09-12T00:54:18.268340+0000","last_peered":"2024-09-12T00:54:18.268340+0000","last_clean":"2024-09-12T00:54:18.268340+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:54:18.268340+0000","last_undegraded":"2024-09-12T00:54:18.268340+0000","last_fullsized":"2024-09-12T00:54:18.268340+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:45.844572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27898,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":285,"num_read_kb":405,"num_write":152,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923531+0000","last_change":"2024-09-12T00:11:53.953180+0000","last_active":"2024-09-12T00:50:54.923531+0000","last_peered":"2024-09-12T00:50:54.923531+0000","last_clean":"2024-09-12T00:50:54.923531+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:50:54.923531+0000","last_undegraded":"2024-09-12T00:50:54.923531+0000","last_fullsized":"2024-09-12T00:50:54.923531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.341688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'167","reported_seq":695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.573638+0000","last_change":"2024-09-12T00:11:55.974975+0000","last_active":"2024-09-12T00:53:13.573638+0000","last_peered":"2024-09-12T00:53:13.573638+0000","last_clean":"2024-09-12T00:53:13.573638+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:53:13.573638+0000","last_undegraded":"2024-09-12T00:53:13.573638+0000","last_fullsized":"2024-09-12T00:53:13.573638+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:59.474049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'471","reported_seq":1903,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.691464+0000","last_change":"2024-09-12T00:11:47.940887+0000","last_active":"2024-09-12T00:52:54.691464+0000","last_peered":"2024-09-12T00:52:54.691464+0000","last_clean":"2024-09-12T00:52:54.691464+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:52:54.691464+0000","last_undegraded":"2024-09-12T00:52:54.691464+0000","last_fullsized":"2024-09-12T00:52:54.691464+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:51.522432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'209","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.037175+0000","last_change":"2024-09-12T00:11:45.943857+0000","last_active":"2024-09-12T00:52:24.037175+0000","last_peered":"2024-09-12T00:52:24.037175+0000","last_clean":"2024-09-12T00:52:24.037175+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:52:24.037175+0000","last_undegraded":"2024-09-12T00:52:24.037175+0000","last_fullsized":"2024-09-12T00:52:24.037175+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:43.419673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553739,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":429,"num_read_kb":1957,"num_write":997,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"37'3","reported_seq":972,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.927575+0000","last_change":"2024-09-12T00:11:49.937297+0000","last_active":"2024-09-12T00:54:30.927575+0000","last_peered":"2024-09-12T00:54:30.927575+0000","last_clean":"2024-09-12T00:54:30.927575+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:30.927575+0000","last_undegraded":"2024-09-12T00:54:30.927575+0000","last_fullsized":"2024-09-12T00:54:30.927575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:00.946216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'161","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.273607+0000","last_change":"2024-09-12T00:11:51.927031+0000","last_active":"2024-09-12T00:54:18.273607+0000","last_peered":"2024-09-12T00:54:18.273607+0000","last_clean":"2024-09-12T00:54:18.273607+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:18.273607+0000","last_undegraded":"2024-09-12T00:54:18.273607+0000","last_fullsized":"2024-09-12T00:54:18.273607+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:02.672539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18135,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":213,"num_read_kb":238,"num_write":170,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910347+0000","last_change":"2024-09-12T00:11:53.968094+0000","last_active":"2024-09-12T00:50:20.910347+0000","last_peered":"2024-09-12T00:50:20.910347+0000","last_clean":"2024-09-12T00:50:20.910347+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:50:20.910347+0000","last_undegraded":"2024-09-12T00:50:20.910347+0000","last_fullsized":"2024-09-12T00:50:20.910347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.434778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'111","reported_seq":608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.371379+0000","last_change":"2024-09-12T00:11:55.962445+0000","last_active":"2024-09-12T00:54:07.371379+0000","last_peered":"2024-09-12T00:54:07.371379+0000","last_clean":"2024-09-12T00:54:07.371379+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:54:07.371379+0000","last_undegraded":"2024-09-12T00:54:07.371379+0000","last_fullsized":"2024-09-12T00:54:07.371379+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.195407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'357","reported_seq":1761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.492153+0000","last_change":"2024-09-12T00:11:47.927194+0000","last_active":"2024-09-12T00:53:10.492153+0000","last_peered":"2024-09-12T00:53:10.492153+0000","last_clean":"2024-09-12T00:53:10.492153+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:53:10.492153+0000","last_undegraded":"2024-09-12T00:53:10.492153+0000","last_fullsized":"2024-09-12T00:53:10.492153+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:01.220441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'177","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:46.022553+0000","last_change":"2024-09-12T00:11:45.917052+0000","last_active":"2024-09-12T00:52:46.022553+0000","last_peered":"2024-09-12T00:52:46.022553+0000","last_clean":"2024-09-12T00:52:46.022553+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:52:46.022553+0000","last_undegraded":"2024-09-12T00:52:46.022553+0000","last_fullsized":"2024-09-12T00:52:46.022553+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:13.426346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266715,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":98751,"num_write":849,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:04.911850+0000","last_change":"2024-09-12T00:11:49.929321+0000","last_active":"2024-09-12T00:50:04.911850+0000","last_peered":"2024-09-12T00:50:04.911850+0000","last_clean":"2024-09-12T00:50:04.911850+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:50:04.911850+0000","last_undegraded":"2024-09-12T00:50:04.911850+0000","last_fullsized":"2024-09-12T00:50:04.911850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:41.401304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'142","reported_seq":720,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.734321+0000","last_change":"2024-09-12T00:11:51.944644+0000","last_active":"2024-09-12T00:52:37.734321+0000","last_peered":"2024-09-12T00:52:37.734321+0000","last_clean":"2024-09-12T00:52:37.734321+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:52:37.734321+0000","last_undegraded":"2024-09-12T00:52:37.734321+0000","last_fullsized":"2024-09-12T00:52:37.734321+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.228465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8597,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":190,"num_read_kb":228,"num_write":104,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'757","reported_seq":4268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.366563+0000","last_change":"2024-09-12T00:11:53.952899+0000","last_active":"2024-09-12T00:54:18.366563+0000","last_peered":"2024-09-12T00:54:18.366563+0000","last_clean":"2024-09-12T00:54:18.366563+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:18.366563+0000","last_undegraded":"2024-09-12T00:54:18.366563+0000","last_fullsized":"2024-09-12T00:54:18.366563+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:12.752310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'131","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.447365+0000","last_change":"2024-09-12T00:11:55.980382+0000","last_active":"2024-09-12T00:53:14.447365+0000","last_peered":"2024-09-12T00:53:14.447365+0000","last_clean":"2024-09-12T00:53:14.447365+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:53:14.447365+0000","last_undegraded":"2024-09-12T00:53:14.447365+0000","last_fullsized":"2024-09-12T00:53:14.447365+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:00.118353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'421","reported_seq":1948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.492491+0000","last_change":"2024-09-12T00:11:47.929290+0000","last_active":"2024-09-12T00:53:01.492491+0000","last_peered":"2024-09-12T00:53:01.492491+0000","last_clean":"2024-09-12T00:53:01.492491+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:53:01.492491+0000","last_undegraded":"2024-09-12T00:53:01.492491+0000","last_fullsized":"2024-09-12T00:53:01.492491+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:17.558291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'200","reported_seq":955,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:44.180384+0000","last_change":"2024-09-12T00:11:45.934214+0000","last_active":"2024-09-12T00:52:44.180384+0000","last_peered":"2024-09-12T00:52:44.180384+0000","last_clean":"2024-09-12T00:52:44.180384+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:52:44.180384+0000","last_undegraded":"2024-09-12T00:52:44.180384+0000","last_fullsized":"2024-09-12T00:52:44.180384+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:16.412728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7523936,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":763,"num_read_kb":199371,"num_write":986,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.943149+0000","last_change":"2024-09-12T00:11:49.916557+0000","last_active":"2024-09-12T00:54:30.943149+0000","last_peered":"2024-09-12T00:54:30.943149+0000","last_clean":"2024-09-12T00:54:30.943149+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:30.943149+0000","last_undegraded":"2024-09-12T00:54:30.943149+0000","last_fullsized":"2024-09-12T00:54:30.943149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:21.916420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'72","reported_seq":590,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.752832+0000","last_change":"2024-09-12T00:11:51.935418+0000","last_active":"2024-09-12T00:53:13.752832+0000","last_peered":"2024-09-12T00:53:13.752832+0000","last_clean":"2024-09-12T00:53:13.752832+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:53:13.752832+0000","last_undegraded":"2024-09-12T00:53:13.752832+0000","last_fullsized":"2024-09-12T00:53:13.752832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:51.747263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'797","reported_seq":2240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.976636+0000","last_change":"2024-09-12T00:11:53.957570+0000","last_active":"2024-09-12T00:54:30.976636+0000","last_peered":"2024-09-12T00:54:30.976636+0000","last_clean":"2024-09-12T00:54:30.976636+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:30.976636+0000","last_undegraded":"2024-09-12T00:54:30.976636+0000","last_fullsized":"2024-09-12T00:54:30.976636+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:04.088118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.135829+0000","last_change":"2024-09-12T00:11:55.975495+0000","last_active":"2024-09-12T00:52:29.135829+0000","last_peered":"2024-09-12T00:52:29.135829+0000","last_clean":"2024-09-12T00:52:29.135829+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:52:29.135829+0000","last_undegraded":"2024-09-12T00:52:29.135829+0000","last_fullsized":"2024-09-12T00:52:29.135829+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.293878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'759","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.232523+0000","last_change":"2024-09-12T00:11:47.955610+0000","last_active":"2024-09-12T00:53:00.232523+0000","last_peered":"2024-09-12T00:53:00.232523+0000","last_clean":"2024-09-12T00:53:00.232523+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:53:00.232523+0000","last_undegraded":"2024-09-12T00:53:00.232523+0000","last_fullsized":"2024-09-12T00:53:00.232523+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:19.656190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'213","reported_seq":859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:52.093662+0000","last_change":"2024-09-12T00:11:45.929866+0000","last_active":"2024-09-12T00:51:52.093662+0000","last_peered":"2024-09-12T00:51:52.093662+0000","last_clean":"2024-09-12T00:51:52.093662+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:51:52.093662+0000","last_undegraded":"2024-09-12T00:51:52.093662+0000","last_fullsized":"2024-09-12T00:51:52.093662+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:51.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5562540,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":31245,"num_write":949,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924891+0000","last_change":"2024-09-12T00:11:49.941210+0000","last_active":"2024-09-12T00:50:05.924891+0000","last_peered":"2024-09-12T00:50:05.924891+0000","last_clean":"2024-09-12T00:50:05.924891+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:50:05.924891+0000","last_undegraded":"2024-09-12T00:50:05.924891+0000","last_fullsized":"2024-09-12T00:50:05.924891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:16.438093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'219","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.305281+0000","last_change":"2024-09-12T00:11:51.947561+0000","last_active":"2024-09-12T00:54:18.305281+0000","last_peered":"2024-09-12T00:54:18.305281+0000","last_clean":"2024-09-12T00:54:18.305281+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:18.305281+0000","last_undegraded":"2024-09-12T00:54:18.305281+0000","last_fullsized":"2024-09-12T00:54:18.305281+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:33.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12252,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":862,"num_read_kb":913,"num_write":1358,"num_write_kb":1231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104173+0000","last_change":"2024-09-12T00:11:53.957928+0000","last_active":"2024-09-12T00:50:11.104173+0000","last_peered":"2024-09-12T00:50:11.104173+0000","last_clean":"2024-09-12T00:50:11.104173+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:50:11.104173+0000","last_undegraded":"2024-09-12T00:50:11.104173+0000","last_fullsized":"2024-09-12T00:50:11.104173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:26.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'106","reported_seq":598,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.427213+0000","last_change":"2024-09-12T00:11:55.978414+0000","last_active":"2024-09-12T00:53:12.427213+0000","last_peered":"2024-09-12T00:53:12.427213+0000","last_clean":"2024-09-12T00:53:12.427213+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:53:12.427213+0000","last_undegraded":"2024-09-12T00:53:12.427213+0000","last_fullsized":"2024-09-12T00:53:12.427213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.992033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'786","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217623+0000","last_change":"2024-09-12T00:11:47.926128+0000","last_active":"2024-09-12T00:53:59.217623+0000","last_peered":"2024-09-12T00:53:59.217623+0000","last_clean":"2024-09-12T00:53:59.217623+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:53:59.217623+0000","last_undegraded":"2024-09-12T00:53:59.217623+0000","last_fullsized":"2024-09-12T00:53:59.217623+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:22.256949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104029+0000","last_change":"2024-09-12T00:11:27.569428+0000","last_active":"2024-09-12T00:51:36.104029+0000","last_peered":"2024-09-12T00:51:36.104029+0000","last_clean":"2024-09-12T00:51:36.104029+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:51:36.104029+0000","last_undegraded":"2024-09-12T00:51:36.104029+0000","last_fullsized":"2024-09-12T00:51:36.104029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_clean_scrub_stamp":"2024-09-12T00:11:26.525321+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.325099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940331+0000","last_change":"2024-09-12T00:11:34.617900+0000","last_active":"2024-09-12T00:51:10.940331+0000","last_peered":"2024-09-12T00:51:10.940331+0000","last_clean":"2024-09-12T00:51:10.940331+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:51:10.940331+0000","last_undegraded":"2024-09-12T00:51:10.940331+0000","last_fullsized":"2024-09-12T00:51:10.940331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'185","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.414785+0000","last_change":"2024-09-12T00:12:19.244194+0000","last_active":"2024-09-12T00:53:11.414785+0000","last_peered":"2024-09-12T00:53:11.414785+0000","last_clean":"2024-09-12T00:53:11.414785+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:53:11.414785+0000","last_undegraded":"2024-09-12T00:53:11.414785+0000","last_fullsized":"2024-09-12T00:53:11.414785+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:17.759014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7853940,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":394,"num_read_kb":15296,"num_write":919,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"37'4","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.927996+0000","last_change":"2024-09-12T00:11:49.928011+0000","last_active":"2024-09-12T00:54:30.927996+0000","last_peered":"2024-09-12T00:54:30.927996+0000","last_clean":"2024-09-12T00:54:30.927996+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:30.927996+0000","last_undegraded":"2024-09-12T00:54:30.927996+0000","last_fullsized":"2024-09-12T00:54:30.927996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:42.062220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'291","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.310659+0000","last_change":"2024-09-12T00:11:51.936332+0000","last_active":"2024-09-12T00:54:18.310659+0000","last_peered":"2024-09-12T00:54:18.310659+0000","last_clean":"2024-09-12T00:54:18.310659+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:54:18.310659+0000","last_undegraded":"2024-09-12T00:54:18.310659+0000","last_fullsized":"2024-09-12T00:54:18.310659+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:22.288477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46469,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":529,"num_read_kb":753,"num_write":440,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923847+0000","last_change":"2024-09-12T00:11:53.937970+0000","last_active":"2024-09-12T00:50:54.923847+0000","last_peered":"2024-09-12T00:50:54.923847+0000","last_clean":"2024-09-12T00:50:54.923847+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:50:54.923847+0000","last_undegraded":"2024-09-12T00:50:54.923847+0000","last_fullsized":"2024-09-12T00:50:54.923847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:32.585484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'188","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.171716+0000","last_change":"2024-09-12T00:11:55.972904+0000","last_active":"2024-09-12T00:53:13.171716+0000","last_peered":"2024-09-12T00:53:13.171716+0000","last_clean":"2024-09-12T00:53:13.171716+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:53:13.171716+0000","last_undegraded":"2024-09-12T00:53:13.171716+0000","last_fullsized":"2024-09-12T00:53:13.171716+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:08.248837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'454","reported_seq":1917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.540410+0000","last_change":"2024-09-12T00:11:47.933958+0000","last_active":"2024-09-12T00:52:57.540410+0000","last_peered":"2024-09-12T00:52:57.540410+0000","last_clean":"2024-09-12T00:52:57.540410+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:52:57.540410+0000","last_undegraded":"2024-09-12T00:52:57.540410+0000","last_fullsized":"2024-09-12T00:52:57.540410+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:36.317791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:45.949008+0000","last_change":"2024-09-12T00:11:34.617340+0000","last_active":"2024-09-12T00:51:45.949008+0000","last_peered":"2024-09-12T00:51:45.949008+0000","last_clean":"2024-09-12T00:51:45.949008+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:51:45.949008+0000","last_undegraded":"2024-09-12T00:51:45.949008+0000","last_fullsized":"2024-09-12T00:51:45.949008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:34.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'193","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.361471+0000","last_change":"2024-09-12T00:11:45.952012+0000","last_active":"2024-09-12T00:52:54.361471+0000","last_peered":"2024-09-12T00:52:54.361471+0000","last_clean":"2024-09-12T00:52:54.361471+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:52:54.361471+0000","last_undegraded":"2024-09-12T00:52:54.361471+0000","last_fullsized":"2024-09-12T00:52:54.361471+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:30.524961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5606791,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":6575,"num_write":978,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.935730+0000","last_change":"2024-09-12T00:11:49.935780+0000","last_active":"2024-09-12T00:50:50.935730+0000","last_peered":"2024-09-12T00:50:50.935730+0000","last_clean":"2024-09-12T00:50:50.935730+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:50:50.935730+0000","last_undegraded":"2024-09-12T00:50:50.935730+0000","last_fullsized":"2024-09-12T00:50:50.935730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.785961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'831","reported_seq":2271,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.358125+0000","last_change":"2024-09-12T00:11:51.943417+0000","last_active":"2024-09-12T00:54:18.358125+0000","last_peered":"2024-09-12T00:54:18.358125+0000","last_clean":"2024-09-12T00:54:18.358125+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:18.358125+0000","last_undegraded":"2024-09-12T00:54:18.358125+0000","last_fullsized":"2024-09-12T00:54:18.358125+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:34.607897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72884,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1145,"num_read_kb":1408,"num_write":274,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947961+0000","last_change":"2024-09-12T00:11:53.962102+0000","last_active":"2024-09-12T00:51:40.947961+0000","last_peered":"2024-09-12T00:51:40.947961+0000","last_clean":"2024-09-12T00:51:40.947961+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:51:40.947961+0000","last_undegraded":"2024-09-12T00:51:40.947961+0000","last_fullsized":"2024-09-12T00:51:40.947961+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:40.329220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'206","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:31.450664+0000","last_change":"2024-09-12T00:11:55.982765+0000","last_active":"2024-09-12T00:52:31.450664+0000","last_peered":"2024-09-12T00:52:31.450664+0000","last_clean":"2024-09-12T00:52:31.450664+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:52:31.450664+0000","last_undegraded":"2024-09-12T00:52:31.450664+0000","last_fullsized":"2024-09-12T00:52:31.450664+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.734557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'992","reported_seq":2842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.297386+0000","last_change":"2024-09-12T00:11:47.941493+0000","last_active":"2024-09-12T00:52:59.297386+0000","last_peered":"2024-09-12T00:52:59.297386+0000","last_clean":"2024-09-12T00:52:59.297386+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:52:59.297386+0000","last_undegraded":"2024-09-12T00:52:59.297386+0000","last_fullsized":"2024-09-12T00:52:59.297386+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:06.733191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.920827+0000","last_change":"2024-09-12T00:11:34.731346+0000","last_active":"2024-09-12T00:51:10.920827+0000","last_peered":"2024-09-12T00:51:10.920827+0000","last_clean":"2024-09-12T00:51:10.920827+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:51:10.920827+0000","last_undegraded":"2024-09-12T00:51:10.920827+0000","last_fullsized":"2024-09-12T00:51:10.920827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:18.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'188","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.758465+0000","last_change":"2024-09-12T00:11:45.963489+0000","last_active":"2024-09-12T00:52:54.758465+0000","last_peered":"2024-09-12T00:52:54.758465+0000","last_clean":"2024-09-12T00:52:54.758465+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:52:54.758465+0000","last_undegraded":"2024-09-12T00:52:54.758465+0000","last_fullsized":"2024-09-12T00:52:54.758465+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:01.526306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5664849,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":16624,"num_write":909,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916628+0000","last_change":"2024-09-12T00:11:49.939428+0000","last_active":"2024-09-12T00:50:50.916628+0000","last_peered":"2024-09-12T00:50:50.916628+0000","last_clean":"2024-09-12T00:50:50.916628+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:50:50.916628+0000","last_undegraded":"2024-09-12T00:50:50.916628+0000","last_fullsized":"2024-09-12T00:50:50.916628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:44.977495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'231","reported_seq":1283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.391143+0000","last_change":"2024-09-12T00:11:51.950048+0000","last_active":"2024-09-12T00:54:15.391143+0000","last_peered":"2024-09-12T00:54:15.391143+0000","last_clean":"2024-09-12T00:54:15.391143+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:15.391143+0000","last_undegraded":"2024-09-12T00:54:15.391143+0000","last_fullsized":"2024-09-12T00:54:15.391143+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:06.199752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926496+0000","last_change":"2024-09-12T00:11:53.968069+0000","last_active":"2024-09-12T00:51:30.926496+0000","last_peered":"2024-09-12T00:51:30.926496+0000","last_clean":"2024-09-12T00:51:30.926496+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:51:30.926496+0000","last_undegraded":"2024-09-12T00:51:30.926496+0000","last_fullsized":"2024-09-12T00:51:30.926496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:02.100203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'312","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.889255+0000","last_change":"2024-09-12T00:11:55.967123+0000","last_active":"2024-09-12T00:53:13.889255+0000","last_peered":"2024-09-12T00:53:13.889255+0000","last_clean":"2024-09-12T00:53:13.889255+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:53:13.889255+0000","last_undegraded":"2024-09-12T00:53:13.889255+0000","last_fullsized":"2024-09-12T00:53:13.889255+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:10.855671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'379","reported_seq":1784,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.948108+0000","last_change":"2024-09-12T00:11:47.943438+0000","last_active":"2024-09-12T00:53:30.948108+0000","last_peered":"2024-09-12T00:53:30.948108+0000","last_clean":"2024-09-12T00:53:30.948108+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:53:30.948108+0000","last_undegraded":"2024-09-12T00:53:30.948108+0000","last_fullsized":"2024-09-12T00:53:30.948108+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:03.957852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940272+0000","last_change":"2024-09-12T00:11:34.618967+0000","last_active":"2024-09-12T00:51:10.940272+0000","last_peered":"2024-09-12T00:51:10.940272+0000","last_clean":"2024-09-12T00:51:10.940272+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:51:10.940272+0000","last_undegraded":"2024-09-12T00:51:10.940272+0000","last_fullsized":"2024-09-12T00:51:10.940272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.762426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'273","reported_seq":946,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.632499+0000","last_change":"2024-09-12T00:11:45.925677+0000","last_active":"2024-09-12T00:52:56.632499+0000","last_peered":"2024-09-12T00:52:56.632499+0000","last_clean":"2024-09-12T00:52:56.632499+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:52:56.632499+0000","last_undegraded":"2024-09-12T00:52:56.632499+0000","last_fullsized":"2024-09-12T00:52:56.632499+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:13.876652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9636774,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":645,"num_read_kb":17781,"num_write":1202,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926404+0000","last_change":"2024-09-12T00:11:49.947103+0000","last_active":"2024-09-12T00:51:35.926404+0000","last_peered":"2024-09-12T00:51:35.926404+0000","last_clean":"2024-09-12T00:51:35.926404+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:51:35.926404+0000","last_undegraded":"2024-09-12T00:51:35.926404+0000","last_fullsized":"2024-09-12T00:51:35.926404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.613882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'109","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.954400+0000","last_change":"2024-09-12T00:11:51.944099+0000","last_active":"2024-09-12T00:53:04.954400+0000","last_peered":"2024-09-12T00:53:04.954400+0000","last_clean":"2024-09-12T00:53:04.954400+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:53:04.954400+0000","last_undegraded":"2024-09-12T00:53:04.954400+0000","last_fullsized":"2024-09-12T00:53:04.954400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:44.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.936964+0000","last_change":"2024-09-12T00:11:53.964265+0000","last_active":"2024-09-12T00:50:55.936964+0000","last_peered":"2024-09-12T00:50:55.936964+0000","last_clean":"2024-09-12T00:50:55.936964+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:50:55.936964+0000","last_undegraded":"2024-09-12T00:50:55.936964+0000","last_fullsized":"2024-09-12T00:50:55.936964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:02.137660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:06.122873+0000","last_change":"2024-09-12T00:11:55.974232+0000","last_active":"2024-09-12T00:53:06.122873+0000","last_peered":"2024-09-12T00:53:06.122873+0000","last_clean":"2024-09-12T00:53:06.122873+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:53:06.122873+0000","last_undegraded":"2024-09-12T00:53:06.122873+0000","last_fullsized":"2024-09-12T00:53:06.122873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:18.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'425","reported_seq":1926,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.195375+0000","last_change":"2024-09-12T00:11:47.950054+0000","last_active":"2024-09-12T00:54:17.195375+0000","last_peered":"2024-09-12T00:54:17.195375+0000","last_clean":"2024-09-12T00:54:17.195375+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:17.195375+0000","last_undegraded":"2024-09-12T00:54:17.195375+0000","last_fullsized":"2024-09-12T00:54:17.195375+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:18.896652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'187","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:09.887862+0000","last_change":"2024-09-12T00:11:45.938174+0000","last_active":"2024-09-12T00:54:09.887862+0000","last_peered":"2024-09-12T00:54:09.887862+0000","last_clean":"2024-09-12T00:54:09.887862+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:09.887862+0000","last_undegraded":"2024-09-12T00:54:09.887862+0000","last_fullsized":"2024-09-12T00:54:09.887862+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:20.890123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6591677,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":910,"num_read_kb":23524,"num_write":937,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927231+0000","last_change":"2024-09-12T00:11:34.874306+0000","last_active":"2024-09-12T00:51:09.927231+0000","last_peered":"2024-09-12T00:51:09.927231+0000","last_clean":"2024-09-12T00:51:09.927231+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:51:09.927231+0000","last_undegraded":"2024-09-12T00:51:09.927231+0000","last_fullsized":"2024-09-12T00:51:09.927231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:04.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.925302+0000","last_change":"2024-09-12T00:11:49.940655+0000","last_active":"2024-09-12T00:51:25.925302+0000","last_peered":"2024-09-12T00:51:25.925302+0000","last_clean":"2024-09-12T00:51:25.925302+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:51:25.925302+0000","last_undegraded":"2024-09-12T00:51:25.925302+0000","last_fullsized":"2024-09-12T00:51:25.925302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:51.772761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'266","reported_seq":932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.288941+0000","last_change":"2024-09-12T00:11:51.951322+0000","last_active":"2024-09-12T00:54:18.288941+0000","last_peered":"2024-09-12T00:54:18.288941+0000","last_clean":"2024-09-12T00:54:18.288941+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:18.288941+0000","last_undegraded":"2024-09-12T00:54:18.288941+0000","last_fullsized":"2024-09-12T00:54:18.288941+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:19.014495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30452,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":374,"num_read_kb":516,"num_write":210,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121823+0000","last_change":"2024-09-12T00:11:53.958248+0000","last_active":"2024-09-12T00:51:31.121823+0000","last_peered":"2024-09-12T00:51:31.121823+0000","last_clean":"2024-09-12T00:51:31.121823+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:51:31.121823+0000","last_undegraded":"2024-09-12T00:51:31.121823+0000","last_fullsized":"2024-09-12T00:51:31.121823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.005296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'149","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.692391+0000","last_change":"2024-09-12T00:11:55.982508+0000","last_active":"2024-09-12T00:52:54.692391+0000","last_peered":"2024-09-12T00:52:54.692391+0000","last_clean":"2024-09-12T00:52:54.692391+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:52:54.692391+0000","last_undegraded":"2024-09-12T00:52:54.692391+0000","last_fullsized":"2024-09-12T00:52:54.692391+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.265884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'457","reported_seq":2076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.193459+0000","last_change":"2024-09-12T00:11:47.941980+0000","last_active":"2024-09-12T00:54:17.193459+0000","last_peered":"2024-09-12T00:54:17.193459+0000","last_clean":"2024-09-12T00:54:17.193459+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:17.193459+0000","last_undegraded":"2024-09-12T00:54:17.193459+0000","last_fullsized":"2024-09-12T00:54:17.193459+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:12.954699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'215","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:13.600648+0000","last_change":"2024-09-12T00:11:45.957384+0000","last_active":"2024-09-12T00:52:13.600648+0000","last_peered":"2024-09-12T00:52:13.600648+0000","last_clean":"2024-09-12T00:52:13.600648+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:52:13.600648+0000","last_undegraded":"2024-09-12T00:52:13.600648+0000","last_fullsized":"2024-09-12T00:52:13.600648+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:27.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244951,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":425,"num_read_kb":4575,"num_write":1016,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:20.943222+0000","last_change":"2024-09-12T00:11:34.617205+0000","last_active":"2024-09-12T00:51:20.943222+0000","last_peered":"2024-09-12T00:51:20.943222+0000","last_clean":"2024-09-12T00:51:20.943222+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:51:20.943222+0000","last_undegraded":"2024-09-12T00:51:20.943222+0000","last_fullsized":"2024-09-12T00:51:20.943222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:51.436105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.926639+0000","last_change":"2024-09-12T00:11:49.929449+0000","last_active":"2024-09-12T00:51:25.926639+0000","last_peered":"2024-09-12T00:51:25.926639+0000","last_clean":"2024-09-12T00:51:25.926639+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:51:25.926639+0000","last_undegraded":"2024-09-12T00:51:25.926639+0000","last_fullsized":"2024-09-12T00:51:25.926639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:39.048491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'179","reported_seq":747,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:29.368057+0000","last_change":"2024-09-12T00:11:51.941186+0000","last_active":"2024-09-12T00:53:29.368057+0000","last_peered":"2024-09-12T00:53:29.368057+0000","last_clean":"2024-09-12T00:53:29.368057+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:53:29.368057+0000","last_undegraded":"2024-09-12T00:53:29.368057+0000","last_fullsized":"2024-09-12T00:53:29.368057+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:41.525044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'799","reported_seq":2666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.970455+0000","last_change":"2024-09-12T00:11:53.946719+0000","last_active":"2024-09-12T00:54:30.970455+0000","last_peered":"2024-09-12T00:54:30.970455+0000","last_clean":"2024-09-12T00:54:30.970455+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:30.970455+0000","last_undegraded":"2024-09-12T00:54:30.970455+0000","last_fullsized":"2024-09-12T00:54:30.970455+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":701,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:54.556954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'113","reported_seq":612,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.080514+0000","last_change":"2024-09-12T00:11:55.974820+0000","last_active":"2024-09-12T00:52:53.080514+0000","last_peered":"2024-09-12T00:52:53.080514+0000","last_clean":"2024-09-12T00:52:53.080514+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:52:53.080514+0000","last_undegraded":"2024-09-12T00:52:53.080514+0000","last_fullsized":"2024-09-12T00:52:53.080514+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:58.128560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'449","reported_seq":1854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.980363+0000","last_change":"2024-09-12T00:11:47.943089+0000","last_active":"2024-09-12T00:53:01.980363+0000","last_peered":"2024-09-12T00:53:01.980363+0000","last_clean":"2024-09-12T00:53:01.980363+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:53:01.980363+0000","last_undegraded":"2024-09-12T00:53:01.980363+0000","last_fullsized":"2024-09-12T00:53:01.980363+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:44.592044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'249","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:58.178304+0000","last_change":"2024-09-12T00:11:45.944133+0000","last_active":"2024-09-12T00:52:58.178304+0000","last_peered":"2024-09-12T00:52:58.178304+0000","last_clean":"2024-09-12T00:52:58.178304+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:52:58.178304+0000","last_undegraded":"2024-09-12T00:52:58.178304+0000","last_fullsized":"2024-09-12T00:52:58.178304+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.226214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2343909,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":627,"num_read_kb":14953,"num_write":1329,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.914062+0000","last_change":"2024-09-12T00:11:34.613977+0000","last_active":"2024-09-12T00:50:35.914062+0000","last_peered":"2024-09-12T00:50:35.914062+0000","last_clean":"2024-09-12T00:50:35.914062+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:50:35.914062+0000","last_undegraded":"2024-09-12T00:50:35.914062+0000","last_fullsized":"2024-09-12T00:50:35.914062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:31.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.944327+0000","last_change":"2024-09-12T00:11:49.929660+0000","last_active":"2024-09-12T00:51:25.944327+0000","last_peered":"2024-09-12T00:51:25.944327+0000","last_clean":"2024-09-12T00:51:25.944327+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:51:25.944327+0000","last_undegraded":"2024-09-12T00:51:25.944327+0000","last_fullsized":"2024-09-12T00:51:25.944327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:57.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'109","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:28.252812+0000","last_change":"2024-09-12T00:11:51.947657+0000","last_active":"2024-09-12T00:52:28.252812+0000","last_peered":"2024-09-12T00:52:28.252812+0000","last_clean":"2024-09-12T00:52:28.252812+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:52:28.252812+0000","last_undegraded":"2024-09-12T00:52:28.252812+0000","last_fullsized":"2024-09-12T00:52:28.252812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:12.346313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'786","reported_seq":2340,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.370733+0000","last_change":"2024-09-12T00:11:53.968955+0000","last_active":"2024-09-12T00:54:18.370733+0000","last_peered":"2024-09-12T00:54:18.370733+0000","last_clean":"2024-09-12T00:54:18.370733+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:54:18.370733+0000","last_undegraded":"2024-09-12T00:54:18.370733+0000","last_fullsized":"2024-09-12T00:54:18.370733+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":701,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:38.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'188","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:47.798689+0000","last_change":"2024-09-12T00:11:55.972707+0000","last_active":"2024-09-12T00:52:47.798689+0000","last_peered":"2024-09-12T00:52:47.798689+0000","last_clean":"2024-09-12T00:52:47.798689+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:52:47.798689+0000","last_undegraded":"2024-09-12T00:52:47.798689+0000","last_fullsized":"2024-09-12T00:52:47.798689+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.070375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'482","reported_seq":2168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199159+0000","last_change":"2024-09-12T00:11:47.920074+0000","last_active":"2024-09-12T00:54:17.199159+0000","last_peered":"2024-09-12T00:54:17.199159+0000","last_clean":"2024-09-12T00:54:17.199159+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:17.199159+0000","last_undegraded":"2024-09-12T00:54:17.199159+0000","last_fullsized":"2024-09-12T00:54:17.199159+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:15.555950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'214","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.190115+0000","last_change":"2024-09-12T00:11:45.934651+0000","last_active":"2024-09-12T00:53:11.190115+0000","last_peered":"2024-09-12T00:53:11.190115+0000","last_clean":"2024-09-12T00:53:11.190115+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:53:11.190115+0000","last_undegraded":"2024-09-12T00:53:11.190115+0000","last_fullsized":"2024-09-12T00:53:11.190115+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:00.165999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14703459,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":60723,"num_write":945,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.932047+0000","last_change":"2024-09-12T00:11:34.618193+0000","last_active":"2024-09-12T00:50:35.932047+0000","last_peered":"2024-09-12T00:50:35.932047+0000","last_clean":"2024-09-12T00:50:35.932047+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:50:35.932047+0000","last_undegraded":"2024-09-12T00:50:35.932047+0000","last_fullsized":"2024-09-12T00:50:35.932047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:18.144454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933247+0000","last_change":"2024-09-12T00:11:49.928566+0000","last_active":"2024-09-12T00:52:00.933247+0000","last_peered":"2024-09-12T00:52:00.933247+0000","last_clean":"2024-09-12T00:52:00.933247+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:52:00.933247+0000","last_undegraded":"2024-09-12T00:52:00.933247+0000","last_fullsized":"2024-09-12T00:52:00.933247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:38.587979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'331","reported_seq":1034,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.283692+0000","last_change":"2024-09-12T00:11:51.944165+0000","last_active":"2024-09-12T00:54:18.283692+0000","last_peered":"2024-09-12T00:54:18.283692+0000","last_clean":"2024-09-12T00:54:18.283692+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:18.283692+0000","last_undegraded":"2024-09-12T00:54:18.283692+0000","last_fullsized":"2024-09-12T00:54:18.283692+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:13.970557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":460,"num_read_kb":648,"num_write":246,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926396+0000","last_change":"2024-09-12T00:11:53.959232+0000","last_active":"2024-09-12T00:51:30.926396+0000","last_peered":"2024-09-12T00:51:30.926396+0000","last_clean":"2024-09-12T00:51:30.926396+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:51:30.926396+0000","last_undegraded":"2024-09-12T00:51:30.926396+0000","last_fullsized":"2024-09-12T00:51:30.926396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:48.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'91","reported_seq":581,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.028563+0000","last_change":"2024-09-12T00:11:55.977283+0000","last_active":"2024-09-12T00:52:49.028563+0000","last_peered":"2024-09-12T00:52:49.028563+0000","last_clean":"2024-09-12T00:52:49.028563+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:52:49.028563+0000","last_undegraded":"2024-09-12T00:52:49.028563+0000","last_fullsized":"2024-09-12T00:52:49.028563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:03.673797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'150","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.512255+0000","last_change":"2024-09-12T00:11:55.987098+0000","last_active":"2024-09-12T00:53:14.512255+0000","last_peered":"2024-09-12T00:53:14.512255+0000","last_clean":"2024-09-12T00:53:14.512255+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:53:14.512255+0000","last_undegraded":"2024-09-12T00:53:14.512255+0000","last_fullsized":"2024-09-12T00:53:14.512255+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:47.859646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'404","reported_seq":1793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:51.152300+0000","last_change":"2024-09-12T00:11:47.921763+0000","last_active":"2024-09-12T00:53:51.152300+0000","last_peered":"2024-09-12T00:53:51.152300+0000","last_clean":"2024-09-12T00:53:51.152300+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:53:51.152300+0000","last_undegraded":"2024-09-12T00:53:51.152300+0000","last_fullsized":"2024-09-12T00:53:51.152300+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'183","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.878375+0000","last_change":"2024-09-12T00:11:45.930485+0000","last_active":"2024-09-12T00:52:59.878375+0000","last_peered":"2024-09-12T00:52:59.878375+0000","last_clean":"2024-09-12T00:52:59.878375+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:52:59.878375+0000","last_undegraded":"2024-09-12T00:52:59.878375+0000","last_fullsized":"2024-09-12T00:52:59.878375+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.242243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":101459,"num_write":842,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.921522+0000","last_change":"2024-09-12T00:11:49.940350+0000","last_active":"2024-09-12T00:51:30.921522+0000","last_peered":"2024-09-12T00:51:30.921522+0000","last_clean":"2024-09-12T00:51:30.921522+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:51:30.921522+0000","last_undegraded":"2024-09-12T00:51:30.921522+0000","last_fullsized":"2024-09-12T00:51:30.921522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:25.951150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'139","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.953227+0000","last_change":"2024-09-12T00:11:51.929179+0000","last_active":"2024-09-12T00:53:55.953227+0000","last_peered":"2024-09-12T00:53:55.953227+0000","last_clean":"2024-09-12T00:53:55.953227+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:53:55.953227+0000","last_undegraded":"2024-09-12T00:53:55.953227+0000","last_fullsized":"2024-09-12T00:53:55.953227+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:47.615364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15370,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926201+0000","last_change":"2024-09-12T00:11:53.965867+0000","last_active":"2024-09-12T00:51:35.926201+0000","last_peered":"2024-09-12T00:51:35.926201+0000","last_clean":"2024-09-12T00:51:35.926201+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:51:35.926201+0000","last_undegraded":"2024-09-12T00:51:35.926201+0000","last_fullsized":"2024-09-12T00:51:35.926201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:46.503762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.778087+0000","last_change":"2024-09-12T00:11:55.975673+0000","last_active":"2024-09-12T00:53:13.778087+0000","last_peered":"2024-09-12T00:53:13.778087+0000","last_clean":"2024-09-12T00:53:13.778087+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:53:13.778087+0000","last_undegraded":"2024-09-12T00:53:13.778087+0000","last_fullsized":"2024-09-12T00:53:13.778087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:53.889300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'348","reported_seq":1863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.366932+0000","last_change":"2024-09-12T00:11:47.935945+0000","last_active":"2024-09-12T00:53:14.366932+0000","last_peered":"2024-09-12T00:53:14.366932+0000","last_clean":"2024-09-12T00:53:14.366932+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:53:14.366932+0000","last_undegraded":"2024-09-12T00:53:14.366932+0000","last_fullsized":"2024-09-12T00:53:14.366932+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'334","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.916821+0000","last_change":"2024-09-12T00:11:45.942994+0000","last_active":"2024-09-12T00:52:32.916821+0000","last_peered":"2024-09-12T00:52:32.916821+0000","last_clean":"2024-09-12T00:52:32.916821+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:52:32.916821+0000","last_undegraded":"2024-09-12T00:52:32.916821+0000","last_fullsized":"2024-09-12T00:52:32.916821+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:36.262305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2700018,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":791,"num_read_kb":9288,"num_write":1285,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926444+0000","last_change":"2024-09-12T00:11:49.942679+0000","last_active":"2024-09-12T00:51:30.926444+0000","last_peered":"2024-09-12T00:51:30.926444+0000","last_clean":"2024-09-12T00:51:30.926444+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:51:30.926444+0000","last_undegraded":"2024-09-12T00:51:30.926444+0000","last_fullsized":"2024-09-12T00:51:30.926444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:19.512522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'54","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.203822+0000","last_change":"2024-09-12T00:11:51.951112+0000","last_active":"2024-09-12T00:52:02.203822+0000","last_peered":"2024-09-12T00:52:02.203822+0000","last_clean":"2024-09-12T00:52:02.203822+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:52:02.203822+0000","last_undegraded":"2024-09-12T00:52:02.203822+0000","last_fullsized":"2024-09-12T00:52:02.203822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.473635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.122929+0000","last_change":"2024-09-12T00:11:53.965509+0000","last_active":"2024-09-12T00:51:36.122929+0000","last_peered":"2024-09-12T00:51:36.122929+0000","last_clean":"2024-09-12T00:51:36.122929+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:51:36.122929+0000","last_undegraded":"2024-09-12T00:51:36.122929+0000","last_fullsized":"2024-09-12T00:51:36.122929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:23.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'192","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.755700+0000","last_change":"2024-09-12T00:11:55.977952+0000","last_active":"2024-09-12T00:53:13.755700+0000","last_peered":"2024-09-12T00:53:13.755700+0000","last_clean":"2024-09-12T00:53:13.755700+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:53:13.755700+0000","last_undegraded":"2024-09-12T00:53:13.755700+0000","last_fullsized":"2024-09-12T00:53:13.755700+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'771","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.245517+0000","last_change":"2024-09-12T00:11:47.926772+0000","last_active":"2024-09-12T00:53:00.245517+0000","last_peered":"2024-09-12T00:53:00.245517+0000","last_clean":"2024-09-12T00:53:00.245517+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:53:00.245517+0000","last_undegraded":"2024-09-12T00:53:00.245517+0000","last_fullsized":"2024-09-12T00:53:00.245517+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'189","reported_seq":830,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.085599+0000","last_change":"2024-09-12T00:11:45.915920+0000","last_active":"2024-09-12T00:54:31.085599+0000","last_peered":"2024-09-12T00:54:31.085599+0000","last_clean":"2024-09-12T00:54:31.085599+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:31.085599+0000","last_undegraded":"2024-09-12T00:54:31.085599+0000","last_fullsized":"2024-09-12T00:54:31.085599+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:59.681239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267641,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":25665,"num_write":919,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121782+0000","last_change":"2024-09-12T00:11:49.923313+0000","last_active":"2024-09-12T00:51:31.121782+0000","last_peered":"2024-09-12T00:51:31.121782+0000","last_clean":"2024-09-12T00:51:31.121782+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:51:31.121782+0000","last_undegraded":"2024-09-12T00:51:31.121782+0000","last_fullsized":"2024-09-12T00:51:31.121782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'173","reported_seq":758,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.956572+0000","last_change":"2024-09-12T00:11:51.938094+0000","last_active":"2024-09-12T00:53:55.956572+0000","last_peered":"2024-09-12T00:53:55.956572+0000","last_clean":"2024-09-12T00:53:55.956572+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:53:55.956572+0000","last_undegraded":"2024-09-12T00:53:55.956572+0000","last_fullsized":"2024-09-12T00:53:55.956572+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":285,"num_write":130,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104093+0000","last_change":"2024-09-12T00:11:53.955154+0000","last_active":"2024-09-12T00:51:36.104093+0000","last_peered":"2024-09-12T00:51:36.104093+0000","last_clean":"2024-09-12T00:51:36.104093+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:51:36.104093+0000","last_undegraded":"2024-09-12T00:51:36.104093+0000","last_fullsized":"2024-09-12T00:51:36.104093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:55.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'104","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.550126+0000","last_change":"2024-09-12T00:11:55.959282+0000","last_active":"2024-09-12T00:52:29.550126+0000","last_peered":"2024-09-12T00:52:29.550126+0000","last_clean":"2024-09-12T00:52:29.550126+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:52:29.550126+0000","last_undegraded":"2024-09-12T00:52:29.550126+0000","last_fullsized":"2024-09-12T00:52:29.550126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:03.301311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'808","reported_seq":2294,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.551364+0000","last_change":"2024-09-12T00:11:47.933067+0000","last_active":"2024-09-12T00:52:56.551364+0000","last_peered":"2024-09-12T00:52:56.551364+0000","last_clean":"2024-09-12T00:52:56.551364+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:52:56.551364+0000","last_undegraded":"2024-09-12T00:52:56.551364+0000","last_fullsized":"2024-09-12T00:52:56.551364+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.114451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'186","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.255863+0000","last_change":"2024-09-12T00:11:45.958369+0000","last_active":"2024-09-12T00:53:11.255863+0000","last_peered":"2024-09-12T00:53:11.255863+0000","last_clean":"2024-09-12T00:53:11.255863+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:53:11.255863+0000","last_undegraded":"2024-09-12T00:53:11.255863+0000","last_fullsized":"2024-09-12T00:53:11.255863+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:06.439973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15390438,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":452,"num_read_kb":36400,"num_write":895,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.945612+0000","last_change":"2024-09-12T00:11:49.928504+0000","last_active":"2024-09-12T00:51:30.945612+0000","last_peered":"2024-09-12T00:51:30.945612+0000","last_clean":"2024-09-12T00:51:30.945612+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:51:30.945612+0000","last_undegraded":"2024-09-12T00:51:30.945612+0000","last_fullsized":"2024-09-12T00:51:30.945612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:00.545918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'127","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.956356+0000","last_change":"2024-09-12T00:11:51.951940+0000","last_active":"2024-09-12T00:53:55.956356+0000","last_peered":"2024-09-12T00:53:55.956356+0000","last_clean":"2024-09-12T00:53:55.956356+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:53:55.956356+0000","last_undegraded":"2024-09-12T00:53:55.956356+0000","last_fullsized":"2024-09-12T00:53:55.956356+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.384189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926323+0000","last_change":"2024-09-12T00:11:53.970031+0000","last_active":"2024-09-12T00:51:35.926323+0000","last_peered":"2024-09-12T00:51:35.926323+0000","last_clean":"2024-09-12T00:51:35.926323+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:51:35.926323+0000","last_undegraded":"2024-09-12T00:51:35.926323+0000","last_fullsized":"2024-09-12T00:51:35.926323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.869156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'722","reported_seq":2103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.974112+0000","last_change":"2024-09-12T00:11:47.944209+0000","last_active":"2024-09-12T00:53:30.974112+0000","last_peered":"2024-09-12T00:53:30.974112+0000","last_clean":"2024-09-12T00:53:30.974112+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:53:30.974112+0000","last_undegraded":"2024-09-12T00:53:30.974112+0000","last_fullsized":"2024-09-12T00:53:30.974112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:07.479060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'183","reported_seq":801,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.111330+0000","last_change":"2024-09-12T00:11:45.967978+0000","last_active":"2024-09-12T00:53:01.111330+0000","last_peered":"2024-09-12T00:53:01.111330+0000","last_clean":"2024-09-12T00:53:01.111330+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:53:01.111330+0000","last_undegraded":"2024-09-12T00:53:01.111330+0000","last_fullsized":"2024-09-12T00:53:01.111330+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:25.205405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7264373,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":379,"num_read_kb":8086,"num_write":857,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928734+0000","last_change":"2024-09-12T00:11:49.940476+0000","last_active":"2024-09-12T00:52:00.928734+0000","last_peered":"2024-09-12T00:52:00.928734+0000","last_clean":"2024-09-12T00:52:00.928734+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:52:00.928734+0000","last_undegraded":"2024-09-12T00:52:00.928734+0000","last_fullsized":"2024-09-12T00:52:00.928734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.808496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'190","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.328604+0000","last_change":"2024-09-12T00:11:51.955207+0000","last_active":"2024-09-12T00:54:18.328604+0000","last_peered":"2024-09-12T00:54:18.328604+0000","last_clean":"2024-09-12T00:54:18.328604+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:54:18.328604+0000","last_undegraded":"2024-09-12T00:54:18.328604+0000","last_fullsized":"2024-09-12T00:54:18.328604+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:43.145562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23262,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":290,"num_read_kb":373,"num_write":186,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.127739+0000","last_change":"2024-09-12T00:11:53.970075+0000","last_active":"2024-09-12T00:51:56.127739+0000","last_peered":"2024-09-12T00:51:56.127739+0000","last_clean":"2024-09-12T00:51:56.127739+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:51:56.127739+0000","last_undegraded":"2024-09-12T00:51:56.127739+0000","last_fullsized":"2024-09-12T00:51:56.127739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.073296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'153","reported_seq":652,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967355+0000","last_change":"2024-09-12T00:11:55.983643+0000","last_active":"2024-09-12T00:53:59.967355+0000","last_peered":"2024-09-12T00:53:59.967355+0000","last_clean":"2024-09-12T00:53:59.967355+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:53:59.967355+0000","last_undegraded":"2024-09-12T00:53:59.967355+0000","last_fullsized":"2024-09-12T00:53:59.967355+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:01.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'499","reported_seq":2219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.214803+0000","last_change":"2024-09-12T00:11:47.931274+0000","last_active":"2024-09-12T00:53:59.214803+0000","last_peered":"2024-09-12T00:53:59.214803+0000","last_clean":"2024-09-12T00:53:59.214803+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:53:59.214803+0000","last_undegraded":"2024-09-12T00:53:59.214803+0000","last_fullsized":"2024-09-12T00:53:59.214803+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:56.542635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'199","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.406760+0000","last_change":"2024-09-12T00:11:45.930986+0000","last_active":"2024-09-12T00:52:33.406760+0000","last_peered":"2024-09-12T00:52:33.406760+0000","last_clean":"2024-09-12T00:52:33.406760+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:52:33.406760+0000","last_undegraded":"2024-09-12T00:52:33.406760+0000","last_fullsized":"2024-09-12T00:52:33.406760+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:07.918577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5315388,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":23120,"num_write":963,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:26.120894+0000","last_change":"2024-09-12T00:11:49.940474+0000","last_active":"2024-09-12T00:51:26.120894+0000","last_peered":"2024-09-12T00:51:26.120894+0000","last_clean":"2024-09-12T00:51:26.120894+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:51:26.120894+0000","last_undegraded":"2024-09-12T00:51:26.120894+0000","last_fullsized":"2024-09-12T00:51:26.120894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:37.832060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'161","reported_seq":738,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.281148+0000","last_change":"2024-09-12T00:11:51.943970+0000","last_active":"2024-09-12T00:54:18.281148+0000","last_peered":"2024-09-12T00:54:18.281148+0000","last_clean":"2024-09-12T00:54:18.281148+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:54:18.281148+0000","last_undegraded":"2024-09-12T00:54:18.281148+0000","last_fullsized":"2024-09-12T00:54:18.281148+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:17.685375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10349,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":272,"num_write":142,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:54.937822+0000","last_change":"2024-09-12T00:11:53.969086+0000","last_active":"2024-09-12T00:51:54.937822+0000","last_peered":"2024-09-12T00:51:54.937822+0000","last_clean":"2024-09-12T00:51:54.937822+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:51:54.937822+0000","last_undegraded":"2024-09-12T00:51:54.937822+0000","last_fullsized":"2024-09-12T00:51:54.937822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.001970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.122045+0000","last_change":"2024-09-12T00:11:55.970975+0000","last_active":"2024-09-12T00:54:17.122045+0000","last_peered":"2024-09-12T00:54:17.122045+0000","last_clean":"2024-09-12T00:54:17.122045+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:54:17.122045+0000","last_undegraded":"2024-09-12T00:54:17.122045+0000","last_fullsized":"2024-09-12T00:54:17.122045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:19.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'810","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749355+0000","last_change":"2024-09-12T00:11:47.946771+0000","last_active":"2024-09-12T00:53:13.749355+0000","last_peered":"2024-09-12T00:53:13.749355+0000","last_clean":"2024-09-12T00:53:13.749355+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:53:13.749355+0000","last_undegraded":"2024-09-12T00:53:13.749355+0000","last_fullsized":"2024-09-12T00:53:13.749355+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:20.616253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'208","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.134591+0000","last_change":"2024-09-12T00:11:45.950887+0000","last_active":"2024-09-12T00:54:16.134591+0000","last_peered":"2024-09-12T00:54:16.134591+0000","last_clean":"2024-09-12T00:54:16.134591+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:16.134591+0000","last_undegraded":"2024-09-12T00:54:16.134591+0000","last_fullsized":"2024-09-12T00:54:16.134591+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.570694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388623,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":378,"num_read_kb":5549,"num_write":1013,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126599+0000","last_change":"2024-09-12T00:11:49.932242+0000","last_active":"2024-09-12T00:51:51.126599+0000","last_peered":"2024-09-12T00:51:51.126599+0000","last_clean":"2024-09-12T00:51:51.126599+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:51:51.126599+0000","last_undegraded":"2024-09-12T00:51:51.126599+0000","last_fullsized":"2024-09-12T00:51:51.126599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:01.572248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'146","reported_seq":723,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:35.949198+0000","last_change":"2024-09-12T00:11:51.947579+0000","last_active":"2024-09-12T00:53:35.949198+0000","last_peered":"2024-09-12T00:53:35.949198+0000","last_clean":"2024-09-12T00:53:35.949198+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:53:35.949198+0000","last_undegraded":"2024-09-12T00:53:35.949198+0000","last_fullsized":"2024-09-12T00:53:35.949198+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:01.742280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13472,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":193,"num_write":100,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932799+0000","last_change":"2024-09-12T00:11:53.966010+0000","last_active":"2024-09-12T00:52:05.932799+0000","last_peered":"2024-09-12T00:52:05.932799+0000","last_clean":"2024-09-12T00:52:05.932799+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:52:05.932799+0000","last_undegraded":"2024-09-12T00:52:05.932799+0000","last_fullsized":"2024-09-12T00:52:05.932799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.714255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'153","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.341421+0000","last_change":"2024-09-12T00:11:55.984385+0000","last_active":"2024-09-12T00:54:18.341421+0000","last_peered":"2024-09-12T00:54:18.341421+0000","last_clean":"2024-09-12T00:54:18.341421+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:54:18.341421+0000","last_undegraded":"2024-09-12T00:54:18.341421+0000","last_fullsized":"2024-09-12T00:54:18.341421+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:18.613083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'789","reported_seq":2425,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981146+0000","last_change":"2024-09-12T00:11:47.953467+0000","last_active":"2024-09-12T00:53:01.981146+0000","last_peered":"2024-09-12T00:53:01.981146+0000","last_clean":"2024-09-12T00:53:01.981146+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:53:01.981146+0000","last_undegraded":"2024-09-12T00:53:01.981146+0000","last_fullsized":"2024-09-12T00:53:01.981146+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.239103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'206","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.045447+0000","last_change":"2024-09-12T00:11:45.933222+0000","last_active":"2024-09-12T00:52:24.045447+0000","last_peered":"2024-09-12T00:52:24.045447+0000","last_clean":"2024-09-12T00:52:24.045447+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:52:24.045447+0000","last_undegraded":"2024-09-12T00:52:24.045447+0000","last_fullsized":"2024-09-12T00:52:24.045447+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:11.850109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6604377,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":521,"num_read_kb":30758,"num_write":1016,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931153+0000","last_change":"2024-09-12T00:11:49.944879+0000","last_active":"2024-09-12T00:51:50.931153+0000","last_peered":"2024-09-12T00:51:50.931153+0000","last_clean":"2024-09-12T00:51:50.931153+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:51:50.931153+0000","last_undegraded":"2024-09-12T00:51:50.931153+0000","last_fullsized":"2024-09-12T00:51:50.931153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.523417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'95","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954504+0000","last_change":"2024-09-12T00:11:51.938728+0000","last_active":"2024-09-12T00:52:05.954504+0000","last_peered":"2024-09-12T00:52:05.954504+0000","last_clean":"2024-09-12T00:52:05.954504+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:52:05.954504+0000","last_undegraded":"2024-09-12T00:52:05.954504+0000","last_fullsized":"2024-09-12T00:52:05.954504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:11.275648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'752","reported_seq":2385,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.362874+0000","last_change":"2024-09-12T00:11:53.945013+0000","last_active":"2024-09-12T00:54:18.362874+0000","last_peered":"2024-09-12T00:54:18.362874+0000","last_clean":"2024-09-12T00:54:18.362874+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:18.362874+0000","last_undegraded":"2024-09-12T00:54:18.362874+0000","last_fullsized":"2024-09-12T00:54:18.362874+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:55.474571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.361616+0000","last_change":"2024-09-12T00:11:55.961931+0000","last_active":"2024-09-12T00:53:14.361616+0000","last_peered":"2024-09-12T00:53:14.361616+0000","last_clean":"2024-09-12T00:53:14.361616+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:53:14.361616+0000","last_undegraded":"2024-09-12T00:53:14.361616+0000","last_fullsized":"2024-09-12T00:53:14.361616+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.615113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'464","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.299711+0000","last_change":"2024-09-12T00:11:47.941918+0000","last_active":"2024-09-12T00:52:59.299711+0000","last_peered":"2024-09-12T00:52:59.299711+0000","last_clean":"2024-09-12T00:52:59.299711+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:52:59.299711+0000","last_undegraded":"2024-09-12T00:52:59.299711+0000","last_fullsized":"2024-09-12T00:52:59.299711+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:21.380303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'212","reported_seq":856,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.134651+0000","last_change":"2024-09-12T00:11:45.950800+0000","last_active":"2024-09-12T00:54:16.134651+0000","last_peered":"2024-09-12T00:54:16.134651+0000","last_clean":"2024-09-12T00:54:16.134651+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:16.134651+0000","last_undegraded":"2024-09-12T00:54:16.134651+0000","last_fullsized":"2024-09-12T00:54:16.134651+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:25.266687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9206037,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":458,"num_read_kb":55718,"num_write":994,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.107449+0000","last_change":"2024-09-12T00:11:49.920143+0000","last_active":"2024-09-12T00:51:51.107449+0000","last_peered":"2024-09-12T00:51:51.107449+0000","last_clean":"2024-09-12T00:51:51.107449+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:51:51.107449+0000","last_undegraded":"2024-09-12T00:51:51.107449+0000","last_fullsized":"2024-09-12T00:51:51.107449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:13.928120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'185","reported_seq":781,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.948913+0000","last_change":"2024-09-12T00:11:51.942692+0000","last_active":"2024-09-12T00:53:10.948913+0000","last_peered":"2024-09-12T00:53:10.948913+0000","last_clean":"2024-09-12T00:53:10.948913+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:53:10.948913+0000","last_undegraded":"2024-09-12T00:53:10.948913+0000","last_fullsized":"2024-09-12T00:53:10.948913+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.066244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":236,"num_read_kb":288,"num_write":136,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.913907+0000","last_change":"2024-09-12T00:11:53.968374+0000","last_active":"2024-09-12T00:50:35.913907+0000","last_peered":"2024-09-12T00:50:35.913907+0000","last_clean":"2024-09-12T00:50:35.913907+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:50:35.913907+0000","last_undegraded":"2024-09-12T00:50:35.913907+0000","last_fullsized":"2024-09-12T00:50:35.913907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:08.048773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'124","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.975045+0000","last_change":"2024-09-12T00:11:55.975761+0000","last_active":"2024-09-12T00:53:01.975045+0000","last_peered":"2024-09-12T00:53:01.975045+0000","last_clean":"2024-09-12T00:53:01.975045+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:53:01.975045+0000","last_undegraded":"2024-09-12T00:53:01.975045+0000","last_fullsized":"2024-09-12T00:53:01.975045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:21.563576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'923","reported_seq":2627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217609+0000","last_change":"2024-09-12T00:11:47.940921+0000","last_active":"2024-09-12T00:53:59.217609+0000","last_peered":"2024-09-12T00:53:59.217609+0000","last_clean":"2024-09-12T00:53:59.217609+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:53:59.217609+0000","last_undegraded":"2024-09-12T00:53:59.217609+0000","last_fullsized":"2024-09-12T00:53:59.217609+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:58.054782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'216","reported_seq":833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.684144+0000","last_change":"2024-09-12T00:11:45.930250+0000","last_active":"2024-09-12T00:52:33.684144+0000","last_peered":"2024-09-12T00:52:33.684144+0000","last_clean":"2024-09-12T00:52:33.684144+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:52:33.684144+0000","last_undegraded":"2024-09-12T00:52:33.684144+0000","last_fullsized":"2024-09-12T00:52:33.684144+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:11.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277951,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":8883,"num_write":985,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126541+0000","last_change":"2024-09-12T00:11:49.932760+0000","last_active":"2024-09-12T00:51:51.126541+0000","last_peered":"2024-09-12T00:51:51.126541+0000","last_clean":"2024-09-12T00:51:51.126541+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:51:51.126541+0000","last_undegraded":"2024-09-12T00:51:51.126541+0000","last_fullsized":"2024-09-12T00:51:51.126541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:03.502198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'128","reported_seq":698,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.945884+0000","last_change":"2024-09-12T00:11:51.948398+0000","last_active":"2024-09-12T00:53:00.945884+0000","last_peered":"2024-09-12T00:53:00.945884+0000","last_clean":"2024-09-12T00:53:00.945884+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:53:00.945884+0000","last_undegraded":"2024-09-12T00:53:00.945884+0000","last_fullsized":"2024-09-12T00:53:00.945884+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:24.018531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15063,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":231,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934303+0000","last_change":"2024-09-12T00:11:53.964372+0000","last_active":"2024-09-12T00:50:45.934303+0000","last_peered":"2024-09-12T00:50:45.934303+0000","last_clean":"2024-09-12T00:50:45.934303+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:50:45.934303+0000","last_undegraded":"2024-09-12T00:50:45.934303+0000","last_fullsized":"2024-09-12T00:50:45.934303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:46.181767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'122","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.250013+0000","last_change":"2024-09-12T00:11:55.983399+0000","last_active":"2024-09-12T00:53:00.250013+0000","last_peered":"2024-09-12T00:53:00.250013+0000","last_clean":"2024-09-12T00:53:00.250013+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:53:00.250013+0000","last_undegraded":"2024-09-12T00:53:00.250013+0000","last_fullsized":"2024-09-12T00:53:00.250013+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.340677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'510","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981820+0000","last_change":"2024-09-12T00:11:47.945866+0000","last_active":"2024-09-12T00:53:01.981820+0000","last_peered":"2024-09-12T00:53:01.981820+0000","last_clean":"2024-09-12T00:53:01.981820+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:53:01.981820+0000","last_undegraded":"2024-09-12T00:53:01.981820+0000","last_fullsized":"2024-09-12T00:53:01.981820+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:11.670029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'211","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.939064+0000","last_change":"2024-09-12T00:11:45.965907+0000","last_active":"2024-09-12T00:51:59.939064+0000","last_peered":"2024-09-12T00:51:59.939064+0000","last_clean":"2024-09-12T00:51:59.939064+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:51:59.939064+0000","last_undegraded":"2024-09-12T00:51:59.939064+0000","last_fullsized":"2024-09-12T00:51:59.939064+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:25.908411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637093,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":6403,"num_write":965,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:31.087675+0000","last_change":"2024-09-12T00:11:49.916956+0000","last_active":"2024-09-12T00:50:31.087675+0000","last_peered":"2024-09-12T00:50:31.087675+0000","last_clean":"2024-09-12T00:50:31.087675+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:50:31.087675+0000","last_undegraded":"2024-09-12T00:50:31.087675+0000","last_fullsized":"2024-09-12T00:50:31.087675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.223448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'98","reported_seq":657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.317551+0000","last_change":"2024-09-12T00:11:51.934188+0000","last_active":"2024-09-12T00:54:18.317551+0000","last_peered":"2024-09-12T00:54:18.317551+0000","last_clean":"2024-09-12T00:54:18.317551+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:18.317551+0000","last_undegraded":"2024-09-12T00:54:18.317551+0000","last_fullsized":"2024-09-12T00:54:18.317551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.730149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":180,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.951806+0000","last_change":"2024-09-12T00:11:53.953440+0000","last_active":"2024-09-12T00:51:55.951806+0000","last_peered":"2024-09-12T00:51:55.951806+0000","last_clean":"2024-09-12T00:51:55.951806+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:51:55.951806+0000","last_undegraded":"2024-09-12T00:51:55.951806+0000","last_fullsized":"2024-09-12T00:51:55.951806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:27.100590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'166","reported_seq":1291,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.040679+0000","last_change":"2024-09-12T00:11:55.977584+0000","last_active":"2024-09-12T00:53:12.040679+0000","last_peered":"2024-09-12T00:53:12.040679+0000","last_clean":"2024-09-12T00:53:12.040679+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:53:12.040679+0000","last_undegraded":"2024-09-12T00:53:12.040679+0000","last_fullsized":"2024-09-12T00:53:12.040679+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:56.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'389","reported_seq":1782,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.983959+0000","last_change":"2024-09-12T00:11:47.935949+0000","last_active":"2024-09-12T00:53:01.983959+0000","last_peered":"2024-09-12T00:53:01.983959+0000","last_clean":"2024-09-12T00:53:01.983959+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:53:01.983959+0000","last_undegraded":"2024-09-12T00:53:01.983959+0000","last_fullsized":"2024-09-12T00:53:01.983959+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:17.556138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'222","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:42.017931+0000","last_change":"2024-09-12T00:11:45.966312+0000","last_active":"2024-09-12T00:51:42.017931+0000","last_peered":"2024-09-12T00:51:42.017931+0000","last_clean":"2024-09-12T00:51:42.017931+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:51:42.017931+0000","last_undegraded":"2024-09-12T00:51:42.017931+0000","last_fullsized":"2024-09-12T00:51:42.017931+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:38.020981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483681,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":20983,"num_write":1043,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.915124+0000","last_change":"2024-09-12T00:11:49.935062+0000","last_active":"2024-09-12T00:50:40.915124+0000","last_peered":"2024-09-12T00:50:40.915124+0000","last_clean":"2024-09-12T00:50:40.915124+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:50:40.915124+0000","last_undegraded":"2024-09-12T00:50:40.915124+0000","last_fullsized":"2024-09-12T00:50:40.915124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:45.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'173","reported_seq":763,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.328228+0000","last_change":"2024-09-12T00:11:51.953534+0000","last_active":"2024-09-12T00:54:18.328228+0000","last_peered":"2024-09-12T00:54:18.328228+0000","last_clean":"2024-09-12T00:54:18.328228+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:54:18.328228+0000","last_undegraded":"2024-09-12T00:54:18.328228+0000","last_fullsized":"2024-09-12T00:54:18.328228+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:08.139733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17971,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":295,"num_write":132,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.932205+0000","last_change":"2024-09-12T00:11:53.964796+0000","last_active":"2024-09-12T00:51:55.932205+0000","last_peered":"2024-09-12T00:51:55.932205+0000","last_clean":"2024-09-12T00:51:55.932205+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:51:55.932205+0000","last_undegraded":"2024-09-12T00:51:55.932205+0000","last_fullsized":"2024-09-12T00:51:55.932205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:35.493703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'120","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.194988+0000","last_change":"2024-09-12T00:11:55.976617+0000","last_active":"2024-09-12T00:54:17.194988+0000","last_peered":"2024-09-12T00:54:17.194988+0000","last_clean":"2024-09-12T00:54:17.194988+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:54:17.194988+0000","last_undegraded":"2024-09-12T00:54:17.194988+0000","last_fullsized":"2024-09-12T00:54:17.194988+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:04.168911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'498","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.933790+0000","last_change":"2024-09-12T00:11:47.934353+0000","last_active":"2024-09-12T00:53:00.933790+0000","last_peered":"2024-09-12T00:53:00.933790+0000","last_clean":"2024-09-12T00:53:00.933790+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:53:00.933790+0000","last_undegraded":"2024-09-12T00:53:00.933790+0000","last_fullsized":"2024-09-12T00:53:00.933790+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:35.038205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'188","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.250021+0000","last_change":"2024-09-12T00:11:45.927795+0000","last_active":"2024-09-12T00:52:56.250021+0000","last_peered":"2024-09-12T00:52:56.250021+0000","last_clean":"2024-09-12T00:52:56.250021+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:52:56.250021+0000","last_undegraded":"2024-09-12T00:52:56.250021+0000","last_fullsized":"2024-09-12T00:52:56.250021+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:34.884235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557112,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":480,"num_read_kb":61937,"num_write":915,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'816","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.944422+0000","last_change":"2024-09-12T00:11:47.956154+0000","last_active":"2024-09-12T00:53:00.944422+0000","last_peered":"2024-09-12T00:53:00.944422+0000","last_clean":"2024-09-12T00:53:00.944422+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:53:00.944422+0000","last_undegraded":"2024-09-12T00:53:00.944422+0000","last_fullsized":"2024-09-12T00:53:00.944422+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:03.574450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'183","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.791802+0000","last_change":"2024-09-12T00:11:45.938208+0000","last_active":"2024-09-12T00:52:32.791802+0000","last_peered":"2024-09-12T00:52:32.791802+0000","last_clean":"2024-09-12T00:52:32.791802+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:52:32.791802+0000","last_undegraded":"2024-09-12T00:52:32.791802+0000","last_fullsized":"2024-09-12T00:52:32.791802+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.569205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6645389,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":18747,"num_write":855,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1200","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.294002+0000","last_change":"2024-09-12T00:11:47.923352+0000","last_active":"2024-09-12T00:53:59.294002+0000","last_peered":"2024-09-12T00:53:59.294002+0000","last_clean":"2024-09-12T00:53:59.294002+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:53:59.294002+0000","last_undegraded":"2024-09-12T00:53:59.294002+0000","last_fullsized":"2024-09-12T00:53:59.294002+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'206","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.402474+0000","last_change":"2024-09-12T00:11:45.955798+0000","last_active":"2024-09-12T00:53:11.402474+0000","last_peered":"2024-09-12T00:53:11.402474+0000","last_clean":"2024-09-12T00:53:11.402474+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:53:11.402474+0000","last_undegraded":"2024-09-12T00:53:11.402474+0000","last_fullsized":"2024-09-12T00:53:11.402474+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:10.064782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14466751,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":35398,"num_write":966,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'471","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.953028+0000","last_change":"2024-09-12T00:11:47.925461+0000","last_active":"2024-09-12T00:52:59.953028+0000","last_peered":"2024-09-12T00:52:59.953028+0000","last_clean":"2024-09-12T00:52:59.953028+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:52:59.953028+0000","last_undegraded":"2024-09-12T00:52:59.953028+0000","last_fullsized":"2024-09-12T00:52:59.953028+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:27.139459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'197","reported_seq":825,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:39.211022+0000","last_change":"2024-09-12T00:11:45.963753+0000","last_active":"2024-09-12T00:52:39.211022+0000","last_peered":"2024-09-12T00:52:39.211022+0000","last_clean":"2024-09-12T00:52:39.211022+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:52:39.211022+0000","last_undegraded":"2024-09-12T00:52:39.211022+0000","last_fullsized":"2024-09-12T00:52:39.211022+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.076031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":421,"num_read_kb":18770,"num_write":977,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'803","reported_seq":2332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:39.962743+0000","last_change":"2024-09-12T00:11:47.933827+0000","last_active":"2024-09-12T00:53:39.962743+0000","last_peered":"2024-09-12T00:53:39.962743+0000","last_clean":"2024-09-12T00:53:39.962743+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:53:39.962743+0000","last_undegraded":"2024-09-12T00:53:39.962743+0000","last_fullsized":"2024-09-12T00:53:39.962743+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:55.730348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'242","reported_seq":913,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:38.480550+0000","last_change":"2024-09-12T00:11:45.938920+0000","last_active":"2024-09-12T00:51:38.480550+0000","last_peered":"2024-09-12T00:51:38.480550+0000","last_clean":"2024-09-12T00:51:38.480550+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:51:38.480550+0000","last_undegraded":"2024-09-12T00:51:38.480550+0000","last_fullsized":"2024-09-12T00:51:38.480550+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:19.946280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6987873,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":608,"num_read_kb":28384,"num_write":1050,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'476","reported_seq":1937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369796+0000","last_change":"2024-09-12T00:11:47.930919+0000","last_active":"2024-09-12T00:53:14.369796+0000","last_peered":"2024-09-12T00:53:14.369796+0000","last_clean":"2024-09-12T00:53:14.369796+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:53:14.369796+0000","last_undegraded":"2024-09-12T00:53:14.369796+0000","last_fullsized":"2024-09-12T00:53:14.369796+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:25.247323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'286","reported_seq":1098,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:40.933503+0000","last_change":"2024-09-12T00:11:45.938219+0000","last_active":"2024-09-12T00:52:40.933503+0000","last_peered":"2024-09-12T00:52:40.933503+0000","last_clean":"2024-09-12T00:52:40.933503+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:52:40.933503+0000","last_undegraded":"2024-09-12T00:52:40.933503+0000","last_fullsized":"2024-09-12T00:52:40.933503+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.279970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277127,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1391,"num_read_kb":1619,"num_write":1270,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'611","reported_seq":2341,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.506794+0000","last_change":"2024-09-12T00:11:47.950515+0000","last_active":"2024-09-12T00:53:10.506794+0000","last_peered":"2024-09-12T00:53:10.506794+0000","last_clean":"2024-09-12T00:53:10.506794+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:53:10.506794+0000","last_undegraded":"2024-09-12T00:53:10.506794+0000","last_fullsized":"2024-09-12T00:53:10.506794+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:14.307717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'226","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.109362+0000","last_change":"2024-09-12T00:11:45.921722+0000","last_active":"2024-09-12T00:54:31.109362+0000","last_peered":"2024-09-12T00:54:31.109362+0000","last_clean":"2024-09-12T00:54:31.109362+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:31.109362+0000","last_undegraded":"2024-09-12T00:54:31.109362+0000","last_fullsized":"2024-09-12T00:54:31.109362+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9289927,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":17177,"num_write":1051,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1255","reported_seq":3015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.372859+0000","last_change":"2024-09-12T00:11:47.924558+0000","last_active":"2024-09-12T00:53:14.372859+0000","last_peered":"2024-09-12T00:53:14.372859+0000","last_clean":"2024-09-12T00:53:14.372859+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:53:14.372859+0000","last_undegraded":"2024-09-12T00:53:14.372859+0000","last_fullsized":"2024-09-12T00:53:14.372859+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:39.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'271","reported_seq":916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:36.782753+0000","last_change":"2024-09-12T00:11:45.965487+0000","last_active":"2024-09-12T00:52:36.782753+0000","last_peered":"2024-09-12T00:52:36.782753+0000","last_clean":"2024-09-12T00:52:36.782753+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:52:36.782753+0000","last_undegraded":"2024-09-12T00:52:36.782753+0000","last_fullsized":"2024-09-12T00:52:36.782753+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:11.343524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5071032,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":15585,"num_write":1261,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'826","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.503633+0000","last_change":"2024-09-12T00:11:47.951105+0000","last_active":"2024-09-12T00:53:10.503633+0000","last_peered":"2024-09-12T00:53:10.503633+0000","last_clean":"2024-09-12T00:53:10.503633+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:53:10.503633+0000","last_undegraded":"2024-09-12T00:53:10.503633+0000","last_fullsized":"2024-09-12T00:53:10.503633+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:49.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'249","reported_seq":890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:52.659064+0000","last_change":"2024-09-12T00:11:45.963287+0000","last_active":"2024-09-12T00:52:52.659064+0000","last_peered":"2024-09-12T00:52:52.659064+0000","last_clean":"2024-09-12T00:52:52.659064+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:52:52.659064+0000","last_undegraded":"2024-09-12T00:52:52.659064+0000","last_fullsized":"2024-09-12T00:52:52.659064+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.996463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14313078,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":58641,"num_write":1116,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1327","reported_seq":2850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:50.955784+0000","last_change":"2024-09-12T00:11:47.934364+0000","last_active":"2024-09-12T00:53:50.955784+0000","last_peered":"2024-09-12T00:53:50.955784+0000","last_clean":"2024-09-12T00:53:50.955784+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:53:50.955784+0000","last_undegraded":"2024-09-12T00:53:50.955784+0000","last_fullsized":"2024-09-12T00:53:50.955784+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'191","reported_seq":810,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:42.943924+0000","last_change":"2024-09-12T00:11:45.963871+0000","last_active":"2024-09-12T00:52:42.943924+0000","last_peered":"2024-09-12T00:52:42.943924+0000","last_clean":"2024-09-12T00:52:42.943924+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:52:42.943924+0000","last_undegraded":"2024-09-12T00:52:42.943924+0000","last_fullsized":"2024-09-12T00:52:42.943924+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.697592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9732406,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":445,"num_read_kb":34280,"num_write":924,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'551","reported_seq":2098,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.490083+0000","last_change":"2024-09-12T00:11:47.935891+0000","last_active":"2024-09-12T00:53:10.490083+0000","last_peered":"2024-09-12T00:53:10.490083+0000","last_clean":"2024-09-12T00:53:10.490083+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:53:10.490083+0000","last_undegraded":"2024-09-12T00:53:10.490083+0000","last_fullsized":"2024-09-12T00:53:10.490083+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:40.527099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'225","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:16.112540+0000","last_change":"2024-09-12T00:11:45.923906+0000","last_active":"2024-09-12T00:52:16.112540+0000","last_peered":"2024-09-12T00:52:16.112540+0000","last_clean":"2024-09-12T00:52:16.112540+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:52:16.112540+0000","last_undegraded":"2024-09-12T00:52:16.112540+0000","last_fullsized":"2024-09-12T00:52:16.112540+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:44.019789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7677221,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":742,"num_read_kb":61726,"num_write":1106,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'700","reported_seq":2496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.504786+0000","last_change":"2024-09-12T00:11:47.936000+0000","last_active":"2024-09-12T00:53:10.504786+0000","last_peered":"2024-09-12T00:53:10.504786+0000","last_clean":"2024-09-12T00:53:10.504786+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:53:10.504786+0000","last_undegraded":"2024-09-12T00:53:10.504786+0000","last_fullsized":"2024-09-12T00:53:10.504786+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.990104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'205","reported_seq":815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.400956+0000","last_change":"2024-09-12T00:11:45.945290+0000","last_active":"2024-09-12T00:53:11.400956+0000","last_peered":"2024-09-12T00:53:11.400956+0000","last_clean":"2024-09-12T00:53:11.400956+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:53:11.400956+0000","last_undegraded":"2024-09-12T00:53:11.400956+0000","last_fullsized":"2024-09-12T00:53:11.400956+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.645752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9737824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":428,"num_read_kb":13749,"num_write":931,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'963","reported_seq":2517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.236155+0000","last_change":"2024-09-12T00:11:47.941903+0000","last_active":"2024-09-12T00:53:00.236155+0000","last_peered":"2024-09-12T00:53:00.236155+0000","last_clean":"2024-09-12T00:53:00.236155+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:53:00.236155+0000","last_undegraded":"2024-09-12T00:53:00.236155+0000","last_fullsized":"2024-09-12T00:53:00.236155+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":900,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:15.435909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:44.299796+0000","last_change":"2024-09-12T00:11:45.937710+0000","last_active":"2024-09-12T00:52:44.299796+0000","last_peered":"2024-09-12T00:52:44.299796+0000","last_clean":"2024-09-12T00:52:44.299796+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:52:44.299796+0000","last_undegraded":"2024-09-12T00:52:44.299796+0000","last_fullsized":"2024-09-12T00:52:44.299796+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:53.751417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2072216,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":584,"num_read_kb":23861,"num_write":1048,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'752","reported_seq":2227,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.968292+0000","last_change":"2024-09-12T00:11:47.940732+0000","last_active":"2024-09-12T00:53:01.968292+0000","last_peered":"2024-09-12T00:53:01.968292+0000","last_clean":"2024-09-12T00:53:01.968292+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:53:01.968292+0000","last_undegraded":"2024-09-12T00:53:01.968292+0000","last_fullsized":"2024-09-12T00:53:01.968292+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.413376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'162","reported_seq":765,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.559498+0000","last_change":"2024-09-12T00:11:45.934430+0000","last_active":"2024-09-12T00:53:01.559498+0000","last_peered":"2024-09-12T00:53:01.559498+0000","last_clean":"2024-09-12T00:53:01.559498+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:53:01.559498+0000","last_undegraded":"2024-09-12T00:53:01.559498+0000","last_fullsized":"2024-09-12T00:53:01.559498+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.951800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470357,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":3653,"num_write":815,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'834","reported_seq":2657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.968223+0000","last_change":"2024-09-12T00:11:47.951096+0000","last_active":"2024-09-12T00:53:01.968223+0000","last_peered":"2024-09-12T00:53:01.968223+0000","last_clean":"2024-09-12T00:53:01.968223+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:53:01.968223+0000","last_undegraded":"2024-09-12T00:53:01.968223+0000","last_fullsized":"2024-09-12T00:53:01.968223+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:06.513554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'211","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.929359+0000","last_change":"2024-09-12T00:11:45.926172+0000","last_active":"2024-09-12T00:52:53.929359+0000","last_peered":"2024-09-12T00:52:53.929359+0000","last_clean":"2024-09-12T00:52:53.929359+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:52:53.929359+0000","last_undegraded":"2024-09-12T00:52:53.929359+0000","last_fullsized":"2024-09-12T00:52:53.929359+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:26.600245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12280161,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":490,"num_read_kb":27002,"num_write":967,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'447","reported_seq":2066,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.036909+0000","last_change":"2024-09-12T00:11:47.941908+0000","last_active":"2024-09-12T00:52:49.036909+0000","last_peered":"2024-09-12T00:52:49.036909+0000","last_clean":"2024-09-12T00:52:49.036909+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:52:49.036909+0000","last_undegraded":"2024-09-12T00:52:49.036909+0000","last_fullsized":"2024-09-12T00:52:49.036909+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.535433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'184","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.273931+0000","last_change":"2024-09-12T00:11:45.964131+0000","last_active":"2024-09-12T00:52:02.273931+0000","last_peered":"2024-09-12T00:52:02.273931+0000","last_clean":"2024-09-12T00:52:02.273931+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:52:02.273931+0000","last_undegraded":"2024-09-12T00:52:02.273931+0000","last_fullsized":"2024-09-12T00:52:02.273931+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:45.901253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049107,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":12744,"num_write":920,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'219","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.499645+0000","last_change":"2024-09-12T00:11:45.935207+0000","last_active":"2024-09-12T00:53:11.499645+0000","last_peered":"2024-09-12T00:53:11.499645+0000","last_clean":"2024-09-12T00:53:11.499645+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:53:11.499645+0000","last_undegraded":"2024-09-12T00:53:11.499645+0000","last_fullsized":"2024-09-12T00:53:11.499645+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:45.585339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17885897,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":71383,"num_write":1065,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.502646+0000","last_change":"2024-09-12T00:11:47.953166+0000","last_active":"2024-09-12T00:53:10.502646+0000","last_peered":"2024-09-12T00:53:10.502646+0000","last_clean":"2024-09-12T00:53:10.502646+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:53:10.502646+0000","last_undegraded":"2024-09-12T00:53:10.502646+0000","last_fullsized":"2024-09-12T00:53:10.502646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:29.576578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'202","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.400938+0000","last_change":"2024-09-12T00:11:45.965734+0000","last_active":"2024-09-12T00:53:11.400938+0000","last_peered":"2024-09-12T00:53:11.400938+0000","last_clean":"2024-09-12T00:53:11.400938+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:53:11.400938+0000","last_undegraded":"2024-09-12T00:53:11.400938+0000","last_fullsized":"2024-09-12T00:53:11.400938+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.306543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9812130,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":704,"num_read_kb":180313,"num_write":957,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'926","reported_seq":2688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.196736+0000","last_change":"2024-09-12T00:11:47.940663+0000","last_active":"2024-09-12T00:54:17.196736+0000","last_peered":"2024-09-12T00:54:17.196736+0000","last_clean":"2024-09-12T00:54:17.196736+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:17.196736+0000","last_undegraded":"2024-09-12T00:54:17.196736+0000","last_fullsized":"2024-09-12T00:54:17.196736+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":959,"ondisk_log_size":959,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1850,"ondisk_log_size":1850,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":639,"ondisk_log_size":639,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":445853,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8289,"num_read_kb":10087,"num_write":5619,"num_write_kb":2639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":222580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1858,"ondisk_log_size":1858,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3935,"ondisk_log_size":3935,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":410963992,"num_objects":519,"num_object_clones":0,"num_object_copies":1557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":0,"num_read":32940,"num_read_kb":1979745,"num_write":63114,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":624386048,"data_stored":624386048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4396,"ondisk_log_size":4396,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72641901,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":145,"num_read_kb":190493,"num_write":161,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146341888,"data_stored":146332378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73106114,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":143,"num_read_kb":189755,"num_write":161,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142610432,"data_stored":142602287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509959,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320248,"kb_used_data":122536,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94051592,"statfs":{"total":96636764160,"available":96308830208,"internally_reserved":0,"allocated":125476864,"data_stored":123457796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509960,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198864,"kb_used_data":131584,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94172976,"statfs":{"total":96636764160,"available":96433127424,"internally_reserved":0,"allocated":134742016,"data_stored":132690622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509961,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288760,"kb_used_data":127144,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94083080,"statfs":{"total":96636764160,"available":96341073920,"internally_reserved":0,"allocated":130195456,"data_stored":128157869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509961,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329136,"kb_used_data":135520,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94042704,"statfs":{"total":96636764160,"available":96299728896,"internally_reserved":0,"allocated":138772480,"data_stored":136734146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509962,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189500,"kb_used_data":108332,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94182340,"statfs":{"total":96636764160,"available":96442716160,"internally_reserved":0,"allocated":110931968,"data_stored":108910447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509961,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368232,"kb_used_data":98264,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94003608,"statfs":{"total":96636764160,"available":96259694592,"internally_reserved":0,"allocated":100622336,"data_stored":98567019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509960,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215332,"kb_used_data":116116,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94156508,"statfs":{"total":96636764160,"available":96416264192,"internally_reserved":0,"allocated":118902784,"data_stored":116838032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542668,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346356,"kb_used_data":104164,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94025484,"statfs":{"total":96636764160,"available":96282095616,"internally_reserved":0,"allocated":106663936,"data_stored":104618795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":247986629},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":79962112,"data_stored":79962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":66723840,"data_stored":66723840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":75902976,"data_stored":75902976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100593664,"data_stored":100593664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98041856,"data_stored":98041856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69595136,"data_stored":69595136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64786432,"data_stored":64786432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":68780032,"data_stored":68780032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":38134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":23391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":33408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":28921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":33829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20680704,"data_stored":20677314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19632128,"data_stored":19628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":716800,"data_stored":714225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14258176,"data_stored":14255996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14345713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39424000,"data_stored":39421820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:54:32.393 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-12T00:54:32.394 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:54:32.743 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:54:32.760 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:54:32.768 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1552,"stamp":"2024-09-12T00:54:31.351387+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":557765235,"num_objects":1060,"num_object_clones":0,"num_object_copies":2639,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1060,"num_whiteouts":0,"num_read":277489,"num_read_kb":2585916,"num_write":143116,"num_write_kb":2344217,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13931,"ondisk_log_size":13931,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2256428,"kb_used_data":943660,"kb_used_omap":12,"kb_used_meta":1312627,"kb_avail":752718292,"statfs":{"total":773094113280,"available":770783531008,"internally_reserved":0,"allocated":966307840,"data_stored":949974726,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1344130610},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-12467169,"num_objects":-27,"num_object_clones":0,"num_object_copies":-62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-27,"num_whiteouts":0,"num_read":276,"num_read_kb":270,"num_write":52,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-12,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007887"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934222+0000","last_change":"2024-09-12T00:39:28.138350+0000","last_active":"2024-09-12T00:52:00.934222+0000","last_peered":"2024-09-12T00:52:00.934222+0000","last_clean":"2024-09-12T00:52:00.934222+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:52:00.934222+0000","last_undegraded":"2024-09-12T00:52:00.934222+0000","last_fullsized":"2024-09-12T00:52:00.934222+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:55.798857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092228+0000","last_change":"2024-09-12T00:28:17.047281+0000","last_active":"2024-09-12T00:50:51.092228+0000","last_peered":"2024-09-12T00:50:51.092228+0000","last_clean":"2024-09-12T00:50:51.092228+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:50:51.092228+0000","last_undegraded":"2024-09-12T00:50:51.092228+0000","last_fullsized":"2024-09-12T00:50:51.092228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:27.659088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915451+0000","last_change":"2024-09-12T00:28:14.033426+0000","last_active":"2024-09-12T00:50:45.915451+0000","last_peered":"2024-09-12T00:50:45.915451+0000","last_clean":"2024-09-12T00:50:45.915451+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:50:45.915451+0000","last_undegraded":"2024-09-12T00:50:45.915451+0000","last_fullsized":"2024-09-12T00:50:45.915451+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:32.619191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931203+0000","last_change":"2024-09-12T00:26:48.570033+0000","last_active":"2024-09-12T00:51:50.931203+0000","last_peered":"2024-09-12T00:51:50.931203+0000","last_clean":"2024-09-12T00:51:50.931203+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:51:50.931203+0000","last_undegraded":"2024-09-12T00:51:50.931203+0000","last_fullsized":"2024-09-12T00:51:50.931203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.353377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928588+0000","last_change":"2024-09-12T00:39:28.129464+0000","last_active":"2024-09-12T00:52:00.928588+0000","last_peered":"2024-09-12T00:52:00.928588+0000","last_clean":"2024-09-12T00:52:00.928588+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:52:00.928588+0000","last_undegraded":"2024-09-12T00:52:00.928588+0000","last_fullsized":"2024-09-12T00:52:00.928588+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:48.897603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113095+0000","last_change":"2024-09-12T00:28:17.071932+0000","last_active":"2024-09-12T00:50:51.113095+0000","last_peered":"2024-09-12T00:50:51.113095+0000","last_clean":"2024-09-12T00:50:51.113095+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:50:51.113095+0000","last_undegraded":"2024-09-12T00:50:51.113095+0000","last_fullsized":"2024-09-12T00:50:51.113095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.458170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921118+0000","last_change":"2024-09-12T00:28:14.053061+0000","last_active":"2024-09-12T00:50:44.921118+0000","last_peered":"2024-09-12T00:50:44.921118+0000","last_clean":"2024-09-12T00:50:44.921118+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:50:44.921118+0000","last_undegraded":"2024-09-12T00:50:44.921118+0000","last_fullsized":"2024-09-12T00:50:44.921118+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.764170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":162,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.061737+0000","last_change":"2024-09-12T00:26:48.579305+0000","last_active":"2024-09-12T00:51:36.061737+0000","last_peered":"2024-09-12T00:51:36.061737+0000","last_clean":"2024-09-12T00:51:36.061737+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:51:36.061737+0000","last_undegraded":"2024-09-12T00:51:36.061737+0000","last_fullsized":"2024-09-12T00:51:36.061737+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:50.899850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.103970+0000","last_change":"2024-09-12T00:39:28.122188+0000","last_active":"2024-09-12T00:51:36.103970+0000","last_peered":"2024-09-12T00:51:36.103970+0000","last_clean":"2024-09-12T00:51:36.103970+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:51:36.103970+0000","last_undegraded":"2024-09-12T00:51:36.103970+0000","last_fullsized":"2024-09-12T00:51:36.103970+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.982189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928491+0000","last_change":"2024-09-12T00:28:17.054566+0000","last_active":"2024-09-12T00:51:14.928491+0000","last_peered":"2024-09-12T00:51:14.928491+0000","last_clean":"2024-09-12T00:51:14.928491+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:51:14.928491+0000","last_undegraded":"2024-09-12T00:51:14.928491+0000","last_fullsized":"2024-09-12T00:51:14.928491+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.840405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:20.935927+0000","last_change":"2024-09-12T00:28:14.047435+0000","last_active":"2024-09-12T00:52:20.935927+0000","last_peered":"2024-09-12T00:52:20.935927+0000","last_clean":"2024-09-12T00:52:20.935927+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:52:20.935927+0000","last_undegraded":"2024-09-12T00:52:20.935927+0000","last_fullsized":"2024-09-12T00:52:20.935927+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:59.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.669268+0000","last_change":"2024-09-12T00:26:48.580614+0000","last_active":"2024-09-12T00:52:01.669268+0000","last_peered":"2024-09-12T00:52:01.669268+0000","last_clean":"2024-09-12T00:52:01.669268+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:52:01.669268+0000","last_undegraded":"2024-09-12T00:52:01.669268+0000","last_fullsized":"2024-09-12T00:52:01.669268+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:44.366801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934194+0000","last_change":"2024-09-12T00:39:28.125516+0000","last_active":"2024-09-12T00:51:39.934194+0000","last_peered":"2024-09-12T00:51:39.934194+0000","last_clean":"2024-09-12T00:51:39.934194+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:51:39.934194+0000","last_undegraded":"2024-09-12T00:51:39.934194+0000","last_fullsized":"2024-09-12T00:51:39.934194+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:50.627744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'4","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.944822+0000","last_change":"2024-09-12T00:28:17.052788+0000","last_active":"2024-09-12T00:52:24.944822+0000","last_peered":"2024-09-12T00:52:24.944822+0000","last_clean":"2024-09-12T00:52:24.944822+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:52:24.944822+0000","last_undegraded":"2024-09-12T00:52:24.944822+0000","last_fullsized":"2024-09-12T00:52:24.944822+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.537154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":9216,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096647+0000","last_change":"2024-09-12T00:28:14.043102+0000","last_active":"2024-09-12T00:51:11.096647+0000","last_peered":"2024-09-12T00:51:11.096647+0000","last_clean":"2024-09-12T00:51:11.096647+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:51:11.096647+0000","last_undegraded":"2024-09-12T00:51:11.096647+0000","last_fullsized":"2024-09-12T00:51:11.096647+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.118617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926319+0000","last_change":"2024-09-12T00:26:48.582273+0000","last_active":"2024-09-12T00:51:50.926319+0000","last_peered":"2024-09-12T00:51:50.926319+0000","last_clean":"2024-09-12T00:51:50.926319+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:51:50.926319+0000","last_undegraded":"2024-09-12T00:51:50.926319+0000","last_fullsized":"2024-09-12T00:51:50.926319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.447704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926457+0000","last_change":"2024-09-12T00:39:28.140327+0000","last_active":"2024-09-12T00:51:35.926457+0000","last_peered":"2024-09-12T00:51:35.926457+0000","last_clean":"2024-09-12T00:51:35.926457+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:51:35.926457+0000","last_undegraded":"2024-09-12T00:51:35.926457+0000","last_fullsized":"2024-09-12T00:51:35.926457+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:53.703852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'1","reported_seq":32,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.910206+0000","last_change":"2024-09-12T00:28:17.062001+0000","last_active":"2024-09-12T00:50:10.910206+0000","last_peered":"2024-09-12T00:50:10.910206+0000","last_clean":"2024-09-12T00:50:10.910206+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:50:10.910206+0000","last_undegraded":"2024-09-12T00:50:10.910206+0000","last_fullsized":"2024-09-12T00:50:10.910206+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.953980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":8192,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:49:59.910445+0000","last_change":"2024-09-12T00:28:14.043324+0000","last_active":"2024-09-12T00:49:59.910445+0000","last_peered":"2024-09-12T00:49:59.910445+0000","last_clean":"2024-09-12T00:49:59.910445+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:49:59.910445+0000","last_undegraded":"2024-09-12T00:49:59.910445+0000","last_fullsized":"2024-09-12T00:49:59.910445+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:29.585815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":8,"num_read_kb":14336,"num_write":12,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926176+0000","last_change":"2024-09-12T00:26:48.586853+0000","last_active":"2024-09-12T00:51:50.926176+0000","last_peered":"2024-09-12T00:51:50.926176+0000","last_clean":"2024-09-12T00:51:50.926176+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:51:50.926176+0000","last_undegraded":"2024-09-12T00:51:50.926176+0000","last_fullsized":"2024-09-12T00:51:50.926176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:56.028583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933422+0000","last_change":"2024-09-12T00:39:28.107499+0000","last_active":"2024-09-12T00:52:00.933422+0000","last_peered":"2024-09-12T00:52:00.933422+0000","last_clean":"2024-09-12T00:52:00.933422+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:52:00.933422+0000","last_undegraded":"2024-09-12T00:52:00.933422+0000","last_fullsized":"2024-09-12T00:52:00.933422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:42.987392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'4","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924539+0000","last_change":"2024-09-12T00:28:17.080528+0000","last_active":"2024-09-12T00:50:05.924539+0000","last_peered":"2024-09-12T00:50:05.924539+0000","last_clean":"2024-09-12T00:50:05.924539+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:50:05.924539+0000","last_undegraded":"2024-09-12T00:50:05.924539+0000","last_fullsized":"2024-09-12T00:50:05.924539+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:57.273734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4818812,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":651,"num_write":9,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'1","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924641+0000","last_change":"2024-09-12T00:28:14.045269+0000","last_active":"2024-09-12T00:50:05.924641+0000","last_peered":"2024-09-12T00:50:05.924641+0000","last_clean":"2024-09-12T00:50:05.924641+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:50:05.924641+0000","last_undegraded":"2024-09-12T00:50:05.924641+0000","last_fullsized":"2024-09-12T00:50:05.924641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:05.105429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":698,"num_write":1,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.892906+0000","last_change":"2024-09-12T00:26:48.573856+0000","last_active":"2024-09-12T00:52:33.892906+0000","last_peered":"2024-09-12T00:52:33.892906+0000","last_clean":"2024-09-12T00:52:33.892906+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:52:33.892906+0000","last_undegraded":"2024-09-12T00:52:33.892906+0000","last_fullsized":"2024-09-12T00:52:33.892906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:49.201091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.128901+0000","last_change":"2024-09-12T00:39:28.140779+0000","last_active":"2024-09-12T00:52:01.128901+0000","last_peered":"2024-09-12T00:52:01.128901+0000","last_clean":"2024-09-12T00:52:01.128901+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:52:01.128901+0000","last_undegraded":"2024-09-12T00:52:01.128901+0000","last_fullsized":"2024-09-12T00:52:01.128901+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.223046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113042+0000","last_change":"2024-09-12T00:28:17.073306+0000","last_active":"2024-09-12T00:50:51.113042+0000","last_peered":"2024-09-12T00:50:51.113042+0000","last_clean":"2024-09-12T00:50:51.113042+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:50:51.113042+0000","last_undegraded":"2024-09-12T00:50:51.113042+0000","last_fullsized":"2024-09-12T00:50:51.113042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.616512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917468+0000","last_change":"2024-09-12T00:28:14.036590+0000","last_active":"2024-09-12T00:50:45.917468+0000","last_peered":"2024-09-12T00:50:45.917468+0000","last_clean":"2024-09-12T00:50:45.917468+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:50:45.917468+0000","last_undegraded":"2024-09-12T00:50:45.917468+0000","last_fullsized":"2024-09-12T00:50:45.917468+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.374471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.485163+0000","last_change":"2024-09-12T00:26:48.567960+0000","last_active":"2024-09-12T00:52:37.485163+0000","last_peered":"2024-09-12T00:52:37.485163+0000","last_clean":"2024-09-12T00:52:37.485163+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:52:37.485163+0000","last_undegraded":"2024-09-12T00:52:37.485163+0000","last_fullsized":"2024-09-12T00:52:37.485163+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.486007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934433+0000","last_change":"2024-09-12T00:39:28.125474+0000","last_active":"2024-09-12T00:52:00.934433+0000","last_peered":"2024-09-12T00:52:00.934433+0000","last_clean":"2024-09-12T00:52:00.934433+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:52:00.934433+0000","last_undegraded":"2024-09-12T00:52:00.934433+0000","last_fullsized":"2024-09-12T00:52:00.934433+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:45.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916437+0000","last_change":"2024-09-12T00:28:17.074749+0000","last_active":"2024-09-12T00:50:50.916437+0000","last_peered":"2024-09-12T00:50:50.916437+0000","last_clean":"2024-09-12T00:50:50.916437+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:50:50.916437+0000","last_undegraded":"2024-09-12T00:50:50.916437+0000","last_fullsized":"2024-09-12T00:50:50.916437+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:59.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.911641+0000","last_change":"2024-09-12T00:28:14.050432+0000","last_active":"2024-09-12T00:50:45.911641+0000","last_peered":"2024-09-12T00:50:45.911641+0000","last_clean":"2024-09-12T00:50:45.911641+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:50:45.911641+0000","last_undegraded":"2024-09-12T00:50:45.911641+0000","last_fullsized":"2024-09-12T00:50:45.911641+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:50.652868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914915+0000","last_change":"2024-09-12T00:26:48.576457+0000","last_active":"2024-09-12T00:51:00.914915+0000","last_peered":"2024-09-12T00:51:00.914915+0000","last_clean":"2024-09-12T00:51:00.914915+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:51:00.914915+0000","last_undegraded":"2024-09-12T00:51:00.914915+0000","last_fullsized":"2024-09-12T00:51:00.914915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:50.385760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927145+0000","last_change":"2024-09-12T00:39:28.133363+0000","last_active":"2024-09-12T00:51:09.927145+0000","last_peered":"2024-09-12T00:51:09.927145+0000","last_clean":"2024-09-12T00:51:09.927145+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:51:09.927145+0000","last_undegraded":"2024-09-12T00:51:09.927145+0000","last_fullsized":"2024-09-12T00:51:09.927145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:45.885764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'8","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.906908+0000","last_change":"2024-09-12T00:28:17.078258+0000","last_active":"2024-09-12T00:50:05.906908+0000","last_peered":"2024-09-12T00:50:05.906908+0000","last_clean":"2024-09-12T00:50:05.906908+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:50:05.906908+0000","last_undegraded":"2024-09-12T00:50:05.906908+0000","last_fullsized":"2024-09-12T00:50:05.906908+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:26.373864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":12306,"num_write":8,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947884+0000","last_change":"2024-09-12T00:28:14.046080+0000","last_active":"2024-09-12T00:51:40.947884+0000","last_peered":"2024-09-12T00:51:40.947884+0000","last_clean":"2024-09-12T00:51:40.947884+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:51:40.947884+0000","last_undegraded":"2024-09-12T00:51:40.947884+0000","last_fullsized":"2024-09-12T00:51:40.947884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.783103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":201,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.951659+0000","last_change":"2024-09-12T00:26:48.572423+0000","last_active":"2024-09-12T00:51:36.951659+0000","last_peered":"2024-09-12T00:51:36.951659+0000","last_clean":"2024-09-12T00:51:36.951659+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:51:36.951659+0000","last_undegraded":"2024-09-12T00:51:36.951659+0000","last_fullsized":"2024-09-12T00:51:36.951659+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:03.523286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917174+0000","last_change":"2024-09-12T00:39:28.115704+0000","last_active":"2024-09-12T00:51:10.917174+0000","last_peered":"2024-09-12T00:51:10.917174+0000","last_clean":"2024-09-12T00:51:10.917174+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:51:10.917174+0000","last_undegraded":"2024-09-12T00:51:10.917174+0000","last_fullsized":"2024-09-12T00:51:10.917174+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.301433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:44.935398+0000","last_change":"2024-09-12T00:28:17.068407+0000","last_active":"2024-09-12T00:51:44.935398+0000","last_peered":"2024-09-12T00:51:44.935398+0000","last_clean":"2024-09-12T00:51:44.935398+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:51:44.935398+0000","last_undegraded":"2024-09-12T00:51:44.935398+0000","last_fullsized":"2024-09-12T00:51:44.935398+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:04.370003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":3,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:00.907982+0000","last_change":"2024-09-12T00:28:14.033635+0000","last_active":"2024-09-12T00:50:00.907982+0000","last_peered":"2024-09-12T00:50:00.907982+0000","last_clean":"2024-09-12T00:50:00.907982+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:50:00.907982+0000","last_undegraded":"2024-09-12T00:50:00.907982+0000","last_fullsized":"2024-09-12T00:50:00.907982+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:21.430932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.729092+0000","last_change":"2024-09-12T00:26:48.579143+0000","last_active":"2024-09-12T00:52:37.729092+0000","last_peered":"2024-09-12T00:52:37.729092+0000","last_clean":"2024-09-12T00:52:37.729092+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:52:37.729092+0000","last_undegraded":"2024-09-12T00:52:37.729092+0000","last_fullsized":"2024-09-12T00:52:37.729092+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:58.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.117359+0000","last_change":"2024-09-12T00:39:28.143755+0000","last_active":"2024-09-12T00:51:11.117359+0000","last_peered":"2024-09-12T00:51:11.117359+0000","last_clean":"2024-09-12T00:51:11.117359+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:51:11.117359+0000","last_undegraded":"2024-09-12T00:51:11.117359+0000","last_fullsized":"2024-09-12T00:51:11.117359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:42.065287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.907031+0000","last_change":"2024-09-12T00:28:17.072223+0000","last_active":"2024-09-12T00:50:05.907031+0000","last_peered":"2024-09-12T00:50:05.907031+0000","last_clean":"2024-09-12T00:50:05.907031+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:50:05.907031+0000","last_undegraded":"2024-09-12T00:50:05.907031+0000","last_fullsized":"2024-09-12T00:50:05.907031+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:56.304323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'3","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:00.905773+0000","last_change":"2024-09-12T00:28:14.051773+0000","last_active":"2024-09-12T00:50:00.905773+0000","last_peered":"2024-09-12T00:50:00.905773+0000","last_clean":"2024-09-12T00:50:00.905773+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:50:00.905773+0000","last_undegraded":"2024-09-12T00:50:00.905773+0000","last_fullsized":"2024-09-12T00:50:00.905773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:12.527606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.918732+0000","last_change":"2024-09-12T00:26:48.566905+0000","last_active":"2024-09-12T00:51:00.918732+0000","last_peered":"2024-09-12T00:51:00.918732+0000","last_clean":"2024-09-12T00:51:00.918732+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:51:00.918732+0000","last_undegraded":"2024-09-12T00:51:00.918732+0000","last_fullsized":"2024-09-12T00:51:00.918732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.878822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.923092+0000","last_change":"2024-09-12T00:39:28.130382+0000","last_active":"2024-09-12T00:51:10.923092+0000","last_peered":"2024-09-12T00:51:10.923092+0000","last_clean":"2024-09-12T00:51:10.923092+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:51:10.923092+0000","last_undegraded":"2024-09-12T00:51:10.923092+0000","last_fullsized":"2024-09-12T00:51:10.923092+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:27.073020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'3","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.909253+0000","last_change":"2024-09-12T00:28:17.073824+0000","last_active":"2024-09-12T00:50:05.909253+0000","last_peered":"2024-09-12T00:50:05.909253+0000","last_clean":"2024-09-12T00:50:05.909253+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:50:05.909253+0000","last_undegraded":"2024-09-12T00:50:05.909253+0000","last_fullsized":"2024-09-12T00:50:05.909253+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.923969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":3072,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:49:59.910715+0000","last_change":"2024-09-12T00:28:14.044796+0000","last_active":"2024-09-12T00:49:59.910715+0000","last_peered":"2024-09-12T00:49:59.910715+0000","last_clean":"2024-09-12T00:49:59.910715+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:49:59.910715+0000","last_undegraded":"2024-09-12T00:49:59.910715+0000","last_fullsized":"2024-09-12T00:49:59.910715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:13.669602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'113","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.539168+0000","last_change":"2024-09-12T00:26:48.578346+0000","last_active":"2024-09-12T00:52:38.539168+0000","last_peered":"2024-09-12T00:52:38.539168+0000","last_clean":"2024-09-12T00:52:38.539168+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:52:38.539168+0000","last_undegraded":"2024-09-12T00:52:38.539168+0000","last_fullsized":"2024-09-12T00:52:38.539168+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:52.917481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933259+0000","last_change":"2024-09-12T00:39:28.130268+0000","last_active":"2024-09-12T00:51:34.933259+0000","last_peered":"2024-09-12T00:51:34.933259+0000","last_clean":"2024-09-12T00:51:34.933259+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:51:34.933259+0000","last_undegraded":"2024-09-12T00:51:34.933259+0000","last_fullsized":"2024-09-12T00:51:34.933259+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:22.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'3","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934267+0000","last_change":"2024-09-12T00:28:17.046685+0000","last_active":"2024-09-12T00:51:39.934267+0000","last_peered":"2024-09-12T00:51:39.934267+0000","last_clean":"2024-09-12T00:51:39.934267+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:51:39.934267+0000","last_undegraded":"2024-09-12T00:51:39.934267+0000","last_fullsized":"2024-09-12T00:51:39.934267+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:31.104948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":714225,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":4468,"num_write":3,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104004+0000","last_change":"2024-09-12T00:28:14.032537+0000","last_active":"2024-09-12T00:51:36.104004+0000","last_peered":"2024-09-12T00:51:36.104004+0000","last_clean":"2024-09-12T00:51:36.104004+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:51:36.104004+0000","last_undegraded":"2024-09-12T00:51:36.104004+0000","last_fullsized":"2024-09-12T00:51:36.104004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.020093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'133","reported_seq":449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.925949+0000","last_change":"2024-09-12T00:26:48.579290+0000","last_active":"2024-09-12T00:50:10.925949+0000","last_peered":"2024-09-12T00:50:10.925949+0000","last_clean":"2024-09-12T00:50:10.925949+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:50:10.925949+0000","last_undegraded":"2024-09-12T00:50:10.925949+0000","last_fullsized":"2024-09-12T00:50:10.925949+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.084724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922871+0000","last_change":"2024-09-12T00:39:28.116214+0000","last_active":"2024-09-12T00:51:35.922871+0000","last_peered":"2024-09-12T00:51:35.922871+0000","last_clean":"2024-09-12T00:51:35.922871+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:51:35.922871+0000","last_undegraded":"2024-09-12T00:51:35.922871+0000","last_fullsized":"2024-09-12T00:51:35.922871+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.593460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934132+0000","last_change":"2024-09-12T00:28:17.059604+0000","last_active":"2024-09-12T00:51:39.934132+0000","last_peered":"2024-09-12T00:51:39.934132+0000","last_clean":"2024-09-12T00:51:39.934132+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:51:39.934132+0000","last_undegraded":"2024-09-12T00:51:39.934132+0000","last_fullsized":"2024-09-12T00:51:39.934132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:54.283922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933089+0000","last_change":"2024-09-12T00:28:14.043789+0000","last_active":"2024-09-12T00:51:34.933089+0000","last_peered":"2024-09-12T00:51:34.933089+0000","last_clean":"2024-09-12T00:51:34.933089+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:51:34.933089+0000","last_undegraded":"2024-09-12T00:51:34.933089+0000","last_fullsized":"2024-09-12T00:51:34.933089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.842950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.908002+0000","last_change":"2024-09-12T00:26:48.587469+0000","last_active":"2024-09-12T00:50:10.908002+0000","last_peered":"2024-09-12T00:50:10.908002+0000","last_clean":"2024-09-12T00:50:10.908002+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:50:10.908002+0000","last_undegraded":"2024-09-12T00:50:10.908002+0000","last_fullsized":"2024-09-12T00:50:10.908002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.099773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923180+0000","last_change":"2024-09-12T00:39:28.116113+0000","last_active":"2024-09-12T00:51:15.923180+0000","last_peered":"2024-09-12T00:51:15.923180+0000","last_clean":"2024-09-12T00:51:15.923180+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:51:15.923180+0000","last_undegraded":"2024-09-12T00:51:15.923180+0000","last_fullsized":"2024-09-12T00:51:15.923180+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'5","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927361+0000","last_change":"2024-09-12T00:28:17.077838+0000","last_active":"2024-09-12T00:51:40.927361+0000","last_peered":"2024-09-12T00:51:40.927361+0000","last_clean":"2024-09-12T00:51:40.927361+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:51:40.927361+0000","last_undegraded":"2024-09-12T00:51:40.927361+0000","last_fullsized":"2024-09-12T00:51:40.927361+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.840518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104119+0000","last_change":"2024-09-12T00:28:14.041233+0000","last_active":"2024-09-12T00:51:36.104119+0000","last_peered":"2024-09-12T00:51:36.104119+0000","last_clean":"2024-09-12T00:51:36.104119+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:51:36.104119+0000","last_undegraded":"2024-09-12T00:51:36.104119+0000","last_fullsized":"2024-09-12T00:51:36.104119+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:48.566724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7340032,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":7168,"num_write":2,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104059+0000","last_change":"2024-09-12T00:26:48.563874+0000","last_active":"2024-09-12T00:50:11.104059+0000","last_peered":"2024-09-12T00:50:11.104059+0000","last_clean":"2024-09-12T00:50:11.104059+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:50:11.104059+0000","last_undegraded":"2024-09-12T00:50:11.104059+0000","last_fullsized":"2024-09-12T00:50:11.104059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.613469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922823+0000","last_change":"2024-09-12T00:39:28.107803+0000","last_active":"2024-09-12T00:51:35.922823+0000","last_peered":"2024-09-12T00:51:35.922823+0000","last_clean":"2024-09-12T00:51:35.922823+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:51:35.922823+0000","last_undegraded":"2024-09-12T00:51:35.922823+0000","last_fullsized":"2024-09-12T00:51:35.922823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.925644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947791+0000","last_change":"2024-09-12T00:28:17.071725+0000","last_active":"2024-09-12T00:51:40.947791+0000","last_peered":"2024-09-12T00:51:40.947791+0000","last_clean":"2024-09-12T00:51:40.947791+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:51:40.947791+0000","last_undegraded":"2024-09-12T00:51:40.947791+0000","last_fullsized":"2024-09-12T00:51:40.947791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:28.212664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'8","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:56.131231+0000","last_change":"2024-09-12T00:28:14.033365+0000","last_active":"2024-09-12T00:53:56.131231+0000","last_peered":"2024-09-12T00:53:56.131231+0000","last_clean":"2024-09-12T00:53:56.131231+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:53:56.131231+0000","last_undegraded":"2024-09-12T00:53:56.131231+0000","last_fullsized":"2024-09-12T00:53:56.131231+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:07.863908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":21053,"num_write":13,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:37.957887+0000","last_change":"2024-09-12T00:26:48.584004+0000","last_active":"2024-09-12T00:51:37.957887+0000","last_peered":"2024-09-12T00:51:37.957887+0000","last_clean":"2024-09-12T00:51:37.957887+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:51:37.957887+0000","last_undegraded":"2024-09-12T00:51:37.957887+0000","last_fullsized":"2024-09-12T00:51:37.957887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:52.685965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:24.916370+0000","last_change":"2024-09-12T00:39:28.127905+0000","last_active":"2024-09-12T00:50:24.916370+0000","last_peered":"2024-09-12T00:50:24.916370+0000","last_clean":"2024-09-12T00:50:24.916370+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:50:24.916370+0000","last_undegraded":"2024-09-12T00:50:24.916370+0000","last_fullsized":"2024-09-12T00:50:24.916370+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:42.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916546+0000","last_change":"2024-09-12T00:28:17.075169+0000","last_active":"2024-09-12T00:50:50.916546+0000","last_peered":"2024-09-12T00:50:50.916546+0000","last_clean":"2024-09-12T00:50:50.916546+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:50:50.916546+0000","last_undegraded":"2024-09-12T00:50:50.916546+0000","last_fullsized":"2024-09-12T00:50:50.916546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:26.934607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111806+0000","last_change":"2024-09-12T00:28:14.015676+0000","last_active":"2024-09-12T00:50:46.111806+0000","last_peered":"2024-09-12T00:50:46.111806+0000","last_clean":"2024-09-12T00:50:46.111806+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:50:46.111806+0000","last_undegraded":"2024-09-12T00:50:46.111806+0000","last_fullsized":"2024-09-12T00:50:46.111806+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:53.120779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927494+0000","last_change":"2024-09-12T00:26:48.573048+0000","last_active":"2024-09-12T00:51:40.927494+0000","last_peered":"2024-09-12T00:51:40.927494+0000","last_clean":"2024-09-12T00:51:40.927494+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:51:40.927494+0000","last_undegraded":"2024-09-12T00:51:40.927494+0000","last_fullsized":"2024-09-12T00:51:40.927494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.722904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.091062+0000","last_change":"2024-09-12T00:39:28.121616+0000","last_active":"2024-09-12T00:50:46.091062+0000","last_peered":"2024-09-12T00:50:46.091062+0000","last_clean":"2024-09-12T00:50:46.091062+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:50:46.091062+0000","last_undegraded":"2024-09-12T00:50:46.091062+0000","last_fullsized":"2024-09-12T00:50:46.091062+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:15.863877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916508+0000","last_change":"2024-09-12T00:28:17.074710+0000","last_active":"2024-09-12T00:50:50.916508+0000","last_peered":"2024-09-12T00:50:50.916508+0000","last_clean":"2024-09-12T00:50:50.916508+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:50:50.916508+0000","last_undegraded":"2024-09-12T00:50:50.916508+0000","last_fullsized":"2024-09-12T00:50:50.916508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:00.241439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'10","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.911762+0000","last_change":"2024-09-12T00:28:14.040584+0000","last_active":"2024-09-12T00:50:45.911762+0000","last_peered":"2024-09-12T00:50:45.911762+0000","last_clean":"2024-09-12T00:50:45.911762+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:50:45.911762+0000","last_undegraded":"2024-09-12T00:50:45.911762+0000","last_fullsized":"2024-09-12T00:50:45.911762+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:08.411307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":10242,"num_write":15,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.946780+0000","last_change":"2024-09-12T00:26:48.585190+0000","last_active":"2024-09-12T00:51:35.946780+0000","last_peered":"2024-09-12T00:51:35.946780+0000","last_clean":"2024-09-12T00:51:35.946780+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:51:35.946780+0000","last_undegraded":"2024-09-12T00:51:35.946780+0000","last_fullsized":"2024-09-12T00:51:35.946780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:29.090617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.928152+0000","last_change":"2024-09-12T00:39:28.136382+0000","last_active":"2024-09-12T00:50:20.928152+0000","last_peered":"2024-09-12T00:50:20.928152+0000","last_clean":"2024-09-12T00:50:20.928152+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:50:20.928152+0000","last_undegraded":"2024-09-12T00:50:20.928152+0000","last_fullsized":"2024-09-12T00:50:20.928152+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.917696+0000","last_change":"2024-09-12T00:28:17.077942+0000","last_active":"2024-09-12T00:50:55.917696+0000","last_peered":"2024-09-12T00:50:55.917696+0000","last_clean":"2024-09-12T00:50:55.917696+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:50:55.917696+0000","last_undegraded":"2024-09-12T00:50:55.917696+0000","last_fullsized":"2024-09-12T00:50:55.917696+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:31.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'4","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915561+0000","last_change":"2024-09-12T00:28:14.053908+0000","last_active":"2024-09-12T00:50:45.915561+0000","last_peered":"2024-09-12T00:50:45.915561+0000","last_clean":"2024-09-12T00:50:45.915561+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:50:45.915561+0000","last_undegraded":"2024-09-12T00:50:45.915561+0000","last_fullsized":"2024-09-12T00:50:45.915561+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:56.421414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":9,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104215+0000","last_change":"2024-09-12T00:26:48.567108+0000","last_active":"2024-09-12T00:51:36.104215+0000","last_peered":"2024-09-12T00:51:36.104215+0000","last_clean":"2024-09-12T00:51:36.104215+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:51:36.104215+0000","last_undegraded":"2024-09-12T00:51:36.104215+0000","last_fullsized":"2024-09-12T00:51:36.104215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:04.721131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:21.085319+0000","last_change":"2024-09-12T00:39:28.116516+0000","last_active":"2024-09-12T00:50:21.085319+0000","last_peered":"2024-09-12T00:50:21.085319+0000","last_clean":"2024-09-12T00:50:21.085319+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:50:21.085319+0000","last_undegraded":"2024-09-12T00:50:21.085319+0000","last_fullsized":"2024-09-12T00:50:21.085319+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:59.615039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:49.922385+0000","last_change":"2024-09-12T00:28:17.060880+0000","last_active":"2024-09-12T00:50:49.922385+0000","last_peered":"2024-09-12T00:50:49.922385+0000","last_clean":"2024-09-12T00:50:49.922385+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:50:49.922385+0000","last_undegraded":"2024-09-12T00:50:49.922385+0000","last_fullsized":"2024-09-12T00:50:49.922385+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:02.004120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'5","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916667+0000","last_change":"2024-09-12T00:28:14.053133+0000","last_active":"2024-09-12T00:50:50.916667+0000","last_peered":"2024-09-12T00:50:50.916667+0000","last_clean":"2024-09-12T00:50:50.916667+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:50:50.916667+0000","last_undegraded":"2024-09-12T00:50:50.916667+0000","last_fullsized":"2024-09-12T00:50:50.916667+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:48.456675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":13312,"num_write":10,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922780+0000","last_change":"2024-09-12T00:26:48.590043+0000","last_active":"2024-09-12T00:51:35.922780+0000","last_peered":"2024-09-12T00:51:35.922780+0000","last_clean":"2024-09-12T00:51:35.922780+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:51:35.922780+0000","last_undegraded":"2024-09-12T00:51:35.922780+0000","last_fullsized":"2024-09-12T00:51:35.922780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.146720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921176+0000","last_change":"2024-09-12T00:39:28.133468+0000","last_active":"2024-09-12T00:50:44.921176+0000","last_peered":"2024-09-12T00:50:44.921176+0000","last_clean":"2024-09-12T00:50:44.921176+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:50:44.921176+0000","last_undegraded":"2024-09-12T00:50:44.921176+0000","last_fullsized":"2024-09-12T00:50:44.921176+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.124886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'1","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955663+0000","last_change":"2024-09-12T00:28:17.078262+0000","last_active":"2024-09-12T00:52:10.955663+0000","last_peered":"2024-09-12T00:52:10.955663+0000","last_clean":"2024-09-12T00:52:10.955663+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:52:10.955663+0000","last_undegraded":"2024-09-12T00:52:10.955663+0000","last_fullsized":"2024-09-12T00:52:10.955663+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:56.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932572+0000","last_change":"2024-09-12T00:28:14.039832+0000","last_active":"2024-09-12T00:52:05.932572+0000","last_peered":"2024-09-12T00:52:05.932572+0000","last_clean":"2024-09-12T00:52:05.932572+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:52:05.932572+0000","last_undegraded":"2024-09-12T00:52:05.932572+0000","last_fullsized":"2024-09-12T00:52:05.932572+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.914782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922721+0000","last_change":"2024-09-12T00:26:48.586236+0000","last_active":"2024-09-12T00:51:35.922721+0000","last_peered":"2024-09-12T00:51:35.922721+0000","last_clean":"2024-09-12T00:51:35.922721+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:51:35.922721+0000","last_undegraded":"2024-09-12T00:51:35.922721+0000","last_fullsized":"2024-09-12T00:51:35.922721+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:36.773801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113170+0000","last_change":"2024-09-12T00:39:28.126995+0000","last_active":"2024-09-12T00:50:51.113170+0000","last_peered":"2024-09-12T00:50:51.113170+0000","last_clean":"2024-09-12T00:50:51.113170+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:50:51.113170+0000","last_undegraded":"2024-09-12T00:50:51.113170+0000","last_fullsized":"2024-09-12T00:50:51.113170+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.631391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:21.158401+0000","last_change":"2024-09-12T00:28:17.067864+0000","last_active":"2024-09-12T00:54:21.158401+0000","last_peered":"2024-09-12T00:54:21.158401+0000","last_clean":"2024-09-12T00:54:21.158401+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:54:21.158401+0000","last_undegraded":"2024-09-12T00:54:21.158401+0000","last_fullsized":"2024-09-12T00:54:21.158401+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.110223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5,"num_read_kb":10240,"num_write":5,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'3","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:04.940068+0000","last_change":"2024-09-12T00:28:14.042940+0000","last_active":"2024-09-12T00:52:04.940068+0000","last_peered":"2024-09-12T00:52:04.940068+0000","last_clean":"2024-09-12T00:52:04.940068+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:52:04.940068+0000","last_undegraded":"2024-09-12T00:52:04.940068+0000","last_fullsized":"2024-09-12T00:52:04.940068+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:51.011440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111675+0000","last_change":"2024-09-12T00:26:48.568729+0000","last_active":"2024-09-12T00:50:46.111675+0000","last_peered":"2024-09-12T00:50:46.111675+0000","last_clean":"2024-09-12T00:50:46.111675+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:50:46.111675+0000","last_undegraded":"2024-09-12T00:50:46.111675+0000","last_fullsized":"2024-09-12T00:50:46.111675+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:40.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917549+0000","last_change":"2024-09-12T00:39:28.130189+0000","last_active":"2024-09-12T00:50:45.917549+0000","last_peered":"2024-09-12T00:50:45.917549+0000","last_clean":"2024-09-12T00:50:45.917549+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:50:45.917549+0000","last_undegraded":"2024-09-12T00:50:45.917549+0000","last_fullsized":"2024-09-12T00:50:45.917549+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.938677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912817+0000","last_change":"2024-09-12T00:28:17.080617+0000","last_active":"2024-09-12T00:50:50.912817+0000","last_peered":"2024-09-12T00:50:50.912817+0000","last_clean":"2024-09-12T00:50:50.912817+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:50:50.912817+0000","last_undegraded":"2024-09-12T00:50:50.912817+0000","last_fullsized":"2024-09-12T00:50:50.912817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.933670+0000","last_change":"2024-09-12T00:28:14.047276+0000","last_active":"2024-09-12T00:52:10.933670+0000","last_peered":"2024-09-12T00:52:10.933670+0000","last_clean":"2024-09-12T00:52:10.933670+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:52:10.933670+0000","last_undegraded":"2024-09-12T00:52:10.933670+0000","last_fullsized":"2024-09-12T00:52:10.933670+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:28.302616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:39.919900+0000","last_change":"2024-09-12T00:26:48.570384+0000","last_active":"2024-09-12T00:50:39.919900+0000","last_peered":"2024-09-12T00:50:39.919900+0000","last_clean":"2024-09-12T00:50:39.919900+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:50:39.919900+0000","last_undegraded":"2024-09-12T00:50:39.919900+0000","last_fullsized":"2024-09-12T00:50:39.919900+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.851801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915515+0000","last_change":"2024-09-12T00:39:28.139264+0000","last_active":"2024-09-12T00:50:45.915515+0000","last_peered":"2024-09-12T00:50:45.915515+0000","last_clean":"2024-09-12T00:50:45.915515+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:50:45.915515+0000","last_undegraded":"2024-09-12T00:50:45.915515+0000","last_fullsized":"2024-09-12T00:50:45.915515+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:33.394535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'2","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:15.937612+0000","last_change":"2024-09-12T00:28:17.064501+0000","last_active":"2024-09-12T00:52:15.937612+0000","last_peered":"2024-09-12T00:52:15.937612+0000","last_clean":"2024-09-12T00:52:15.937612+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:52:15.937612+0000","last_undegraded":"2024-09-12T00:52:15.937612+0000","last_fullsized":"2024-09-12T00:52:15.937612+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:53.028265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5242880,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":5120,"num_write":2,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934413+0000","last_change":"2024-09-12T00:28:14.045720+0000","last_active":"2024-09-12T00:50:45.934413+0000","last_peered":"2024-09-12T00:50:45.934413+0000","last_clean":"2024-09-12T00:50:45.934413+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:50:45.934413+0000","last_undegraded":"2024-09-12T00:50:45.934413+0000","last_fullsized":"2024-09-12T00:50:45.934413+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.935181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1024,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.916225+0000","last_change":"2024-09-12T00:26:48.572885+0000","last_active":"2024-09-12T00:50:40.916225+0000","last_peered":"2024-09-12T00:50:40.916225+0000","last_clean":"2024-09-12T00:50:40.916225+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:50:40.916225+0000","last_undegraded":"2024-09-12T00:50:40.916225+0000","last_fullsized":"2024-09-12T00:50:40.916225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:04.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934275+0000","last_change":"2024-09-12T00:39:28.125866+0000","last_active":"2024-09-12T00:52:00.934275+0000","last_peered":"2024-09-12T00:52:00.934275+0000","last_clean":"2024-09-12T00:52:00.934275+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:52:00.934275+0000","last_undegraded":"2024-09-12T00:52:00.934275+0000","last_fullsized":"2024-09-12T00:52:00.934275+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.504703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:19.929554+0000","last_change":"2024-09-12T00:28:17.054632+0000","last_active":"2024-09-12T00:51:19.929554+0000","last_peered":"2024-09-12T00:51:19.929554+0000","last_clean":"2024-09-12T00:51:19.929554+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:51:19.929554+0000","last_undegraded":"2024-09-12T00:51:19.929554+0000","last_fullsized":"2024-09-12T00:51:19.929554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:40.665178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'6","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940366+0000","last_change":"2024-09-12T00:28:14.035922+0000","last_active":"2024-09-12T00:51:10.940366+0000","last_peered":"2024-09-12T00:51:10.940366+0000","last_clean":"2024-09-12T00:51:10.940366+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:51:10.940366+0000","last_undegraded":"2024-09-12T00:51:10.940366+0000","last_fullsized":"2024-09-12T00:51:10.940366+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:49.298722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":11,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.959193+0000","last_change":"2024-09-12T00:26:48.586797+0000","last_active":"2024-09-12T00:51:16.959193+0000","last_peered":"2024-09-12T00:51:16.959193+0000","last_clean":"2024-09-12T00:51:16.959193+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:51:16.959193+0000","last_undegraded":"2024-09-12T00:51:16.959193+0000","last_fullsized":"2024-09-12T00:51:16.959193+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.109038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934301+0000","last_change":"2024-09-12T00:39:28.120562+0000","last_active":"2024-09-12T00:52:00.934301+0000","last_peered":"2024-09-12T00:52:00.934301+0000","last_clean":"2024-09-12T00:52:00.934301+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:52:00.934301+0000","last_undegraded":"2024-09-12T00:52:00.934301+0000","last_fullsized":"2024-09-12T00:52:00.934301+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.131360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928367+0000","last_change":"2024-09-12T00:28:17.068535+0000","last_active":"2024-09-12T00:51:14.928367+0000","last_peered":"2024-09-12T00:51:14.928367+0000","last_clean":"2024-09-12T00:51:14.928367+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:51:14.928367+0000","last_undegraded":"2024-09-12T00:51:14.928367+0000","last_fullsized":"2024-09-12T00:51:14.928367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.915337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'1","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923221+0000","last_change":"2024-09-12T00:28:14.046616+0000","last_active":"2024-09-12T00:51:15.923221+0000","last_peered":"2024-09-12T00:51:15.923221+0000","last_clean":"2024-09-12T00:51:15.923221+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:51:15.923221+0000","last_undegraded":"2024-09-12T00:51:15.923221+0000","last_fullsized":"2024-09-12T00:51:15.923221+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.933281+0000","last_change":"2024-09-12T00:26:48.580888+0000","last_active":"2024-09-12T00:50:40.933281+0000","last_peered":"2024-09-12T00:50:40.933281+0000","last_clean":"2024-09-12T00:50:40.933281+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:50:40.933281+0000","last_undegraded":"2024-09-12T00:50:40.933281+0000","last_fullsized":"2024-09-12T00:50:40.933281+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:20.695674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.932994+0000","last_change":"2024-09-12T00:39:28.111443+0000","last_active":"2024-09-12T00:51:34.932994+0000","last_peered":"2024-09-12T00:51:34.932994+0000","last_clean":"2024-09-12T00:51:34.932994+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:51:34.932994+0000","last_undegraded":"2024-09-12T00:51:34.932994+0000","last_fullsized":"2024-09-12T00:51:34.932994+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:45.919919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'9","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.936631+0000","last_change":"2024-09-12T00:28:17.064371+0000","last_active":"2024-09-12T00:52:10.936631+0000","last_peered":"2024-09-12T00:52:10.936631+0000","last_clean":"2024-09-12T00:52:10.936631+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:52:10.936631+0000","last_undegraded":"2024-09-12T00:52:10.936631+0000","last_fullsized":"2024-09-12T00:52:10.936631+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:33.177694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437184,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":12,"num_read_kb":28674,"num_write":19,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:06.130194+0000","last_change":"2024-09-12T00:28:14.038263+0000","last_active":"2024-09-12T00:52:06.130194+0000","last_peered":"2024-09-12T00:52:06.130194+0000","last_clean":"2024-09-12T00:52:06.130194+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:52:06.130194+0000","last_undegraded":"2024-09-12T00:52:06.130194+0000","last_fullsized":"2024-09-12T00:52:06.130194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:11.087385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.931038+0000","last_change":"2024-09-12T00:26:48.578925+0000","last_active":"2024-09-12T00:51:56.931038+0000","last_peered":"2024-09-12T00:51:56.931038+0000","last_clean":"2024-09-12T00:51:56.931038+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:51:56.931038+0000","last_undegraded":"2024-09-12T00:51:56.931038+0000","last_fullsized":"2024-09-12T00:51:56.931038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:28.812698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.952894+0000","last_change":"2024-09-12T00:39:28.134519+0000","last_active":"2024-09-12T00:52:00.952894+0000","last_peered":"2024-09-12T00:52:00.952894+0000","last_clean":"2024-09-12T00:52:00.952894+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:52:00.952894+0000","last_undegraded":"2024-09-12T00:52:00.952894+0000","last_fullsized":"2024-09-12T00:52:00.952894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.950649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955943+0000","last_change":"2024-09-12T00:28:17.073665+0000","last_active":"2024-09-12T00:52:10.955943+0000","last_peered":"2024-09-12T00:52:10.955943+0000","last_clean":"2024-09-12T00:52:10.955943+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:52:10.955943+0000","last_undegraded":"2024-09-12T00:52:10.955943+0000","last_fullsized":"2024-09-12T00:52:10.955943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.110456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954576+0000","last_change":"2024-09-12T00:28:14.044717+0000","last_active":"2024-09-12T00:52:05.954576+0000","last_peered":"2024-09-12T00:52:05.954576+0000","last_clean":"2024-09-12T00:52:05.954576+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:52:05.954576+0000","last_undegraded":"2024-09-12T00:52:05.954576+0000","last_fullsized":"2024-09-12T00:52:05.954576+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:17.236547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":15360,"num_write":5,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.929500+0000","last_change":"2024-09-12T00:26:48.578631+0000","last_active":"2024-09-12T00:51:50.929500+0000","last_peered":"2024-09-12T00:51:50.929500+0000","last_clean":"2024-09-12T00:51:50.929500+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:51:50.929500+0000","last_undegraded":"2024-09-12T00:51:50.929500+0000","last_fullsized":"2024-09-12T00:51:50.929500+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.001351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910185+0000","last_change":"2024-09-12T00:39:28.145050+0000","last_active":"2024-09-12T00:50:20.910185+0000","last_peered":"2024-09-12T00:50:20.910185+0000","last_clean":"2024-09-12T00:50:20.910185+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:50:20.910185+0000","last_undegraded":"2024-09-12T00:50:20.910185+0000","last_fullsized":"2024-09-12T00:50:20.910185+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:20.809036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923080+0000","last_change":"2024-09-12T00:28:17.061641+0000","last_active":"2024-09-12T00:51:15.923080+0000","last_peered":"2024-09-12T00:51:15.923080+0000","last_clean":"2024-09-12T00:51:15.923080+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:51:15.923080+0000","last_undegraded":"2024-09-12T00:51:15.923080+0000","last_fullsized":"2024-09-12T00:51:15.923080+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:36.317632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":12290,"num_write":5,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'1","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:21.133487+0000","last_change":"2024-09-12T00:28:14.038655+0000","last_active":"2024-09-12T00:52:21.133487+0000","last_peered":"2024-09-12T00:52:21.133487+0000","last_clean":"2024-09-12T00:52:21.133487+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:52:21.133487+0000","last_undegraded":"2024-09-12T00:52:21.133487+0000","last_fullsized":"2024-09-12T00:52:21.133487+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:19.550915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1048576,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2048,"num_write":1,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126487+0000","last_change":"2024-09-12T00:26:48.570084+0000","last_active":"2024-09-12T00:51:51.126487+0000","last_peered":"2024-09-12T00:51:51.126487+0000","last_clean":"2024-09-12T00:51:51.126487+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:51:51.126487+0000","last_undegraded":"2024-09-12T00:51:51.126487+0000","last_fullsized":"2024-09-12T00:51:51.126487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.533768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910538+0000","last_change":"2024-09-12T00:39:28.134280+0000","last_active":"2024-09-12T00:50:20.910538+0000","last_peered":"2024-09-12T00:50:20.910538+0000","last_clean":"2024-09-12T00:50:20.910538+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:50:20.910538+0000","last_undegraded":"2024-09-12T00:50:20.910538+0000","last_fullsized":"2024-09-12T00:50:20.910538+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.467826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'6","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:25.959578+0000","last_change":"2024-09-12T00:28:17.078304+0000","last_active":"2024-09-12T00:52:25.959578+0000","last_peered":"2024-09-12T00:52:25.959578+0000","last_clean":"2024-09-12T00:52:25.959578+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:52:25.959578+0000","last_undegraded":"2024-09-12T00:52:25.959578+0000","last_fullsized":"2024-09-12T00:52:25.959578+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.775329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":20482,"num_write":11,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'3","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940141+0000","last_change":"2024-09-12T00:28:14.051795+0000","last_active":"2024-09-12T00:51:10.940141+0000","last_peered":"2024-09-12T00:51:10.940141+0000","last_clean":"2024-09-12T00:51:10.940141+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:51:10.940141+0000","last_undegraded":"2024-09-12T00:51:10.940141+0000","last_fullsized":"2024-09-12T00:51:10.940141+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":8192,"num_write":3,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950431+0000","last_change":"2024-09-12T00:26:48.572457+0000","last_active":"2024-09-12T00:51:50.950431+0000","last_peered":"2024-09-12T00:51:50.950431+0000","last_clean":"2024-09-12T00:51:50.950431+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:51:50.950431+0000","last_undegraded":"2024-09-12T00:51:50.950431+0000","last_fullsized":"2024-09-12T00:51:50.950431+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:54.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.938985+0000","last_change":"2024-09-12T00:39:28.125155+0000","last_active":"2024-09-12T00:51:59.938985+0000","last_peered":"2024-09-12T00:51:59.938985+0000","last_clean":"2024-09-12T00:51:59.938985+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:51:59.938985+0000","last_undegraded":"2024-09-12T00:51:59.938985+0000","last_fullsized":"2024-09-12T00:51:59.938985+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:43.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'1","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.118652+0000","last_change":"2024-09-12T00:28:17.074251+0000","last_active":"2024-09-12T00:51:16.118652+0000","last_peered":"2024-09-12T00:51:16.118652+0000","last_clean":"2024-09-12T00:51:16.118652+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:51:16.118652+0000","last_undegraded":"2024-09-12T00:51:16.118652+0000","last_fullsized":"2024-09-12T00:51:16.118652+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:25.385818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":4096,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'18","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917089+0000","last_change":"2024-09-12T00:28:14.035208+0000","last_active":"2024-09-12T00:51:10.917089+0000","last_peered":"2024-09-12T00:51:10.917089+0000","last_clean":"2024-09-12T00:51:10.917089+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:51:10.917089+0000","last_undegraded":"2024-09-12T00:51:10.917089+0000","last_fullsized":"2024-09-12T00:51:10.917089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.116394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":30726,"num_write":23,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950319+0000","last_change":"2024-09-12T00:26:48.568293+0000","last_active":"2024-09-12T00:51:50.950319+0000","last_peered":"2024-09-12T00:51:50.950319+0000","last_clean":"2024-09-12T00:51:50.950319+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:51:50.950319+0000","last_undegraded":"2024-09-12T00:51:50.950319+0000","last_fullsized":"2024-09-12T00:51:50.950319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:56.992825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954372+0000","last_change":"2024-09-12T00:39:28.135750+0000","last_active":"2024-09-12T00:52:05.954372+0000","last_peered":"2024-09-12T00:52:05.954372+0000","last_clean":"2024-09-12T00:52:05.954372+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:52:05.954372+0000","last_undegraded":"2024-09-12T00:52:05.954372+0000","last_fullsized":"2024-09-12T00:52:05.954372+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.659110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'3","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.118588+0000","last_change":"2024-09-12T00:28:17.067509+0000","last_active":"2024-09-12T00:51:16.118588+0000","last_peered":"2024-09-12T00:51:16.118588+0000","last_clean":"2024-09-12T00:51:16.118588+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:51:16.118588+0000","last_undegraded":"2024-09-12T00:51:16.118588+0000","last_fullsized":"2024-09-12T00:51:16.118588+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:22.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4096,"num_write":8,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'4","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096562+0000","last_change":"2024-09-12T00:28:14.047213+0000","last_active":"2024-09-12T00:51:11.096562+0000","last_peered":"2024-09-12T00:51:11.096562+0000","last_clean":"2024-09-12T00:51:11.096562+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:51:11.096562+0000","last_undegraded":"2024-09-12T00:51:11.096562+0000","last_fullsized":"2024-09-12T00:51:11.096562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:39.487908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40145,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4,"num_read_kb":4136,"num_write":9,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:56.114009+0000","last_change":"2024-09-12T00:26:48.572978+0000","last_active":"2024-09-12T00:50:56.114009+0000","last_peered":"2024-09-12T00:50:56.114009+0000","last_clean":"2024-09-12T00:50:56.114009+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:50:56.114009+0000","last_undegraded":"2024-09-12T00:50:56.114009+0000","last_fullsized":"2024-09-12T00:50:56.114009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'258","reported_seq":902,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.538178+0000","last_change":"2024-09-12T00:11:45.934895+0000","last_active":"2024-09-12T00:51:51.538178+0000","last_peered":"2024-09-12T00:51:51.538178+0000","last_clean":"2024-09-12T00:51:51.538178+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:51:51.538178+0000","last_undegraded":"2024-09-12T00:51:51.538178+0000","last_fullsized":"2024-09-12T00:51:51.538178+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":200,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:30.942936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4225013,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":615,"num_read_kb":2922,"num_write":1051,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1205","reported_seq":2896,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.210228+0000","last_change":"2024-09-12T00:11:47.923845+0000","last_active":"2024-09-12T00:54:17.210228+0000","last_peered":"2024-09-12T00:54:17.210228+0000","last_clean":"2024-09-12T00:54:17.210228+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:17.210228+0000","last_undegraded":"2024-09-12T00:54:17.210228+0000","last_fullsized":"2024-09-12T00:54:17.210228+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:37.116342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'222","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.218128+0000","last_change":"2024-09-12T00:11:45.957898+0000","last_active":"2024-09-12T00:52:57.218128+0000","last_peered":"2024-09-12T00:52:57.218128+0000","last_clean":"2024-09-12T00:52:57.218128+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:52:57.218128+0000","last_undegraded":"2024-09-12T00:52:57.218128+0000","last_fullsized":"2024-09-12T00:52:57.218128+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:15.924735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":446871,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":450,"num_read_kb":8607,"num_write":1037,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'455","reported_seq":2037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.541162+0000","last_change":"2024-09-12T00:11:47.930458+0000","last_active":"2024-09-12T00:52:57.541162+0000","last_peered":"2024-09-12T00:52:57.541162+0000","last_clean":"2024-09-12T00:52:57.541162+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:52:57.541162+0000","last_undegraded":"2024-09-12T00:52:57.541162+0000","last_fullsized":"2024-09-12T00:52:57.541162+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.070919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'195","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.508381+0000","last_change":"2024-09-12T00:11:45.962948+0000","last_active":"2024-09-12T00:52:32.508381+0000","last_peered":"2024-09-12T00:52:32.508381+0000","last_clean":"2024-09-12T00:52:32.508381+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:52:32.508381+0000","last_undegraded":"2024-09-12T00:52:32.508381+0000","last_fullsized":"2024-09-12T00:52:32.508381+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":100,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.772276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1372314,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":404,"num_read_kb":9697,"num_write":932,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'469","reported_seq":2018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.750311+0000","last_change":"2024-09-12T00:11:47.929458+0000","last_active":"2024-09-12T00:53:13.750311+0000","last_peered":"2024-09-12T00:53:13.750311+0000","last_clean":"2024-09-12T00:53:13.750311+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:53:13.750311+0000","last_undegraded":"2024-09-12T00:53:13.750311+0000","last_fullsized":"2024-09-12T00:53:13.750311+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:37.545862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'170","reported_seq":792,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.732405+0000","last_change":"2024-09-12T00:11:45.918049+0000","last_active":"2024-09-12T00:52:00.732405+0000","last_peered":"2024-09-12T00:52:00.732405+0000","last_clean":"2024-09-12T00:52:00.732405+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:52:00.732405+0000","last_undegraded":"2024-09-12T00:52:00.732405+0000","last_fullsized":"2024-09-12T00:52:00.732405+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:52.132957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5820542,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":420,"num_read_kb":16186,"num_write":897,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'822","reported_seq":2408,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.959350+0000","last_change":"2024-09-12T00:11:47.934714+0000","last_active":"2024-09-12T00:52:56.959350+0000","last_peered":"2024-09-12T00:52:56.959350+0000","last_clean":"2024-09-12T00:52:56.959350+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:52:56.959350+0000","last_undegraded":"2024-09-12T00:52:56.959350+0000","last_fullsized":"2024-09-12T00:52:56.959350+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'188","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.366493+0000","last_change":"2024-09-12T00:11:45.949664+0000","last_active":"2024-09-12T00:52:49.366493+0000","last_peered":"2024-09-12T00:52:49.366493+0000","last_clean":"2024-09-12T00:52:49.366493+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:52:49.366493+0000","last_undegraded":"2024-09-12T00:52:49.366493+0000","last_fullsized":"2024-09-12T00:52:49.366493+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:02.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1645466,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":463,"num_read_kb":16314,"num_write":908,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'799","reported_seq":2283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.596547+0000","last_change":"2024-09-12T00:11:47.930048+0000","last_active":"2024-09-12T00:52:55.596547+0000","last_peered":"2024-09-12T00:52:55.596547+0000","last_clean":"2024-09-12T00:52:55.596547+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:52:55.596547+0000","last_undegraded":"2024-09-12T00:52:55.596547+0000","last_fullsized":"2024-09-12T00:52:55.596547+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.783185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'174","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.157353+0000","last_change":"2024-09-12T00:11:45.916383+0000","last_active":"2024-09-12T00:54:16.157353+0000","last_peered":"2024-09-12T00:54:16.157353+0000","last_clean":"2024-09-12T00:54:16.157353+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:16.157353+0000","last_undegraded":"2024-09-12T00:54:16.157353+0000","last_fullsized":"2024-09-12T00:54:16.157353+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.552714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4239606,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":30215,"num_write":843,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'391","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.368436+0000","last_change":"2024-09-12T00:11:47.942397+0000","last_active":"2024-09-12T00:53:14.368436+0000","last_peered":"2024-09-12T00:53:14.368436+0000","last_clean":"2024-09-12T00:53:14.368436+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:53:14.368436+0000","last_undegraded":"2024-09-12T00:53:14.368436+0000","last_fullsized":"2024-09-12T00:53:14.368436+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:36.328976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'223","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.416294+0000","last_change":"2024-09-12T00:11:45.935583+0000","last_active":"2024-09-12T00:53:11.416294+0000","last_peered":"2024-09-12T00:53:11.416294+0000","last_clean":"2024-09-12T00:53:11.416294+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:53:11.416294+0000","last_undegraded":"2024-09-12T00:53:11.416294+0000","last_fullsized":"2024-09-12T00:53:11.416294+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.329848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10185441,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":409,"num_read_kb":17813,"num_write":1026,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'990","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.505994+0000","last_change":"2024-09-12T00:11:47.923621+0000","last_active":"2024-09-12T00:53:10.505994+0000","last_peered":"2024-09-12T00:53:10.505994+0000","last_clean":"2024-09-12T00:53:10.505994+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:53:10.505994+0000","last_undegraded":"2024-09-12T00:53:10.505994+0000","last_fullsized":"2024-09-12T00:53:10.505994+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":900,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:15.959935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'178","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.174408+0000","last_change":"2024-09-12T00:12:19.246741+0000","last_active":"2024-09-12T00:52:38.174408+0000","last_peered":"2024-09-12T00:52:38.174408+0000","last_clean":"2024-09-12T00:52:38.174408+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:52:38.174408+0000","last_undegraded":"2024-09-12T00:52:38.174408+0000","last_fullsized":"2024-09-12T00:52:38.174408+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":100,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.798814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8656926,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":347,"num_read_kb":20841,"num_write":797,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2401,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749106+0000","last_change":"2024-09-12T00:11:47.945525+0000","last_active":"2024-09-12T00:53:13.749106+0000","last_peered":"2024-09-12T00:53:13.749106+0000","last_clean":"2024-09-12T00:53:13.749106+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:53:13.749106+0000","last_undegraded":"2024-09-12T00:53:13.749106+0000","last_fullsized":"2024-09-12T00:53:13.749106+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:16.688767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'810","reported_seq":2356,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.198693+0000","last_change":"2024-09-12T00:11:47.933883+0000","last_active":"2024-09-12T00:54:17.198693+0000","last_peered":"2024-09-12T00:54:17.198693+0000","last_clean":"2024-09-12T00:54:17.198693+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:17.198693+0000","last_undegraded":"2024-09-12T00:54:17.198693+0000","last_fullsized":"2024-09-12T00:54:17.198693+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.403220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'274","reported_seq":998,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.850453+0000","last_change":"2024-09-12T00:11:45.960039+0000","last_active":"2024-09-12T00:52:55.850453+0000","last_peered":"2024-09-12T00:52:55.850453+0000","last_clean":"2024-09-12T00:52:55.850453+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:52:55.850453+0000","last_undegraded":"2024-09-12T00:52:55.850453+0000","last_fullsized":"2024-09-12T00:52:55.850453+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:20.482316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2536787,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":924,"num_read_kb":25081,"num_write":1223,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2586,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199630+0000","last_change":"2024-09-12T00:11:47.935606+0000","last_active":"2024-09-12T00:54:17.199630+0000","last_peered":"2024-09-12T00:54:17.199630+0000","last_clean":"2024-09-12T00:54:17.199630+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:17.199630+0000","last_undegraded":"2024-09-12T00:54:17.199630+0000","last_fullsized":"2024-09-12T00:54:17.199630+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:09.287342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'181","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.336408+0000","last_change":"2024-09-12T00:11:45.920735+0000","last_active":"2024-09-12T00:54:16.336408+0000","last_peered":"2024-09-12T00:54:16.336408+0000","last_clean":"2024-09-12T00:54:16.336408+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:16.336408+0000","last_undegraded":"2024-09-12T00:54:16.336408+0000","last_fullsized":"2024-09-12T00:54:16.336408+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:08.846428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22688,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":439,"num_read_kb":23009,"num_write":866,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'439","reported_seq":2004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.211419+0000","last_change":"2024-09-12T00:11:47.940868+0000","last_active":"2024-09-12T00:54:17.211419+0000","last_peered":"2024-09-12T00:54:17.211419+0000","last_clean":"2024-09-12T00:54:17.211419+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:17.211419+0000","last_undegraded":"2024-09-12T00:54:17.211419+0000","last_fullsized":"2024-09-12T00:54:17.211419+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:23.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'189","reported_seq":811,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:48.027510+0000","last_change":"2024-09-12T00:11:45.925804+0000","last_active":"2024-09-12T00:52:48.027510+0000","last_peered":"2024-09-12T00:52:48.027510+0000","last_clean":"2024-09-12T00:52:48.027510+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:52:48.027510+0000","last_undegraded":"2024-09-12T00:52:48.027510+0000","last_fullsized":"2024-09-12T00:52:48.027510+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:55.107812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2778905,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":464,"num_read_kb":15824,"num_write":916,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'552","reported_seq":2152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.505098+0000","last_change":"2024-09-12T00:11:47.949066+0000","last_active":"2024-09-12T00:53:01.505098+0000","last_peered":"2024-09-12T00:53:01.505098+0000","last_clean":"2024-09-12T00:53:01.505098+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:53:01.505098+0000","last_undegraded":"2024-09-12T00:53:01.505098+0000","last_fullsized":"2024-09-12T00:53:01.505098+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'209","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:02.043040+0000","last_change":"2024-09-12T00:11:45.937137+0000","last_active":"2024-09-12T00:53:02.043040+0000","last_peered":"2024-09-12T00:53:02.043040+0000","last_clean":"2024-09-12T00:53:02.043040+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:53:02.043040+0000","last_undegraded":"2024-09-12T00:53:02.043040+0000","last_fullsized":"2024-09-12T00:53:02.043040+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:36.986793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":974316,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":456,"num_read_kb":26404,"num_write":989,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'628","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.967393+0000","last_change":"2024-09-12T00:11:47.924685+0000","last_active":"2024-09-12T00:53:01.967393+0000","last_peered":"2024-09-12T00:53:01.967393+0000","last_clean":"2024-09-12T00:53:01.967393+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:53:01.967393+0000","last_undegraded":"2024-09-12T00:53:01.967393+0000","last_fullsized":"2024-09-12T00:53:01.967393+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:06.368642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'182","reported_seq":804,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.242410+0000","last_change":"2024-09-12T00:11:45.950496+0000","last_active":"2024-09-12T00:53:11.242410+0000","last_peered":"2024-09-12T00:53:11.242410+0000","last_clean":"2024-09-12T00:53:11.242410+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:53:11.242410+0000","last_undegraded":"2024-09-12T00:53:11.242410+0000","last_fullsized":"2024-09-12T00:53:11.242410+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:36.187975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18534561,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":391,"num_read_kb":19556,"num_write":887,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1215","reported_seq":2911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.201094+0000","last_change":"2024-09-12T00:11:47.925124+0000","last_active":"2024-09-12T00:54:17.201094+0000","last_peered":"2024-09-12T00:54:17.201094+0000","last_clean":"2024-09-12T00:54:17.201094+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:17.201094+0000","last_undegraded":"2024-09-12T00:54:17.201094+0000","last_fullsized":"2024-09-12T00:54:17.201094+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:30.824531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'203","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.659905+0000","last_change":"2024-09-12T00:11:45.938512+0000","last_active":"2024-09-12T00:54:07.659905+0000","last_peered":"2024-09-12T00:54:07.659905+0000","last_clean":"2024-09-12T00:54:07.659905+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:07.659905+0000","last_undegraded":"2024-09-12T00:54:07.659905+0000","last_fullsized":"2024-09-12T00:54:07.659905+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:43.280807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9437213,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":569,"num_read_kb":13603,"num_write":996,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'158","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.440855+0000","last_change":"2024-09-12T00:11:55.962848+0000","last_active":"2024-09-12T00:53:14.440855+0000","last_peered":"2024-09-12T00:53:14.440855+0000","last_clean":"2024-09-12T00:53:14.440855+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:53:14.440855+0000","last_undegraded":"2024-09-12T00:53:14.440855+0000","last_fullsized":"2024-09-12T00:53:14.440855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:04.549126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'428","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.365744+0000","last_change":"2024-09-12T00:11:47.957238+0000","last_active":"2024-09-12T00:53:14.365744+0000","last_peered":"2024-09-12T00:53:14.365744+0000","last_clean":"2024-09-12T00:53:14.365744+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:53:14.365744+0000","last_undegraded":"2024-09-12T00:53:14.365744+0000","last_fullsized":"2024-09-12T00:53:14.365744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:35.988751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'193","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:13.592676+0000","last_change":"2024-09-12T00:12:19.243333+0000","last_active":"2024-09-12T00:52:13.592676+0000","last_peered":"2024-09-12T00:52:13.592676+0000","last_clean":"2024-09-12T00:52:13.592676+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:52:13.592676+0000","last_undegraded":"2024-09-12T00:52:13.592676+0000","last_fullsized":"2024-09-12T00:52:13.592676+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:21.362685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":291438,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":555,"num_read_kb":1948,"num_write":1007,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930718+0000","last_change":"2024-09-12T00:11:49.940927+0000","last_active":"2024-09-12T00:50:30.930718+0000","last_peered":"2024-09-12T00:50:30.930718+0000","last_clean":"2024-09-12T00:50:30.930718+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:50:30.930718+0000","last_undegraded":"2024-09-12T00:50:30.930718+0000","last_fullsized":"2024-09-12T00:50:30.930718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:54.486050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'196","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.946114+0000","last_change":"2024-09-12T00:11:51.947651+0000","last_active":"2024-09-12T00:53:00.946114+0000","last_peered":"2024-09-12T00:53:00.946114+0000","last_clean":"2024-09-12T00:53:00.946114+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:53:00.946114+0000","last_undegraded":"2024-09-12T00:53:00.946114+0000","last_fullsized":"2024-09-12T00:53:00.946114+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:29.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11858,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":263,"num_read_kb":317,"num_write":156,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089124+0000","last_change":"2024-09-12T00:11:53.948633+0000","last_active":"2024-09-12T00:50:36.089124+0000","last_peered":"2024-09-12T00:50:36.089124+0000","last_clean":"2024-09-12T00:50:36.089124+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:50:36.089124+0000","last_undegraded":"2024-09-12T00:50:36.089124+0000","last_fullsized":"2024-09-12T00:50:36.089124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:09.362747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2472","reported_seq":4364,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.220805+0000","last_change":"2024-09-12T00:11:55.974612+0000","last_active":"2024-09-12T00:53:59.220805+0000","last_peered":"2024-09-12T00:53:59.220805+0000","last_clean":"2024-09-12T00:53:59.220805+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:53:59.220805+0000","last_undegraded":"2024-09-12T00:53:59.220805+0000","last_fullsized":"2024-09-12T00:53:59.220805+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:50.591689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'463","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.197150+0000","last_change":"2024-09-12T00:11:47.930826+0000","last_active":"2024-09-12T00:54:17.197150+0000","last_peered":"2024-09-12T00:54:17.197150+0000","last_clean":"2024-09-12T00:54:17.197150+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:17.197150+0000","last_undegraded":"2024-09-12T00:54:17.197150+0000","last_fullsized":"2024-09-12T00:54:17.197150+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:30.387857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'239","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.576017+0000","last_change":"2024-09-12T00:11:45.930202+0000","last_active":"2024-09-12T00:53:00.576017+0000","last_peered":"2024-09-12T00:53:00.576017+0000","last_clean":"2024-09-12T00:53:00.576017+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:53:00.576017+0000","last_undegraded":"2024-09-12T00:53:00.576017+0000","last_fullsized":"2024-09-12T00:53:00.576017+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:48.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9488471,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":589,"num_read_kb":71900,"num_write":1163,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.928736+0000","last_change":"2024-09-12T00:11:49.928414+0000","last_active":"2024-09-12T00:51:40.928736+0000","last_peered":"2024-09-12T00:51:40.928736+0000","last_clean":"2024-09-12T00:51:40.928736+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:51:40.928736+0000","last_undegraded":"2024-09-12T00:51:40.928736+0000","last_fullsized":"2024-09-12T00:51:40.928736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.325652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'91","reported_seq":624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.782442+0000","last_change":"2024-09-12T00:11:51.929989+0000","last_active":"2024-09-12T00:52:37.782442+0000","last_peered":"2024-09-12T00:52:37.782442+0000","last_clean":"2024-09-12T00:52:37.782442+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:52:37.782442+0000","last_undegraded":"2024-09-12T00:52:37.782442+0000","last_fullsized":"2024-09-12T00:52:37.782442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:18.143324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089023+0000","last_change":"2024-09-12T00:11:53.948950+0000","last_active":"2024-09-12T00:50:36.089023+0000","last_peered":"2024-09-12T00:50:36.089023+0000","last_clean":"2024-09-12T00:50:36.089023+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:50:36.089023+0000","last_undegraded":"2024-09-12T00:50:36.089023+0000","last_fullsized":"2024-09-12T00:50:36.089023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:44.328086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'155","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.554087+0000","last_change":"2024-09-12T00:11:55.974329+0000","last_active":"2024-09-12T00:52:56.554087+0000","last_peered":"2024-09-12T00:52:56.554087+0000","last_clean":"2024-09-12T00:52:56.554087+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:52:56.554087+0000","last_undegraded":"2024-09-12T00:52:56.554087+0000","last_fullsized":"2024-09-12T00:52:56.554087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:22.758032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'565","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.733246+0000","last_change":"2024-09-12T00:11:47.935137+0000","last_active":"2024-09-12T00:53:13.733246+0000","last_peered":"2024-09-12T00:53:13.733246+0000","last_clean":"2024-09-12T00:53:13.733246+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:53:13.733246+0000","last_undegraded":"2024-09-12T00:53:13.733246+0000","last_fullsized":"2024-09-12T00:53:13.733246+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.622836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'223","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.284615+0000","last_change":"2024-09-12T00:11:45.920772+0000","last_active":"2024-09-12T00:52:00.284615+0000","last_peered":"2024-09-12T00:52:00.284615+0000","last_clean":"2024-09-12T00:52:00.284615+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:52:00.284615+0000","last_undegraded":"2024-09-12T00:52:00.284615+0000","last_fullsized":"2024-09-12T00:52:00.284615+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":200,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:51.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1064999,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":463,"num_read_kb":11763,"num_write":999,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.912975+0000","last_change":"2024-09-12T00:11:49.946026+0000","last_active":"2024-09-12T00:50:30.912975+0000","last_peered":"2024-09-12T00:50:30.912975+0000","last_clean":"2024-09-12T00:50:30.912975+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:50:30.912975+0000","last_undegraded":"2024-09-12T00:50:30.912975+0000","last_fullsized":"2024-09-12T00:50:30.912975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.002432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'128","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:34.133774+0000","last_change":"2024-09-12T00:11:51.952490+0000","last_active":"2024-09-12T00:52:34.133774+0000","last_peered":"2024-09-12T00:52:34.133774+0000","last_clean":"2024-09-12T00:52:34.133774+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:52:34.133774+0000","last_undegraded":"2024-09-12T00:52:34.133774+0000","last_fullsized":"2024-09-12T00:52:34.133774+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:12.676121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'778","reported_seq":2215,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.972496+0000","last_change":"2024-09-12T00:11:53.963903+0000","last_active":"2024-09-12T00:54:30.972496+0000","last_peered":"2024-09-12T00:54:30.972496+0000","last_clean":"2024-09-12T00:54:30.972496+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:54:30.972496+0000","last_undegraded":"2024-09-12T00:54:30.972496+0000","last_fullsized":"2024-09-12T00:54:30.972496+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":78,"log_dups_size":700,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:11.131097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'218","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.508260+0000","last_change":"2024-09-12T00:11:55.967351+0000","last_active":"2024-09-12T00:53:14.508260+0000","last_peered":"2024-09-12T00:53:14.508260+0000","last_clean":"2024-09-12T00:53:14.508260+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:53:14.508260+0000","last_undegraded":"2024-09-12T00:53:14.508260+0000","last_fullsized":"2024-09-12T00:53:14.508260+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:31.864573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'339","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.748057+0000","last_change":"2024-09-12T00:11:47.931389+0000","last_active":"2024-09-12T00:53:13.748057+0000","last_peered":"2024-09-12T00:53:13.748057+0000","last_clean":"2024-09-12T00:53:13.748057+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:53:13.748057+0000","last_undegraded":"2024-09-12T00:53:13.748057+0000","last_fullsized":"2024-09-12T00:53:13.748057+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:39.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'200","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:46.129859+0000","last_change":"2024-09-12T00:11:45.960713+0000","last_active":"2024-09-12T00:53:46.129859+0000","last_peered":"2024-09-12T00:53:46.129859+0000","last_clean":"2024-09-12T00:53:46.129859+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:53:46.129859+0000","last_undegraded":"2024-09-12T00:53:46.129859+0000","last_fullsized":"2024-09-12T00:53:46.129859+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.838856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1075321,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":364,"num_read_kb":5525,"num_write":925,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930757+0000","last_change":"2024-09-12T00:11:49.936925+0000","last_active":"2024-09-12T00:50:30.930757+0000","last_peered":"2024-09-12T00:50:30.930757+0000","last_clean":"2024-09-12T00:50:30.930757+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:50:30.930757+0000","last_undegraded":"2024-09-12T00:50:30.930757+0000","last_fullsized":"2024-09-12T00:50:30.930757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.835956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'118","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.288970+0000","last_change":"2024-09-12T00:11:51.945240+0000","last_active":"2024-09-12T00:54:18.288970+0000","last_peered":"2024-09-12T00:54:18.288970+0000","last_clean":"2024-09-12T00:54:18.288970+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:18.288970+0000","last_undegraded":"2024-09-12T00:54:18.288970+0000","last_fullsized":"2024-09-12T00:54:18.288970+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":100,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:43.775349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4460,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":142,"num_read_kb":135,"num_write":68,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'787","reported_seq":2256,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.373943+0000","last_change":"2024-09-12T00:11:53.966127+0000","last_active":"2024-09-12T00:54:18.373943+0000","last_peered":"2024-09-12T00:54:18.373943+0000","last_clean":"2024-09-12T00:54:18.373943+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:54:18.373943+0000","last_undegraded":"2024-09-12T00:54:18.373943+0000","last_fullsized":"2024-09-12T00:54:18.373943+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":700,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.057133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'538","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.492338+0000","last_change":"2024-09-12T00:11:47.925552+0000","last_active":"2024-09-12T00:53:10.492338+0000","last_peered":"2024-09-12T00:53:10.492338+0000","last_clean":"2024-09-12T00:53:10.492338+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:53:10.492338+0000","last_undegraded":"2024-09-12T00:53:10.492338+0000","last_fullsized":"2024-09-12T00:53:10.492338+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:35.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'239","reported_seq":895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.324905+0000","last_change":"2024-09-12T00:11:45.936612+0000","last_active":"2024-09-12T00:52:53.324905+0000","last_peered":"2024-09-12T00:52:53.324905+0000","last_clean":"2024-09-12T00:52:53.324905+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:52:53.324905+0000","last_undegraded":"2024-09-12T00:52:53.324905+0000","last_fullsized":"2024-09-12T00:52:53.324905+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":200,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:04.380015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13222281,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":589,"num_read_kb":40518,"num_write":1095,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092095+0000","last_change":"2024-09-12T00:11:49.915889+0000","last_active":"2024-09-12T00:50:51.092095+0000","last_peered":"2024-09-12T00:50:51.092095+0000","last_clean":"2024-09-12T00:50:51.092095+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:50:51.092095+0000","last_undegraded":"2024-09-12T00:50:51.092095+0000","last_fullsized":"2024-09-12T00:50:51.092095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:01.391369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'216","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.950080+0000","last_change":"2024-09-12T00:11:51.952724+0000","last_active":"2024-09-12T00:53:15.950080+0000","last_peered":"2024-09-12T00:53:15.950080+0000","last_clean":"2024-09-12T00:53:15.950080+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:53:15.950080+0000","last_undegraded":"2024-09-12T00:53:15.950080+0000","last_fullsized":"2024-09-12T00:53:15.950080+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:30.153282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12559,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":291,"num_read_kb":346,"num_write":174,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.904191+0000","last_change":"2024-09-12T00:11:53.969081+0000","last_active":"2024-09-12T00:50:10.904191+0000","last_peered":"2024-09-12T00:50:10.904191+0000","last_clean":"2024-09-12T00:50:10.904191+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:50:10.904191+0000","last_undegraded":"2024-09-12T00:50:10.904191+0000","last_fullsized":"2024-09-12T00:50:10.904191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:12.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'542","reported_seq":1368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.342188+0000","last_change":"2024-09-12T00:11:55.961717+0000","last_active":"2024-09-12T00:54:18.342188+0000","last_peered":"2024-09-12T00:54:18.342188+0000","last_clean":"2024-09-12T00:54:18.342188+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:54:18.342188+0000","last_undegraded":"2024-09-12T00:54:18.342188+0000","last_fullsized":"2024-09-12T00:54:18.342188+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'843","reported_seq":2486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.493186+0000","last_change":"2024-09-12T00:11:47.924514+0000","last_active":"2024-09-12T00:53:10.493186+0000","last_peered":"2024-09-12T00:53:10.493186+0000","last_clean":"2024-09-12T00:53:10.493186+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:53:10.493186+0000","last_undegraded":"2024-09-12T00:53:10.493186+0000","last_fullsized":"2024-09-12T00:53:10.493186+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:28.061678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'183","reported_seq":993,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.134909+0000","last_change":"2024-09-12T00:11:45.960456+0000","last_active":"2024-09-12T00:54:31.134909+0000","last_peered":"2024-09-12T00:54:31.134909+0000","last_clean":"2024-09-12T00:54:31.134909+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:31.134909+0000","last_undegraded":"2024-09-12T00:54:31.134909+0000","last_fullsized":"2024-09-12T00:54:31.134909+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:26.947144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2527593,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":810,"num_read_kb":32531,"num_write":876,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912730+0000","last_change":"2024-09-12T00:11:49.945091+0000","last_active":"2024-09-12T00:50:50.912730+0000","last_peered":"2024-09-12T00:50:50.912730+0000","last_clean":"2024-09-12T00:50:50.912730+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:50:50.912730+0000","last_undegraded":"2024-09-12T00:50:50.912730+0000","last_fullsized":"2024-09-12T00:50:50.912730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.590584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'125","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.373388+0000","last_change":"2024-09-12T00:11:51.947825+0000","last_active":"2024-09-12T00:53:14.373388+0000","last_peered":"2024-09-12T00:53:14.373388+0000","last_clean":"2024-09-12T00:53:14.373388+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:53:14.373388+0000","last_undegraded":"2024-09-12T00:53:14.373388+0000","last_fullsized":"2024-09-12T00:53:14.373388+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:40.118757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9635,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":160,"num_read_kb":217,"num_write":84,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:05.920875+0000","last_change":"2024-09-12T00:11:53.971538+0000","last_active":"2024-09-12T00:51:05.920875+0000","last_peered":"2024-09-12T00:51:05.920875+0000","last_clean":"2024-09-12T00:51:05.920875+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:51:05.920875+0000","last_undegraded":"2024-09-12T00:51:05.920875+0000","last_fullsized":"2024-09-12T00:51:05.920875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.262175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'143","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:41.129296+0000","last_change":"2024-09-12T00:11:55.983166+0000","last_active":"2024-09-12T00:53:41.129296+0000","last_peered":"2024-09-12T00:53:41.129296+0000","last_clean":"2024-09-12T00:53:41.129296+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:53:41.129296+0000","last_undegraded":"2024-09-12T00:53:41.129296+0000","last_fullsized":"2024-09-12T00:53:41.129296+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.841060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'471","reported_seq":1963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369406+0000","last_change":"2024-09-12T00:11:47.926269+0000","last_active":"2024-09-12T00:53:14.369406+0000","last_peered":"2024-09-12T00:53:14.369406+0000","last_clean":"2024-09-12T00:53:14.369406+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:53:14.369406+0000","last_undegraded":"2024-09-12T00:53:14.369406+0000","last_fullsized":"2024-09-12T00:53:14.369406+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:55.592362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'164","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:15.957076+0000","last_change":"2024-09-12T00:11:45.932385+0000","last_active":"2024-09-12T00:52:15.957076+0000","last_peered":"2024-09-12T00:52:15.957076+0000","last_clean":"2024-09-12T00:52:15.957076+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:52:15.957076+0000","last_undegraded":"2024-09-12T00:52:15.957076+0000","last_fullsized":"2024-09-12T00:52:15.957076+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.293210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13921921,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":351,"num_read_kb":53604,"num_write":793,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:04.911798+0000","last_change":"2024-09-12T00:11:49.936538+0000","last_active":"2024-09-12T00:50:04.911798+0000","last_peered":"2024-09-12T00:50:04.911798+0000","last_clean":"2024-09-12T00:50:04.911798+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:50:04.911798+0000","last_undegraded":"2024-09-12T00:50:04.911798+0000","last_fullsized":"2024-09-12T00:50:04.911798+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'161","reported_seq":752,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:05.968254+0000","last_change":"2024-09-12T00:11:51.935323+0000","last_active":"2024-09-12T00:53:05.968254+0000","last_peered":"2024-09-12T00:53:05.968254+0000","last_clean":"2024-09-12T00:53:05.968254+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:53:05.968254+0000","last_undegraded":"2024-09-12T00:53:05.968254+0000","last_fullsized":"2024-09-12T00:53:05.968254+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.661049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13243,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":216,"num_read_kb":276,"num_write":122,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'786","reported_seq":4494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.376700+0000","last_change":"2024-09-12T00:11:53.965915+0000","last_active":"2024-09-12T00:54:18.376700+0000","last_peered":"2024-09-12T00:54:18.376700+0000","last_clean":"2024-09-12T00:54:18.376700+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:54:18.376700+0000","last_undegraded":"2024-09-12T00:54:18.376700+0000","last_fullsized":"2024-09-12T00:54:18.376700+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.284890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'110","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.118486+0000","last_change":"2024-09-12T00:11:55.974936+0000","last_active":"2024-09-12T00:54:17.118486+0000","last_peered":"2024-09-12T00:54:17.118486+0000","last_clean":"2024-09-12T00:54:17.118486+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:54:17.118486+0000","last_undegraded":"2024-09-12T00:54:17.118486+0000","last_fullsized":"2024-09-12T00:54:17.118486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.341303+0000","last_change":"2024-09-12T00:11:47.936806+0000","last_active":"2024-09-12T00:53:14.341303+0000","last_peered":"2024-09-12T00:53:14.341303+0000","last_clean":"2024-09-12T00:53:14.341303+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:53:14.341303+0000","last_undegraded":"2024-09-12T00:53:14.341303+0000","last_fullsized":"2024-09-12T00:53:14.341303+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.241629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'202","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.186525+0000","last_change":"2024-09-12T00:11:45.924370+0000","last_active":"2024-09-12T00:52:37.186525+0000","last_peered":"2024-09-12T00:52:37.186525+0000","last_clean":"2024-09-12T00:52:37.186525+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:52:37.186525+0000","last_undegraded":"2024-09-12T00:52:37.186525+0000","last_fullsized":"2024-09-12T00:52:37.186525+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.161944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1636479,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":351,"num_read_kb":7228,"num_write":901,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914998+0000","last_change":"2024-09-12T00:11:49.935933+0000","last_active":"2024-09-12T00:51:00.914998+0000","last_peered":"2024-09-12T00:51:00.914998+0000","last_clean":"2024-09-12T00:51:00.914998+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:51:00.914998+0000","last_undegraded":"2024-09-12T00:51:00.914998+0000","last_fullsized":"2024-09-12T00:51:00.914998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:55.844937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'213","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.268340+0000","last_change":"2024-09-12T00:11:51.953736+0000","last_active":"2024-09-12T00:54:18.268340+0000","last_peered":"2024-09-12T00:54:18.268340+0000","last_clean":"2024-09-12T00:54:18.268340+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:54:18.268340+0000","last_undegraded":"2024-09-12T00:54:18.268340+0000","last_fullsized":"2024-09-12T00:54:18.268340+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:45.844572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":27898,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":285,"num_read_kb":405,"num_write":152,"num_write_kb":50,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923531+0000","last_change":"2024-09-12T00:11:53.953180+0000","last_active":"2024-09-12T00:50:54.923531+0000","last_peered":"2024-09-12T00:50:54.923531+0000","last_clean":"2024-09-12T00:50:54.923531+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:50:54.923531+0000","last_undegraded":"2024-09-12T00:50:54.923531+0000","last_fullsized":"2024-09-12T00:50:54.923531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.341688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'167","reported_seq":695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.573638+0000","last_change":"2024-09-12T00:11:55.974975+0000","last_active":"2024-09-12T00:53:13.573638+0000","last_peered":"2024-09-12T00:53:13.573638+0000","last_clean":"2024-09-12T00:53:13.573638+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:53:13.573638+0000","last_undegraded":"2024-09-12T00:53:13.573638+0000","last_fullsized":"2024-09-12T00:53:13.573638+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:59.474049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'471","reported_seq":1903,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.691464+0000","last_change":"2024-09-12T00:11:47.940887+0000","last_active":"2024-09-12T00:52:54.691464+0000","last_peered":"2024-09-12T00:52:54.691464+0000","last_clean":"2024-09-12T00:52:54.691464+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:52:54.691464+0000","last_undegraded":"2024-09-12T00:52:54.691464+0000","last_fullsized":"2024-09-12T00:52:54.691464+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:51.522432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'209","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.037175+0000","last_change":"2024-09-12T00:11:45.943857+0000","last_active":"2024-09-12T00:52:24.037175+0000","last_peered":"2024-09-12T00:52:24.037175+0000","last_clean":"2024-09-12T00:52:24.037175+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:52:24.037175+0000","last_undegraded":"2024-09-12T00:52:24.037175+0000","last_fullsized":"2024-09-12T00:52:24.037175+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:43.419673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553739,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":429,"num_read_kb":1957,"num_write":997,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"37'3","reported_seq":972,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.927575+0000","last_change":"2024-09-12T00:11:49.937297+0000","last_active":"2024-09-12T00:54:30.927575+0000","last_peered":"2024-09-12T00:54:30.927575+0000","last_clean":"2024-09-12T00:54:30.927575+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:30.927575+0000","last_undegraded":"2024-09-12T00:54:30.927575+0000","last_fullsized":"2024-09-12T00:54:30.927575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:00.946216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'161","reported_seq":740,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.273607+0000","last_change":"2024-09-12T00:11:51.927031+0000","last_active":"2024-09-12T00:54:18.273607+0000","last_peered":"2024-09-12T00:54:18.273607+0000","last_clean":"2024-09-12T00:54:18.273607+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:18.273607+0000","last_undegraded":"2024-09-12T00:54:18.273607+0000","last_fullsized":"2024-09-12T00:54:18.273607+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:02.672539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18135,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":213,"num_read_kb":238,"num_write":170,"num_write_kb":98,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910347+0000","last_change":"2024-09-12T00:11:53.968094+0000","last_active":"2024-09-12T00:50:20.910347+0000","last_peered":"2024-09-12T00:50:20.910347+0000","last_clean":"2024-09-12T00:50:20.910347+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:50:20.910347+0000","last_undegraded":"2024-09-12T00:50:20.910347+0000","last_fullsized":"2024-09-12T00:50:20.910347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.434778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'111","reported_seq":608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.371379+0000","last_change":"2024-09-12T00:11:55.962445+0000","last_active":"2024-09-12T00:54:07.371379+0000","last_peered":"2024-09-12T00:54:07.371379+0000","last_clean":"2024-09-12T00:54:07.371379+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:54:07.371379+0000","last_undegraded":"2024-09-12T00:54:07.371379+0000","last_fullsized":"2024-09-12T00:54:07.371379+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.195407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'357","reported_seq":1761,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.492153+0000","last_change":"2024-09-12T00:11:47.927194+0000","last_active":"2024-09-12T00:53:10.492153+0000","last_peered":"2024-09-12T00:53:10.492153+0000","last_clean":"2024-09-12T00:53:10.492153+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:53:10.492153+0000","last_undegraded":"2024-09-12T00:53:10.492153+0000","last_fullsized":"2024-09-12T00:53:10.492153+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:01.220441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'177","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:46.022553+0000","last_change":"2024-09-12T00:11:45.917052+0000","last_active":"2024-09-12T00:52:46.022553+0000","last_peered":"2024-09-12T00:52:46.022553+0000","last_clean":"2024-09-12T00:52:46.022553+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:52:46.022553+0000","last_undegraded":"2024-09-12T00:52:46.022553+0000","last_fullsized":"2024-09-12T00:52:46.022553+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:13.426346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5266715,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":412,"num_read_kb":98751,"num_write":849,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:04.911850+0000","last_change":"2024-09-12T00:11:49.929321+0000","last_active":"2024-09-12T00:50:04.911850+0000","last_peered":"2024-09-12T00:50:04.911850+0000","last_clean":"2024-09-12T00:50:04.911850+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:50:04.911850+0000","last_undegraded":"2024-09-12T00:50:04.911850+0000","last_fullsized":"2024-09-12T00:50:04.911850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:41.401304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'142","reported_seq":720,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.734321+0000","last_change":"2024-09-12T00:11:51.944644+0000","last_active":"2024-09-12T00:52:37.734321+0000","last_peered":"2024-09-12T00:52:37.734321+0000","last_clean":"2024-09-12T00:52:37.734321+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:52:37.734321+0000","last_undegraded":"2024-09-12T00:52:37.734321+0000","last_fullsized":"2024-09-12T00:52:37.734321+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":100,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.228465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8597,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":190,"num_read_kb":228,"num_write":104,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'757","reported_seq":4268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.366563+0000","last_change":"2024-09-12T00:11:53.952899+0000","last_active":"2024-09-12T00:54:18.366563+0000","last_peered":"2024-09-12T00:54:18.366563+0000","last_clean":"2024-09-12T00:54:18.366563+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:18.366563+0000","last_undegraded":"2024-09-12T00:54:18.366563+0000","last_fullsized":"2024-09-12T00:54:18.366563+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":700,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:12.752310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'131","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.447365+0000","last_change":"2024-09-12T00:11:55.980382+0000","last_active":"2024-09-12T00:53:14.447365+0000","last_peered":"2024-09-12T00:53:14.447365+0000","last_clean":"2024-09-12T00:53:14.447365+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:53:14.447365+0000","last_undegraded":"2024-09-12T00:53:14.447365+0000","last_fullsized":"2024-09-12T00:53:14.447365+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:00.118353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'421","reported_seq":1948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.492491+0000","last_change":"2024-09-12T00:11:47.929290+0000","last_active":"2024-09-12T00:53:01.492491+0000","last_peered":"2024-09-12T00:53:01.492491+0000","last_clean":"2024-09-12T00:53:01.492491+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:53:01.492491+0000","last_undegraded":"2024-09-12T00:53:01.492491+0000","last_fullsized":"2024-09-12T00:53:01.492491+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:17.558291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'200","reported_seq":955,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:44.180384+0000","last_change":"2024-09-12T00:11:45.934214+0000","last_active":"2024-09-12T00:52:44.180384+0000","last_peered":"2024-09-12T00:52:44.180384+0000","last_clean":"2024-09-12T00:52:44.180384+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:52:44.180384+0000","last_undegraded":"2024-09-12T00:52:44.180384+0000","last_fullsized":"2024-09-12T00:52:44.180384+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:16.412728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7523936,"num_objects":13,"num_object_clones":0,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":763,"num_read_kb":199371,"num_write":986,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.943149+0000","last_change":"2024-09-12T00:11:49.916557+0000","last_active":"2024-09-12T00:54:30.943149+0000","last_peered":"2024-09-12T00:54:30.943149+0000","last_clean":"2024-09-12T00:54:30.943149+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:30.943149+0000","last_undegraded":"2024-09-12T00:54:30.943149+0000","last_fullsized":"2024-09-12T00:54:30.943149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:21.916420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'72","reported_seq":590,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.752832+0000","last_change":"2024-09-12T00:11:51.935418+0000","last_active":"2024-09-12T00:53:13.752832+0000","last_peered":"2024-09-12T00:53:13.752832+0000","last_clean":"2024-09-12T00:53:13.752832+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:53:13.752832+0000","last_undegraded":"2024-09-12T00:53:13.752832+0000","last_fullsized":"2024-09-12T00:53:13.752832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:51.747263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'797","reported_seq":2240,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.976636+0000","last_change":"2024-09-12T00:11:53.957570+0000","last_active":"2024-09-12T00:54:30.976636+0000","last_peered":"2024-09-12T00:54:30.976636+0000","last_clean":"2024-09-12T00:54:30.976636+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:30.976636+0000","last_undegraded":"2024-09-12T00:54:30.976636+0000","last_fullsized":"2024-09-12T00:54:30.976636+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":701,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:04.088118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.135829+0000","last_change":"2024-09-12T00:11:55.975495+0000","last_active":"2024-09-12T00:52:29.135829+0000","last_peered":"2024-09-12T00:52:29.135829+0000","last_clean":"2024-09-12T00:52:29.135829+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:52:29.135829+0000","last_undegraded":"2024-09-12T00:52:29.135829+0000","last_fullsized":"2024-09-12T00:52:29.135829+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.293878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'759","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.232523+0000","last_change":"2024-09-12T00:11:47.955610+0000","last_active":"2024-09-12T00:53:00.232523+0000","last_peered":"2024-09-12T00:53:00.232523+0000","last_clean":"2024-09-12T00:53:00.232523+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:53:00.232523+0000","last_undegraded":"2024-09-12T00:53:00.232523+0000","last_fullsized":"2024-09-12T00:53:00.232523+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:19.656190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'213","reported_seq":859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:52.093662+0000","last_change":"2024-09-12T00:11:45.929866+0000","last_active":"2024-09-12T00:51:52.093662+0000","last_peered":"2024-09-12T00:51:52.093662+0000","last_clean":"2024-09-12T00:51:52.093662+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:51:52.093662+0000","last_undegraded":"2024-09-12T00:51:52.093662+0000","last_fullsized":"2024-09-12T00:51:52.093662+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:51.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5562540,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":492,"num_read_kb":31245,"num_write":949,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.924891+0000","last_change":"2024-09-12T00:11:49.941210+0000","last_active":"2024-09-12T00:50:05.924891+0000","last_peered":"2024-09-12T00:50:05.924891+0000","last_clean":"2024-09-12T00:50:05.924891+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:50:05.924891+0000","last_undegraded":"2024-09-12T00:50:05.924891+0000","last_fullsized":"2024-09-12T00:50:05.924891+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:16.438093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'219","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.305281+0000","last_change":"2024-09-12T00:11:51.947561+0000","last_active":"2024-09-12T00:54:18.305281+0000","last_peered":"2024-09-12T00:54:18.305281+0000","last_clean":"2024-09-12T00:54:18.305281+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:18.305281+0000","last_undegraded":"2024-09-12T00:54:18.305281+0000","last_fullsized":"2024-09-12T00:54:18.305281+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:33.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12252,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":862,"num_read_kb":913,"num_write":1358,"num_write_kb":1231,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104173+0000","last_change":"2024-09-12T00:11:53.957928+0000","last_active":"2024-09-12T00:50:11.104173+0000","last_peered":"2024-09-12T00:50:11.104173+0000","last_clean":"2024-09-12T00:50:11.104173+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:50:11.104173+0000","last_undegraded":"2024-09-12T00:50:11.104173+0000","last_fullsized":"2024-09-12T00:50:11.104173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:26.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'106","reported_seq":598,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.427213+0000","last_change":"2024-09-12T00:11:55.978414+0000","last_active":"2024-09-12T00:53:12.427213+0000","last_peered":"2024-09-12T00:53:12.427213+0000","last_clean":"2024-09-12T00:53:12.427213+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:53:12.427213+0000","last_undegraded":"2024-09-12T00:53:12.427213+0000","last_fullsized":"2024-09-12T00:53:12.427213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.992033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'786","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217623+0000","last_change":"2024-09-12T00:11:47.926128+0000","last_active":"2024-09-12T00:53:59.217623+0000","last_peered":"2024-09-12T00:53:59.217623+0000","last_clean":"2024-09-12T00:53:59.217623+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:53:59.217623+0000","last_undegraded":"2024-09-12T00:53:59.217623+0000","last_fullsized":"2024-09-12T00:53:59.217623+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:22.256949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'72","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104029+0000","last_change":"2024-09-12T00:11:27.569428+0000","last_active":"2024-09-12T00:51:36.104029+0000","last_peered":"2024-09-12T00:51:36.104029+0000","last_clean":"2024-09-12T00:51:36.104029+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:51:36.104029+0000","last_undegraded":"2024-09-12T00:51:36.104029+0000","last_fullsized":"2024-09-12T00:51:36.104029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:26.525321+0000","last_clean_scrub_stamp":"2024-09-12T00:11:26.525321+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:53.325099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940331+0000","last_change":"2024-09-12T00:11:34.617900+0000","last_active":"2024-09-12T00:51:10.940331+0000","last_peered":"2024-09-12T00:51:10.940331+0000","last_clean":"2024-09-12T00:51:10.940331+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:51:10.940331+0000","last_undegraded":"2024-09-12T00:51:10.940331+0000","last_fullsized":"2024-09-12T00:51:10.940331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'185","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.414785+0000","last_change":"2024-09-12T00:12:19.244194+0000","last_active":"2024-09-12T00:53:11.414785+0000","last_peered":"2024-09-12T00:53:11.414785+0000","last_clean":"2024-09-12T00:53:11.414785+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:53:11.414785+0000","last_undegraded":"2024-09-12T00:53:11.414785+0000","last_fullsized":"2024-09-12T00:53:11.414785+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:17.759014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7853940,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":394,"num_read_kb":15296,"num_write":919,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"37'4","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.927996+0000","last_change":"2024-09-12T00:11:49.928011+0000","last_active":"2024-09-12T00:54:30.927996+0000","last_peered":"2024-09-12T00:54:30.927996+0000","last_clean":"2024-09-12T00:54:30.927996+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:30.927996+0000","last_undegraded":"2024-09-12T00:54:30.927996+0000","last_fullsized":"2024-09-12T00:54:30.927996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:42.062220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'291","reported_seq":984,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.310659+0000","last_change":"2024-09-12T00:11:51.936332+0000","last_active":"2024-09-12T00:54:18.310659+0000","last_peered":"2024-09-12T00:54:18.310659+0000","last_clean":"2024-09-12T00:54:18.310659+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:54:18.310659+0000","last_undegraded":"2024-09-12T00:54:18.310659+0000","last_fullsized":"2024-09-12T00:54:18.310659+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":200,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:22.288477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46469,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":529,"num_read_kb":753,"num_write":440,"num_write_kb":313,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923847+0000","last_change":"2024-09-12T00:11:53.937970+0000","last_active":"2024-09-12T00:50:54.923847+0000","last_peered":"2024-09-12T00:50:54.923847+0000","last_clean":"2024-09-12T00:50:54.923847+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:50:54.923847+0000","last_undegraded":"2024-09-12T00:50:54.923847+0000","last_fullsized":"2024-09-12T00:50:54.923847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:32.585484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'188","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.171716+0000","last_change":"2024-09-12T00:11:55.972904+0000","last_active":"2024-09-12T00:53:13.171716+0000","last_peered":"2024-09-12T00:53:13.171716+0000","last_clean":"2024-09-12T00:53:13.171716+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:53:13.171716+0000","last_undegraded":"2024-09-12T00:53:13.171716+0000","last_fullsized":"2024-09-12T00:53:13.171716+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:08.248837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'454","reported_seq":1917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.540410+0000","last_change":"2024-09-12T00:11:47.933958+0000","last_active":"2024-09-12T00:52:57.540410+0000","last_peered":"2024-09-12T00:52:57.540410+0000","last_clean":"2024-09-12T00:52:57.540410+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:52:57.540410+0000","last_undegraded":"2024-09-12T00:52:57.540410+0000","last_fullsized":"2024-09-12T00:52:57.540410+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:36.317791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:45.949008+0000","last_change":"2024-09-12T00:11:34.617340+0000","last_active":"2024-09-12T00:51:45.949008+0000","last_peered":"2024-09-12T00:51:45.949008+0000","last_clean":"2024-09-12T00:51:45.949008+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:51:45.949008+0000","last_undegraded":"2024-09-12T00:51:45.949008+0000","last_fullsized":"2024-09-12T00:51:45.949008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:34.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'193","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.361471+0000","last_change":"2024-09-12T00:11:45.952012+0000","last_active":"2024-09-12T00:52:54.361471+0000","last_peered":"2024-09-12T00:52:54.361471+0000","last_clean":"2024-09-12T00:52:54.361471+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:52:54.361471+0000","last_undegraded":"2024-09-12T00:52:54.361471+0000","last_fullsized":"2024-09-12T00:52:54.361471+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:30.524961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5606791,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":392,"num_read_kb":6575,"num_write":978,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.935730+0000","last_change":"2024-09-12T00:11:49.935780+0000","last_active":"2024-09-12T00:50:50.935730+0000","last_peered":"2024-09-12T00:50:50.935730+0000","last_clean":"2024-09-12T00:50:50.935730+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:50:50.935730+0000","last_undegraded":"2024-09-12T00:50:50.935730+0000","last_fullsized":"2024-09-12T00:50:50.935730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.785961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'831","reported_seq":2271,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.358125+0000","last_change":"2024-09-12T00:11:51.943417+0000","last_active":"2024-09-12T00:54:18.358125+0000","last_peered":"2024-09-12T00:54:18.358125+0000","last_clean":"2024-09-12T00:54:18.358125+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:18.358125+0000","last_undegraded":"2024-09-12T00:54:18.358125+0000","last_fullsized":"2024-09-12T00:54:18.358125+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":800,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:34.607897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":72884,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1145,"num_read_kb":1408,"num_write":274,"num_write_kb":157,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947961+0000","last_change":"2024-09-12T00:11:53.962102+0000","last_active":"2024-09-12T00:51:40.947961+0000","last_peered":"2024-09-12T00:51:40.947961+0000","last_clean":"2024-09-12T00:51:40.947961+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:51:40.947961+0000","last_undegraded":"2024-09-12T00:51:40.947961+0000","last_fullsized":"2024-09-12T00:51:40.947961+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:40.329220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'206","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:31.450664+0000","last_change":"2024-09-12T00:11:55.982765+0000","last_active":"2024-09-12T00:52:31.450664+0000","last_peered":"2024-09-12T00:52:31.450664+0000","last_clean":"2024-09-12T00:52:31.450664+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:52:31.450664+0000","last_undegraded":"2024-09-12T00:52:31.450664+0000","last_fullsized":"2024-09-12T00:52:31.450664+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.734557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'992","reported_seq":2842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.297386+0000","last_change":"2024-09-12T00:11:47.941493+0000","last_active":"2024-09-12T00:52:59.297386+0000","last_peered":"2024-09-12T00:52:59.297386+0000","last_clean":"2024-09-12T00:52:59.297386+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:52:59.297386+0000","last_undegraded":"2024-09-12T00:52:59.297386+0000","last_fullsized":"2024-09-12T00:52:59.297386+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:06.733191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.920827+0000","last_change":"2024-09-12T00:11:34.731346+0000","last_active":"2024-09-12T00:51:10.920827+0000","last_peered":"2024-09-12T00:51:10.920827+0000","last_clean":"2024-09-12T00:51:10.920827+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:51:10.920827+0000","last_undegraded":"2024-09-12T00:51:10.920827+0000","last_fullsized":"2024-09-12T00:51:10.920827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:18.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'188","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.758465+0000","last_change":"2024-09-12T00:11:45.963489+0000","last_active":"2024-09-12T00:52:54.758465+0000","last_peered":"2024-09-12T00:52:54.758465+0000","last_clean":"2024-09-12T00:52:54.758465+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:52:54.758465+0000","last_undegraded":"2024-09-12T00:52:54.758465+0000","last_fullsized":"2024-09-12T00:52:54.758465+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:01.526306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5664849,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":399,"num_read_kb":16624,"num_write":909,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916628+0000","last_change":"2024-09-12T00:11:49.939428+0000","last_active":"2024-09-12T00:50:50.916628+0000","last_peered":"2024-09-12T00:50:50.916628+0000","last_clean":"2024-09-12T00:50:50.916628+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:50:50.916628+0000","last_undegraded":"2024-09-12T00:50:50.916628+0000","last_fullsized":"2024-09-12T00:50:50.916628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:44.977495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'231","reported_seq":1283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.391143+0000","last_change":"2024-09-12T00:11:51.950048+0000","last_active":"2024-09-12T00:54:15.391143+0000","last_peered":"2024-09-12T00:54:15.391143+0000","last_clean":"2024-09-12T00:54:15.391143+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:15.391143+0000","last_undegraded":"2024-09-12T00:54:15.391143+0000","last_fullsized":"2024-09-12T00:54:15.391143+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:06.199752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926496+0000","last_change":"2024-09-12T00:11:53.968069+0000","last_active":"2024-09-12T00:51:30.926496+0000","last_peered":"2024-09-12T00:51:30.926496+0000","last_clean":"2024-09-12T00:51:30.926496+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:51:30.926496+0000","last_undegraded":"2024-09-12T00:51:30.926496+0000","last_fullsized":"2024-09-12T00:51:30.926496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:02.100203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'312","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.889255+0000","last_change":"2024-09-12T00:11:55.967123+0000","last_active":"2024-09-12T00:53:13.889255+0000","last_peered":"2024-09-12T00:53:13.889255+0000","last_clean":"2024-09-12T00:53:13.889255+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:53:13.889255+0000","last_undegraded":"2024-09-12T00:53:13.889255+0000","last_fullsized":"2024-09-12T00:53:13.889255+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:10.855671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'379","reported_seq":1784,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.948108+0000","last_change":"2024-09-12T00:11:47.943438+0000","last_active":"2024-09-12T00:53:30.948108+0000","last_peered":"2024-09-12T00:53:30.948108+0000","last_clean":"2024-09-12T00:53:30.948108+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:53:30.948108+0000","last_undegraded":"2024-09-12T00:53:30.948108+0000","last_fullsized":"2024-09-12T00:53:30.948108+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:03.957852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940272+0000","last_change":"2024-09-12T00:11:34.618967+0000","last_active":"2024-09-12T00:51:10.940272+0000","last_peered":"2024-09-12T00:51:10.940272+0000","last_clean":"2024-09-12T00:51:10.940272+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:51:10.940272+0000","last_undegraded":"2024-09-12T00:51:10.940272+0000","last_fullsized":"2024-09-12T00:51:10.940272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.762426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'273","reported_seq":946,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.632499+0000","last_change":"2024-09-12T00:11:45.925677+0000","last_active":"2024-09-12T00:52:56.632499+0000","last_peered":"2024-09-12T00:52:56.632499+0000","last_clean":"2024-09-12T00:52:56.632499+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:52:56.632499+0000","last_undegraded":"2024-09-12T00:52:56.632499+0000","last_fullsized":"2024-09-12T00:52:56.632499+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":200,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:13.876652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9636774,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":645,"num_read_kb":17781,"num_write":1202,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926404+0000","last_change":"2024-09-12T00:11:49.947103+0000","last_active":"2024-09-12T00:51:35.926404+0000","last_peered":"2024-09-12T00:51:35.926404+0000","last_clean":"2024-09-12T00:51:35.926404+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:51:35.926404+0000","last_undegraded":"2024-09-12T00:51:35.926404+0000","last_fullsized":"2024-09-12T00:51:35.926404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.613882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'109","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.954400+0000","last_change":"2024-09-12T00:11:51.944099+0000","last_active":"2024-09-12T00:53:04.954400+0000","last_peered":"2024-09-12T00:53:04.954400+0000","last_clean":"2024-09-12T00:53:04.954400+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:53:04.954400+0000","last_undegraded":"2024-09-12T00:53:04.954400+0000","last_fullsized":"2024-09-12T00:53:04.954400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:44.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.936964+0000","last_change":"2024-09-12T00:11:53.964265+0000","last_active":"2024-09-12T00:50:55.936964+0000","last_peered":"2024-09-12T00:50:55.936964+0000","last_clean":"2024-09-12T00:50:55.936964+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:50:55.936964+0000","last_undegraded":"2024-09-12T00:50:55.936964+0000","last_fullsized":"2024-09-12T00:50:55.936964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:02.137660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:06.122873+0000","last_change":"2024-09-12T00:11:55.974232+0000","last_active":"2024-09-12T00:53:06.122873+0000","last_peered":"2024-09-12T00:53:06.122873+0000","last_clean":"2024-09-12T00:53:06.122873+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:53:06.122873+0000","last_undegraded":"2024-09-12T00:53:06.122873+0000","last_fullsized":"2024-09-12T00:53:06.122873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:18.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'425","reported_seq":1926,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.195375+0000","last_change":"2024-09-12T00:11:47.950054+0000","last_active":"2024-09-12T00:54:17.195375+0000","last_peered":"2024-09-12T00:54:17.195375+0000","last_clean":"2024-09-12T00:54:17.195375+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:17.195375+0000","last_undegraded":"2024-09-12T00:54:17.195375+0000","last_fullsized":"2024-09-12T00:54:17.195375+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:18.896652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'187","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:09.887862+0000","last_change":"2024-09-12T00:11:45.938174+0000","last_active":"2024-09-12T00:54:09.887862+0000","last_peered":"2024-09-12T00:54:09.887862+0000","last_clean":"2024-09-12T00:54:09.887862+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:09.887862+0000","last_undegraded":"2024-09-12T00:54:09.887862+0000","last_fullsized":"2024-09-12T00:54:09.887862+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":87,"log_dups_size":100,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:26:20.890123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6591677,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":910,"num_read_kb":23524,"num_write":937,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927231+0000","last_change":"2024-09-12T00:11:34.874306+0000","last_active":"2024-09-12T00:51:09.927231+0000","last_peered":"2024-09-12T00:51:09.927231+0000","last_clean":"2024-09-12T00:51:09.927231+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:51:09.927231+0000","last_undegraded":"2024-09-12T00:51:09.927231+0000","last_fullsized":"2024-09-12T00:51:09.927231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:04.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.925302+0000","last_change":"2024-09-12T00:11:49.940655+0000","last_active":"2024-09-12T00:51:25.925302+0000","last_peered":"2024-09-12T00:51:25.925302+0000","last_clean":"2024-09-12T00:51:25.925302+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:51:25.925302+0000","last_undegraded":"2024-09-12T00:51:25.925302+0000","last_fullsized":"2024-09-12T00:51:25.925302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:51.772761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'266","reported_seq":932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.288941+0000","last_change":"2024-09-12T00:11:51.951322+0000","last_active":"2024-09-12T00:54:18.288941+0000","last_peered":"2024-09-12T00:54:18.288941+0000","last_clean":"2024-09-12T00:54:18.288941+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:18.288941+0000","last_undegraded":"2024-09-12T00:54:18.288941+0000","last_fullsized":"2024-09-12T00:54:18.288941+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":200,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:19.014495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":30452,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":374,"num_read_kb":516,"num_write":210,"num_write_kb":65,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121823+0000","last_change":"2024-09-12T00:11:53.958248+0000","last_active":"2024-09-12T00:51:31.121823+0000","last_peered":"2024-09-12T00:51:31.121823+0000","last_clean":"2024-09-12T00:51:31.121823+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:51:31.121823+0000","last_undegraded":"2024-09-12T00:51:31.121823+0000","last_fullsized":"2024-09-12T00:51:31.121823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.005296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'149","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.692391+0000","last_change":"2024-09-12T00:11:55.982508+0000","last_active":"2024-09-12T00:52:54.692391+0000","last_peered":"2024-09-12T00:52:54.692391+0000","last_clean":"2024-09-12T00:52:54.692391+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:52:54.692391+0000","last_undegraded":"2024-09-12T00:52:54.692391+0000","last_fullsized":"2024-09-12T00:52:54.692391+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.265884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'457","reported_seq":2076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.193459+0000","last_change":"2024-09-12T00:11:47.941980+0000","last_active":"2024-09-12T00:54:17.193459+0000","last_peered":"2024-09-12T00:54:17.193459+0000","last_clean":"2024-09-12T00:54:17.193459+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:17.193459+0000","last_undegraded":"2024-09-12T00:54:17.193459+0000","last_fullsized":"2024-09-12T00:54:17.193459+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:12.954699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'215","reported_seq":837,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:13.600648+0000","last_change":"2024-09-12T00:11:45.957384+0000","last_active":"2024-09-12T00:52:13.600648+0000","last_peered":"2024-09-12T00:52:13.600648+0000","last_clean":"2024-09-12T00:52:13.600648+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:52:13.600648+0000","last_undegraded":"2024-09-12T00:52:13.600648+0000","last_fullsized":"2024-09-12T00:52:13.600648+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:27.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5244951,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":425,"num_read_kb":4575,"num_write":1016,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:20.943222+0000","last_change":"2024-09-12T00:11:34.617205+0000","last_active":"2024-09-12T00:51:20.943222+0000","last_peered":"2024-09-12T00:51:20.943222+0000","last_clean":"2024-09-12T00:51:20.943222+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:51:20.943222+0000","last_undegraded":"2024-09-12T00:51:20.943222+0000","last_fullsized":"2024-09-12T00:51:20.943222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:51.436105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.926639+0000","last_change":"2024-09-12T00:11:49.929449+0000","last_active":"2024-09-12T00:51:25.926639+0000","last_peered":"2024-09-12T00:51:25.926639+0000","last_clean":"2024-09-12T00:51:25.926639+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:51:25.926639+0000","last_undegraded":"2024-09-12T00:51:25.926639+0000","last_fullsized":"2024-09-12T00:51:25.926639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:39.048491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'179","reported_seq":747,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:29.368057+0000","last_change":"2024-09-12T00:11:51.941186+0000","last_active":"2024-09-12T00:53:29.368057+0000","last_peered":"2024-09-12T00:53:29.368057+0000","last_clean":"2024-09-12T00:53:29.368057+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:53:29.368057+0000","last_undegraded":"2024-09-12T00:53:29.368057+0000","last_fullsized":"2024-09-12T00:53:29.368057+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:41.525044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'799","reported_seq":2666,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.970455+0000","last_change":"2024-09-12T00:11:53.946719+0000","last_active":"2024-09-12T00:54:30.970455+0000","last_peered":"2024-09-12T00:54:30.970455+0000","last_clean":"2024-09-12T00:54:30.970455+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:30.970455+0000","last_undegraded":"2024-09-12T00:54:30.970455+0000","last_fullsized":"2024-09-12T00:54:30.970455+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":701,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:54.556954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'113","reported_seq":612,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.080514+0000","last_change":"2024-09-12T00:11:55.974820+0000","last_active":"2024-09-12T00:52:53.080514+0000","last_peered":"2024-09-12T00:52:53.080514+0000","last_clean":"2024-09-12T00:52:53.080514+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:52:53.080514+0000","last_undegraded":"2024-09-12T00:52:53.080514+0000","last_fullsized":"2024-09-12T00:52:53.080514+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:58.128560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'449","reported_seq":1854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.980363+0000","last_change":"2024-09-12T00:11:47.943089+0000","last_active":"2024-09-12T00:53:01.980363+0000","last_peered":"2024-09-12T00:53:01.980363+0000","last_clean":"2024-09-12T00:53:01.980363+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:53:01.980363+0000","last_undegraded":"2024-09-12T00:53:01.980363+0000","last_fullsized":"2024-09-12T00:53:01.980363+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:44.592044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'249","reported_seq":910,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:58.178304+0000","last_change":"2024-09-12T00:11:45.944133+0000","last_active":"2024-09-12T00:52:58.178304+0000","last_peered":"2024-09-12T00:52:58.178304+0000","last_clean":"2024-09-12T00:52:58.178304+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:52:58.178304+0000","last_undegraded":"2024-09-12T00:52:58.178304+0000","last_fullsized":"2024-09-12T00:52:58.178304+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.226214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2343909,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":627,"num_read_kb":14953,"num_write":1329,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.914062+0000","last_change":"2024-09-12T00:11:34.613977+0000","last_active":"2024-09-12T00:50:35.914062+0000","last_peered":"2024-09-12T00:50:35.914062+0000","last_clean":"2024-09-12T00:50:35.914062+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:50:35.914062+0000","last_undegraded":"2024-09-12T00:50:35.914062+0000","last_fullsized":"2024-09-12T00:50:35.914062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:31.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.944327+0000","last_change":"2024-09-12T00:11:49.929660+0000","last_active":"2024-09-12T00:51:25.944327+0000","last_peered":"2024-09-12T00:51:25.944327+0000","last_clean":"2024-09-12T00:51:25.944327+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:51:25.944327+0000","last_undegraded":"2024-09-12T00:51:25.944327+0000","last_fullsized":"2024-09-12T00:51:25.944327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:57.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'109","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:28.252812+0000","last_change":"2024-09-12T00:11:51.947657+0000","last_active":"2024-09-12T00:52:28.252812+0000","last_peered":"2024-09-12T00:52:28.252812+0000","last_clean":"2024-09-12T00:52:28.252812+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:52:28.252812+0000","last_undegraded":"2024-09-12T00:52:28.252812+0000","last_fullsized":"2024-09-12T00:52:28.252812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:12.346313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'786","reported_seq":2340,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.370733+0000","last_change":"2024-09-12T00:11:53.968955+0000","last_active":"2024-09-12T00:54:18.370733+0000","last_peered":"2024-09-12T00:54:18.370733+0000","last_clean":"2024-09-12T00:54:18.370733+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:54:18.370733+0000","last_undegraded":"2024-09-12T00:54:18.370733+0000","last_fullsized":"2024-09-12T00:54:18.370733+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":701,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:38.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'188","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:47.798689+0000","last_change":"2024-09-12T00:11:55.972707+0000","last_active":"2024-09-12T00:52:47.798689+0000","last_peered":"2024-09-12T00:52:47.798689+0000","last_clean":"2024-09-12T00:52:47.798689+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:52:47.798689+0000","last_undegraded":"2024-09-12T00:52:47.798689+0000","last_fullsized":"2024-09-12T00:52:47.798689+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.070375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'482","reported_seq":2168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199159+0000","last_change":"2024-09-12T00:11:47.920074+0000","last_active":"2024-09-12T00:54:17.199159+0000","last_peered":"2024-09-12T00:54:17.199159+0000","last_clean":"2024-09-12T00:54:17.199159+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:17.199159+0000","last_undegraded":"2024-09-12T00:54:17.199159+0000","last_fullsized":"2024-09-12T00:54:17.199159+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:15.555950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'214","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.190115+0000","last_change":"2024-09-12T00:11:45.934651+0000","last_active":"2024-09-12T00:53:11.190115+0000","last_peered":"2024-09-12T00:53:11.190115+0000","last_clean":"2024-09-12T00:53:11.190115+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:53:11.190115+0000","last_undegraded":"2024-09-12T00:53:11.190115+0000","last_fullsized":"2024-09-12T00:53:11.190115+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":200,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:00.165999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14703459,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":535,"num_read_kb":60723,"num_write":945,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.932047+0000","last_change":"2024-09-12T00:11:34.618193+0000","last_active":"2024-09-12T00:50:35.932047+0000","last_peered":"2024-09-12T00:50:35.932047+0000","last_clean":"2024-09-12T00:50:35.932047+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:50:35.932047+0000","last_undegraded":"2024-09-12T00:50:35.932047+0000","last_fullsized":"2024-09-12T00:50:35.932047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:18.144454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933247+0000","last_change":"2024-09-12T00:11:49.928566+0000","last_active":"2024-09-12T00:52:00.933247+0000","last_peered":"2024-09-12T00:52:00.933247+0000","last_clean":"2024-09-12T00:52:00.933247+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:52:00.933247+0000","last_undegraded":"2024-09-12T00:52:00.933247+0000","last_fullsized":"2024-09-12T00:52:00.933247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:38.587979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'331","reported_seq":1034,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.283692+0000","last_change":"2024-09-12T00:11:51.944165+0000","last_active":"2024-09-12T00:54:18.283692+0000","last_peered":"2024-09-12T00:54:18.283692+0000","last_clean":"2024-09-12T00:54:18.283692+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:18.283692+0000","last_undegraded":"2024-09-12T00:54:18.283692+0000","last_fullsized":"2024-09-12T00:54:18.283692+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":300,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:13.970557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39694,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":460,"num_read_kb":648,"num_write":246,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926396+0000","last_change":"2024-09-12T00:11:53.959232+0000","last_active":"2024-09-12T00:51:30.926396+0000","last_peered":"2024-09-12T00:51:30.926396+0000","last_clean":"2024-09-12T00:51:30.926396+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:51:30.926396+0000","last_undegraded":"2024-09-12T00:51:30.926396+0000","last_fullsized":"2024-09-12T00:51:30.926396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:48.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'91","reported_seq":581,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.028563+0000","last_change":"2024-09-12T00:11:55.977283+0000","last_active":"2024-09-12T00:52:49.028563+0000","last_peered":"2024-09-12T00:52:49.028563+0000","last_clean":"2024-09-12T00:52:49.028563+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:52:49.028563+0000","last_undegraded":"2024-09-12T00:52:49.028563+0000","last_fullsized":"2024-09-12T00:52:49.028563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:03.673797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'150","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.512255+0000","last_change":"2024-09-12T00:11:55.987098+0000","last_active":"2024-09-12T00:53:14.512255+0000","last_peered":"2024-09-12T00:53:14.512255+0000","last_clean":"2024-09-12T00:53:14.512255+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:53:14.512255+0000","last_undegraded":"2024-09-12T00:53:14.512255+0000","last_fullsized":"2024-09-12T00:53:14.512255+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:47.859646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'404","reported_seq":1793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:51.152300+0000","last_change":"2024-09-12T00:11:47.921763+0000","last_active":"2024-09-12T00:53:51.152300+0000","last_peered":"2024-09-12T00:53:51.152300+0000","last_clean":"2024-09-12T00:53:51.152300+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:53:51.152300+0000","last_undegraded":"2024-09-12T00:53:51.152300+0000","last_fullsized":"2024-09-12T00:53:51.152300+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'183","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.878375+0000","last_change":"2024-09-12T00:11:45.930485+0000","last_active":"2024-09-12T00:52:59.878375+0000","last_peered":"2024-09-12T00:52:59.878375+0000","last_clean":"2024-09-12T00:52:59.878375+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:52:59.878375+0000","last_undegraded":"2024-09-12T00:52:59.878375+0000","last_fullsized":"2024-09-12T00:52:59.878375+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.242243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1136220,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":522,"num_read_kb":101459,"num_write":842,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.921522+0000","last_change":"2024-09-12T00:11:49.940350+0000","last_active":"2024-09-12T00:51:30.921522+0000","last_peered":"2024-09-12T00:51:30.921522+0000","last_clean":"2024-09-12T00:51:30.921522+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:51:30.921522+0000","last_undegraded":"2024-09-12T00:51:30.921522+0000","last_fullsized":"2024-09-12T00:51:30.921522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:25.951150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'139","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.953227+0000","last_change":"2024-09-12T00:11:51.929179+0000","last_active":"2024-09-12T00:53:55.953227+0000","last_peered":"2024-09-12T00:53:55.953227+0000","last_clean":"2024-09-12T00:53:55.953227+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:53:55.953227+0000","last_undegraded":"2024-09-12T00:53:55.953227+0000","last_fullsized":"2024-09-12T00:53:55.953227+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":100,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:47.615364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15370,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":180,"num_read_kb":249,"num_write":98,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926201+0000","last_change":"2024-09-12T00:11:53.965867+0000","last_active":"2024-09-12T00:51:35.926201+0000","last_peered":"2024-09-12T00:51:35.926201+0000","last_clean":"2024-09-12T00:51:35.926201+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:51:35.926201+0000","last_undegraded":"2024-09-12T00:51:35.926201+0000","last_fullsized":"2024-09-12T00:51:35.926201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:46.503762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.778087+0000","last_change":"2024-09-12T00:11:55.975673+0000","last_active":"2024-09-12T00:53:13.778087+0000","last_peered":"2024-09-12T00:53:13.778087+0000","last_clean":"2024-09-12T00:53:13.778087+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:53:13.778087+0000","last_undegraded":"2024-09-12T00:53:13.778087+0000","last_fullsized":"2024-09-12T00:53:13.778087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:53.889300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'348","reported_seq":1863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.366932+0000","last_change":"2024-09-12T00:11:47.935945+0000","last_active":"2024-09-12T00:53:14.366932+0000","last_peered":"2024-09-12T00:53:14.366932+0000","last_clean":"2024-09-12T00:53:14.366932+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:53:14.366932+0000","last_undegraded":"2024-09-12T00:53:14.366932+0000","last_fullsized":"2024-09-12T00:53:14.366932+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'334","reported_seq":1006,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.916821+0000","last_change":"2024-09-12T00:11:45.942994+0000","last_active":"2024-09-12T00:52:32.916821+0000","last_peered":"2024-09-12T00:52:32.916821+0000","last_clean":"2024-09-12T00:52:32.916821+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:52:32.916821+0000","last_undegraded":"2024-09-12T00:52:32.916821+0000","last_fullsized":"2024-09-12T00:52:32.916821+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":300,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:36.262305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2700018,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":791,"num_read_kb":9288,"num_write":1285,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926444+0000","last_change":"2024-09-12T00:11:49.942679+0000","last_active":"2024-09-12T00:51:30.926444+0000","last_peered":"2024-09-12T00:51:30.926444+0000","last_clean":"2024-09-12T00:51:30.926444+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:51:30.926444+0000","last_undegraded":"2024-09-12T00:51:30.926444+0000","last_fullsized":"2024-09-12T00:51:30.926444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:19.512522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'54","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.203822+0000","last_change":"2024-09-12T00:11:51.951112+0000","last_active":"2024-09-12T00:52:02.203822+0000","last_peered":"2024-09-12T00:52:02.203822+0000","last_clean":"2024-09-12T00:52:02.203822+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:52:02.203822+0000","last_undegraded":"2024-09-12T00:52:02.203822+0000","last_fullsized":"2024-09-12T00:52:02.203822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.473635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.122929+0000","last_change":"2024-09-12T00:11:53.965509+0000","last_active":"2024-09-12T00:51:36.122929+0000","last_peered":"2024-09-12T00:51:36.122929+0000","last_clean":"2024-09-12T00:51:36.122929+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:51:36.122929+0000","last_undegraded":"2024-09-12T00:51:36.122929+0000","last_fullsized":"2024-09-12T00:51:36.122929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:23.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'192","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.755700+0000","last_change":"2024-09-12T00:11:55.977952+0000","last_active":"2024-09-12T00:53:13.755700+0000","last_peered":"2024-09-12T00:53:13.755700+0000","last_clean":"2024-09-12T00:53:13.755700+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:53:13.755700+0000","last_undegraded":"2024-09-12T00:53:13.755700+0000","last_fullsized":"2024-09-12T00:53:13.755700+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'771","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.245517+0000","last_change":"2024-09-12T00:11:47.926772+0000","last_active":"2024-09-12T00:53:00.245517+0000","last_peered":"2024-09-12T00:53:00.245517+0000","last_clean":"2024-09-12T00:53:00.245517+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:53:00.245517+0000","last_undegraded":"2024-09-12T00:53:00.245517+0000","last_fullsized":"2024-09-12T00:53:00.245517+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'189","reported_seq":830,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.085599+0000","last_change":"2024-09-12T00:11:45.915920+0000","last_active":"2024-09-12T00:54:31.085599+0000","last_peered":"2024-09-12T00:54:31.085599+0000","last_clean":"2024-09-12T00:54:31.085599+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:31.085599+0000","last_undegraded":"2024-09-12T00:54:31.085599+0000","last_fullsized":"2024-09-12T00:54:31.085599+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:59.681239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5267641,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":432,"num_read_kb":25665,"num_write":919,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121782+0000","last_change":"2024-09-12T00:11:49.923313+0000","last_active":"2024-09-12T00:51:31.121782+0000","last_peered":"2024-09-12T00:51:31.121782+0000","last_clean":"2024-09-12T00:51:31.121782+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:51:31.121782+0000","last_undegraded":"2024-09-12T00:51:31.121782+0000","last_fullsized":"2024-09-12T00:51:31.121782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'173","reported_seq":758,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.956572+0000","last_change":"2024-09-12T00:11:51.938094+0000","last_active":"2024-09-12T00:53:55.956572+0000","last_peered":"2024-09-12T00:53:55.956572+0000","last_clean":"2024-09-12T00:53:55.956572+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:53:55.956572+0000","last_undegraded":"2024-09-12T00:53:55.956572+0000","last_fullsized":"2024-09-12T00:53:55.956572+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11244,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":285,"num_write":130,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104093+0000","last_change":"2024-09-12T00:11:53.955154+0000","last_active":"2024-09-12T00:51:36.104093+0000","last_peered":"2024-09-12T00:51:36.104093+0000","last_clean":"2024-09-12T00:51:36.104093+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:51:36.104093+0000","last_undegraded":"2024-09-12T00:51:36.104093+0000","last_fullsized":"2024-09-12T00:51:36.104093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:55.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'104","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.550126+0000","last_change":"2024-09-12T00:11:55.959282+0000","last_active":"2024-09-12T00:52:29.550126+0000","last_peered":"2024-09-12T00:52:29.550126+0000","last_clean":"2024-09-12T00:52:29.550126+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:52:29.550126+0000","last_undegraded":"2024-09-12T00:52:29.550126+0000","last_fullsized":"2024-09-12T00:52:29.550126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:03.301311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'808","reported_seq":2294,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.551364+0000","last_change":"2024-09-12T00:11:47.933067+0000","last_active":"2024-09-12T00:52:56.551364+0000","last_peered":"2024-09-12T00:52:56.551364+0000","last_clean":"2024-09-12T00:52:56.551364+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:52:56.551364+0000","last_undegraded":"2024-09-12T00:52:56.551364+0000","last_fullsized":"2024-09-12T00:52:56.551364+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.114451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'186","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.255863+0000","last_change":"2024-09-12T00:11:45.958369+0000","last_active":"2024-09-12T00:53:11.255863+0000","last_peered":"2024-09-12T00:53:11.255863+0000","last_clean":"2024-09-12T00:53:11.255863+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:53:11.255863+0000","last_undegraded":"2024-09-12T00:53:11.255863+0000","last_fullsized":"2024-09-12T00:53:11.255863+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:06.439973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15390438,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":452,"num_read_kb":36400,"num_write":895,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.945612+0000","last_change":"2024-09-12T00:11:49.928504+0000","last_active":"2024-09-12T00:51:30.945612+0000","last_peered":"2024-09-12T00:51:30.945612+0000","last_clean":"2024-09-12T00:51:30.945612+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:51:30.945612+0000","last_undegraded":"2024-09-12T00:51:30.945612+0000","last_fullsized":"2024-09-12T00:51:30.945612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:00.545918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'127","reported_seq":684,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:55.956356+0000","last_change":"2024-09-12T00:11:51.951940+0000","last_active":"2024-09-12T00:53:55.956356+0000","last_peered":"2024-09-12T00:53:55.956356+0000","last_clean":"2024-09-12T00:53:55.956356+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:53:55.956356+0000","last_undegraded":"2024-09-12T00:53:55.956356+0000","last_fullsized":"2024-09-12T00:53:55.956356+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.384189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9115,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":163,"num_read_kb":221,"num_write":90,"num_write_kb":22,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926323+0000","last_change":"2024-09-12T00:11:53.970031+0000","last_active":"2024-09-12T00:51:35.926323+0000","last_peered":"2024-09-12T00:51:35.926323+0000","last_clean":"2024-09-12T00:51:35.926323+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:51:35.926323+0000","last_undegraded":"2024-09-12T00:51:35.926323+0000","last_fullsized":"2024-09-12T00:51:35.926323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.869156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'722","reported_seq":2103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.974112+0000","last_change":"2024-09-12T00:11:47.944209+0000","last_active":"2024-09-12T00:53:30.974112+0000","last_peered":"2024-09-12T00:53:30.974112+0000","last_clean":"2024-09-12T00:53:30.974112+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:53:30.974112+0000","last_undegraded":"2024-09-12T00:53:30.974112+0000","last_fullsized":"2024-09-12T00:53:30.974112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:07.479060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'183","reported_seq":801,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.111330+0000","last_change":"2024-09-12T00:11:45.967978+0000","last_active":"2024-09-12T00:53:01.111330+0000","last_peered":"2024-09-12T00:53:01.111330+0000","last_clean":"2024-09-12T00:53:01.111330+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:53:01.111330+0000","last_undegraded":"2024-09-12T00:53:01.111330+0000","last_fullsized":"2024-09-12T00:53:01.111330+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:25.205405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7264373,"num_objects":12,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":379,"num_read_kb":8086,"num_write":857,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928734+0000","last_change":"2024-09-12T00:11:49.940476+0000","last_active":"2024-09-12T00:52:00.928734+0000","last_peered":"2024-09-12T00:52:00.928734+0000","last_clean":"2024-09-12T00:52:00.928734+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:52:00.928734+0000","last_undegraded":"2024-09-12T00:52:00.928734+0000","last_fullsized":"2024-09-12T00:52:00.928734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.808496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'190","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.328604+0000","last_change":"2024-09-12T00:11:51.955207+0000","last_active":"2024-09-12T00:54:18.328604+0000","last_peered":"2024-09-12T00:54:18.328604+0000","last_clean":"2024-09-12T00:54:18.328604+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:54:18.328604+0000","last_undegraded":"2024-09-12T00:54:18.328604+0000","last_fullsized":"2024-09-12T00:54:18.328604+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:43.145562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23262,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":290,"num_read_kb":373,"num_write":186,"num_write_kb":118,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.127739+0000","last_change":"2024-09-12T00:11:53.970075+0000","last_active":"2024-09-12T00:51:56.127739+0000","last_peered":"2024-09-12T00:51:56.127739+0000","last_clean":"2024-09-12T00:51:56.127739+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:51:56.127739+0000","last_undegraded":"2024-09-12T00:51:56.127739+0000","last_fullsized":"2024-09-12T00:51:56.127739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.073296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'153","reported_seq":652,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967355+0000","last_change":"2024-09-12T00:11:55.983643+0000","last_active":"2024-09-12T00:53:59.967355+0000","last_peered":"2024-09-12T00:53:59.967355+0000","last_clean":"2024-09-12T00:53:59.967355+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:53:59.967355+0000","last_undegraded":"2024-09-12T00:53:59.967355+0000","last_fullsized":"2024-09-12T00:53:59.967355+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:01.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'499","reported_seq":2219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.214803+0000","last_change":"2024-09-12T00:11:47.931274+0000","last_active":"2024-09-12T00:53:59.214803+0000","last_peered":"2024-09-12T00:53:59.214803+0000","last_clean":"2024-09-12T00:53:59.214803+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:53:59.214803+0000","last_undegraded":"2024-09-12T00:53:59.214803+0000","last_fullsized":"2024-09-12T00:53:59.214803+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:56.542635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'199","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.406760+0000","last_change":"2024-09-12T00:11:45.930986+0000","last_active":"2024-09-12T00:52:33.406760+0000","last_peered":"2024-09-12T00:52:33.406760+0000","last_clean":"2024-09-12T00:52:33.406760+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:52:33.406760+0000","last_undegraded":"2024-09-12T00:52:33.406760+0000","last_fullsized":"2024-09-12T00:52:33.406760+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:07.918577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5315388,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":541,"num_read_kb":23120,"num_write":963,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:26.120894+0000","last_change":"2024-09-12T00:11:49.940474+0000","last_active":"2024-09-12T00:51:26.120894+0000","last_peered":"2024-09-12T00:51:26.120894+0000","last_clean":"2024-09-12T00:51:26.120894+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:51:26.120894+0000","last_undegraded":"2024-09-12T00:51:26.120894+0000","last_fullsized":"2024-09-12T00:51:26.120894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:37.832060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'161","reported_seq":738,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.281148+0000","last_change":"2024-09-12T00:11:51.943970+0000","last_active":"2024-09-12T00:54:18.281148+0000","last_peered":"2024-09-12T00:54:18.281148+0000","last_clean":"2024-09-12T00:54:18.281148+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:54:18.281148+0000","last_undegraded":"2024-09-12T00:54:18.281148+0000","last_fullsized":"2024-09-12T00:54:18.281148+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:17.685375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10349,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":217,"num_read_kb":272,"num_write":142,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:54.937822+0000","last_change":"2024-09-12T00:11:53.969086+0000","last_active":"2024-09-12T00:51:54.937822+0000","last_peered":"2024-09-12T00:51:54.937822+0000","last_clean":"2024-09-12T00:51:54.937822+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:51:54.937822+0000","last_undegraded":"2024-09-12T00:51:54.937822+0000","last_fullsized":"2024-09-12T00:51:54.937822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.001970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.122045+0000","last_change":"2024-09-12T00:11:55.970975+0000","last_active":"2024-09-12T00:54:17.122045+0000","last_peered":"2024-09-12T00:54:17.122045+0000","last_clean":"2024-09-12T00:54:17.122045+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:54:17.122045+0000","last_undegraded":"2024-09-12T00:54:17.122045+0000","last_fullsized":"2024-09-12T00:54:17.122045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:19.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'810","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749355+0000","last_change":"2024-09-12T00:11:47.946771+0000","last_active":"2024-09-12T00:53:13.749355+0000","last_peered":"2024-09-12T00:53:13.749355+0000","last_clean":"2024-09-12T00:53:13.749355+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:53:13.749355+0000","last_undegraded":"2024-09-12T00:53:13.749355+0000","last_fullsized":"2024-09-12T00:53:13.749355+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:20.616253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'208","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.134591+0000","last_change":"2024-09-12T00:11:45.950887+0000","last_active":"2024-09-12T00:54:16.134591+0000","last_peered":"2024-09-12T00:54:16.134591+0000","last_clean":"2024-09-12T00:54:16.134591+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:16.134591+0000","last_undegraded":"2024-09-12T00:54:16.134591+0000","last_fullsized":"2024-09-12T00:54:16.134591+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.570694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388623,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":378,"num_read_kb":5549,"num_write":1013,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126599+0000","last_change":"2024-09-12T00:11:49.932242+0000","last_active":"2024-09-12T00:51:51.126599+0000","last_peered":"2024-09-12T00:51:51.126599+0000","last_clean":"2024-09-12T00:51:51.126599+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:51:51.126599+0000","last_undegraded":"2024-09-12T00:51:51.126599+0000","last_fullsized":"2024-09-12T00:51:51.126599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:01.572248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'146","reported_seq":723,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:35.949198+0000","last_change":"2024-09-12T00:11:51.947579+0000","last_active":"2024-09-12T00:53:35.949198+0000","last_peered":"2024-09-12T00:53:35.949198+0000","last_clean":"2024-09-12T00:53:35.949198+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:53:35.949198+0000","last_undegraded":"2024-09-12T00:53:35.949198+0000","last_fullsized":"2024-09-12T00:53:35.949198+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:01.742280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13472,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":177,"num_read_kb":193,"num_write":100,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932799+0000","last_change":"2024-09-12T00:11:53.966010+0000","last_active":"2024-09-12T00:52:05.932799+0000","last_peered":"2024-09-12T00:52:05.932799+0000","last_clean":"2024-09-12T00:52:05.932799+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:52:05.932799+0000","last_undegraded":"2024-09-12T00:52:05.932799+0000","last_fullsized":"2024-09-12T00:52:05.932799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.714255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'153","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.341421+0000","last_change":"2024-09-12T00:11:55.984385+0000","last_active":"2024-09-12T00:54:18.341421+0000","last_peered":"2024-09-12T00:54:18.341421+0000","last_clean":"2024-09-12T00:54:18.341421+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:54:18.341421+0000","last_undegraded":"2024-09-12T00:54:18.341421+0000","last_fullsized":"2024-09-12T00:54:18.341421+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:18.613083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'789","reported_seq":2425,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981146+0000","last_change":"2024-09-12T00:11:47.953467+0000","last_active":"2024-09-12T00:53:01.981146+0000","last_peered":"2024-09-12T00:53:01.981146+0000","last_clean":"2024-09-12T00:53:01.981146+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:53:01.981146+0000","last_undegraded":"2024-09-12T00:53:01.981146+0000","last_fullsized":"2024-09-12T00:53:01.981146+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.239103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'206","reported_seq":858,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.045447+0000","last_change":"2024-09-12T00:11:45.933222+0000","last_active":"2024-09-12T00:52:24.045447+0000","last_peered":"2024-09-12T00:52:24.045447+0000","last_clean":"2024-09-12T00:52:24.045447+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:52:24.045447+0000","last_undegraded":"2024-09-12T00:52:24.045447+0000","last_fullsized":"2024-09-12T00:52:24.045447+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:11.850109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6604377,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":521,"num_read_kb":30758,"num_write":1016,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931153+0000","last_change":"2024-09-12T00:11:49.944879+0000","last_active":"2024-09-12T00:51:50.931153+0000","last_peered":"2024-09-12T00:51:50.931153+0000","last_clean":"2024-09-12T00:51:50.931153+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:51:50.931153+0000","last_undegraded":"2024-09-12T00:51:50.931153+0000","last_fullsized":"2024-09-12T00:51:50.931153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.523417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'95","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954504+0000","last_change":"2024-09-12T00:11:51.938728+0000","last_active":"2024-09-12T00:52:05.954504+0000","last_peered":"2024-09-12T00:52:05.954504+0000","last_clean":"2024-09-12T00:52:05.954504+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:52:05.954504+0000","last_undegraded":"2024-09-12T00:52:05.954504+0000","last_fullsized":"2024-09-12T00:52:05.954504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:11.275648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'752","reported_seq":2385,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.362874+0000","last_change":"2024-09-12T00:11:53.945013+0000","last_active":"2024-09-12T00:54:18.362874+0000","last_peered":"2024-09-12T00:54:18.362874+0000","last_clean":"2024-09-12T00:54:18.362874+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:18.362874+0000","last_undegraded":"2024-09-12T00:54:18.362874+0000","last_fullsized":"2024-09-12T00:54:18.362874+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:55.474571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.361616+0000","last_change":"2024-09-12T00:11:55.961931+0000","last_active":"2024-09-12T00:53:14.361616+0000","last_peered":"2024-09-12T00:53:14.361616+0000","last_clean":"2024-09-12T00:53:14.361616+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:53:14.361616+0000","last_undegraded":"2024-09-12T00:53:14.361616+0000","last_fullsized":"2024-09-12T00:53:14.361616+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.615113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'464","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.299711+0000","last_change":"2024-09-12T00:11:47.941918+0000","last_active":"2024-09-12T00:52:59.299711+0000","last_peered":"2024-09-12T00:52:59.299711+0000","last_clean":"2024-09-12T00:52:59.299711+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:52:59.299711+0000","last_undegraded":"2024-09-12T00:52:59.299711+0000","last_fullsized":"2024-09-12T00:52:59.299711+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:21.380303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'212","reported_seq":856,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:16.134651+0000","last_change":"2024-09-12T00:11:45.950800+0000","last_active":"2024-09-12T00:54:16.134651+0000","last_peered":"2024-09-12T00:54:16.134651+0000","last_clean":"2024-09-12T00:54:16.134651+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:16.134651+0000","last_undegraded":"2024-09-12T00:54:16.134651+0000","last_fullsized":"2024-09-12T00:54:16.134651+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":200,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:25.266687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9206037,"num_objects":16,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":458,"num_read_kb":55718,"num_write":994,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.107449+0000","last_change":"2024-09-12T00:11:49.920143+0000","last_active":"2024-09-12T00:51:51.107449+0000","last_peered":"2024-09-12T00:51:51.107449+0000","last_clean":"2024-09-12T00:51:51.107449+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:51:51.107449+0000","last_undegraded":"2024-09-12T00:51:51.107449+0000","last_fullsized":"2024-09-12T00:51:51.107449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:13.928120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'185","reported_seq":781,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.948913+0000","last_change":"2024-09-12T00:11:51.942692+0000","last_active":"2024-09-12T00:53:10.948913+0000","last_peered":"2024-09-12T00:53:10.948913+0000","last_clean":"2024-09-12T00:53:10.948913+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:53:10.948913+0000","last_undegraded":"2024-09-12T00:53:10.948913+0000","last_fullsized":"2024-09-12T00:53:10.948913+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":100,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.066244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11309,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":236,"num_read_kb":288,"num_write":136,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.913907+0000","last_change":"2024-09-12T00:11:53.968374+0000","last_active":"2024-09-12T00:50:35.913907+0000","last_peered":"2024-09-12T00:50:35.913907+0000","last_clean":"2024-09-12T00:50:35.913907+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:50:35.913907+0000","last_undegraded":"2024-09-12T00:50:35.913907+0000","last_fullsized":"2024-09-12T00:50:35.913907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:08.048773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'124","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.975045+0000","last_change":"2024-09-12T00:11:55.975761+0000","last_active":"2024-09-12T00:53:01.975045+0000","last_peered":"2024-09-12T00:53:01.975045+0000","last_clean":"2024-09-12T00:53:01.975045+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:53:01.975045+0000","last_undegraded":"2024-09-12T00:53:01.975045+0000","last_fullsized":"2024-09-12T00:53:01.975045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:21.563576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'923","reported_seq":2627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217609+0000","last_change":"2024-09-12T00:11:47.940921+0000","last_active":"2024-09-12T00:53:59.217609+0000","last_peered":"2024-09-12T00:53:59.217609+0000","last_clean":"2024-09-12T00:53:59.217609+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:53:59.217609+0000","last_undegraded":"2024-09-12T00:53:59.217609+0000","last_fullsized":"2024-09-12T00:53:59.217609+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:58.054782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'216","reported_seq":833,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.684144+0000","last_change":"2024-09-12T00:11:45.930250+0000","last_active":"2024-09-12T00:52:33.684144+0000","last_peered":"2024-09-12T00:52:33.684144+0000","last_clean":"2024-09-12T00:52:33.684144+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:52:33.684144+0000","last_undegraded":"2024-09-12T00:52:33.684144+0000","last_fullsized":"2024-09-12T00:52:33.684144+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:11.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277951,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":412,"num_read_kb":8883,"num_write":985,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126541+0000","last_change":"2024-09-12T00:11:49.932760+0000","last_active":"2024-09-12T00:51:51.126541+0000","last_peered":"2024-09-12T00:51:51.126541+0000","last_clean":"2024-09-12T00:51:51.126541+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:51:51.126541+0000","last_undegraded":"2024-09-12T00:51:51.126541+0000","last_fullsized":"2024-09-12T00:51:51.126541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:03.502198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'128","reported_seq":698,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.945884+0000","last_change":"2024-09-12T00:11:51.948398+0000","last_active":"2024-09-12T00:53:00.945884+0000","last_peered":"2024-09-12T00:53:00.945884+0000","last_clean":"2024-09-12T00:53:00.945884+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:53:00.945884+0000","last_undegraded":"2024-09-12T00:53:00.945884+0000","last_fullsized":"2024-09-12T00:53:00.945884+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:24.018531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15063,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":164,"num_read_kb":231,"num_write":88,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934303+0000","last_change":"2024-09-12T00:11:53.964372+0000","last_active":"2024-09-12T00:50:45.934303+0000","last_peered":"2024-09-12T00:50:45.934303+0000","last_clean":"2024-09-12T00:50:45.934303+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:50:45.934303+0000","last_undegraded":"2024-09-12T00:50:45.934303+0000","last_fullsized":"2024-09-12T00:50:45.934303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:46.181767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'122","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.250013+0000","last_change":"2024-09-12T00:11:55.983399+0000","last_active":"2024-09-12T00:53:00.250013+0000","last_peered":"2024-09-12T00:53:00.250013+0000","last_clean":"2024-09-12T00:53:00.250013+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:53:00.250013+0000","last_undegraded":"2024-09-12T00:53:00.250013+0000","last_fullsized":"2024-09-12T00:53:00.250013+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.340677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'510","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981820+0000","last_change":"2024-09-12T00:11:47.945866+0000","last_active":"2024-09-12T00:53:01.981820+0000","last_peered":"2024-09-12T00:53:01.981820+0000","last_clean":"2024-09-12T00:53:01.981820+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:53:01.981820+0000","last_undegraded":"2024-09-12T00:53:01.981820+0000","last_fullsized":"2024-09-12T00:53:01.981820+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:11.670029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'211","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.939064+0000","last_change":"2024-09-12T00:11:45.965907+0000","last_active":"2024-09-12T00:51:59.939064+0000","last_peered":"2024-09-12T00:51:59.939064+0000","last_clean":"2024-09-12T00:51:59.939064+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:51:59.939064+0000","last_undegraded":"2024-09-12T00:51:59.939064+0000","last_fullsized":"2024-09-12T00:51:59.939064+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:25.908411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":637093,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":447,"num_read_kb":6403,"num_write":965,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:31.087675+0000","last_change":"2024-09-12T00:11:49.916956+0000","last_active":"2024-09-12T00:50:31.087675+0000","last_peered":"2024-09-12T00:50:31.087675+0000","last_clean":"2024-09-12T00:50:31.087675+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:50:31.087675+0000","last_undegraded":"2024-09-12T00:50:31.087675+0000","last_fullsized":"2024-09-12T00:50:31.087675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.223448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'98","reported_seq":657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.317551+0000","last_change":"2024-09-12T00:11:51.934188+0000","last_active":"2024-09-12T00:54:18.317551+0000","last_peered":"2024-09-12T00:54:18.317551+0000","last_clean":"2024-09-12T00:54:18.317551+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:18.317551+0000","last_undegraded":"2024-09-12T00:54:18.317551+0000","last_fullsized":"2024-09-12T00:54:18.317551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":0,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.730149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10408,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":126,"num_read_kb":180,"num_write":60,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.951806+0000","last_change":"2024-09-12T00:11:53.953440+0000","last_active":"2024-09-12T00:51:55.951806+0000","last_peered":"2024-09-12T00:51:55.951806+0000","last_clean":"2024-09-12T00:51:55.951806+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:51:55.951806+0000","last_undegraded":"2024-09-12T00:51:55.951806+0000","last_fullsized":"2024-09-12T00:51:55.951806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:27.100590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'166","reported_seq":1291,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.040679+0000","last_change":"2024-09-12T00:11:55.977584+0000","last_active":"2024-09-12T00:53:12.040679+0000","last_peered":"2024-09-12T00:53:12.040679+0000","last_clean":"2024-09-12T00:53:12.040679+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:53:12.040679+0000","last_undegraded":"2024-09-12T00:53:12.040679+0000","last_fullsized":"2024-09-12T00:53:12.040679+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:56.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'389","reported_seq":1782,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.983959+0000","last_change":"2024-09-12T00:11:47.935949+0000","last_active":"2024-09-12T00:53:01.983959+0000","last_peered":"2024-09-12T00:53:01.983959+0000","last_clean":"2024-09-12T00:53:01.983959+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:53:01.983959+0000","last_undegraded":"2024-09-12T00:53:01.983959+0000","last_fullsized":"2024-09-12T00:53:01.983959+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:17.556138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'222","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:42.017931+0000","last_change":"2024-09-12T00:11:45.966312+0000","last_active":"2024-09-12T00:51:42.017931+0000","last_peered":"2024-09-12T00:51:42.017931+0000","last_clean":"2024-09-12T00:51:42.017931+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:51:42.017931+0000","last_undegraded":"2024-09-12T00:51:42.017931+0000","last_fullsized":"2024-09-12T00:51:42.017931+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:38.020981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4483681,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":454,"num_read_kb":20983,"num_write":1043,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.915124+0000","last_change":"2024-09-12T00:11:49.935062+0000","last_active":"2024-09-12T00:50:40.915124+0000","last_peered":"2024-09-12T00:50:40.915124+0000","last_clean":"2024-09-12T00:50:40.915124+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:50:40.915124+0000","last_undegraded":"2024-09-12T00:50:40.915124+0000","last_fullsized":"2024-09-12T00:50:40.915124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:45.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'173","reported_seq":763,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.328228+0000","last_change":"2024-09-12T00:11:51.953534+0000","last_active":"2024-09-12T00:54:18.328228+0000","last_peered":"2024-09-12T00:54:18.328228+0000","last_clean":"2024-09-12T00:54:18.328228+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:54:18.328228+0000","last_undegraded":"2024-09-12T00:54:18.328228+0000","last_fullsized":"2024-09-12T00:54:18.328228+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:08.139733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17971,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":226,"num_read_kb":295,"num_write":132,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.932205+0000","last_change":"2024-09-12T00:11:53.964796+0000","last_active":"2024-09-12T00:51:55.932205+0000","last_peered":"2024-09-12T00:51:55.932205+0000","last_clean":"2024-09-12T00:51:55.932205+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:51:55.932205+0000","last_undegraded":"2024-09-12T00:51:55.932205+0000","last_fullsized":"2024-09-12T00:51:55.932205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:35.493703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'120","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.194988+0000","last_change":"2024-09-12T00:11:55.976617+0000","last_active":"2024-09-12T00:54:17.194988+0000","last_peered":"2024-09-12T00:54:17.194988+0000","last_clean":"2024-09-12T00:54:17.194988+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:54:17.194988+0000","last_undegraded":"2024-09-12T00:54:17.194988+0000","last_fullsized":"2024-09-12T00:54:17.194988+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:04.168911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'498","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.933790+0000","last_change":"2024-09-12T00:11:47.934353+0000","last_active":"2024-09-12T00:53:00.933790+0000","last_peered":"2024-09-12T00:53:00.933790+0000","last_clean":"2024-09-12T00:53:00.933790+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:53:00.933790+0000","last_undegraded":"2024-09-12T00:53:00.933790+0000","last_fullsized":"2024-09-12T00:53:00.933790+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:35.038205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'188","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.250021+0000","last_change":"2024-09-12T00:11:45.927795+0000","last_active":"2024-09-12T00:52:56.250021+0000","last_peered":"2024-09-12T00:52:56.250021+0000","last_clean":"2024-09-12T00:52:56.250021+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:52:56.250021+0000","last_undegraded":"2024-09-12T00:52:56.250021+0000","last_fullsized":"2024-09-12T00:52:56.250021+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:34.884235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11557112,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":480,"num_read_kb":61937,"num_write":915,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'816","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.944422+0000","last_change":"2024-09-12T00:11:47.956154+0000","last_active":"2024-09-12T00:53:00.944422+0000","last_peered":"2024-09-12T00:53:00.944422+0000","last_clean":"2024-09-12T00:53:00.944422+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:53:00.944422+0000","last_undegraded":"2024-09-12T00:53:00.944422+0000","last_fullsized":"2024-09-12T00:53:00.944422+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:03.574450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'183","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:32.791802+0000","last_change":"2024-09-12T00:11:45.938208+0000","last_active":"2024-09-12T00:52:32.791802+0000","last_peered":"2024-09-12T00:52:32.791802+0000","last_clean":"2024-09-12T00:52:32.791802+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:52:32.791802+0000","last_undegraded":"2024-09-12T00:52:32.791802+0000","last_fullsized":"2024-09-12T00:52:32.791802+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.569205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6645389,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":412,"num_read_kb":18747,"num_write":855,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1200","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.294002+0000","last_change":"2024-09-12T00:11:47.923352+0000","last_active":"2024-09-12T00:53:59.294002+0000","last_peered":"2024-09-12T00:53:59.294002+0000","last_clean":"2024-09-12T00:53:59.294002+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:53:59.294002+0000","last_undegraded":"2024-09-12T00:53:59.294002+0000","last_fullsized":"2024-09-12T00:53:59.294002+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'206","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.402474+0000","last_change":"2024-09-12T00:11:45.955798+0000","last_active":"2024-09-12T00:53:11.402474+0000","last_peered":"2024-09-12T00:53:11.402474+0000","last_clean":"2024-09-12T00:53:11.402474+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:53:11.402474+0000","last_undegraded":"2024-09-12T00:53:11.402474+0000","last_fullsized":"2024-09-12T00:53:11.402474+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:10.064782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14466751,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":435,"num_read_kb":35398,"num_write":966,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'471","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.953028+0000","last_change":"2024-09-12T00:11:47.925461+0000","last_active":"2024-09-12T00:52:59.953028+0000","last_peered":"2024-09-12T00:52:59.953028+0000","last_clean":"2024-09-12T00:52:59.953028+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:52:59.953028+0000","last_undegraded":"2024-09-12T00:52:59.953028+0000","last_fullsized":"2024-09-12T00:52:59.953028+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:27.139459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'197","reported_seq":825,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:39.211022+0000","last_change":"2024-09-12T00:11:45.963753+0000","last_active":"2024-09-12T00:52:39.211022+0000","last_peered":"2024-09-12T00:52:39.211022+0000","last_clean":"2024-09-12T00:52:39.211022+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:52:39.211022+0000","last_undegraded":"2024-09-12T00:52:39.211022+0000","last_fullsized":"2024-09-12T00:52:39.211022+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.076031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5308112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":421,"num_read_kb":18770,"num_write":977,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'803","reported_seq":2332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:39.962743+0000","last_change":"2024-09-12T00:11:47.933827+0000","last_active":"2024-09-12T00:53:39.962743+0000","last_peered":"2024-09-12T00:53:39.962743+0000","last_clean":"2024-09-12T00:53:39.962743+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:53:39.962743+0000","last_undegraded":"2024-09-12T00:53:39.962743+0000","last_fullsized":"2024-09-12T00:53:39.962743+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:55.730348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'242","reported_seq":913,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:38.480550+0000","last_change":"2024-09-12T00:11:45.938920+0000","last_active":"2024-09-12T00:51:38.480550+0000","last_peered":"2024-09-12T00:51:38.480550+0000","last_clean":"2024-09-12T00:51:38.480550+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:51:38.480550+0000","last_undegraded":"2024-09-12T00:51:38.480550+0000","last_fullsized":"2024-09-12T00:51:38.480550+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":200,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:19.946280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6987873,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":608,"num_read_kb":28384,"num_write":1050,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'476","reported_seq":1937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369796+0000","last_change":"2024-09-12T00:11:47.930919+0000","last_active":"2024-09-12T00:53:14.369796+0000","last_peered":"2024-09-12T00:53:14.369796+0000","last_clean":"2024-09-12T00:53:14.369796+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:53:14.369796+0000","last_undegraded":"2024-09-12T00:53:14.369796+0000","last_fullsized":"2024-09-12T00:53:14.369796+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:25.247323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'286","reported_seq":1098,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:40.933503+0000","last_change":"2024-09-12T00:11:45.938219+0000","last_active":"2024-09-12T00:52:40.933503+0000","last_peered":"2024-09-12T00:52:40.933503+0000","last_clean":"2024-09-12T00:52:40.933503+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:52:40.933503+0000","last_undegraded":"2024-09-12T00:52:40.933503+0000","last_fullsized":"2024-09-12T00:52:40.933503+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":200,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.279970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4277127,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1391,"num_read_kb":1619,"num_write":1270,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'611","reported_seq":2341,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.506794+0000","last_change":"2024-09-12T00:11:47.950515+0000","last_active":"2024-09-12T00:53:10.506794+0000","last_peered":"2024-09-12T00:53:10.506794+0000","last_clean":"2024-09-12T00:53:10.506794+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:53:10.506794+0000","last_undegraded":"2024-09-12T00:53:10.506794+0000","last_fullsized":"2024-09-12T00:53:10.506794+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:14.307717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'226","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.109362+0000","last_change":"2024-09-12T00:11:45.921722+0000","last_active":"2024-09-12T00:54:31.109362+0000","last_peered":"2024-09-12T00:54:31.109362+0000","last_clean":"2024-09-12T00:54:31.109362+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:31.109362+0000","last_undegraded":"2024-09-12T00:54:31.109362+0000","last_fullsized":"2024-09-12T00:54:31.109362+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9289927,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":430,"num_read_kb":17177,"num_write":1051,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1255","reported_seq":3015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.372859+0000","last_change":"2024-09-12T00:11:47.924558+0000","last_active":"2024-09-12T00:53:14.372859+0000","last_peered":"2024-09-12T00:53:14.372859+0000","last_clean":"2024-09-12T00:53:14.372859+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:53:14.372859+0000","last_undegraded":"2024-09-12T00:53:14.372859+0000","last_fullsized":"2024-09-12T00:53:14.372859+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:39.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'271","reported_seq":916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:36.782753+0000","last_change":"2024-09-12T00:11:45.965487+0000","last_active":"2024-09-12T00:52:36.782753+0000","last_peered":"2024-09-12T00:52:36.782753+0000","last_clean":"2024-09-12T00:52:36.782753+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:52:36.782753+0000","last_undegraded":"2024-09-12T00:52:36.782753+0000","last_fullsized":"2024-09-12T00:52:36.782753+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":200,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:11.343524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5071032,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":542,"num_read_kb":15585,"num_write":1261,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'826","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.503633+0000","last_change":"2024-09-12T00:11:47.951105+0000","last_active":"2024-09-12T00:53:10.503633+0000","last_peered":"2024-09-12T00:53:10.503633+0000","last_clean":"2024-09-12T00:53:10.503633+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:53:10.503633+0000","last_undegraded":"2024-09-12T00:53:10.503633+0000","last_fullsized":"2024-09-12T00:53:10.503633+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:49.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'249","reported_seq":890,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:52.659064+0000","last_change":"2024-09-12T00:11:45.963287+0000","last_active":"2024-09-12T00:52:52.659064+0000","last_peered":"2024-09-12T00:52:52.659064+0000","last_clean":"2024-09-12T00:52:52.659064+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:52:52.659064+0000","last_undegraded":"2024-09-12T00:52:52.659064+0000","last_fullsized":"2024-09-12T00:52:52.659064+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":200,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.996463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":14313078,"num_objects":11,"num_object_clones":0,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":589,"num_read_kb":58641,"num_write":1116,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1327","reported_seq":2850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:50.955784+0000","last_change":"2024-09-12T00:11:47.934364+0000","last_active":"2024-09-12T00:53:50.955784+0000","last_peered":"2024-09-12T00:53:50.955784+0000","last_clean":"2024-09-12T00:53:50.955784+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:53:50.955784+0000","last_undegraded":"2024-09-12T00:53:50.955784+0000","last_fullsized":"2024-09-12T00:53:50.955784+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'191","reported_seq":810,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:42.943924+0000","last_change":"2024-09-12T00:11:45.963871+0000","last_active":"2024-09-12T00:52:42.943924+0000","last_peered":"2024-09-12T00:52:42.943924+0000","last_clean":"2024-09-12T00:52:42.943924+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:52:42.943924+0000","last_undegraded":"2024-09-12T00:52:42.943924+0000","last_fullsized":"2024-09-12T00:52:42.943924+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.697592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9732406,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":445,"num_read_kb":34280,"num_write":924,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'551","reported_seq":2098,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.490083+0000","last_change":"2024-09-12T00:11:47.935891+0000","last_active":"2024-09-12T00:53:10.490083+0000","last_peered":"2024-09-12T00:53:10.490083+0000","last_clean":"2024-09-12T00:53:10.490083+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:53:10.490083+0000","last_undegraded":"2024-09-12T00:53:10.490083+0000","last_fullsized":"2024-09-12T00:53:10.490083+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:40.527099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'225","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:16.112540+0000","last_change":"2024-09-12T00:11:45.923906+0000","last_active":"2024-09-12T00:52:16.112540+0000","last_peered":"2024-09-12T00:52:16.112540+0000","last_clean":"2024-09-12T00:52:16.112540+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:52:16.112540+0000","last_undegraded":"2024-09-12T00:52:16.112540+0000","last_fullsized":"2024-09-12T00:52:16.112540+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:44.019789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7677221,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":742,"num_read_kb":61726,"num_write":1106,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'700","reported_seq":2496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.504786+0000","last_change":"2024-09-12T00:11:47.936000+0000","last_active":"2024-09-12T00:53:10.504786+0000","last_peered":"2024-09-12T00:53:10.504786+0000","last_clean":"2024-09-12T00:53:10.504786+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:53:10.504786+0000","last_undegraded":"2024-09-12T00:53:10.504786+0000","last_fullsized":"2024-09-12T00:53:10.504786+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:13.990104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'205","reported_seq":815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.400956+0000","last_change":"2024-09-12T00:11:45.945290+0000","last_active":"2024-09-12T00:53:11.400956+0000","last_peered":"2024-09-12T00:53:11.400956+0000","last_clean":"2024-09-12T00:53:11.400956+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:53:11.400956+0000","last_undegraded":"2024-09-12T00:53:11.400956+0000","last_fullsized":"2024-09-12T00:53:11.400956+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.645752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9737824,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":428,"num_read_kb":13749,"num_write":931,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'963","reported_seq":2517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.236155+0000","last_change":"2024-09-12T00:11:47.941903+0000","last_active":"2024-09-12T00:53:00.236155+0000","last_peered":"2024-09-12T00:53:00.236155+0000","last_clean":"2024-09-12T00:53:00.236155+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:53:00.236155+0000","last_undegraded":"2024-09-12T00:53:00.236155+0000","last_fullsized":"2024-09-12T00:53:00.236155+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":900,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:03:15.435909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'208","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:44.299796+0000","last_change":"2024-09-12T00:11:45.937710+0000","last_active":"2024-09-12T00:52:44.299796+0000","last_peered":"2024-09-12T00:52:44.299796+0000","last_clean":"2024-09-12T00:52:44.299796+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:52:44.299796+0000","last_undegraded":"2024-09-12T00:52:44.299796+0000","last_fullsized":"2024-09-12T00:52:44.299796+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:53.751417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2072216,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":584,"num_read_kb":23861,"num_write":1048,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'752","reported_seq":2227,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.968292+0000","last_change":"2024-09-12T00:11:47.940732+0000","last_active":"2024-09-12T00:53:01.968292+0000","last_peered":"2024-09-12T00:53:01.968292+0000","last_clean":"2024-09-12T00:53:01.968292+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:53:01.968292+0000","last_undegraded":"2024-09-12T00:53:01.968292+0000","last_fullsized":"2024-09-12T00:53:01.968292+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.413376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'162","reported_seq":765,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.559498+0000","last_change":"2024-09-12T00:11:45.934430+0000","last_active":"2024-09-12T00:53:01.559498+0000","last_peered":"2024-09-12T00:53:01.559498+0000","last_clean":"2024-09-12T00:53:01.559498+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:53:01.559498+0000","last_undegraded":"2024-09-12T00:53:01.559498+0000","last_fullsized":"2024-09-12T00:53:01.559498+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":100,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.951800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1470357,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":369,"num_read_kb":3653,"num_write":815,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'834","reported_seq":2657,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.968223+0000","last_change":"2024-09-12T00:11:47.951096+0000","last_active":"2024-09-12T00:53:01.968223+0000","last_peered":"2024-09-12T00:53:01.968223+0000","last_clean":"2024-09-12T00:53:01.968223+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:53:01.968223+0000","last_undegraded":"2024-09-12T00:53:01.968223+0000","last_fullsized":"2024-09-12T00:53:01.968223+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:06.513554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'211","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.929359+0000","last_change":"2024-09-12T00:11:45.926172+0000","last_active":"2024-09-12T00:52:53.929359+0000","last_peered":"2024-09-12T00:52:53.929359+0000","last_clean":"2024-09-12T00:52:53.929359+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:52:53.929359+0000","last_undegraded":"2024-09-12T00:52:53.929359+0000","last_fullsized":"2024-09-12T00:52:53.929359+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:26.600245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12280161,"num_objects":17,"num_object_clones":0,"num_object_copies":51,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":490,"num_read_kb":27002,"num_write":967,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'447","reported_seq":2066,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.036909+0000","last_change":"2024-09-12T00:11:47.941908+0000","last_active":"2024-09-12T00:52:49.036909+0000","last_peered":"2024-09-12T00:52:49.036909+0000","last_clean":"2024-09-12T00:52:49.036909+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:52:49.036909+0000","last_undegraded":"2024-09-12T00:52:49.036909+0000","last_fullsized":"2024-09-12T00:52:49.036909+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.535433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'184","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.273931+0000","last_change":"2024-09-12T00:11:45.964131+0000","last_active":"2024-09-12T00:52:02.273931+0000","last_peered":"2024-09-12T00:52:02.273931+0000","last_clean":"2024-09-12T00:52:02.273931+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:52:02.273931+0000","last_undegraded":"2024-09-12T00:52:02.273931+0000","last_fullsized":"2024-09-12T00:52:02.273931+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":84,"log_dups_size":100,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:45.901253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1049107,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":430,"num_read_kb":12744,"num_write":920,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'219","reported_seq":869,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.499645+0000","last_change":"2024-09-12T00:11:45.935207+0000","last_active":"2024-09-12T00:53:11.499645+0000","last_peered":"2024-09-12T00:53:11.499645+0000","last_clean":"2024-09-12T00:53:11.499645+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:53:11.499645+0000","last_undegraded":"2024-09-12T00:53:11.499645+0000","last_fullsized":"2024-09-12T00:53:11.499645+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":200,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:45.585339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17885897,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":445,"num_read_kb":71383,"num_write":1065,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.502646+0000","last_change":"2024-09-12T00:11:47.953166+0000","last_active":"2024-09-12T00:53:10.502646+0000","last_peered":"2024-09-12T00:53:10.502646+0000","last_clean":"2024-09-12T00:53:10.502646+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:53:10.502646+0000","last_undegraded":"2024-09-12T00:53:10.502646+0000","last_fullsized":"2024-09-12T00:53:10.502646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:29.576578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'202","reported_seq":952,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:11.400938+0000","last_change":"2024-09-12T00:11:45.965734+0000","last_active":"2024-09-12T00:53:11.400938+0000","last_peered":"2024-09-12T00:53:11.400938+0000","last_clean":"2024-09-12T00:53:11.400938+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:53:11.400938+0000","last_undegraded":"2024-09-12T00:53:11.400938+0000","last_fullsized":"2024-09-12T00:53:11.400938+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":100,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.306543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9812130,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":704,"num_read_kb":180313,"num_write":957,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'926","reported_seq":2688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.196736+0000","last_change":"2024-09-12T00:11:47.940663+0000","last_active":"2024-09-12T00:54:17.196736+0000","last_peered":"2024-09-12T00:54:17.196736+0000","last_clean":"2024-09-12T00:54:17.196736+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:17.196736+0000","last_undegraded":"2024-09-12T00:54:17.196736+0000","last_fullsized":"2024-09-12T00:54:17.196736+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":959,"ondisk_log_size":959,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1850,"ondisk_log_size":1850,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":639,"ondisk_log_size":639,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":445853,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8289,"num_read_kb":10087,"num_write":5619,"num_write_kb":2639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":729088,"data_stored":222580,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1858,"ondisk_log_size":1858,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3935,"ondisk_log_size":3935,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":410963992,"num_objects":519,"num_object_clones":0,"num_object_copies":1557,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":519,"num_whiteouts":0,"num_read":32940,"num_read_kb":1979745,"num_write":63114,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":624386048,"data_stored":624386048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4396,"ondisk_log_size":4396,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":72641901,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":145,"num_read_kb":190493,"num_write":161,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":146341888,"data_stored":146332378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":73106114,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":143,"num_read_kb":189755,"num_write":161,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":142610432,"data_stored":142602287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":101,"ondisk_log_size":101,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509959,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":320248,"kb_used_data":122536,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94051592,"statfs":{"total":96636764160,"available":96308830208,"internally_reserved":0,"allocated":125476864,"data_stored":123457796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509960,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":198864,"kb_used_data":131584,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94172976,"statfs":{"total":96636764160,"available":96433127424,"internally_reserved":0,"allocated":134742016,"data_stored":132690622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509961,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":288760,"kb_used_data":127144,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94083080,"statfs":{"total":96636764160,"available":96341073920,"internally_reserved":0,"allocated":130195456,"data_stored":128157869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509961,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":329136,"kb_used_data":135520,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94042704,"statfs":{"total":96636764160,"available":96299728896,"internally_reserved":0,"allocated":138772480,"data_stored":136734146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509962,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":189500,"kb_used_data":108332,"kb_used_omap":1,"kb_used_meta":81150,"kb_avail":94182340,"statfs":{"total":96636764160,"available":96442716160,"internally_reserved":0,"allocated":110931968,"data_stored":108910447,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83098053},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509961,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":368232,"kb_used_data":98264,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94003608,"statfs":{"total":96636764160,"available":96259694592,"internally_reserved":0,"allocated":100622336,"data_stored":98567019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509960,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":215332,"kb_used_data":116116,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94156508,"statfs":{"total":96636764160,"available":96416264192,"internally_reserved":0,"allocated":118902784,"data_stored":116838032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542668,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":346356,"kb_used_data":104164,"kb_used_omap":1,"kb_used_meta":242174,"kb_avail":94025484,"statfs":{"total":96636764160,"available":96282095616,"internally_reserved":0,"allocated":106663936,"data_stored":104618795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":247986629},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":79962112,"data_stored":79962112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":66723840,"data_stored":66723840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":75902976,"data_stored":75902976,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":100593664,"data_stored":100593664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98041856,"data_stored":98041856,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69595136,"data_stored":69595136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":64786432,"data_stored":64786432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":68780032,"data_stored":68780032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":131072,"data_stored":38134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":126976,"data_stored":41060,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":7938,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":23391,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":33408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":28921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":33829,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":15899,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20680704,"data_stored":20677314,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":5242880,"data_stored":5242880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":19632128,"data_stored":19628738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":11071488,"data_stored":11070123,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":17825792,"data_stored":17825792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":26214400,"data_stored":26214400,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":37748736,"data_stored":37748736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":30408704,"data_stored":30408704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":716800,"data_stored":714225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":15728640,"data_stored":15728640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":14258176,"data_stored":14255996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16777216,"data_stored":16777216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":14348288,"data_stored":14345713,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":39424000,"data_stored":39421820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14680064,"data_stored":14680064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:54:32.782 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-12T00:54:33.115 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:54:33.115 INFO:teuthology.orchestra.run.smithi078.stdout:{"epoch":266,"fsid":"78cfadc1-91d4-4e4b-90ea-b6dfd9feb20b","created":"2024-09-12T00:11:12.947588+0000","modified":"2024-09-12T00:39:29.114764+0000","last_up_change":"2024-09-12T00:11:25.519857+0000","last_in_change":"2024-09-12T00:11:15.209220+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":16,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":68,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-12T00:11:25.793509+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-12T00:11:31.236417+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":22,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4.9800000190734863,"score_stable":4.9800000190734863,"optimal_score":0.87999999523162842,"raw_score_acting":4.380000114440918,"raw_score_stable":4.380000114440918,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-12T00:11:43.880268+0000","flags":1,"flags_names":"hashpspool","type":3,"size":3,"min_size":2,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-12T00:11:46.251530+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-12T00:11:48.047527+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-12T00:11:50.456152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-12T00:11:51.968433+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-12T00:11:54.090603+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":65,"pool_name":"default.rgw.buckets.non-ec","create_time":"2024-09-12T00:26:46.767358+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"257","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":66,"pool_name":"default.rgw.buckets.data.frozen","create_time":"2024-09-12T00:28:12.532745+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"260","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":67,"pool_name":"default.rgw.buckets.data.lukewarm","create_time":"2024-09-12T00:28:15.193201+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"263","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":68,"pool_name":"default.rgw.otp","create_time":"2024-09-12T00:39:26.485180+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"266","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"5cdb3cf6-5125-400d-9866-a3037e1ebe83","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6824","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6825","nonce":4270621360}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6826","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6827","nonce":4270621360}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6830","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6831","nonce":4270621360}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6828","nonce":4270621360},{"type":"v1","addr":"172.21.15.78:6829","nonce":4270621360}]},"public_addr":"172.21.15.78:6825/4270621360","cluster_addr":"172.21.15.78:6827/4270621360","heartbeat_back_addr":"172.21.15.78:6831/4270621360","heartbeat_front_addr":"172.21.15.78:6829/4270621360","state":["exists","up"]},{"osd":1,"uuid":"f726fc95-5f4f-4f4a-b3c4-db2902f06b24","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6808","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6809","nonce":1578510999}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6810","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6811","nonce":1578510999}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6814","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6815","nonce":1578510999}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6812","nonce":1578510999},{"type":"v1","addr":"172.21.15.78:6813","nonce":1578510999}]},"public_addr":"172.21.15.78:6809/1578510999","cluster_addr":"172.21.15.78:6811/1578510999","heartbeat_back_addr":"172.21.15.78:6815/1578510999","heartbeat_front_addr":"172.21.15.78:6813/1578510999","state":["exists","up"]},{"osd":2,"uuid":"4aad87d6-f1cc-4c5d-bfb6-bdd15bea9821","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6816","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6817","nonce":1585845466}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6818","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6819","nonce":1585845466}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6822","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6823","nonce":1585845466}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6820","nonce":1585845466},{"type":"v1","addr":"172.21.15.78:6821","nonce":1585845466}]},"public_addr":"172.21.15.78:6817/1585845466","cluster_addr":"172.21.15.78:6819/1585845466","heartbeat_back_addr":"172.21.15.78:6823/1585845466","heartbeat_front_addr":"172.21.15.78:6821/1585845466","state":["exists","up"]},{"osd":3,"uuid":"6bdbffb1-245f-4cf4-9fb1-7920af67c88f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6800","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6801","nonce":3497928690}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6802","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6803","nonce":3497928690}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6806","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6807","nonce":3497928690}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.78:6804","nonce":3497928690},{"type":"v1","addr":"172.21.15.78:6805","nonce":3497928690}]},"public_addr":"172.21.15.78:6801/3497928690","cluster_addr":"172.21.15.78:6803/3497928690","heartbeat_back_addr":"172.21.15.78:6807/3497928690","heartbeat_front_addr":"172.21.15.78:6805/3497928690","state":["exists","up"]},{"osd":4,"uuid":"45b971e0-2e7b-4fec-a3b2-8ea970b35b7d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6808","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6809","nonce":2267522783}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6810","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6811","nonce":2267522783}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6814","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6815","nonce":2267522783}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6812","nonce":2267522783},{"type":"v1","addr":"172.21.15.171:6813","nonce":2267522783}]},"public_addr":"172.21.15.171:6809/2267522783","cluster_addr":"172.21.15.171:6811/2267522783","heartbeat_back_addr":"172.21.15.171:6815/2267522783","heartbeat_front_addr":"172.21.15.171:6813/2267522783","state":["exists","up"]},{"osd":5,"uuid":"b4d242df-45e0-4793-92fc-5026219a364e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6800","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6801","nonce":4023521963}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6802","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6803","nonce":4023521963}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6806","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6807","nonce":4023521963}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6804","nonce":4023521963},{"type":"v1","addr":"172.21.15.171:6805","nonce":4023521963}]},"public_addr":"172.21.15.171:6801/4023521963","cluster_addr":"172.21.15.171:6803/4023521963","heartbeat_back_addr":"172.21.15.171:6807/4023521963","heartbeat_front_addr":"172.21.15.171:6805/4023521963","state":["exists","up"]},{"osd":6,"uuid":"ab48cb27-377f-48d0-b2d4-50796590b361","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6816","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6817","nonce":997797030}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6818","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6819","nonce":997797030}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6822","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6823","nonce":997797030}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6820","nonce":997797030},{"type":"v1","addr":"172.21.15.171:6821","nonce":997797030}]},"public_addr":"172.21.15.171:6817/997797030","cluster_addr":"172.21.15.171:6819/997797030","heartbeat_back_addr":"172.21.15.171:6823/997797030","heartbeat_front_addr":"172.21.15.171:6821/997797030","state":["exists","up"]},{"osd":7,"uuid":"a2a626bb-6b0f-489e-840b-2e47e7fed948","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":264,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6824","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6825","nonce":2486579375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6826","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6827","nonce":2486579375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6830","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6831","nonce":2486579375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.171:6828","nonce":2486579375},{"type":"v1","addr":"172.21.15.171:6829","nonce":2486579375}]},"public_addr":"172.21.15.171:6825/2486579375","cluster_addr":"172.21.15.171:6827/2486579375","heartbeat_back_addr":"172.21.15.171:6831/2486579375","heartbeat_front_addr":"172.21.15.171:6829/2486579375","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.515862+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.135509+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.020820+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.745991+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.803336+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:21.511875+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.068614+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-12T00:11:22.178830+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.2","mappings":[{"from":0,"to":6}]},{"pgid":"3.13","mappings":[{"from":3,"to":6}]},{"pgid":"3.38","mappings":[{"from":3,"to":1}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":26,"snaps":[{"begin":1,"length":2}]},{"pool":31,"snaps":[{"begin":1,"length":2}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-12T00:54:34.136 INFO:tasks.ceph:Scrubbing osd.0 2024-09-12T00:54:34.136 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:34.296 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:34.296 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:34.296 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:34.312 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-12T00:54:34.462 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-12T00:54:34.617 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 0 to deep-scrub 2024-09-12T00:54:34.636 INFO:tasks.ceph:Scrubbing osd.1 2024-09-12T00:54:34.636 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:34.778 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:34.779 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:34.779 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:34.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-12T00:54:35.090 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 1 to deep-scrub 2024-09-12T00:54:35.109 INFO:tasks.ceph:Scrubbing osd.2 2024-09-12T00:54:35.109 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:35.245 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:35.245 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:35.245 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:35.260 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-12T00:54:35.551 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 2 to deep-scrub 2024-09-12T00:54:35.569 INFO:tasks.ceph:Scrubbing osd.3 2024-09-12T00:54:35.570 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:35.705 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:35.705 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:35.705 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:35.720 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-12T00:54:35.999 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 3 to deep-scrub 2024-09-12T00:54:36.017 INFO:tasks.ceph:Scrubbing osd.4 2024-09-12T00:54:36.017 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:36.162 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:36.163 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:36.163 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:36.177 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-12T00:54:36.468 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 4 to deep-scrub 2024-09-12T00:54:36.487 INFO:tasks.ceph:Scrubbing osd.5 2024-09-12T00:54:36.487 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:36.635 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:36.635 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:36.635 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:36.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-12T00:54:36.926 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 5 to deep-scrub 2024-09-12T00:54:36.944 INFO:tasks.ceph:Scrubbing osd.6 2024-09-12T00:54:36.944 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:37.090 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:37.090 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:37.091 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:37.106 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-12T00:54:37.396 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 6 to deep-scrub 2024-09-12T00:54:37.414 INFO:tasks.ceph:Scrubbing osd.7 2024-09-12T00:54:37.414 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-12T00:54:37.566 INFO:teuthology.orchestra.run.smithi078.stdout:{ 2024-09-12T00:54:37.567 INFO:teuthology.orchestra.run.smithi078.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-12T00:54:37.567 INFO:teuthology.orchestra.run.smithi078.stdout:} 2024-09-12T00:54:37.584 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-12T00:54:37.884 INFO:teuthology.orchestra.run.smithi078.stderr:instructed osd(s) 7 to deep-scrub 2024-09-12T00:54:37.904 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:54:38.225 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:54:38.237 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:54:38.245 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1555,"stamp":"2024-09-12T00:54:37.354396+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105863228,"num_objects":726,"num_object_clones":0,"num_object_copies":1691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":278142,"num_read_kb":2586611,"num_write":143606,"num_write_kb":2344249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14241,"ondisk_log_size":14241,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1508600,"kb_used_data":189880,"kb_used_omap":12,"kb_used_meta":1318195,"kb_avail":753466120,"statfs":{"total":773094113280,"available":771549306880,"internally_reserved":0,"allocated":194437120,"data_stored":178358410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1349832242},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[2],"upper_bound":2},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-464368016,"num_objects":-343,"num_object_clones":0,"num_object_copies":-973,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-343,"num_whiteouts":0,"num_read":674,"num_read_kb":709,"num_write":501,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007036"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934222+0000","last_change":"2024-09-12T00:39:28.138350+0000","last_active":"2024-09-12T00:52:00.934222+0000","last_peered":"2024-09-12T00:52:00.934222+0000","last_clean":"2024-09-12T00:52:00.934222+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:52:00.934222+0000","last_undegraded":"2024-09-12T00:52:00.934222+0000","last_fullsized":"2024-09-12T00:52:00.934222+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:55.798857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092228+0000","last_change":"2024-09-12T00:28:17.047281+0000","last_active":"2024-09-12T00:50:51.092228+0000","last_peered":"2024-09-12T00:50:51.092228+0000","last_clean":"2024-09-12T00:50:51.092228+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:50:51.092228+0000","last_undegraded":"2024-09-12T00:50:51.092228+0000","last_fullsized":"2024-09-12T00:50:51.092228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:27.659088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.947765+0000","last_change":"2024-09-12T00:28:14.033426+0000","last_active":"2024-09-12T00:53:15.947765+0000","last_peered":"2024-09-12T00:53:15.947765+0000","last_clean":"2024-09-12T00:53:15.947765+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:53:15.947765+0000","last_undegraded":"2024-09-12T00:53:15.947765+0000","last_fullsized":"2024-09-12T00:53:15.947765+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:32.619191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931203+0000","last_change":"2024-09-12T00:26:48.570033+0000","last_active":"2024-09-12T00:51:50.931203+0000","last_peered":"2024-09-12T00:51:50.931203+0000","last_clean":"2024-09-12T00:51:50.931203+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:51:50.931203+0000","last_undegraded":"2024-09-12T00:51:50.931203+0000","last_fullsized":"2024-09-12T00:51:50.931203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.353377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928588+0000","last_change":"2024-09-12T00:39:28.129464+0000","last_active":"2024-09-12T00:52:00.928588+0000","last_peered":"2024-09-12T00:52:00.928588+0000","last_clean":"2024-09-12T00:52:00.928588+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:52:00.928588+0000","last_undegraded":"2024-09-12T00:52:00.928588+0000","last_fullsized":"2024-09-12T00:52:00.928588+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:48.897603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113095+0000","last_change":"2024-09-12T00:28:17.071932+0000","last_active":"2024-09-12T00:50:51.113095+0000","last_peered":"2024-09-12T00:50:51.113095+0000","last_clean":"2024-09-12T00:50:51.113095+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:50:51.113095+0000","last_undegraded":"2024-09-12T00:50:51.113095+0000","last_fullsized":"2024-09-12T00:50:51.113095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.458170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921118+0000","last_change":"2024-09-12T00:28:14.053061+0000","last_active":"2024-09-12T00:50:44.921118+0000","last_peered":"2024-09-12T00:50:44.921118+0000","last_clean":"2024-09-12T00:50:44.921118+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:50:44.921118+0000","last_undegraded":"2024-09-12T00:50:44.921118+0000","last_fullsized":"2024-09-12T00:50:44.921118+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.764170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":162,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.061737+0000","last_change":"2024-09-12T00:26:48.579305+0000","last_active":"2024-09-12T00:51:36.061737+0000","last_peered":"2024-09-12T00:51:36.061737+0000","last_clean":"2024-09-12T00:51:36.061737+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:51:36.061737+0000","last_undegraded":"2024-09-12T00:51:36.061737+0000","last_fullsized":"2024-09-12T00:51:36.061737+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:50.899850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.103970+0000","last_change":"2024-09-12T00:39:28.122188+0000","last_active":"2024-09-12T00:51:36.103970+0000","last_peered":"2024-09-12T00:51:36.103970+0000","last_clean":"2024-09-12T00:51:36.103970+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:51:36.103970+0000","last_undegraded":"2024-09-12T00:51:36.103970+0000","last_fullsized":"2024-09-12T00:51:36.103970+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.982189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928491+0000","last_change":"2024-09-12T00:28:17.054566+0000","last_active":"2024-09-12T00:51:14.928491+0000","last_peered":"2024-09-12T00:51:14.928491+0000","last_clean":"2024-09-12T00:51:14.928491+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:51:14.928491+0000","last_undegraded":"2024-09-12T00:51:14.928491+0000","last_fullsized":"2024-09-12T00:51:14.928491+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.840405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'3","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:20.962121+0000","last_change":"2024-09-12T00:28:14.047435+0000","last_active":"2024-09-12T00:54:20.962121+0000","last_peered":"2024-09-12T00:54:20.962121+0000","last_clean":"2024-09-12T00:54:20.962121+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:54:20.962121+0000","last_undegraded":"2024-09-12T00:54:20.962121+0000","last_fullsized":"2024-09-12T00:54:20.962121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:59.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.669268+0000","last_change":"2024-09-12T00:26:48.580614+0000","last_active":"2024-09-12T00:52:01.669268+0000","last_peered":"2024-09-12T00:52:01.669268+0000","last_clean":"2024-09-12T00:52:01.669268+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:52:01.669268+0000","last_undegraded":"2024-09-12T00:52:01.669268+0000","last_fullsized":"2024-09-12T00:52:01.669268+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:44.366801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934194+0000","last_change":"2024-09-12T00:39:28.125516+0000","last_active":"2024-09-12T00:51:39.934194+0000","last_peered":"2024-09-12T00:51:39.934194+0000","last_clean":"2024-09-12T00:51:39.934194+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:51:39.934194+0000","last_undegraded":"2024-09-12T00:51:39.934194+0000","last_fullsized":"2024-09-12T00:51:39.934194+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:50.627744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'5","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:24.978258+0000","last_change":"2024-09-12T00:28:17.052788+0000","last_active":"2024-09-12T00:54:24.978258+0000","last_peered":"2024-09-12T00:54:24.978258+0000","last_clean":"2024-09-12T00:54:24.978258+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:54:24.978258+0000","last_undegraded":"2024-09-12T00:54:24.978258+0000","last_fullsized":"2024-09-12T00:54:24.978258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.537154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096647+0000","last_change":"2024-09-12T00:28:14.043102+0000","last_active":"2024-09-12T00:51:11.096647+0000","last_peered":"2024-09-12T00:51:11.096647+0000","last_clean":"2024-09-12T00:51:11.096647+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:51:11.096647+0000","last_undegraded":"2024-09-12T00:51:11.096647+0000","last_fullsized":"2024-09-12T00:51:11.096647+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.118617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926319+0000","last_change":"2024-09-12T00:26:48.582273+0000","last_active":"2024-09-12T00:51:50.926319+0000","last_peered":"2024-09-12T00:51:50.926319+0000","last_clean":"2024-09-12T00:51:50.926319+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:51:50.926319+0000","last_undegraded":"2024-09-12T00:51:50.926319+0000","last_fullsized":"2024-09-12T00:51:50.926319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.447704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926457+0000","last_change":"2024-09-12T00:39:28.140327+0000","last_active":"2024-09-12T00:51:35.926457+0000","last_peered":"2024-09-12T00:51:35.926457+0000","last_clean":"2024-09-12T00:51:35.926457+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:51:35.926457+0000","last_undegraded":"2024-09-12T00:51:35.926457+0000","last_fullsized":"2024-09-12T00:51:35.926457+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:53.703852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'2","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:35.941802+0000","last_change":"2024-09-12T00:28:17.062001+0000","last_active":"2024-09-12T00:52:35.941802+0000","last_peered":"2024-09-12T00:52:35.941802+0000","last_clean":"2024-09-12T00:52:35.941802+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:52:35.941802+0000","last_undegraded":"2024-09-12T00:52:35.941802+0000","last_fullsized":"2024-09-12T00:52:35.941802+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.953980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'9","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.155481+0000","last_change":"2024-09-12T00:28:14.043324+0000","last_active":"2024-09-12T00:54:31.155481+0000","last_peered":"2024-09-12T00:54:31.155481+0000","last_clean":"2024-09-12T00:54:31.155481+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:54:31.155481+0000","last_undegraded":"2024-09-12T00:54:31.155481+0000","last_fullsized":"2024-09-12T00:54:31.155481+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:29.585815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926176+0000","last_change":"2024-09-12T00:26:48.586853+0000","last_active":"2024-09-12T00:51:50.926176+0000","last_peered":"2024-09-12T00:51:50.926176+0000","last_clean":"2024-09-12T00:51:50.926176+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:51:50.926176+0000","last_undegraded":"2024-09-12T00:51:50.926176+0000","last_fullsized":"2024-09-12T00:51:50.926176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:56.028583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933422+0000","last_change":"2024-09-12T00:39:28.107499+0000","last_active":"2024-09-12T00:52:00.933422+0000","last_peered":"2024-09-12T00:52:00.933422+0000","last_clean":"2024-09-12T00:52:00.933422+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:52:00.933422+0000","last_undegraded":"2024-09-12T00:52:00.933422+0000","last_fullsized":"2024-09-12T00:52:00.933422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:42.987392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'7","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.292635+0000","last_change":"2024-09-12T00:28:17.080528+0000","last_active":"2024-09-12T00:54:31.292635+0000","last_peered":"2024-09-12T00:54:31.292635+0000","last_clean":"2024-09-12T00:54:31.292635+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:54:31.292635+0000","last_undegraded":"2024-09-12T00:54:31.292635+0000","last_fullsized":"2024-09-12T00:54:31.292635+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:33:57.273734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":651,"num_write":12,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.961171+0000","last_change":"2024-09-12T00:28:14.045269+0000","last_active":"2024-09-12T00:52:30.961171+0000","last_peered":"2024-09-12T00:52:30.961171+0000","last_clean":"2024-09-12T00:52:30.961171+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:52:30.961171+0000","last_undegraded":"2024-09-12T00:52:30.961171+0000","last_fullsized":"2024-09-12T00:52:30.961171+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:05.105429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.892906+0000","last_change":"2024-09-12T00:26:48.573856+0000","last_active":"2024-09-12T00:52:33.892906+0000","last_peered":"2024-09-12T00:52:33.892906+0000","last_clean":"2024-09-12T00:52:33.892906+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:52:33.892906+0000","last_undegraded":"2024-09-12T00:52:33.892906+0000","last_fullsized":"2024-09-12T00:52:33.892906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:49.201091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.128901+0000","last_change":"2024-09-12T00:39:28.140779+0000","last_active":"2024-09-12T00:52:01.128901+0000","last_peered":"2024-09-12T00:52:01.128901+0000","last_clean":"2024-09-12T00:52:01.128901+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:52:01.128901+0000","last_undegraded":"2024-09-12T00:52:01.128901+0000","last_fullsized":"2024-09-12T00:52:01.128901+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.223046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113042+0000","last_change":"2024-09-12T00:28:17.073306+0000","last_active":"2024-09-12T00:50:51.113042+0000","last_peered":"2024-09-12T00:50:51.113042+0000","last_clean":"2024-09-12T00:50:51.113042+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:50:51.113042+0000","last_undegraded":"2024-09-12T00:50:51.113042+0000","last_fullsized":"2024-09-12T00:50:51.113042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.616512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917468+0000","last_change":"2024-09-12T00:28:14.036590+0000","last_active":"2024-09-12T00:50:45.917468+0000","last_peered":"2024-09-12T00:50:45.917468+0000","last_clean":"2024-09-12T00:50:45.917468+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:50:45.917468+0000","last_undegraded":"2024-09-12T00:50:45.917468+0000","last_fullsized":"2024-09-12T00:50:45.917468+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.374471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.485163+0000","last_change":"2024-09-12T00:26:48.567960+0000","last_active":"2024-09-12T00:52:37.485163+0000","last_peered":"2024-09-12T00:52:37.485163+0000","last_clean":"2024-09-12T00:52:37.485163+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:52:37.485163+0000","last_undegraded":"2024-09-12T00:52:37.485163+0000","last_fullsized":"2024-09-12T00:52:37.485163+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.486007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934433+0000","last_change":"2024-09-12T00:39:28.125474+0000","last_active":"2024-09-12T00:52:00.934433+0000","last_peered":"2024-09-12T00:52:00.934433+0000","last_clean":"2024-09-12T00:52:00.934433+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:52:00.934433+0000","last_undegraded":"2024-09-12T00:52:00.934433+0000","last_fullsized":"2024-09-12T00:52:00.934433+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:45.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916437+0000","last_change":"2024-09-12T00:28:17.074749+0000","last_active":"2024-09-12T00:50:50.916437+0000","last_peered":"2024-09-12T00:50:50.916437+0000","last_clean":"2024-09-12T00:50:50.916437+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:50:50.916437+0000","last_undegraded":"2024-09-12T00:50:50.916437+0000","last_fullsized":"2024-09-12T00:50:50.916437+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:59.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.944795+0000","last_change":"2024-09-12T00:28:14.050432+0000","last_active":"2024-09-12T00:53:15.944795+0000","last_peered":"2024-09-12T00:53:15.944795+0000","last_clean":"2024-09-12T00:53:15.944795+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:53:15.944795+0000","last_undegraded":"2024-09-12T00:53:15.944795+0000","last_fullsized":"2024-09-12T00:53:15.944795+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:50.652868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914915+0000","last_change":"2024-09-12T00:26:48.576457+0000","last_active":"2024-09-12T00:51:00.914915+0000","last_peered":"2024-09-12T00:51:00.914915+0000","last_clean":"2024-09-12T00:51:00.914915+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:51:00.914915+0000","last_undegraded":"2024-09-12T00:51:00.914915+0000","last_fullsized":"2024-09-12T00:51:00.914915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:50.385760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927145+0000","last_change":"2024-09-12T00:39:28.133363+0000","last_active":"2024-09-12T00:51:09.927145+0000","last_peered":"2024-09-12T00:51:09.927145+0000","last_clean":"2024-09-12T00:51:09.927145+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:51:09.927145+0000","last_undegraded":"2024-09-12T00:51:09.927145+0000","last_fullsized":"2024-09-12T00:51:09.927145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:45.885764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'10","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.426710+0000","last_change":"2024-09-12T00:28:17.078258+0000","last_active":"2024-09-12T00:54:31.426710+0000","last_peered":"2024-09-12T00:54:31.426710+0000","last_clean":"2024-09-12T00:54:31.426710+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:54:31.426710+0000","last_undegraded":"2024-09-12T00:54:31.426710+0000","last_fullsized":"2024-09-12T00:54:31.426710+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:59:26.373864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12306,"num_write":10,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947884+0000","last_change":"2024-09-12T00:28:14.046080+0000","last_active":"2024-09-12T00:51:40.947884+0000","last_peered":"2024-09-12T00:51:40.947884+0000","last_clean":"2024-09-12T00:51:40.947884+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:51:40.947884+0000","last_undegraded":"2024-09-12T00:51:40.947884+0000","last_fullsized":"2024-09-12T00:51:40.947884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.783103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":201,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.951659+0000","last_change":"2024-09-12T00:26:48.572423+0000","last_active":"2024-09-12T00:51:36.951659+0000","last_peered":"2024-09-12T00:51:36.951659+0000","last_clean":"2024-09-12T00:51:36.951659+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:51:36.951659+0000","last_undegraded":"2024-09-12T00:51:36.951659+0000","last_fullsized":"2024-09-12T00:51:36.951659+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:03.523286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917174+0000","last_change":"2024-09-12T00:39:28.115704+0000","last_active":"2024-09-12T00:51:10.917174+0000","last_peered":"2024-09-12T00:51:10.917174+0000","last_clean":"2024-09-12T00:51:10.917174+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:51:10.917174+0000","last_undegraded":"2024-09-12T00:51:10.917174+0000","last_fullsized":"2024-09-12T00:51:10.917174+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.301433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'4","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:04.968671+0000","last_change":"2024-09-12T00:28:17.068407+0000","last_active":"2024-09-12T00:54:04.968671+0000","last_peered":"2024-09-12T00:54:04.968671+0000","last_clean":"2024-09-12T00:54:04.968671+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:54:04.968671+0000","last_undegraded":"2024-09-12T00:54:04.968671+0000","last_fullsized":"2024-09-12T00:54:04.968671+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:04.370003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:00.907982+0000","last_change":"2024-09-12T00:28:14.033635+0000","last_active":"2024-09-12T00:50:00.907982+0000","last_peered":"2024-09-12T00:50:00.907982+0000","last_clean":"2024-09-12T00:50:00.907982+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:50:00.907982+0000","last_undegraded":"2024-09-12T00:50:00.907982+0000","last_fullsized":"2024-09-12T00:50:00.907982+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:21.430932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.729092+0000","last_change":"2024-09-12T00:26:48.579143+0000","last_active":"2024-09-12T00:52:37.729092+0000","last_peered":"2024-09-12T00:52:37.729092+0000","last_clean":"2024-09-12T00:52:37.729092+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:52:37.729092+0000","last_undegraded":"2024-09-12T00:52:37.729092+0000","last_fullsized":"2024-09-12T00:52:37.729092+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:58.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.117359+0000","last_change":"2024-09-12T00:39:28.143755+0000","last_active":"2024-09-12T00:51:11.117359+0000","last_peered":"2024-09-12T00:51:11.117359+0000","last_clean":"2024-09-12T00:51:11.117359+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:51:11.117359+0000","last_undegraded":"2024-09-12T00:51:11.117359+0000","last_fullsized":"2024-09-12T00:51:11.117359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:42.065287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:05.907031+0000","last_change":"2024-09-12T00:28:17.072223+0000","last_active":"2024-09-12T00:50:05.907031+0000","last_peered":"2024-09-12T00:50:05.907031+0000","last_clean":"2024-09-12T00:50:05.907031+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:50:05.907031+0000","last_undegraded":"2024-09-12T00:50:05.907031+0000","last_fullsized":"2024-09-12T00:50:05.907031+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:56.304323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'4","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:25.936968+0000","last_change":"2024-09-12T00:28:14.051773+0000","last_active":"2024-09-12T00:52:25.936968+0000","last_peered":"2024-09-12T00:52:25.936968+0000","last_clean":"2024-09-12T00:52:25.936968+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:52:25.936968+0000","last_undegraded":"2024-09-12T00:52:25.936968+0000","last_fullsized":"2024-09-12T00:52:25.936968+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:12.527606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.918732+0000","last_change":"2024-09-12T00:26:48.566905+0000","last_active":"2024-09-12T00:51:00.918732+0000","last_peered":"2024-09-12T00:51:00.918732+0000","last_clean":"2024-09-12T00:51:00.918732+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:51:00.918732+0000","last_undegraded":"2024-09-12T00:51:00.918732+0000","last_fullsized":"2024-09-12T00:51:00.918732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.878822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.923092+0000","last_change":"2024-09-12T00:39:28.130382+0000","last_active":"2024-09-12T00:51:10.923092+0000","last_peered":"2024-09-12T00:51:10.923092+0000","last_clean":"2024-09-12T00:51:10.923092+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:51:10.923092+0000","last_undegraded":"2024-09-12T00:51:10.923092+0000","last_fullsized":"2024-09-12T00:51:10.923092+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:27.073020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'5","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.521354+0000","last_change":"2024-09-12T00:28:17.073824+0000","last_active":"2024-09-12T00:54:31.521354+0000","last_peered":"2024-09-12T00:54:31.521354+0000","last_clean":"2024-09-12T00:54:31.521354+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:54:31.521354+0000","last_undegraded":"2024-09-12T00:54:31.521354+0000","last_fullsized":"2024-09-12T00:54:31.521354+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:31.923969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:49:59.910715+0000","last_change":"2024-09-12T00:28:14.044796+0000","last_active":"2024-09-12T00:49:59.910715+0000","last_peered":"2024-09-12T00:49:59.910715+0000","last_clean":"2024-09-12T00:49:59.910715+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:49:59.910715+0000","last_undegraded":"2024-09-12T00:49:59.910715+0000","last_fullsized":"2024-09-12T00:49:59.910715+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:13.669602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'113","reported_seq":399,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.539168+0000","last_change":"2024-09-12T00:26:48.578346+0000","last_active":"2024-09-12T00:52:38.539168+0000","last_peered":"2024-09-12T00:52:38.539168+0000","last_clean":"2024-09-12T00:52:38.539168+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:52:38.539168+0000","last_undegraded":"2024-09-12T00:52:38.539168+0000","last_fullsized":"2024-09-12T00:52:38.539168+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:52.917481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933259+0000","last_change":"2024-09-12T00:39:28.130268+0000","last_active":"2024-09-12T00:51:34.933259+0000","last_peered":"2024-09-12T00:51:34.933259+0000","last_clean":"2024-09-12T00:51:34.933259+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:51:34.933259+0000","last_undegraded":"2024-09-12T00:51:34.933259+0000","last_fullsized":"2024-09-12T00:51:34.933259+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:22.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'4","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967275+0000","last_change":"2024-09-12T00:28:17.046685+0000","last_active":"2024-09-12T00:53:59.967275+0000","last_peered":"2024-09-12T00:53:59.967275+0000","last_clean":"2024-09-12T00:53:59.967275+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:53:59.967275+0000","last_undegraded":"2024-09-12T00:53:59.967275+0000","last_fullsized":"2024-09-12T00:53:59.967275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:31.104948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4468,"num_write":4,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104004+0000","last_change":"2024-09-12T00:28:14.032537+0000","last_active":"2024-09-12T00:51:36.104004+0000","last_peered":"2024-09-12T00:51:36.104004+0000","last_clean":"2024-09-12T00:51:36.104004+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:51:36.104004+0000","last_undegraded":"2024-09-12T00:51:36.104004+0000","last_fullsized":"2024-09-12T00:51:36.104004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.020093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'133","reported_seq":449,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.925949+0000","last_change":"2024-09-12T00:26:48.579290+0000","last_active":"2024-09-12T00:50:10.925949+0000","last_peered":"2024-09-12T00:50:10.925949+0000","last_clean":"2024-09-12T00:50:10.925949+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:50:10.925949+0000","last_undegraded":"2024-09-12T00:50:10.925949+0000","last_fullsized":"2024-09-12T00:50:10.925949+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:43:54.084724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922871+0000","last_change":"2024-09-12T00:39:28.116214+0000","last_active":"2024-09-12T00:51:35.922871+0000","last_peered":"2024-09-12T00:51:35.922871+0000","last_clean":"2024-09-12T00:51:35.922871+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:51:35.922871+0000","last_undegraded":"2024-09-12T00:51:35.922871+0000","last_fullsized":"2024-09-12T00:51:35.922871+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.593460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934132+0000","last_change":"2024-09-12T00:28:17.059604+0000","last_active":"2024-09-12T00:51:39.934132+0000","last_peered":"2024-09-12T00:51:39.934132+0000","last_clean":"2024-09-12T00:51:39.934132+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:51:39.934132+0000","last_undegraded":"2024-09-12T00:51:39.934132+0000","last_fullsized":"2024-09-12T00:51:39.934132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:54.283922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933089+0000","last_change":"2024-09-12T00:28:14.043789+0000","last_active":"2024-09-12T00:51:34.933089+0000","last_peered":"2024-09-12T00:51:34.933089+0000","last_clean":"2024-09-12T00:51:34.933089+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:51:34.933089+0000","last_undegraded":"2024-09-12T00:51:34.933089+0000","last_fullsized":"2024-09-12T00:51:34.933089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.842950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.908002+0000","last_change":"2024-09-12T00:26:48.587469+0000","last_active":"2024-09-12T00:50:10.908002+0000","last_peered":"2024-09-12T00:50:10.908002+0000","last_clean":"2024-09-12T00:50:10.908002+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:50:10.908002+0000","last_undegraded":"2024-09-12T00:50:10.908002+0000","last_fullsized":"2024-09-12T00:50:10.908002+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:15.099773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923180+0000","last_change":"2024-09-12T00:39:28.116113+0000","last_active":"2024-09-12T00:51:15.923180+0000","last_peered":"2024-09-12T00:51:15.923180+0000","last_clean":"2024-09-12T00:51:15.923180+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:51:15.923180+0000","last_undegraded":"2024-09-12T00:51:15.923180+0000","last_fullsized":"2024-09-12T00:51:15.923180+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'7","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.162360+0000","last_change":"2024-09-12T00:28:17.077838+0000","last_active":"2024-09-12T00:54:31.162360+0000","last_peered":"2024-09-12T00:54:31.162360+0000","last_clean":"2024-09-12T00:54:31.162360+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:54:31.162360+0000","last_undegraded":"2024-09-12T00:54:31.162360+0000","last_fullsized":"2024-09-12T00:54:31.162360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.840518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'4","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.164217+0000","last_change":"2024-09-12T00:28:14.041233+0000","last_active":"2024-09-12T00:54:31.164217+0000","last_peered":"2024-09-12T00:54:31.164217+0000","last_clean":"2024-09-12T00:54:31.164217+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:54:31.164217+0000","last_undegraded":"2024-09-12T00:54:31.164217+0000","last_fullsized":"2024-09-12T00:54:31.164217+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:48.566724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":71,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104059+0000","last_change":"2024-09-12T00:26:48.563874+0000","last_active":"2024-09-12T00:50:11.104059+0000","last_peered":"2024-09-12T00:50:11.104059+0000","last_clean":"2024-09-12T00:50:11.104059+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:50:11.104059+0000","last_undegraded":"2024-09-12T00:50:11.104059+0000","last_fullsized":"2024-09-12T00:50:11.104059+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:55.613469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922823+0000","last_change":"2024-09-12T00:39:28.107803+0000","last_active":"2024-09-12T00:51:35.922823+0000","last_peered":"2024-09-12T00:51:35.922823+0000","last_clean":"2024-09-12T00:51:35.922823+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:51:35.922823+0000","last_undegraded":"2024-09-12T00:51:35.922823+0000","last_fullsized":"2024-09-12T00:51:35.922823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.925644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947791+0000","last_change":"2024-09-12T00:28:17.071725+0000","last_active":"2024-09-12T00:51:40.947791+0000","last_peered":"2024-09-12T00:51:40.947791+0000","last_clean":"2024-09-12T00:51:40.947791+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:51:40.947791+0000","last_undegraded":"2024-09-12T00:51:40.947791+0000","last_fullsized":"2024-09-12T00:51:40.947791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:28.212664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'9","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.111411+0000","last_change":"2024-09-12T00:28:14.033365+0000","last_active":"2024-09-12T00:54:31.111411+0000","last_peered":"2024-09-12T00:54:31.111411+0000","last_clean":"2024-09-12T00:54:31.111411+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:54:31.111411+0000","last_undegraded":"2024-09-12T00:54:31.111411+0000","last_fullsized":"2024-09-12T00:54:31.111411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:07.863908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21053,"num_write":14,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:37.957887+0000","last_change":"2024-09-12T00:26:48.584004+0000","last_active":"2024-09-12T00:51:37.957887+0000","last_peered":"2024-09-12T00:51:37.957887+0000","last_clean":"2024-09-12T00:51:37.957887+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:51:37.957887+0000","last_undegraded":"2024-09-12T00:51:37.957887+0000","last_fullsized":"2024-09-12T00:51:37.957887+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:52.685965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:24.916370+0000","last_change":"2024-09-12T00:39:28.127905+0000","last_active":"2024-09-12T00:50:24.916370+0000","last_peered":"2024-09-12T00:50:24.916370+0000","last_clean":"2024-09-12T00:50:24.916370+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:50:24.916370+0000","last_undegraded":"2024-09-12T00:50:24.916370+0000","last_fullsized":"2024-09-12T00:50:24.916370+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:57:42.757971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916546+0000","last_change":"2024-09-12T00:28:17.075169+0000","last_active":"2024-09-12T00:50:50.916546+0000","last_peered":"2024-09-12T00:50:50.916546+0000","last_clean":"2024-09-12T00:50:50.916546+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:50:50.916546+0000","last_undegraded":"2024-09-12T00:50:50.916546+0000","last_fullsized":"2024-09-12T00:50:50.916546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:26.934607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.141632+0000","last_change":"2024-09-12T00:28:14.015676+0000","last_active":"2024-09-12T00:53:01.141632+0000","last_peered":"2024-09-12T00:53:01.141632+0000","last_clean":"2024-09-12T00:53:01.141632+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:53:01.141632+0000","last_undegraded":"2024-09-12T00:53:01.141632+0000","last_fullsized":"2024-09-12T00:53:01.141632+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:53.120779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927494+0000","last_change":"2024-09-12T00:26:48.573048+0000","last_active":"2024-09-12T00:51:40.927494+0000","last_peered":"2024-09-12T00:51:40.927494+0000","last_clean":"2024-09-12T00:51:40.927494+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:51:40.927494+0000","last_undegraded":"2024-09-12T00:51:40.927494+0000","last_fullsized":"2024-09-12T00:51:40.927494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.722904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.091062+0000","last_change":"2024-09-12T00:39:28.121616+0000","last_active":"2024-09-12T00:50:46.091062+0000","last_peered":"2024-09-12T00:50:46.091062+0000","last_clean":"2024-09-12T00:50:46.091062+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:50:46.091062+0000","last_undegraded":"2024-09-12T00:50:46.091062+0000","last_fullsized":"2024-09-12T00:50:46.091062+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:15.863877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916508+0000","last_change":"2024-09-12T00:28:17.074710+0000","last_active":"2024-09-12T00:50:50.916508+0000","last_peered":"2024-09-12T00:50:50.916508+0000","last_clean":"2024-09-12T00:50:50.916508+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:50:50.916508+0000","last_undegraded":"2024-09-12T00:50:50.916508+0000","last_fullsized":"2024-09-12T00:50:50.916508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:00.241439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'13","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.155718+0000","last_change":"2024-09-12T00:28:14.040584+0000","last_active":"2024-09-12T00:54:31.155718+0000","last_peered":"2024-09-12T00:54:31.155718+0000","last_clean":"2024-09-12T00:54:31.155718+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:54:31.155718+0000","last_undegraded":"2024-09-12T00:54:31.155718+0000","last_fullsized":"2024-09-12T00:54:31.155718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:08.411307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":18,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.946780+0000","last_change":"2024-09-12T00:26:48.585190+0000","last_active":"2024-09-12T00:51:35.946780+0000","last_peered":"2024-09-12T00:51:35.946780+0000","last_clean":"2024-09-12T00:51:35.946780+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:51:35.946780+0000","last_undegraded":"2024-09-12T00:51:35.946780+0000","last_fullsized":"2024-09-12T00:51:35.946780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:29.090617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.928152+0000","last_change":"2024-09-12T00:39:28.136382+0000","last_active":"2024-09-12T00:50:20.928152+0000","last_peered":"2024-09-12T00:50:20.928152+0000","last_clean":"2024-09-12T00:50:20.928152+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:50:20.928152+0000","last_undegraded":"2024-09-12T00:50:20.928152+0000","last_fullsized":"2024-09-12T00:50:20.928152+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:00:23.148193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.917696+0000","last_change":"2024-09-12T00:28:17.077942+0000","last_active":"2024-09-12T00:50:55.917696+0000","last_peered":"2024-09-12T00:50:55.917696+0000","last_clean":"2024-09-12T00:50:55.917696+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:50:55.917696+0000","last_undegraded":"2024-09-12T00:50:55.917696+0000","last_fullsized":"2024-09-12T00:50:55.917696+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:31.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.944447+0000","last_change":"2024-09-12T00:28:14.053908+0000","last_active":"2024-09-12T00:53:00.944447+0000","last_peered":"2024-09-12T00:53:00.944447+0000","last_clean":"2024-09-12T00:53:00.944447+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:53:00.944447+0000","last_undegraded":"2024-09-12T00:53:00.944447+0000","last_fullsized":"2024-09-12T00:53:00.944447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:56.421414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104215+0000","last_change":"2024-09-12T00:26:48.567108+0000","last_active":"2024-09-12T00:51:36.104215+0000","last_peered":"2024-09-12T00:51:36.104215+0000","last_clean":"2024-09-12T00:51:36.104215+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:51:36.104215+0000","last_undegraded":"2024-09-12T00:51:36.104215+0000","last_fullsized":"2024-09-12T00:51:36.104215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:04.721131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:21.085319+0000","last_change":"2024-09-12T00:39:28.116516+0000","last_active":"2024-09-12T00:50:21.085319+0000","last_peered":"2024-09-12T00:50:21.085319+0000","last_clean":"2024-09-12T00:50:21.085319+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:50:21.085319+0000","last_undegraded":"2024-09-12T00:50:21.085319+0000","last_fullsized":"2024-09-12T00:50:21.085319+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:59.615039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:49.922385+0000","last_change":"2024-09-12T00:28:17.060880+0000","last_active":"2024-09-12T00:50:49.922385+0000","last_peered":"2024-09-12T00:50:49.922385+0000","last_clean":"2024-09-12T00:50:49.922385+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:50:49.922385+0000","last_undegraded":"2024-09-12T00:50:49.922385+0000","last_fullsized":"2024-09-12T00:50:49.922385+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:02.004120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.183295+0000","last_change":"2024-09-12T00:28:14.053133+0000","last_active":"2024-09-12T00:54:31.183295+0000","last_peered":"2024-09-12T00:54:31.183295+0000","last_clean":"2024-09-12T00:54:31.183295+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:54:31.183295+0000","last_undegraded":"2024-09-12T00:54:31.183295+0000","last_fullsized":"2024-09-12T00:54:31.183295+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:48.456675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922780+0000","last_change":"2024-09-12T00:26:48.590043+0000","last_active":"2024-09-12T00:51:35.922780+0000","last_peered":"2024-09-12T00:51:35.922780+0000","last_clean":"2024-09-12T00:51:35.922780+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:51:35.922780+0000","last_undegraded":"2024-09-12T00:51:35.922780+0000","last_fullsized":"2024-09-12T00:51:35.922780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.146720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921176+0000","last_change":"2024-09-12T00:39:28.133468+0000","last_active":"2024-09-12T00:50:44.921176+0000","last_peered":"2024-09-12T00:50:44.921176+0000","last_clean":"2024-09-12T00:50:44.921176+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:50:44.921176+0000","last_undegraded":"2024-09-12T00:50:44.921176+0000","last_fullsized":"2024-09-12T00:50:44.921176+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.124886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'2","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:20.982962+0000","last_change":"2024-09-12T00:28:17.078262+0000","last_active":"2024-09-12T00:54:20.982962+0000","last_peered":"2024-09-12T00:54:20.982962+0000","last_clean":"2024-09-12T00:54:20.982962+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:54:20.982962+0000","last_undegraded":"2024-09-12T00:54:20.982962+0000","last_fullsized":"2024-09-12T00:54:20.982962+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:56.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932572+0000","last_change":"2024-09-12T00:28:14.039832+0000","last_active":"2024-09-12T00:52:05.932572+0000","last_peered":"2024-09-12T00:52:05.932572+0000","last_clean":"2024-09-12T00:52:05.932572+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:52:05.932572+0000","last_undegraded":"2024-09-12T00:52:05.932572+0000","last_fullsized":"2024-09-12T00:52:05.932572+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.914782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922721+0000","last_change":"2024-09-12T00:26:48.586236+0000","last_active":"2024-09-12T00:51:35.922721+0000","last_peered":"2024-09-12T00:51:35.922721+0000","last_clean":"2024-09-12T00:51:35.922721+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:51:35.922721+0000","last_undegraded":"2024-09-12T00:51:35.922721+0000","last_fullsized":"2024-09-12T00:51:35.922721+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:36.773801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113170+0000","last_change":"2024-09-12T00:39:28.126995+0000","last_active":"2024-09-12T00:50:51.113170+0000","last_peered":"2024-09-12T00:50:51.113170+0000","last_clean":"2024-09-12T00:50:51.113170+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:50:51.113170+0000","last_undegraded":"2024-09-12T00:50:51.113170+0000","last_fullsized":"2024-09-12T00:50:51.113170+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.631391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'8","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.520205+0000","last_change":"2024-09-12T00:28:17.067864+0000","last_active":"2024-09-12T00:54:31.520205+0000","last_peered":"2024-09-12T00:54:31.520205+0000","last_clean":"2024-09-12T00:54:31.520205+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:54:31.520205+0000","last_undegraded":"2024-09-12T00:54:31.520205+0000","last_fullsized":"2024-09-12T00:54:31.520205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.110223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.154401+0000","last_change":"2024-09-12T00:28:14.042940+0000","last_active":"2024-09-12T00:54:31.154401+0000","last_peered":"2024-09-12T00:54:31.154401+0000","last_clean":"2024-09-12T00:54:31.154401+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:54:31.154401+0000","last_undegraded":"2024-09-12T00:54:31.154401+0000","last_fullsized":"2024-09-12T00:54:31.154401+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:51.011440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111675+0000","last_change":"2024-09-12T00:26:48.568729+0000","last_active":"2024-09-12T00:50:46.111675+0000","last_peered":"2024-09-12T00:50:46.111675+0000","last_clean":"2024-09-12T00:50:46.111675+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:50:46.111675+0000","last_undegraded":"2024-09-12T00:50:46.111675+0000","last_fullsized":"2024-09-12T00:50:46.111675+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:40.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917549+0000","last_change":"2024-09-12T00:39:28.130189+0000","last_active":"2024-09-12T00:50:45.917549+0000","last_peered":"2024-09-12T00:50:45.917549+0000","last_clean":"2024-09-12T00:50:45.917549+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:50:45.917549+0000","last_undegraded":"2024-09-12T00:50:45.917549+0000","last_fullsized":"2024-09-12T00:50:45.917549+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.938677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912817+0000","last_change":"2024-09-12T00:28:17.080617+0000","last_active":"2024-09-12T00:50:50.912817+0000","last_peered":"2024-09-12T00:50:50.912817+0000","last_clean":"2024-09-12T00:50:50.912817+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:50:50.912817+0000","last_undegraded":"2024-09-12T00:50:50.912817+0000","last_fullsized":"2024-09-12T00:50:50.912817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.933670+0000","last_change":"2024-09-12T00:28:14.047276+0000","last_active":"2024-09-12T00:52:10.933670+0000","last_peered":"2024-09-12T00:52:10.933670+0000","last_clean":"2024-09-12T00:52:10.933670+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:52:10.933670+0000","last_undegraded":"2024-09-12T00:52:10.933670+0000","last_fullsized":"2024-09-12T00:52:10.933670+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:28.302616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:39.919900+0000","last_change":"2024-09-12T00:26:48.570384+0000","last_active":"2024-09-12T00:50:39.919900+0000","last_peered":"2024-09-12T00:50:39.919900+0000","last_clean":"2024-09-12T00:50:39.919900+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:50:39.919900+0000","last_undegraded":"2024-09-12T00:50:39.919900+0000","last_fullsized":"2024-09-12T00:50:39.919900+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.851801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915515+0000","last_change":"2024-09-12T00:39:28.139264+0000","last_active":"2024-09-12T00:50:45.915515+0000","last_peered":"2024-09-12T00:50:45.915515+0000","last_clean":"2024-09-12T00:50:45.915515+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:50:45.915515+0000","last_undegraded":"2024-09-12T00:50:45.915515+0000","last_fullsized":"2024-09-12T00:50:45.915515+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:33.394535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'4","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.167069+0000","last_change":"2024-09-12T00:28:17.064501+0000","last_active":"2024-09-12T00:54:31.167069+0000","last_peered":"2024-09-12T00:54:31.167069+0000","last_clean":"2024-09-12T00:54:31.167069+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:54:31.167069+0000","last_undegraded":"2024-09-12T00:54:31.167069+0000","last_fullsized":"2024-09-12T00:54:31.167069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:53.028265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.967593+0000","last_change":"2024-09-12T00:28:14.045720+0000","last_active":"2024-09-12T00:53:00.967593+0000","last_peered":"2024-09-12T00:53:00.967593+0000","last_clean":"2024-09-12T00:53:00.967593+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:53:00.967593+0000","last_undegraded":"2024-09-12T00:53:00.967593+0000","last_fullsized":"2024-09-12T00:53:00.967593+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.935181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.916225+0000","last_change":"2024-09-12T00:26:48.572885+0000","last_active":"2024-09-12T00:50:40.916225+0000","last_peered":"2024-09-12T00:50:40.916225+0000","last_clean":"2024-09-12T00:50:40.916225+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:50:40.916225+0000","last_undegraded":"2024-09-12T00:50:40.916225+0000","last_fullsized":"2024-09-12T00:50:40.916225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:04.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934275+0000","last_change":"2024-09-12T00:39:28.125866+0000","last_active":"2024-09-12T00:52:00.934275+0000","last_peered":"2024-09-12T00:52:00.934275+0000","last_clean":"2024-09-12T00:52:00.934275+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:52:00.934275+0000","last_undegraded":"2024-09-12T00:52:00.934275+0000","last_fullsized":"2024-09-12T00:52:00.934275+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.504703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:19.929554+0000","last_change":"2024-09-12T00:28:17.054632+0000","last_active":"2024-09-12T00:51:19.929554+0000","last_peered":"2024-09-12T00:51:19.929554+0000","last_clean":"2024-09-12T00:51:19.929554+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:51:19.929554+0000","last_undegraded":"2024-09-12T00:51:19.929554+0000","last_fullsized":"2024-09-12T00:51:19.929554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:40.665178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'7","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.970906+0000","last_change":"2024-09-12T00:28:14.035922+0000","last_active":"2024-09-12T00:53:15.970906+0000","last_peered":"2024-09-12T00:53:15.970906+0000","last_clean":"2024-09-12T00:53:15.970906+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:53:15.970906+0000","last_undegraded":"2024-09-12T00:53:15.970906+0000","last_fullsized":"2024-09-12T00:53:15.970906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:49.298722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.959193+0000","last_change":"2024-09-12T00:26:48.586797+0000","last_active":"2024-09-12T00:51:16.959193+0000","last_peered":"2024-09-12T00:51:16.959193+0000","last_clean":"2024-09-12T00:51:16.959193+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:51:16.959193+0000","last_undegraded":"2024-09-12T00:51:16.959193+0000","last_fullsized":"2024-09-12T00:51:16.959193+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.109038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934301+0000","last_change":"2024-09-12T00:39:28.120562+0000","last_active":"2024-09-12T00:52:00.934301+0000","last_peered":"2024-09-12T00:52:00.934301+0000","last_clean":"2024-09-12T00:52:00.934301+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:52:00.934301+0000","last_undegraded":"2024-09-12T00:52:00.934301+0000","last_fullsized":"2024-09-12T00:52:00.934301+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.131360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928367+0000","last_change":"2024-09-12T00:28:17.068535+0000","last_active":"2024-09-12T00:51:14.928367+0000","last_peered":"2024-09-12T00:51:14.928367+0000","last_clean":"2024-09-12T00:51:14.928367+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:51:14.928367+0000","last_undegraded":"2024-09-12T00:51:14.928367+0000","last_fullsized":"2024-09-12T00:51:14.928367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.915337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:20.950508+0000","last_change":"2024-09-12T00:28:14.046616+0000","last_active":"2024-09-12T00:53:20.950508+0000","last_peered":"2024-09-12T00:53:20.950508+0000","last_clean":"2024-09-12T00:53:20.950508+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:53:20.950508+0000","last_undegraded":"2024-09-12T00:53:20.950508+0000","last_fullsized":"2024-09-12T00:53:20.950508+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.933281+0000","last_change":"2024-09-12T00:26:48.580888+0000","last_active":"2024-09-12T00:50:40.933281+0000","last_peered":"2024-09-12T00:50:40.933281+0000","last_clean":"2024-09-12T00:50:40.933281+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:50:40.933281+0000","last_undegraded":"2024-09-12T00:50:40.933281+0000","last_fullsized":"2024-09-12T00:50:40.933281+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:20.695674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.932994+0000","last_change":"2024-09-12T00:39:28.111443+0000","last_active":"2024-09-12T00:51:34.932994+0000","last_peered":"2024-09-12T00:51:34.932994+0000","last_clean":"2024-09-12T00:51:34.932994+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:51:34.932994+0000","last_undegraded":"2024-09-12T00:51:34.932994+0000","last_fullsized":"2024-09-12T00:51:34.932994+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:45.919919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'12","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.539513+0000","last_change":"2024-09-12T00:28:17.064371+0000","last_active":"2024-09-12T00:54:31.539513+0000","last_peered":"2024-09-12T00:54:31.539513+0000","last_clean":"2024-09-12T00:54:31.539513+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:54:31.539513+0000","last_undegraded":"2024-09-12T00:54:31.539513+0000","last_fullsized":"2024-09-12T00:54:31.539513+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:33.177694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":22,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:06.130194+0000","last_change":"2024-09-12T00:28:14.038263+0000","last_active":"2024-09-12T00:52:06.130194+0000","last_peered":"2024-09-12T00:52:06.130194+0000","last_clean":"2024-09-12T00:52:06.130194+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:52:06.130194+0000","last_undegraded":"2024-09-12T00:52:06.130194+0000","last_fullsized":"2024-09-12T00:52:06.130194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:11.087385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.931038+0000","last_change":"2024-09-12T00:26:48.578925+0000","last_active":"2024-09-12T00:51:56.931038+0000","last_peered":"2024-09-12T00:51:56.931038+0000","last_clean":"2024-09-12T00:51:56.931038+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:51:56.931038+0000","last_undegraded":"2024-09-12T00:51:56.931038+0000","last_fullsized":"2024-09-12T00:51:56.931038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:28.812698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.952894+0000","last_change":"2024-09-12T00:39:28.134519+0000","last_active":"2024-09-12T00:52:00.952894+0000","last_peered":"2024-09-12T00:52:00.952894+0000","last_clean":"2024-09-12T00:52:00.952894+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:52:00.952894+0000","last_undegraded":"2024-09-12T00:52:00.952894+0000","last_fullsized":"2024-09-12T00:52:00.952894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.950649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955943+0000","last_change":"2024-09-12T00:28:17.073665+0000","last_active":"2024-09-12T00:52:10.955943+0000","last_peered":"2024-09-12T00:52:10.955943+0000","last_clean":"2024-09-12T00:52:10.955943+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:52:10.955943+0000","last_undegraded":"2024-09-12T00:52:10.955943+0000","last_fullsized":"2024-09-12T00:52:10.955943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.110456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'6","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.981931+0000","last_change":"2024-09-12T00:28:14.044717+0000","last_active":"2024-09-12T00:54:15.981931+0000","last_peered":"2024-09-12T00:54:15.981931+0000","last_clean":"2024-09-12T00:54:15.981931+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:54:15.981931+0000","last_undegraded":"2024-09-12T00:54:15.981931+0000","last_fullsized":"2024-09-12T00:54:15.981931+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:17.236547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.929500+0000","last_change":"2024-09-12T00:26:48.578631+0000","last_active":"2024-09-12T00:51:50.929500+0000","last_peered":"2024-09-12T00:51:50.929500+0000","last_clean":"2024-09-12T00:51:50.929500+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:51:50.929500+0000","last_undegraded":"2024-09-12T00:51:50.929500+0000","last_fullsized":"2024-09-12T00:51:50.929500+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.001351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910185+0000","last_change":"2024-09-12T00:39:28.145050+0000","last_active":"2024-09-12T00:50:20.910185+0000","last_peered":"2024-09-12T00:50:20.910185+0000","last_clean":"2024-09-12T00:50:20.910185+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:50:20.910185+0000","last_undegraded":"2024-09-12T00:50:20.910185+0000","last_fullsized":"2024-09-12T00:50:20.910185+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:20.809036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:20.950384+0000","last_change":"2024-09-12T00:28:17.061641+0000","last_active":"2024-09-12T00:53:20.950384+0000","last_peered":"2024-09-12T00:53:20.950384+0000","last_clean":"2024-09-12T00:53:20.950384+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:53:20.950384+0000","last_undegraded":"2024-09-12T00:53:20.950384+0000","last_fullsized":"2024-09-12T00:53:20.950384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:36.317632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:21.158440+0000","last_change":"2024-09-12T00:28:14.038655+0000","last_active":"2024-09-12T00:54:21.158440+0000","last_peered":"2024-09-12T00:54:21.158440+0000","last_clean":"2024-09-12T00:54:21.158440+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:54:21.158440+0000","last_undegraded":"2024-09-12T00:54:21.158440+0000","last_fullsized":"2024-09-12T00:54:21.158440+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:19.550915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126487+0000","last_change":"2024-09-12T00:26:48.570084+0000","last_active":"2024-09-12T00:51:51.126487+0000","last_peered":"2024-09-12T00:51:51.126487+0000","last_clean":"2024-09-12T00:51:51.126487+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:51:51.126487+0000","last_undegraded":"2024-09-12T00:51:51.126487+0000","last_fullsized":"2024-09-12T00:51:51.126487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.533768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910538+0000","last_change":"2024-09-12T00:39:28.134280+0000","last_active":"2024-09-12T00:50:20.910538+0000","last_peered":"2024-09-12T00:50:20.910538+0000","last_clean":"2024-09-12T00:50:20.910538+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:50:20.910538+0000","last_undegraded":"2024-09-12T00:50:20.910538+0000","last_fullsized":"2024-09-12T00:50:20.910538+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:57.467826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'7","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:25.984189+0000","last_change":"2024-09-12T00:28:17.078304+0000","last_active":"2024-09-12T00:54:25.984189+0000","last_peered":"2024-09-12T00:54:25.984189+0000","last_clean":"2024-09-12T00:54:25.984189+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:54:25.984189+0000","last_undegraded":"2024-09-12T00:54:25.984189+0000","last_fullsized":"2024-09-12T00:54:25.984189+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.775329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.970680+0000","last_change":"2024-09-12T00:28:14.051795+0000","last_active":"2024-09-12T00:53:15.970680+0000","last_peered":"2024-09-12T00:53:15.970680+0000","last_clean":"2024-09-12T00:53:15.970680+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:53:15.970680+0000","last_undegraded":"2024-09-12T00:53:15.970680+0000","last_fullsized":"2024-09-12T00:53:15.970680+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950431+0000","last_change":"2024-09-12T00:26:48.572457+0000","last_active":"2024-09-12T00:51:50.950431+0000","last_peered":"2024-09-12T00:51:50.950431+0000","last_clean":"2024-09-12T00:51:50.950431+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:51:50.950431+0000","last_undegraded":"2024-09-12T00:51:50.950431+0000","last_fullsized":"2024-09-12T00:51:50.950431+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:54.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.938985+0000","last_change":"2024-09-12T00:39:28.125155+0000","last_active":"2024-09-12T00:51:59.938985+0000","last_peered":"2024-09-12T00:51:59.938985+0000","last_clean":"2024-09-12T00:51:59.938985+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:51:59.938985+0000","last_undegraded":"2024-09-12T00:51:59.938985+0000","last_fullsized":"2024-09-12T00:51:59.938985+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:43.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:21.145839+0000","last_change":"2024-09-12T00:28:17.074251+0000","last_active":"2024-09-12T00:53:21.145839+0000","last_peered":"2024-09-12T00:53:21.145839+0000","last_clean":"2024-09-12T00:53:21.145839+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:53:21.145839+0000","last_undegraded":"2024-09-12T00:53:21.145839+0000","last_fullsized":"2024-09-12T00:53:21.145839+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:25.385818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'19","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.944706+0000","last_change":"2024-09-12T00:28:14.035208+0000","last_active":"2024-09-12T00:53:15.944706+0000","last_peered":"2024-09-12T00:53:15.944706+0000","last_clean":"2024-09-12T00:53:15.944706+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:53:15.944706+0000","last_undegraded":"2024-09-12T00:53:15.944706+0000","last_fullsized":"2024-09-12T00:53:15.944706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.116394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":30726,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950319+0000","last_change":"2024-09-12T00:26:48.568293+0000","last_active":"2024-09-12T00:51:50.950319+0000","last_peered":"2024-09-12T00:51:50.950319+0000","last_clean":"2024-09-12T00:51:50.950319+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:51:50.950319+0000","last_undegraded":"2024-09-12T00:51:50.950319+0000","last_fullsized":"2024-09-12T00:51:50.950319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:56.992825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954372+0000","last_change":"2024-09-12T00:39:28.135750+0000","last_active":"2024-09-12T00:52:05.954372+0000","last_peered":"2024-09-12T00:52:05.954372+0000","last_clean":"2024-09-12T00:52:05.954372+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:52:05.954372+0000","last_undegraded":"2024-09-12T00:52:05.954372+0000","last_fullsized":"2024-09-12T00:52:05.954372+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.659110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.538152+0000","last_change":"2024-09-12T00:28:17.067509+0000","last_active":"2024-09-12T00:54:31.538152+0000","last_peered":"2024-09-12T00:54:31.538152+0000","last_clean":"2024-09-12T00:54:31.538152+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:54:31.538152+0000","last_undegraded":"2024-09-12T00:54:31.538152+0000","last_fullsized":"2024-09-12T00:54:31.538152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:22.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'5","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:16.124939+0000","last_change":"2024-09-12T00:28:14.047213+0000","last_active":"2024-09-12T00:53:16.124939+0000","last_peered":"2024-09-12T00:53:16.124939+0000","last_clean":"2024-09-12T00:53:16.124939+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:53:16.124939+0000","last_undegraded":"2024-09-12T00:53:16.124939+0000","last_fullsized":"2024-09-12T00:53:16.124939+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:39.487908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:56.114009+0000","last_change":"2024-09-12T00:26:48.572978+0000","last_active":"2024-09-12T00:50:56.114009+0000","last_peered":"2024-09-12T00:50:56.114009+0000","last_clean":"2024-09-12T00:50:56.114009+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:50:56.114009+0000","last_undegraded":"2024-09-12T00:50:56.114009+0000","last_fullsized":"2024-09-12T00:50:56.114009+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:12.830137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'262","reported_seq":906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.377392+0000","last_change":"2024-09-12T00:11:45.934895+0000","last_active":"2024-09-12T00:54:31.377392+0000","last_peered":"2024-09-12T00:54:31.377392+0000","last_clean":"2024-09-12T00:54:31.377392+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:54:31.377392+0000","last_undegraded":"2024-09-12T00:54:31.377392+0000","last_fullsized":"2024-09-12T00:54:31.377392+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:30.942936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":2922,"num_write":1055,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1205","reported_seq":2896,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.210228+0000","last_change":"2024-09-12T00:11:47.923845+0000","last_active":"2024-09-12T00:54:17.210228+0000","last_peered":"2024-09-12T00:54:17.210228+0000","last_clean":"2024-09-12T00:54:17.210228+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:17.210228+0000","last_undegraded":"2024-09-12T00:54:17.210228+0000","last_fullsized":"2024-09-12T00:54:17.210228+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":1100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:50:37.116342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'226","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.354150+0000","last_change":"2024-09-12T00:11:45.957898+0000","last_active":"2024-09-12T00:54:31.354150+0000","last_peered":"2024-09-12T00:54:31.354150+0000","last_clean":"2024-09-12T00:54:31.354150+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:54:31.354150+0000","last_undegraded":"2024-09-12T00:54:31.354150+0000","last_fullsized":"2024-09-12T00:54:31.354150+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:17:15.924735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":8607,"num_write":1041,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'455","reported_seq":2037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.541162+0000","last_change":"2024-09-12T00:11:47.930458+0000","last_active":"2024-09-12T00:52:57.541162+0000","last_peered":"2024-09-12T00:52:57.541162+0000","last_clean":"2024-09-12T00:52:57.541162+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:52:57.541162+0000","last_undegraded":"2024-09-12T00:52:57.541162+0000","last_fullsized":"2024-09-12T00:52:57.541162+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.070919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'205","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.490365+0000","last_change":"2024-09-12T00:11:45.962948+0000","last_active":"2024-09-12T00:54:31.490365+0000","last_peered":"2024-09-12T00:54:31.490365+0000","last_clean":"2024-09-12T00:54:31.490365+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:54:31.490365+0000","last_undegraded":"2024-09-12T00:54:31.490365+0000","last_fullsized":"2024-09-12T00:54:31.490365+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:41.772276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":9703,"num_write":942,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'469","reported_seq":2018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.750311+0000","last_change":"2024-09-12T00:11:47.929458+0000","last_active":"2024-09-12T00:53:13.750311+0000","last_peered":"2024-09-12T00:53:13.750311+0000","last_clean":"2024-09-12T00:53:13.750311+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:53:13.750311+0000","last_undegraded":"2024-09-12T00:53:13.750311+0000","last_fullsized":"2024-09-12T00:53:13.750311+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:37.545862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'172","reported_seq":794,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.261200+0000","last_change":"2024-09-12T00:11:45.918049+0000","last_active":"2024-09-12T00:54:31.261200+0000","last_peered":"2024-09-12T00:54:31.261200+0000","last_clean":"2024-09-12T00:54:31.261200+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:54:31.261200+0000","last_undegraded":"2024-09-12T00:54:31.261200+0000","last_fullsized":"2024-09-12T00:54:31.261200+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:27:52.132957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3723389,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":16186,"num_write":899,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'822","reported_seq":2408,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.959350+0000","last_change":"2024-09-12T00:11:47.934714+0000","last_active":"2024-09-12T00:52:56.959350+0000","last_peered":"2024-09-12T00:52:56.959350+0000","last_clean":"2024-09-12T00:52:56.959350+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:52:56.959350+0000","last_undegraded":"2024-09-12T00:52:56.959350+0000","last_fullsized":"2024-09-12T00:52:56.959350+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":800,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:59.452870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'190","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.235651+0000","last_change":"2024-09-12T00:11:45.949664+0000","last_active":"2024-09-12T00:54:31.235651+0000","last_peered":"2024-09-12T00:54:31.235651+0000","last_clean":"2024-09-12T00:54:31.235651+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:54:31.235651+0000","last_undegraded":"2024-09-12T00:54:31.235651+0000","last_fullsized":"2024-09-12T00:54:31.235651+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:50:02.901695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569693,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":16314,"num_write":910,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'799","reported_seq":2283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.596547+0000","last_change":"2024-09-12T00:11:47.930048+0000","last_active":"2024-09-12T00:52:55.596547+0000","last_peered":"2024-09-12T00:52:55.596547+0000","last_clean":"2024-09-12T00:52:55.596547+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:52:55.596547+0000","last_undegraded":"2024-09-12T00:52:55.596547+0000","last_fullsized":"2024-09-12T00:52:55.596547+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":700,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:13.783185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'177","reported_seq":779,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.335647+0000","last_change":"2024-09-12T00:11:45.916383+0000","last_active":"2024-09-12T00:54:31.335647+0000","last_peered":"2024-09-12T00:54:31.335647+0000","last_clean":"2024-09-12T00:54:31.335647+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:31.335647+0000","last_undegraded":"2024-09-12T00:54:31.335647+0000","last_fullsized":"2024-09-12T00:54:31.335647+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:55:23.552714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":30215,"num_write":846,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'391","reported_seq":1906,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.368436+0000","last_change":"2024-09-12T00:11:47.942397+0000","last_active":"2024-09-12T00:53:14.368436+0000","last_peered":"2024-09-12T00:53:14.368436+0000","last_clean":"2024-09-12T00:53:14.368436+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:53:14.368436+0000","last_undegraded":"2024-09-12T00:53:14.368436+0000","last_fullsized":"2024-09-12T00:53:14.368436+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":300,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:26:36.328976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'229","reported_seq":852,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.521411+0000","last_change":"2024-09-12T00:11:45.935583+0000","last_active":"2024-09-12T00:54:31.521411+0000","last_peered":"2024-09-12T00:54:31.521411+0000","last_clean":"2024-09-12T00:54:31.521411+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:54:31.521411+0000","last_undegraded":"2024-09-12T00:54:31.521411+0000","last_fullsized":"2024-09-12T00:54:31.521411+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:17:35.329848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924437,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":17813,"num_write":1032,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'990","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.505994+0000","last_change":"2024-09-12T00:11:47.923621+0000","last_active":"2024-09-12T00:53:10.505994+0000","last_peered":"2024-09-12T00:53:10.505994+0000","last_clean":"2024-09-12T00:53:10.505994+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:53:10.505994+0000","last_undegraded":"2024-09-12T00:53:10.505994+0000","last_fullsized":"2024-09-12T00:53:10.505994+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":900,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:15.959935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'182","reported_seq":780,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.526740+0000","last_change":"2024-09-12T00:12:19.246741+0000","last_active":"2024-09-12T00:54:31.526740+0000","last_peered":"2024-09-12T00:54:31.526740+0000","last_clean":"2024-09-12T00:54:31.526740+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:54:31.526740+0000","last_undegraded":"2024-09-12T00:54:31.526740+0000","last_fullsized":"2024-09-12T00:54:31.526740+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:34:01.798814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":351,"num_read_kb":20841,"num_write":801,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2401,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749106+0000","last_change":"2024-09-12T00:11:47.945525+0000","last_active":"2024-09-12T00:53:13.749106+0000","last_peered":"2024-09-12T00:53:13.749106+0000","last_clean":"2024-09-12T00:53:13.749106+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:53:13.749106+0000","last_undegraded":"2024-09-12T00:53:13.749106+0000","last_fullsized":"2024-09-12T00:53:13.749106+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:16.688767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'810","reported_seq":2356,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.198693+0000","last_change":"2024-09-12T00:11:47.933883+0000","last_active":"2024-09-12T00:54:17.198693+0000","last_peered":"2024-09-12T00:54:17.198693+0000","last_clean":"2024-09-12T00:54:17.198693+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:17.198693+0000","last_undegraded":"2024-09-12T00:54:17.198693+0000","last_fullsized":"2024-09-12T00:54:17.198693+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.403220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'281","reported_seq":1005,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.527270+0000","last_change":"2024-09-12T00:11:45.960039+0000","last_active":"2024-09-12T00:54:31.527270+0000","last_peered":"2024-09-12T00:54:31.527270+0000","last_clean":"2024-09-12T00:54:31.527270+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:54:31.527270+0000","last_undegraded":"2024-09-12T00:54:31.527270+0000","last_fullsized":"2024-09-12T00:54:31.527270+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:54:20.482316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351099,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":931,"num_read_kb":25081,"num_write":1230,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2586,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199630+0000","last_change":"2024-09-12T00:11:47.935606+0000","last_active":"2024-09-12T00:54:17.199630+0000","last_peered":"2024-09-12T00:54:17.199630+0000","last_clean":"2024-09-12T00:54:17.199630+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:17.199630+0000","last_undegraded":"2024-09-12T00:54:17.199630+0000","last_fullsized":"2024-09-12T00:54:17.199630+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:09.287342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'183","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.355413+0000","last_change":"2024-09-12T00:11:45.920735+0000","last_active":"2024-09-12T00:54:31.355413+0000","last_peered":"2024-09-12T00:54:31.355413+0000","last_clean":"2024-09-12T00:54:31.355413+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:31.355413+0000","last_undegraded":"2024-09-12T00:54:31.355413+0000","last_fullsized":"2024-09-12T00:54:31.355413+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:58:08.846428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":23009,"num_write":868,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'439","reported_seq":2004,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.211419+0000","last_change":"2024-09-12T00:11:47.940868+0000","last_active":"2024-09-12T00:54:17.211419+0000","last_peered":"2024-09-12T00:54:17.211419+0000","last_clean":"2024-09-12T00:54:17.211419+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:17.211419+0000","last_undegraded":"2024-09-12T00:54:17.211419+0000","last_fullsized":"2024-09-12T00:54:17.211419+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":400,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:23.451421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'192","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.428690+0000","last_change":"2024-09-12T00:11:45.925804+0000","last_active":"2024-09-12T00:54:31.428690+0000","last_peered":"2024-09-12T00:54:31.428690+0000","last_clean":"2024-09-12T00:54:31.428690+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:54:31.428690+0000","last_undegraded":"2024-09-12T00:54:31.428690+0000","last_fullsized":"2024-09-12T00:54:31.428690+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:55.107812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129095,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":15824,"num_write":919,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'552","reported_seq":2152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.505098+0000","last_change":"2024-09-12T00:11:47.949066+0000","last_active":"2024-09-12T00:53:01.505098+0000","last_peered":"2024-09-12T00:53:01.505098+0000","last_clean":"2024-09-12T00:53:01.505098+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:53:01.505098+0000","last_undegraded":"2024-09-12T00:53:01.505098+0000","last_fullsized":"2024-09-12T00:53:01.505098+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":500,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:43.977974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'211","reported_seq":830,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.404158+0000","last_change":"2024-09-12T00:11:45.937137+0000","last_active":"2024-09-12T00:54:31.404158+0000","last_peered":"2024-09-12T00:54:31.404158+0000","last_clean":"2024-09-12T00:54:31.404158+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:54:31.404158+0000","last_undegraded":"2024-09-12T00:54:31.404158+0000","last_fullsized":"2024-09-12T00:54:31.404158+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:36.986793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924468,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":26404,"num_write":991,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'628","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.967393+0000","last_change":"2024-09-12T00:11:47.924685+0000","last_active":"2024-09-12T00:53:01.967393+0000","last_peered":"2024-09-12T00:53:01.967393+0000","last_clean":"2024-09-12T00:53:01.967393+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:53:01.967393+0000","last_undegraded":"2024-09-12T00:53:01.967393+0000","last_fullsized":"2024-09-12T00:53:01.967393+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:06.368642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'186","reported_seq":808,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.401663+0000","last_change":"2024-09-12T00:11:45.950496+0000","last_active":"2024-09-12T00:54:31.401663+0000","last_peered":"2024-09-12T00:54:31.401663+0000","last_clean":"2024-09-12T00:54:31.401663+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:54:31.401663+0000","last_undegraded":"2024-09-12T00:54:31.401663+0000","last_fullsized":"2024-09-12T00:54:31.401663+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:36.187975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":395,"num_read_kb":19556,"num_write":891,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1215","reported_seq":2911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.201094+0000","last_change":"2024-09-12T00:11:47.925124+0000","last_active":"2024-09-12T00:54:17.201094+0000","last_peered":"2024-09-12T00:54:17.201094+0000","last_clean":"2024-09-12T00:54:17.201094+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:17.201094+0000","last_undegraded":"2024-09-12T00:54:17.201094+0000","last_fullsized":"2024-09-12T00:54:17.201094+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":1200,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:30.824531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'206","reported_seq":892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.481040+0000","last_change":"2024-09-12T00:11:45.938512+0000","last_active":"2024-09-12T00:54:31.481040+0000","last_peered":"2024-09-12T00:54:31.481040+0000","last_clean":"2024-09-12T00:54:31.481040+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:31.481040+0000","last_undegraded":"2024-09-12T00:54:31.481040+0000","last_fullsized":"2024-09-12T00:54:31.481040+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:02:43.280807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":13603,"num_write":999,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'158","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.440855+0000","last_change":"2024-09-12T00:11:55.962848+0000","last_active":"2024-09-12T00:53:14.440855+0000","last_peered":"2024-09-12T00:53:14.440855+0000","last_clean":"2024-09-12T00:53:14.440855+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:53:14.440855+0000","last_undegraded":"2024-09-12T00:53:14.440855+0000","last_fullsized":"2024-09-12T00:53:14.440855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:04.549126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'428","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.365744+0000","last_change":"2024-09-12T00:11:47.957238+0000","last_active":"2024-09-12T00:53:14.365744+0000","last_peered":"2024-09-12T00:53:14.365744+0000","last_clean":"2024-09-12T00:53:14.365744+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:53:14.365744+0000","last_undegraded":"2024-09-12T00:53:14.365744+0000","last_fullsized":"2024-09-12T00:53:14.365744+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":400,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:35.988751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'200","reported_seq":849,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.491920+0000","last_change":"2024-09-12T00:12:19.243333+0000","last_active":"2024-09-12T00:54:31.491920+0000","last_peered":"2024-09-12T00:54:31.491920+0000","last_clean":"2024-09-12T00:54:31.491920+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:54:31.491920+0000","last_undegraded":"2024-09-12T00:54:31.491920+0000","last_fullsized":"2024-09-12T00:54:31.491920+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:24:21.362685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1954,"num_write":1014,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930718+0000","last_change":"2024-09-12T00:11:49.940927+0000","last_active":"2024-09-12T00:50:30.930718+0000","last_peered":"2024-09-12T00:50:30.930718+0000","last_clean":"2024-09-12T00:50:30.930718+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:50:30.930718+0000","last_undegraded":"2024-09-12T00:50:30.930718+0000","last_fullsized":"2024-09-12T00:50:30.930718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:54.486050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'200","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.386046+0000","last_change":"2024-09-12T00:11:51.947651+0000","last_active":"2024-09-12T00:54:31.386046+0000","last_peered":"2024-09-12T00:54:31.386046+0000","last_clean":"2024-09-12T00:54:31.386046+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:54:31.386046+0000","last_undegraded":"2024-09-12T00:54:31.386046+0000","last_fullsized":"2024-09-12T00:54:31.386046+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:29.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":272,"num_read_kb":332,"num_write":160,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089124+0000","last_change":"2024-09-12T00:11:53.948633+0000","last_active":"2024-09-12T00:50:36.089124+0000","last_peered":"2024-09-12T00:50:36.089124+0000","last_clean":"2024-09-12T00:50:36.089124+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:50:36.089124+0000","last_undegraded":"2024-09-12T00:50:36.089124+0000","last_fullsized":"2024-09-12T00:50:36.089124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:09.362747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2472","reported_seq":4364,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.220805+0000","last_change":"2024-09-12T00:11:55.974612+0000","last_active":"2024-09-12T00:53:59.220805+0000","last_peered":"2024-09-12T00:53:59.220805+0000","last_clean":"2024-09-12T00:53:59.220805+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:53:59.220805+0000","last_undegraded":"2024-09-12T00:53:59.220805+0000","last_fullsized":"2024-09-12T00:53:59.220805+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:50.591689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'463","reported_seq":1911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.197150+0000","last_change":"2024-09-12T00:11:47.930826+0000","last_active":"2024-09-12T00:54:17.197150+0000","last_peered":"2024-09-12T00:54:17.197150+0000","last_clean":"2024-09-12T00:54:17.197150+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:17.197150+0000","last_undegraded":"2024-09-12T00:54:17.197150+0000","last_fullsized":"2024-09-12T00:54:17.197150+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":400,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:30.387857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'244","reported_seq":932,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.524465+0000","last_change":"2024-09-12T00:11:45.930202+0000","last_active":"2024-09-12T00:54:31.524465+0000","last_peered":"2024-09-12T00:54:31.524465+0000","last_clean":"2024-09-12T00:54:31.524465+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:54:31.524465+0000","last_undegraded":"2024-09-12T00:54:31.524465+0000","last_fullsized":"2024-09-12T00:54:31.524465+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:48.494151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49242,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":71900,"num_write":1168,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.928736+0000","last_change":"2024-09-12T00:11:49.928414+0000","last_active":"2024-09-12T00:51:40.928736+0000","last_peered":"2024-09-12T00:51:40.928736+0000","last_clean":"2024-09-12T00:51:40.928736+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:51:40.928736+0000","last_undegraded":"2024-09-12T00:51:40.928736+0000","last_fullsized":"2024-09-12T00:51:40.928736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.325652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'91","reported_seq":624,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.782442+0000","last_change":"2024-09-12T00:11:51.929989+0000","last_active":"2024-09-12T00:52:37.782442+0000","last_peered":"2024-09-12T00:52:37.782442+0000","last_clean":"2024-09-12T00:52:37.782442+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:52:37.782442+0000","last_undegraded":"2024-09-12T00:52:37.782442+0000","last_fullsized":"2024-09-12T00:52:37.782442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:08:18.143324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089023+0000","last_change":"2024-09-12T00:11:53.948950+0000","last_active":"2024-09-12T00:50:36.089023+0000","last_peered":"2024-09-12T00:50:36.089023+0000","last_clean":"2024-09-12T00:50:36.089023+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:50:36.089023+0000","last_undegraded":"2024-09-12T00:50:36.089023+0000","last_fullsized":"2024-09-12T00:50:36.089023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:44.328086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'155","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.554087+0000","last_change":"2024-09-12T00:11:55.974329+0000","last_active":"2024-09-12T00:52:56.554087+0000","last_peered":"2024-09-12T00:52:56.554087+0000","last_clean":"2024-09-12T00:52:56.554087+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:52:56.554087+0000","last_undegraded":"2024-09-12T00:52:56.554087+0000","last_fullsized":"2024-09-12T00:52:56.554087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:22.758032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'565","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.733246+0000","last_change":"2024-09-12T00:11:47.935137+0000","last_active":"2024-09-12T00:53:13.733246+0000","last_peered":"2024-09-12T00:53:13.733246+0000","last_clean":"2024-09-12T00:53:13.733246+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:53:13.733246+0000","last_undegraded":"2024-09-12T00:53:13.733246+0000","last_fullsized":"2024-09-12T00:53:13.733246+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.622836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'235","reported_seq":867,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.538392+0000","last_change":"2024-09-12T00:11:45.920772+0000","last_active":"2024-09-12T00:54:31.538392+0000","last_peered":"2024-09-12T00:54:31.538392+0000","last_clean":"2024-09-12T00:54:31.538392+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:54:31.538392+0000","last_undegraded":"2024-09-12T00:54:31.538392+0000","last_fullsized":"2024-09-12T00:54:31.538392+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:47:51.476722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":11769,"num_write":1011,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.912975+0000","last_change":"2024-09-12T00:11:49.946026+0000","last_active":"2024-09-12T00:50:30.912975+0000","last_peered":"2024-09-12T00:50:30.912975+0000","last_clean":"2024-09-12T00:50:30.912975+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:50:30.912975+0000","last_undegraded":"2024-09-12T00:50:30.912975+0000","last_fullsized":"2024-09-12T00:50:30.912975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.002432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'128","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:34.133774+0000","last_change":"2024-09-12T00:11:51.952490+0000","last_active":"2024-09-12T00:52:34.133774+0000","last_peered":"2024-09-12T00:52:34.133774+0000","last_clean":"2024-09-12T00:52:34.133774+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:52:34.133774+0000","last_undegraded":"2024-09-12T00:52:34.133774+0000","last_fullsized":"2024-09-12T00:52:34.133774+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:12.676121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'779","reported_seq":2216,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.974520+0000","last_change":"2024-09-12T00:11:53.963903+0000","last_active":"2024-09-12T00:54:30.974520+0000","last_peered":"2024-09-12T00:54:30.974520+0000","last_clean":"2024-09-12T00:54:30.974520+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:54:30.974520+0000","last_undegraded":"2024-09-12T00:54:30.974520+0000","last_fullsized":"2024-09-12T00:54:30.974520+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:11.131097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'218","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.508260+0000","last_change":"2024-09-12T00:11:55.967351+0000","last_active":"2024-09-12T00:53:14.508260+0000","last_peered":"2024-09-12T00:53:14.508260+0000","last_clean":"2024-09-12T00:53:14.508260+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:53:14.508260+0000","last_undegraded":"2024-09-12T00:53:14.508260+0000","last_fullsized":"2024-09-12T00:53:14.508260+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:31.864573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'339","reported_seq":1777,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.748057+0000","last_change":"2024-09-12T00:11:47.931389+0000","last_active":"2024-09-12T00:53:13.748057+0000","last_peered":"2024-09-12T00:53:13.748057+0000","last_clean":"2024-09-12T00:53:13.748057+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:53:13.748057+0000","last_undegraded":"2024-09-12T00:53:13.748057+0000","last_fullsized":"2024-09-12T00:53:13.748057+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":300,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:39.305373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'204","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.499907+0000","last_change":"2024-09-12T00:11:45.960713+0000","last_active":"2024-09-12T00:54:31.499907+0000","last_peered":"2024-09-12T00:54:31.499907+0000","last_clean":"2024-09-12T00:54:31.499907+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:54:31.499907+0000","last_undegraded":"2024-09-12T00:54:31.499907+0000","last_fullsized":"2024-09-12T00:54:31.499907+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:50:02.838856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5525,"num_write":929,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930757+0000","last_change":"2024-09-12T00:11:49.936925+0000","last_active":"2024-09-12T00:50:30.930757+0000","last_peered":"2024-09-12T00:50:30.930757+0000","last_clean":"2024-09-12T00:50:30.930757+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:50:30.930757+0000","last_undegraded":"2024-09-12T00:50:30.930757+0000","last_fullsized":"2024-09-12T00:50:30.930757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.835956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'121","reported_seq":691,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.337323+0000","last_change":"2024-09-12T00:11:51.945240+0000","last_active":"2024-09-12T00:54:31.337323+0000","last_peered":"2024-09-12T00:54:31.337323+0000","last_clean":"2024-09-12T00:54:31.337323+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:31.337323+0000","last_undegraded":"2024-09-12T00:54:31.337323+0000","last_fullsized":"2024-09-12T00:54:31.337323+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":100,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:58:43.775349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":150,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'790","reported_seq":2259,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.981859+0000","last_change":"2024-09-12T00:11:53.966127+0000","last_active":"2024-09-12T00:54:30.981859+0000","last_peered":"2024-09-12T00:54:30.981859+0000","last_clean":"2024-09-12T00:54:30.981859+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:54:30.981859+0000","last_undegraded":"2024-09-12T00:54:30.981859+0000","last_fullsized":"2024-09-12T00:54:30.981859+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.057133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'538","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.492338+0000","last_change":"2024-09-12T00:11:47.925552+0000","last_active":"2024-09-12T00:53:10.492338+0000","last_peered":"2024-09-12T00:53:10.492338+0000","last_clean":"2024-09-12T00:53:10.492338+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:53:10.492338+0000","last_undegraded":"2024-09-12T00:53:10.492338+0000","last_fullsized":"2024-09-12T00:53:10.492338+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":500,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:35.564710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'243","reported_seq":899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.500123+0000","last_change":"2024-09-12T00:11:45.936612+0000","last_active":"2024-09-12T00:54:31.500123+0000","last_peered":"2024-09-12T00:54:31.500123+0000","last_clean":"2024-09-12T00:54:31.500123+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:54:31.500123+0000","last_undegraded":"2024-09-12T00:54:31.500123+0000","last_fullsized":"2024-09-12T00:54:31.500123+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:04.380015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639369,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":593,"num_read_kb":40518,"num_write":1099,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092095+0000","last_change":"2024-09-12T00:11:49.915889+0000","last_active":"2024-09-12T00:50:51.092095+0000","last_peered":"2024-09-12T00:50:51.092095+0000","last_clean":"2024-09-12T00:50:51.092095+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:50:51.092095+0000","last_undegraded":"2024-09-12T00:50:51.092095+0000","last_fullsized":"2024-09-12T00:50:51.092095+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:01.391369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'220","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.444886+0000","last_change":"2024-09-12T00:11:51.952724+0000","last_active":"2024-09-12T00:54:31.444886+0000","last_peered":"2024-09-12T00:54:31.444886+0000","last_clean":"2024-09-12T00:54:31.444886+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:54:31.444886+0000","last_undegraded":"2024-09-12T00:54:31.444886+0000","last_fullsized":"2024-09-12T00:54:31.444886+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:30.153282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":300,"num_read_kb":365,"num_write":178,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:10.904191+0000","last_change":"2024-09-12T00:11:53.969081+0000","last_active":"2024-09-12T00:50:10.904191+0000","last_peered":"2024-09-12T00:50:10.904191+0000","last_clean":"2024-09-12T00:50:10.904191+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:50:10.904191+0000","last_undegraded":"2024-09-12T00:50:10.904191+0000","last_fullsized":"2024-09-12T00:50:10.904191+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:12.097774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'542","reported_seq":1368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.342188+0000","last_change":"2024-09-12T00:11:55.961717+0000","last_active":"2024-09-12T00:54:18.342188+0000","last_peered":"2024-09-12T00:54:18.342188+0000","last_clean":"2024-09-12T00:54:18.342188+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:54:18.342188+0000","last_undegraded":"2024-09-12T00:54:18.342188+0000","last_fullsized":"2024-09-12T00:54:18.342188+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'843","reported_seq":2486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.493186+0000","last_change":"2024-09-12T00:11:47.924514+0000","last_active":"2024-09-12T00:53:10.493186+0000","last_peered":"2024-09-12T00:53:10.493186+0000","last_clean":"2024-09-12T00:53:10.493186+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:53:10.493186+0000","last_undegraded":"2024-09-12T00:53:10.493186+0000","last_fullsized":"2024-09-12T00:53:10.493186+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":800,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:15:28.061678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'191","reported_seq":1002,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.538218+0000","last_change":"2024-09-12T00:11:45.960456+0000","last_active":"2024-09-12T00:54:31.538218+0000","last_peered":"2024-09-12T00:54:31.538218+0000","last_clean":"2024-09-12T00:54:31.538218+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:31.538218+0000","last_undegraded":"2024-09-12T00:54:31.538218+0000","last_fullsized":"2024-09-12T00:54:31.538218+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:59:26.947144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399155,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":818,"num_read_kb":32535,"num_write":884,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912730+0000","last_change":"2024-09-12T00:11:49.945091+0000","last_active":"2024-09-12T00:50:50.912730+0000","last_peered":"2024-09-12T00:50:50.912730+0000","last_clean":"2024-09-12T00:50:50.912730+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:50:50.912730+0000","last_undegraded":"2024-09-12T00:50:50.912730+0000","last_fullsized":"2024-09-12T00:50:50.912730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:27.590584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'129","reported_seq":704,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.185654+0000","last_change":"2024-09-12T00:11:51.947825+0000","last_active":"2024-09-12T00:54:31.185654+0000","last_peered":"2024-09-12T00:54:31.185654+0000","last_clean":"2024-09-12T00:54:31.185654+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:54:31.185654+0000","last_undegraded":"2024-09-12T00:54:31.185654+0000","last_fullsized":"2024-09-12T00:54:31.185654+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:40.118757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":236,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:05.920875+0000","last_change":"2024-09-12T00:11:53.971538+0000","last_active":"2024-09-12T00:51:05.920875+0000","last_peered":"2024-09-12T00:51:05.920875+0000","last_clean":"2024-09-12T00:51:05.920875+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:51:05.920875+0000","last_undegraded":"2024-09-12T00:51:05.920875+0000","last_fullsized":"2024-09-12T00:51:05.920875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.262175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'143","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:41.129296+0000","last_change":"2024-09-12T00:11:55.983166+0000","last_active":"2024-09-12T00:53:41.129296+0000","last_peered":"2024-09-12T00:53:41.129296+0000","last_clean":"2024-09-12T00:53:41.129296+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:53:41.129296+0000","last_undegraded":"2024-09-12T00:53:41.129296+0000","last_fullsized":"2024-09-12T00:53:41.129296+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.841060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'471","reported_seq":1963,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369406+0000","last_change":"2024-09-12T00:11:47.926269+0000","last_active":"2024-09-12T00:53:14.369406+0000","last_peered":"2024-09-12T00:53:14.369406+0000","last_clean":"2024-09-12T00:53:14.369406+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:53:14.369406+0000","last_undegraded":"2024-09-12T00:53:14.369406+0000","last_fullsized":"2024-09-12T00:53:14.369406+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:55.592362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'169","reported_seq":783,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.501956+0000","last_change":"2024-09-12T00:11:45.932385+0000","last_active":"2024-09-12T00:54:31.501956+0000","last_peered":"2024-09-12T00:54:31.501956+0000","last_clean":"2024-09-12T00:54:31.501956+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:54:31.501956+0000","last_undegraded":"2024-09-12T00:54:31.501956+0000","last_fullsized":"2024-09-12T00:54:31.501956+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:55.293210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263229,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":53604,"num_write":798,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:19.943503+0000","last_change":"2024-09-12T00:11:49.936538+0000","last_active":"2024-09-12T00:52:19.943503+0000","last_peered":"2024-09-12T00:52:19.943503+0000","last_clean":"2024-09-12T00:52:19.943503+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:52:19.943503+0000","last_undegraded":"2024-09-12T00:52:19.943503+0000","last_fullsized":"2024-09-12T00:52:19.943503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'165","reported_seq":760,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.468527+0000","last_change":"2024-09-12T00:11:51.935323+0000","last_active":"2024-09-12T00:54:31.468527+0000","last_peered":"2024-09-12T00:54:31.468527+0000","last_clean":"2024-09-12T00:54:31.468527+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:54:31.468527+0000","last_undegraded":"2024-09-12T00:54:31.468527+0000","last_fullsized":"2024-09-12T00:54:31.468527+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.661049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":225,"num_read_kb":295,"num_write":126,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'789","reported_seq":4497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.984194+0000","last_change":"2024-09-12T00:11:53.965915+0000","last_active":"2024-09-12T00:54:30.984194+0000","last_peered":"2024-09-12T00:54:30.984194+0000","last_clean":"2024-09-12T00:54:30.984194+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:54:30.984194+0000","last_undegraded":"2024-09-12T00:54:30.984194+0000","last_fullsized":"2024-09-12T00:54:30.984194+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.284890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'110","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.118486+0000","last_change":"2024-09-12T00:11:55.974936+0000","last_active":"2024-09-12T00:54:17.118486+0000","last_peered":"2024-09-12T00:54:17.118486+0000","last_clean":"2024-09-12T00:54:17.118486+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:54:17.118486+0000","last_undegraded":"2024-09-12T00:54:17.118486+0000","last_fullsized":"2024-09-12T00:54:17.118486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.367435+0000","last_change":"2024-09-12T00:11:47.936806+0000","last_active":"2024-09-12T00:53:14.367435+0000","last_peered":"2024-09-12T00:53:14.367435+0000","last_clean":"2024-09-12T00:53:14.367435+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:53:14.367435+0000","last_undegraded":"2024-09-12T00:53:14.367435+0000","last_fullsized":"2024-09-12T00:53:14.367435+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.241629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'206","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.498523+0000","last_change":"2024-09-12T00:11:45.924370+0000","last_active":"2024-09-12T00:54:31.498523+0000","last_peered":"2024-09-12T00:54:31.498523+0000","last_clean":"2024-09-12T00:54:31.498523+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:54:31.498523+0000","last_undegraded":"2024-09-12T00:54:31.498523+0000","last_fullsized":"2024-09-12T00:54:31.498523+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:49.161944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263232,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":7228,"num_write":905,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914998+0000","last_change":"2024-09-12T00:11:49.935933+0000","last_active":"2024-09-12T00:51:00.914998+0000","last_peered":"2024-09-12T00:51:00.914998+0000","last_clean":"2024-09-12T00:51:00.914998+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:51:00.914998+0000","last_undegraded":"2024-09-12T00:51:00.914998+0000","last_fullsized":"2024-09-12T00:51:00.914998+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:58:55.844937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'221","reported_seq":863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.504002+0000","last_change":"2024-09-12T00:11:51.953736+0000","last_active":"2024-09-12T00:54:31.504002+0000","last_peered":"2024-09-12T00:54:31.504002+0000","last_clean":"2024-09-12T00:54:31.504002+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:54:31.504002+0000","last_undegraded":"2024-09-12T00:54:31.504002+0000","last_fullsized":"2024-09-12T00:54:31.504002+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:45.844572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17671,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":453,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923531+0000","last_change":"2024-09-12T00:11:53.953180+0000","last_active":"2024-09-12T00:50:54.923531+0000","last_peered":"2024-09-12T00:50:54.923531+0000","last_clean":"2024-09-12T00:50:54.923531+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:50:54.923531+0000","last_undegraded":"2024-09-12T00:50:54.923531+0000","last_fullsized":"2024-09-12T00:50:54.923531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.341688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'167","reported_seq":695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.573638+0000","last_change":"2024-09-12T00:11:55.974975+0000","last_active":"2024-09-12T00:53:13.573638+0000","last_peered":"2024-09-12T00:53:13.573638+0000","last_clean":"2024-09-12T00:53:13.573638+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:53:13.573638+0000","last_undegraded":"2024-09-12T00:53:13.573638+0000","last_fullsized":"2024-09-12T00:53:13.573638+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:59.474049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'471","reported_seq":1904,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.704239+0000","last_change":"2024-09-12T00:11:47.940887+0000","last_active":"2024-09-12T00:52:54.704239+0000","last_peered":"2024-09-12T00:52:54.704239+0000","last_clean":"2024-09-12T00:52:54.704239+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:52:54.704239+0000","last_undegraded":"2024-09-12T00:52:54.704239+0000","last_fullsized":"2024-09-12T00:52:54.704239+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'213","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.323558+0000","last_change":"2024-09-12T00:11:45.943857+0000","last_active":"2024-09-12T00:54:31.323558+0000","last_peered":"2024-09-12T00:54:31.323558+0000","last_clean":"2024-09-12T00:54:31.323558+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:54:31.323558+0000","last_undegraded":"2024-09-12T00:54:31.323558+0000","last_fullsized":"2024-09-12T00:54:31.323558+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:43.419673+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1957,"num_write":1001,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"37'3","reported_seq":973,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.961969+0000","last_change":"2024-09-12T00:11:49.937297+0000","last_active":"2024-09-12T00:54:30.961969+0000","last_peered":"2024-09-12T00:54:30.961969+0000","last_clean":"2024-09-12T00:54:30.961969+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:30.961969+0000","last_undegraded":"2024-09-12T00:54:30.961969+0000","last_fullsized":"2024-09-12T00:54:30.961969+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:59:00.946216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'164","reported_seq":747,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.276216+0000","last_change":"2024-09-12T00:11:51.927031+0000","last_active":"2024-09-12T00:54:31.276216+0000","last_peered":"2024-09-12T00:54:31.276216+0000","last_clean":"2024-09-12T00:54:31.276216+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:31.276216+0000","last_undegraded":"2024-09-12T00:54:31.276216+0000","last_fullsized":"2024-09-12T00:54:31.276216+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:02.672539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8234,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":271,"num_write":174,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:20.910347+0000","last_change":"2024-09-12T00:11:53.968094+0000","last_active":"2024-09-12T00:50:20.910347+0000","last_peered":"2024-09-12T00:50:20.910347+0000","last_clean":"2024-09-12T00:50:20.910347+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:50:20.910347+0000","last_undegraded":"2024-09-12T00:50:20.910347+0000","last_fullsized":"2024-09-12T00:50:20.910347+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:02:10.434778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'111","reported_seq":608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.371379+0000","last_change":"2024-09-12T00:11:55.962445+0000","last_active":"2024-09-12T00:54:07.371379+0000","last_peered":"2024-09-12T00:54:07.371379+0000","last_clean":"2024-09-12T00:54:07.371379+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:54:07.371379+0000","last_undegraded":"2024-09-12T00:54:07.371379+0000","last_fullsized":"2024-09-12T00:54:07.371379+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.195407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'357","reported_seq":1762,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.504214+0000","last_change":"2024-09-12T00:11:47.927194+0000","last_active":"2024-09-12T00:53:10.504214+0000","last_peered":"2024-09-12T00:53:10.504214+0000","last_clean":"2024-09-12T00:53:10.504214+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:53:10.504214+0000","last_undegraded":"2024-09-12T00:53:10.504214+0000","last_fullsized":"2024-09-12T00:53:10.504214+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":300,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:01.220441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'180","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.521978+0000","last_change":"2024-09-12T00:11:45.917052+0000","last_active":"2024-09-12T00:54:31.521978+0000","last_peered":"2024-09-12T00:54:31.521978+0000","last_clean":"2024-09-12T00:54:31.521978+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:54:31.521978+0000","last_undegraded":"2024-09-12T00:54:31.521978+0000","last_fullsized":"2024-09-12T00:54:31.521978+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:28:13.426346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029147,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":98751,"num_write":852,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:19.943556+0000","last_change":"2024-09-12T00:11:49.929321+0000","last_active":"2024-09-12T00:52:19.943556+0000","last_peered":"2024-09-12T00:52:19.943556+0000","last_clean":"2024-09-12T00:52:19.943556+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:52:19.943556+0000","last_undegraded":"2024-09-12T00:52:19.943556+0000","last_fullsized":"2024-09-12T00:52:19.943556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:41.401304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'146","reported_seq":728,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.121007+0000","last_change":"2024-09-12T00:11:51.944644+0000","last_active":"2024-09-12T00:54:31.121007+0000","last_peered":"2024-09-12T00:54:31.121007+0000","last_clean":"2024-09-12T00:54:31.121007+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:54:31.121007+0000","last_undegraded":"2024-09-12T00:54:31.121007+0000","last_fullsized":"2024-09-12T00:54:31.121007+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:51.228465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4675,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":249,"num_write":108,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'760","reported_seq":4271,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.973673+0000","last_change":"2024-09-12T00:11:53.952899+0000","last_active":"2024-09-12T00:54:30.973673+0000","last_peered":"2024-09-12T00:54:30.973673+0000","last_clean":"2024-09-12T00:54:30.973673+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:30.973673+0000","last_undegraded":"2024-09-12T00:54:30.973673+0000","last_fullsized":"2024-09-12T00:54:30.973673+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:12.752310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'131","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.447365+0000","last_change":"2024-09-12T00:11:55.980382+0000","last_active":"2024-09-12T00:53:14.447365+0000","last_peered":"2024-09-12T00:53:14.447365+0000","last_clean":"2024-09-12T00:53:14.447365+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:53:14.447365+0000","last_undegraded":"2024-09-12T00:53:14.447365+0000","last_fullsized":"2024-09-12T00:53:14.447365+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:00.118353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'421","reported_seq":1949,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.506314+0000","last_change":"2024-09-12T00:11:47.929290+0000","last_active":"2024-09-12T00:53:01.506314+0000","last_peered":"2024-09-12T00:53:01.506314+0000","last_clean":"2024-09-12T00:53:01.506314+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:53:01.506314+0000","last_undegraded":"2024-09-12T00:53:01.506314+0000","last_fullsized":"2024-09-12T00:53:01.506314+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":400,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'205","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.499406+0000","last_change":"2024-09-12T00:11:45.934214+0000","last_active":"2024-09-12T00:54:31.499406+0000","last_peered":"2024-09-12T00:54:31.499406+0000","last_clean":"2024-09-12T00:54:31.499406+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:54:31.499406+0000","last_undegraded":"2024-09-12T00:54:31.499406+0000","last_fullsized":"2024-09-12T00:54:31.499406+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:16.412728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3292722,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":199371,"num_write":991,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"30'2","reported_seq":1446,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.943149+0000","last_change":"2024-09-12T00:11:49.916557+0000","last_active":"2024-09-12T00:54:30.943149+0000","last_peered":"2024-09-12T00:54:30.943149+0000","last_clean":"2024-09-12T00:54:30.943149+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:30.943149+0000","last_undegraded":"2024-09-12T00:54:30.943149+0000","last_fullsized":"2024-09-12T00:54:30.943149+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:21.916420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'72","reported_seq":590,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.752832+0000","last_change":"2024-09-12T00:11:51.935418+0000","last_active":"2024-09-12T00:53:13.752832+0000","last_peered":"2024-09-12T00:53:13.752832+0000","last_clean":"2024-09-12T00:53:13.752832+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:53:13.752832+0000","last_undegraded":"2024-09-12T00:53:13.752832+0000","last_fullsized":"2024-09-12T00:53:13.752832+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:51.747263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'798","reported_seq":2241,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.978729+0000","last_change":"2024-09-12T00:11:53.957570+0000","last_active":"2024-09-12T00:54:30.978729+0000","last_peered":"2024-09-12T00:54:30.978729+0000","last_clean":"2024-09-12T00:54:30.978729+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:30.978729+0000","last_undegraded":"2024-09-12T00:54:30.978729+0000","last_fullsized":"2024-09-12T00:54:30.978729+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":701,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:04.088118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.135829+0000","last_change":"2024-09-12T00:11:55.975495+0000","last_active":"2024-09-12T00:52:29.135829+0000","last_peered":"2024-09-12T00:52:29.135829+0000","last_clean":"2024-09-12T00:52:29.135829+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:52:29.135829+0000","last_undegraded":"2024-09-12T00:52:29.135829+0000","last_fullsized":"2024-09-12T00:52:29.135829+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.293878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'759","reported_seq":2284,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.232523+0000","last_change":"2024-09-12T00:11:47.955610+0000","last_active":"2024-09-12T00:53:00.232523+0000","last_peered":"2024-09-12T00:53:00.232523+0000","last_clean":"2024-09-12T00:53:00.232523+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:53:00.232523+0000","last_undegraded":"2024-09-12T00:53:00.232523+0000","last_fullsized":"2024-09-12T00:53:00.232523+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":700,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:19.656190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'218","reported_seq":864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.352925+0000","last_change":"2024-09-12T00:11:45.929866+0000","last_active":"2024-09-12T00:54:31.352925+0000","last_peered":"2024-09-12T00:54:31.352925+0000","last_clean":"2024-09-12T00:54:31.352925+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:54:31.352925+0000","last_undegraded":"2024-09-12T00:54:31.352925+0000","last_fullsized":"2024-09-12T00:54:31.352925+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:25:51.711983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263224,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":31245,"num_write":954,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:20.958586+0000","last_change":"2024-09-12T00:11:49.941210+0000","last_active":"2024-09-12T00:52:20.958586+0000","last_peered":"2024-09-12T00:52:20.958586+0000","last_clean":"2024-09-12T00:52:20.958586+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:52:20.958586+0000","last_undegraded":"2024-09-12T00:52:20.958586+0000","last_fullsized":"2024-09-12T00:52:20.958586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:16.438093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'222","reported_seq":830,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.407318+0000","last_change":"2024-09-12T00:11:51.947561+0000","last_active":"2024-09-12T00:54:31.407318+0000","last_peered":"2024-09-12T00:54:31.407318+0000","last_clean":"2024-09-12T00:54:31.407318+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:31.407318+0000","last_undegraded":"2024-09-12T00:54:31.407318+0000","last_fullsized":"2024-09-12T00:54:31.407318+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":200,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:33.516766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":871,"num_read_kb":936,"num_write":1362,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:11.104173+0000","last_change":"2024-09-12T00:11:53.957928+0000","last_active":"2024-09-12T00:50:11.104173+0000","last_peered":"2024-09-12T00:50:11.104173+0000","last_clean":"2024-09-12T00:50:11.104173+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:50:11.104173+0000","last_undegraded":"2024-09-12T00:50:11.104173+0000","last_fullsized":"2024-09-12T00:50:11.104173+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:03:26.208933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'106","reported_seq":598,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.427213+0000","last_change":"2024-09-12T00:11:55.978414+0000","last_active":"2024-09-12T00:53:12.427213+0000","last_peered":"2024-09-12T00:53:12.427213+0000","last_clean":"2024-09-12T00:53:12.427213+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:53:12.427213+0000","last_undegraded":"2024-09-12T00:53:12.427213+0000","last_fullsized":"2024-09-12T00:53:12.427213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.992033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'786","reported_seq":2428,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217623+0000","last_change":"2024-09-12T00:11:47.926128+0000","last_active":"2024-09-12T00:53:59.217623+0000","last_peered":"2024-09-12T00:53:59.217623+0000","last_clean":"2024-09-12T00:53:59.217623+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:53:59.217623+0000","last_undegraded":"2024-09-12T00:53:59.217623+0000","last_fullsized":"2024-09-12T00:53:59.217623+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":700,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:22:22.256949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.224884+0000","last_change":"2024-09-12T00:54:35.224884+0000","last_active":"2024-09-12T00:54:35.224884+0000","last_peered":"2024-09-12T00:54:35.224884+0000","last_clean":"2024-09-12T00:54:35.224884+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:54:35.224884+0000","last_undegraded":"2024-09-12T00:54:35.224884+0000","last_fullsized":"2024-09-12T00:54:35.224884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.224815+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:03.397008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"20'1","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940331+0000","last_change":"2024-09-12T00:11:34.617900+0000","last_active":"2024-09-12T00:51:10.940331+0000","last_peered":"2024-09-12T00:51:10.940331+0000","last_clean":"2024-09-12T00:51:10.940331+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:51:10.940331+0000","last_undegraded":"2024-09-12T00:51:10.940331+0000","last_fullsized":"2024-09-12T00:51:10.940331+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:21.798131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'188","reported_seq":806,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.290096+0000","last_change":"2024-09-12T00:12:19.244194+0000","last_active":"2024-09-12T00:54:31.290096+0000","last_peered":"2024-09-12T00:54:31.290096+0000","last_clean":"2024-09-12T00:54:31.290096+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:54:31.290096+0000","last_undegraded":"2024-09-12T00:54:31.290096+0000","last_fullsized":"2024-09-12T00:54:31.290096+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:17.759014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829240,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":15296,"num_write":922,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"37'4","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.927996+0000","last_change":"2024-09-12T00:11:49.928011+0000","last_active":"2024-09-12T00:54:30.927996+0000","last_peered":"2024-09-12T00:54:30.927996+0000","last_clean":"2024-09-12T00:54:30.927996+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:30.927996+0000","last_undegraded":"2024-09-12T00:54:30.927996+0000","last_fullsized":"2024-09-12T00:54:30.927996+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:42.062220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'303","reported_seq":1008,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.573889+0000","last_change":"2024-09-12T00:11:51.936332+0000","last_active":"2024-09-12T00:54:31.573889+0000","last_peered":"2024-09-12T00:54:31.573889+0000","last_clean":"2024-09-12T00:54:31.573889+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:54:31.573889+0000","last_undegraded":"2024-09-12T00:54:31.573889+0000","last_fullsized":"2024-09-12T00:54:31.573889+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:22.288477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38032,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":812,"num_write":452,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923847+0000","last_change":"2024-09-12T00:11:53.937970+0000","last_active":"2024-09-12T00:50:54.923847+0000","last_peered":"2024-09-12T00:50:54.923847+0000","last_clean":"2024-09-12T00:50:54.923847+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:50:54.923847+0000","last_undegraded":"2024-09-12T00:50:54.923847+0000","last_fullsized":"2024-09-12T00:50:54.923847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:32.585484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'188","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.171716+0000","last_change":"2024-09-12T00:11:55.972904+0000","last_active":"2024-09-12T00:53:13.171716+0000","last_peered":"2024-09-12T00:53:13.171716+0000","last_clean":"2024-09-12T00:53:13.171716+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:53:13.171716+0000","last_undegraded":"2024-09-12T00:53:13.171716+0000","last_fullsized":"2024-09-12T00:53:13.171716+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:08.248837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'454","reported_seq":1917,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.540410+0000","last_change":"2024-09-12T00:11:47.933958+0000","last_active":"2024-09-12T00:52:57.540410+0000","last_peered":"2024-09-12T00:52:57.540410+0000","last_clean":"2024-09-12T00:52:57.540410+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:52:57.540410+0000","last_undegraded":"2024-09-12T00:52:57.540410+0000","last_fullsized":"2024-09-12T00:52:57.540410+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":400,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:36.317791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:45.949008+0000","last_change":"2024-09-12T00:11:34.617340+0000","last_active":"2024-09-12T00:51:45.949008+0000","last_peered":"2024-09-12T00:51:45.949008+0000","last_clean":"2024-09-12T00:51:45.949008+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:51:45.949008+0000","last_undegraded":"2024-09-12T00:51:45.949008+0000","last_fullsized":"2024-09-12T00:51:45.949008+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:34.572221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'204","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.502175+0000","last_change":"2024-09-12T00:11:45.952012+0000","last_active":"2024-09-12T00:54:31.502175+0000","last_peered":"2024-09-12T00:54:31.502175+0000","last_clean":"2024-09-12T00:54:31.502175+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:54:31.502175+0000","last_undegraded":"2024-09-12T00:54:31.502175+0000","last_fullsized":"2024-09-12T00:54:31.502175+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:30.524961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306325,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":403,"num_read_kb":6581,"num_write":989,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.935730+0000","last_change":"2024-09-12T00:11:49.935780+0000","last_active":"2024-09-12T00:50:50.935730+0000","last_peered":"2024-09-12T00:50:50.935730+0000","last_clean":"2024-09-12T00:50:50.935730+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:50:50.935730+0000","last_undegraded":"2024-09-12T00:50:50.935730+0000","last_fullsized":"2024-09-12T00:50:50.935730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.785961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'845","reported_seq":2298,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.417771+0000","last_change":"2024-09-12T00:11:51.943417+0000","last_active":"2024-09-12T00:54:31.417771+0000","last_peered":"2024-09-12T00:54:31.417771+0000","last_clean":"2024-09-12T00:54:31.417771+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:31.417771+0000","last_undegraded":"2024-09-12T00:54:31.417771+0000","last_fullsized":"2024-09-12T00:54:31.417771+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":800,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:47:34.607897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66079,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1175,"num_read_kb":1468,"num_write":286,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947961+0000","last_change":"2024-09-12T00:11:53.962102+0000","last_active":"2024-09-12T00:51:40.947961+0000","last_peered":"2024-09-12T00:51:40.947961+0000","last_clean":"2024-09-12T00:51:40.947961+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:51:40.947961+0000","last_undegraded":"2024-09-12T00:51:40.947961+0000","last_fullsized":"2024-09-12T00:51:40.947961+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:40.329220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'206","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:31.450664+0000","last_change":"2024-09-12T00:11:55.982765+0000","last_active":"2024-09-12T00:52:31.450664+0000","last_peered":"2024-09-12T00:52:31.450664+0000","last_clean":"2024-09-12T00:52:31.450664+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:52:31.450664+0000","last_undegraded":"2024-09-12T00:52:31.450664+0000","last_fullsized":"2024-09-12T00:52:31.450664+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.734557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'992","reported_seq":2842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.297386+0000","last_change":"2024-09-12T00:11:47.941493+0000","last_active":"2024-09-12T00:52:59.297386+0000","last_peered":"2024-09-12T00:52:59.297386+0000","last_clean":"2024-09-12T00:52:59.297386+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:52:59.297386+0000","last_undegraded":"2024-09-12T00:52:59.297386+0000","last_fullsized":"2024-09-12T00:52:59.297386+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":900,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:06.733191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.920827+0000","last_change":"2024-09-12T00:11:34.731346+0000","last_active":"2024-09-12T00:51:10.920827+0000","last_peered":"2024-09-12T00:51:10.920827+0000","last_clean":"2024-09-12T00:51:10.920827+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:51:10.920827+0000","last_undegraded":"2024-09-12T00:51:10.920827+0000","last_fullsized":"2024-09-12T00:51:10.920827+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:18.965403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'191","reported_seq":805,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.303955+0000","last_change":"2024-09-12T00:11:45.963489+0000","last_active":"2024-09-12T00:54:31.303955+0000","last_peered":"2024-09-12T00:54:31.303955+0000","last_clean":"2024-09-12T00:54:31.303955+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:54:31.303955+0000","last_undegraded":"2024-09-12T00:54:31.303955+0000","last_fullsized":"2024-09-12T00:54:31.303955+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:12:01.526306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399318,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":402,"num_read_kb":16624,"num_write":912,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"30'1","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916628+0000","last_change":"2024-09-12T00:11:49.939428+0000","last_active":"2024-09-12T00:50:50.916628+0000","last_peered":"2024-09-12T00:50:50.916628+0000","last_clean":"2024-09-12T00:50:50.916628+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:50:50.916628+0000","last_undegraded":"2024-09-12T00:50:50.916628+0000","last_fullsized":"2024-09-12T00:50:50.916628+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:13:44.977495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'231","reported_seq":1283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.391143+0000","last_change":"2024-09-12T00:11:51.950048+0000","last_active":"2024-09-12T00:54:15.391143+0000","last_peered":"2024-09-12T00:54:15.391143+0000","last_clean":"2024-09-12T00:54:15.391143+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:15.391143+0000","last_undegraded":"2024-09-12T00:54:15.391143+0000","last_fullsized":"2024-09-12T00:54:15.391143+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:06.199752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926496+0000","last_change":"2024-09-12T00:11:53.968069+0000","last_active":"2024-09-12T00:51:30.926496+0000","last_peered":"2024-09-12T00:51:30.926496+0000","last_clean":"2024-09-12T00:51:30.926496+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:51:30.926496+0000","last_undegraded":"2024-09-12T00:51:30.926496+0000","last_fullsized":"2024-09-12T00:51:30.926496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:02.100203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'312","reported_seq":934,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.889255+0000","last_change":"2024-09-12T00:11:55.967123+0000","last_active":"2024-09-12T00:53:13.889255+0000","last_peered":"2024-09-12T00:53:13.889255+0000","last_clean":"2024-09-12T00:53:13.889255+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:53:13.889255+0000","last_undegraded":"2024-09-12T00:53:13.889255+0000","last_fullsized":"2024-09-12T00:53:13.889255+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:44:10.855671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'379","reported_seq":1784,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.948108+0000","last_change":"2024-09-12T00:11:47.943438+0000","last_active":"2024-09-12T00:53:30.948108+0000","last_peered":"2024-09-12T00:53:30.948108+0000","last_clean":"2024-09-12T00:53:30.948108+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:53:30.948108+0000","last_undegraded":"2024-09-12T00:53:30.948108+0000","last_fullsized":"2024-09-12T00:53:30.948108+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":300,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:03.957852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"22'2","reported_seq":525,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.940272+0000","last_change":"2024-09-12T00:11:34.618967+0000","last_active":"2024-09-12T00:51:10.940272+0000","last_peered":"2024-09-12T00:51:10.940272+0000","last_clean":"2024-09-12T00:51:10.940272+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:51:10.940272+0000","last_undegraded":"2024-09-12T00:51:10.940272+0000","last_fullsized":"2024-09-12T00:51:10.940272+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:15.762426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'279","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:34.999658+0000","last_change":"2024-09-12T00:54:34.999658+0000","last_active":"2024-09-12T00:54:34.999658+0000","last_peered":"2024-09-12T00:54:34.999658+0000","last_clean":"2024-09-12T00:54:34.999658+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:54:34.999658+0000","last_undegraded":"2024-09-12T00:54:34.999658+0000","last_fullsized":"2024-09-12T00:54:34.999658+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'279","last_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_deep_scrub":"266'279","last_deep_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_clean_scrub_stamp":"2024-09-12T00:54:34.999451+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:22.247017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":17781,"num_write":1208,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926404+0000","last_change":"2024-09-12T00:11:49.947103+0000","last_active":"2024-09-12T00:51:35.926404+0000","last_peered":"2024-09-12T00:51:35.926404+0000","last_clean":"2024-09-12T00:51:35.926404+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:51:35.926404+0000","last_undegraded":"2024-09-12T00:51:35.926404+0000","last_fullsized":"2024-09-12T00:51:35.926404+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:25:19.613882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'109","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.954400+0000","last_change":"2024-09-12T00:11:51.944099+0000","last_active":"2024-09-12T00:53:04.954400+0000","last_peered":"2024-09-12T00:53:04.954400+0000","last_clean":"2024-09-12T00:53:04.954400+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:53:04.954400+0000","last_undegraded":"2024-09-12T00:53:04.954400+0000","last_fullsized":"2024-09-12T00:53:04.954400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:44.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.936964+0000","last_change":"2024-09-12T00:11:53.964265+0000","last_active":"2024-09-12T00:50:55.936964+0000","last_peered":"2024-09-12T00:50:55.936964+0000","last_clean":"2024-09-12T00:50:55.936964+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:50:55.936964+0000","last_undegraded":"2024-09-12T00:50:55.936964+0000","last_fullsized":"2024-09-12T00:50:55.936964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:02.137660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:06.122873+0000","last_change":"2024-09-12T00:11:55.974232+0000","last_active":"2024-09-12T00:53:06.122873+0000","last_peered":"2024-09-12T00:53:06.122873+0000","last_clean":"2024-09-12T00:53:06.122873+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:53:06.122873+0000","last_undegraded":"2024-09-12T00:53:06.122873+0000","last_fullsized":"2024-09-12T00:53:06.122873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:18.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'425","reported_seq":1926,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.195375+0000","last_change":"2024-09-12T00:11:47.950054+0000","last_active":"2024-09-12T00:54:17.195375+0000","last_peered":"2024-09-12T00:54:17.195375+0000","last_clean":"2024-09-12T00:54:17.195375+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:17.195375+0000","last_undegraded":"2024-09-12T00:54:17.195375+0000","last_fullsized":"2024-09-12T00:54:17.195375+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":400,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:32:18.896652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'194","reported_seq":926,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.728711+0000","last_change":"2024-09-12T00:54:35.728711+0000","last_active":"2024-09-12T00:54:35.728711+0000","last_peered":"2024-09-12T00:54:35.728711+0000","last_clean":"2024-09-12T00:54:35.728711+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:35.728711+0000","last_undegraded":"2024-09-12T00:54:35.728711+0000","last_fullsized":"2024-09-12T00:54:35.728711+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.728619+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:56.800395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":917,"num_read_kb":23524,"num_write":944,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927231+0000","last_change":"2024-09-12T00:11:34.874306+0000","last_active":"2024-09-12T00:51:09.927231+0000","last_peered":"2024-09-12T00:51:09.927231+0000","last_clean":"2024-09-12T00:51:09.927231+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:51:09.927231+0000","last_undegraded":"2024-09-12T00:51:09.927231+0000","last_fullsized":"2024-09-12T00:51:09.927231+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:59:04.249195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.925302+0000","last_change":"2024-09-12T00:11:49.940655+0000","last_active":"2024-09-12T00:51:25.925302+0000","last_peered":"2024-09-12T00:51:25.925302+0000","last_clean":"2024-09-12T00:51:25.925302+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:51:25.925302+0000","last_undegraded":"2024-09-12T00:51:25.925302+0000","last_fullsized":"2024-09-12T00:51:25.925302+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:51.772761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'274","reported_seq":948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.344129+0000","last_change":"2024-09-12T00:11:51.951322+0000","last_active":"2024-09-12T00:54:31.344129+0000","last_peered":"2024-09-12T00:54:31.344129+0000","last_clean":"2024-09-12T00:54:31.344129+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:31.344129+0000","last_undegraded":"2024-09-12T00:54:31.344129+0000","last_fullsized":"2024-09-12T00:54:31.344129+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":200,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:19.014495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26101,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":392,"num_read_kb":552,"num_write":218,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":488,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121823+0000","last_change":"2024-09-12T00:11:53.958248+0000","last_active":"2024-09-12T00:51:31.121823+0000","last_peered":"2024-09-12T00:51:31.121823+0000","last_clean":"2024-09-12T00:51:31.121823+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:51:31.121823+0000","last_undegraded":"2024-09-12T00:51:31.121823+0000","last_fullsized":"2024-09-12T00:51:31.121823+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:17.005296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'149","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.692391+0000","last_change":"2024-09-12T00:11:55.982508+0000","last_active":"2024-09-12T00:52:54.692391+0000","last_peered":"2024-09-12T00:52:54.692391+0000","last_clean":"2024-09-12T00:52:54.692391+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:52:54.692391+0000","last_undegraded":"2024-09-12T00:52:54.692391+0000","last_fullsized":"2024-09-12T00:52:54.692391+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.265884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'457","reported_seq":2076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.193459+0000","last_change":"2024-09-12T00:11:47.941980+0000","last_active":"2024-09-12T00:54:17.193459+0000","last_peered":"2024-09-12T00:54:17.193459+0000","last_clean":"2024-09-12T00:54:17.193459+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:17.193459+0000","last_undegraded":"2024-09-12T00:54:17.193459+0000","last_fullsized":"2024-09-12T00:54:17.193459+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:12.954699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'218","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.541434+0000","last_change":"2024-09-12T00:11:45.957384+0000","last_active":"2024-09-12T00:54:31.541434+0000","last_peered":"2024-09-12T00:54:31.541434+0000","last_clean":"2024-09-12T00:54:31.541434+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:54:31.541434+0000","last_undegraded":"2024-09-12T00:54:31.541434+0000","last_fullsized":"2024-09-12T00:54:31.541434+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:57:27.767595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":428,"num_read_kb":4575,"num_write":1019,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":523,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:20.943222+0000","last_change":"2024-09-12T00:11:34.617205+0000","last_active":"2024-09-12T00:51:20.943222+0000","last_peered":"2024-09-12T00:51:20.943222+0000","last_clean":"2024-09-12T00:51:20.943222+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:51:20.943222+0000","last_undegraded":"2024-09-12T00:51:20.943222+0000","last_fullsized":"2024-09-12T00:51:20.943222+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:51.436105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.926639+0000","last_change":"2024-09-12T00:11:49.929449+0000","last_active":"2024-09-12T00:51:25.926639+0000","last_peered":"2024-09-12T00:51:25.926639+0000","last_clean":"2024-09-12T00:51:25.926639+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:51:25.926639+0000","last_undegraded":"2024-09-12T00:51:25.926639+0000","last_fullsized":"2024-09-12T00:51:25.926639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:39.048491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'179","reported_seq":747,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:29.368057+0000","last_change":"2024-09-12T00:11:51.941186+0000","last_active":"2024-09-12T00:53:29.368057+0000","last_peered":"2024-09-12T00:53:29.368057+0000","last_clean":"2024-09-12T00:53:29.368057+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:53:29.368057+0000","last_undegraded":"2024-09-12T00:53:29.368057+0000","last_fullsized":"2024-09-12T00:53:29.368057+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:41.525044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'800","reported_seq":2667,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.972868+0000","last_change":"2024-09-12T00:11:53.946719+0000","last_active":"2024-09-12T00:54:30.972868+0000","last_peered":"2024-09-12T00:54:30.972868+0000","last_clean":"2024-09-12T00:54:30.972868+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:30.972868+0000","last_undegraded":"2024-09-12T00:54:30.972868+0000","last_fullsized":"2024-09-12T00:54:30.972868+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":701,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:54.556954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'113","reported_seq":612,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:53.080514+0000","last_change":"2024-09-12T00:11:55.974820+0000","last_active":"2024-09-12T00:52:53.080514+0000","last_peered":"2024-09-12T00:52:53.080514+0000","last_clean":"2024-09-12T00:52:53.080514+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:52:53.080514+0000","last_undegraded":"2024-09-12T00:52:53.080514+0000","last_fullsized":"2024-09-12T00:52:53.080514+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:03:58.128560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'449","reported_seq":1854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.980363+0000","last_change":"2024-09-12T00:11:47.943089+0000","last_active":"2024-09-12T00:53:01.980363+0000","last_peered":"2024-09-12T00:53:01.980363+0000","last_clean":"2024-09-12T00:53:01.980363+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:53:01.980363+0000","last_undegraded":"2024-09-12T00:53:01.980363+0000","last_fullsized":"2024-09-12T00:53:01.980363+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":400,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:44.592044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'250","reported_seq":911,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:58.254025+0000","last_change":"2024-09-12T00:11:45.944133+0000","last_active":"2024-09-12T00:52:58.254025+0000","last_peered":"2024-09-12T00:52:58.254025+0000","last_clean":"2024-09-12T00:52:58.254025+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:52:58.254025+0000","last_undegraded":"2024-09-12T00:52:58.254025+0000","last_fullsized":"2024-09-12T00:52:58.254025+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:38.226214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337134,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":14953,"num_write":1330,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":524,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.914062+0000","last_change":"2024-09-12T00:11:34.613977+0000","last_active":"2024-09-12T00:50:35.914062+0000","last_peered":"2024-09-12T00:50:35.914062+0000","last_clean":"2024-09-12T00:50:35.914062+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:50:35.914062+0000","last_undegraded":"2024-09-12T00:50:35.914062+0000","last_fullsized":"2024-09-12T00:50:35.914062+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:31.229189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.944327+0000","last_change":"2024-09-12T00:11:49.929660+0000","last_active":"2024-09-12T00:51:25.944327+0000","last_peered":"2024-09-12T00:51:25.944327+0000","last_clean":"2024-09-12T00:51:25.944327+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:51:25.944327+0000","last_undegraded":"2024-09-12T00:51:25.944327+0000","last_fullsized":"2024-09-12T00:51:25.944327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:57.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'109","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:28.252812+0000","last_change":"2024-09-12T00:11:51.947657+0000","last_active":"2024-09-12T00:52:28.252812+0000","last_peered":"2024-09-12T00:52:28.252812+0000","last_clean":"2024-09-12T00:52:28.252812+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:52:28.252812+0000","last_undegraded":"2024-09-12T00:52:28.252812+0000","last_fullsized":"2024-09-12T00:52:28.252812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:12.346313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'789","reported_seq":2343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.978202+0000","last_change":"2024-09-12T00:11:53.968955+0000","last_active":"2024-09-12T00:54:30.978202+0000","last_peered":"2024-09-12T00:54:30.978202+0000","last_clean":"2024-09-12T00:54:30.978202+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:54:30.978202+0000","last_undegraded":"2024-09-12T00:54:30.978202+0000","last_fullsized":"2024-09-12T00:54:30.978202+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":701,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:38.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'188","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:47.798689+0000","last_change":"2024-09-12T00:11:55.972707+0000","last_active":"2024-09-12T00:52:47.798689+0000","last_peered":"2024-09-12T00:52:47.798689+0000","last_clean":"2024-09-12T00:52:47.798689+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:52:47.798689+0000","last_undegraded":"2024-09-12T00:52:47.798689+0000","last_fullsized":"2024-09-12T00:52:47.798689+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:14:59.070375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'482","reported_seq":2168,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.199159+0000","last_change":"2024-09-12T00:11:47.920074+0000","last_active":"2024-09-12T00:54:17.199159+0000","last_peered":"2024-09-12T00:54:17.199159+0000","last_clean":"2024-09-12T00:54:17.199159+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:17.199159+0000","last_undegraded":"2024-09-12T00:54:17.199159+0000","last_fullsized":"2024-09-12T00:54:17.199159+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":400,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:15.555950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'218","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.425622+0000","last_change":"2024-09-12T00:11:45.934651+0000","last_active":"2024-09-12T00:54:31.425622+0000","last_peered":"2024-09-12T00:54:31.425622+0000","last_clean":"2024-09-12T00:54:31.425622+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:54:31.425622+0000","last_undegraded":"2024-09-12T00:54:31.425622+0000","last_fullsized":"2024-09-12T00:54:31.425622+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:00.165999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5989411,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":60723,"num_write":949,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":522,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.932047+0000","last_change":"2024-09-12T00:11:34.618193+0000","last_active":"2024-09-12T00:50:35.932047+0000","last_peered":"2024-09-12T00:50:35.932047+0000","last_clean":"2024-09-12T00:50:35.932047+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:50:35.932047+0000","last_undegraded":"2024-09-12T00:50:35.932047+0000","last_fullsized":"2024-09-12T00:50:35.932047+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:31.559084+0000","last_clean_scrub_stamp":"2024-09-12T00:11:31.559084+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:35:18.144454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933247+0000","last_change":"2024-09-12T00:11:49.928566+0000","last_active":"2024-09-12T00:52:00.933247+0000","last_peered":"2024-09-12T00:52:00.933247+0000","last_clean":"2024-09-12T00:52:00.933247+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:52:00.933247+0000","last_undegraded":"2024-09-12T00:52:00.933247+0000","last_fullsized":"2024-09-12T00:52:00.933247+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:28:38.587979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'343","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.380629+0000","last_change":"2024-09-12T00:11:51.944165+0000","last_active":"2024-09-12T00:54:31.380629+0000","last_peered":"2024-09-12T00:54:31.380629+0000","last_clean":"2024-09-12T00:54:31.380629+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:31.380629+0000","last_undegraded":"2024-09-12T00:54:31.380629+0000","last_fullsized":"2024-09-12T00:54:31.380629+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":300,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:31:13.970557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32232,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":703,"num_write":258,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926396+0000","last_change":"2024-09-12T00:11:53.959232+0000","last_active":"2024-09-12T00:51:30.926396+0000","last_peered":"2024-09-12T00:51:30.926396+0000","last_clean":"2024-09-12T00:51:30.926396+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:51:30.926396+0000","last_undegraded":"2024-09-12T00:51:30.926396+0000","last_fullsized":"2024-09-12T00:51:30.926396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:48.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'91","reported_seq":581,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.028563+0000","last_change":"2024-09-12T00:11:55.977283+0000","last_active":"2024-09-12T00:52:49.028563+0000","last_peered":"2024-09-12T00:52:49.028563+0000","last_clean":"2024-09-12T00:52:49.028563+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:52:49.028563+0000","last_undegraded":"2024-09-12T00:52:49.028563+0000","last_fullsized":"2024-09-12T00:52:49.028563+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:16:03.673797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'150","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.512255+0000","last_change":"2024-09-12T00:11:55.987098+0000","last_active":"2024-09-12T00:53:14.512255+0000","last_peered":"2024-09-12T00:53:14.512255+0000","last_clean":"2024-09-12T00:53:14.512255+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:53:14.512255+0000","last_undegraded":"2024-09-12T00:53:14.512255+0000","last_fullsized":"2024-09-12T00:53:14.512255+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:47.859646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'404","reported_seq":1793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:51.152300+0000","last_change":"2024-09-12T00:11:47.921763+0000","last_active":"2024-09-12T00:53:51.152300+0000","last_peered":"2024-09-12T00:53:51.152300+0000","last_clean":"2024-09-12T00:53:51.152300+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:53:51.152300+0000","last_undegraded":"2024-09-12T00:53:51.152300+0000","last_fullsized":"2024-09-12T00:53:51.152300+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":300,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'186","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.396748+0000","last_change":"2024-09-12T00:11:45.930485+0000","last_active":"2024-09-12T00:54:31.396748+0000","last_peered":"2024-09-12T00:54:31.396748+0000","last_clean":"2024-09-12T00:54:31.396748+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:54:31.396748+0000","last_undegraded":"2024-09-12T00:54:31.396748+0000","last_fullsized":"2024-09-12T00:54:31.396748+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:57.242243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33239,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":101459,"num_write":845,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.921522+0000","last_change":"2024-09-12T00:11:49.940350+0000","last_active":"2024-09-12T00:51:30.921522+0000","last_peered":"2024-09-12T00:51:30.921522+0000","last_clean":"2024-09-12T00:51:30.921522+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:51:30.921522+0000","last_undegraded":"2024-09-12T00:51:30.921522+0000","last_fullsized":"2024-09-12T00:51:30.921522+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:25.951150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'143","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.455425+0000","last_change":"2024-09-12T00:11:51.929179+0000","last_active":"2024-09-12T00:54:31.455425+0000","last_peered":"2024-09-12T00:54:31.455425+0000","last_clean":"2024-09-12T00:54:31.455425+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:54:31.455425+0000","last_undegraded":"2024-09-12T00:54:31.455425+0000","last_fullsized":"2024-09-12T00:54:31.455425+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:47.615364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13149,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":189,"num_read_kb":268,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926201+0000","last_change":"2024-09-12T00:11:53.965867+0000","last_active":"2024-09-12T00:51:35.926201+0000","last_peered":"2024-09-12T00:51:35.926201+0000","last_clean":"2024-09-12T00:51:35.926201+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:51:35.926201+0000","last_undegraded":"2024-09-12T00:51:35.926201+0000","last_fullsized":"2024-09-12T00:51:35.926201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:46.503762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.778087+0000","last_change":"2024-09-12T00:11:55.975673+0000","last_active":"2024-09-12T00:53:13.778087+0000","last_peered":"2024-09-12T00:53:13.778087+0000","last_clean":"2024-09-12T00:53:13.778087+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:53:13.778087+0000","last_undegraded":"2024-09-12T00:53:13.778087+0000","last_fullsized":"2024-09-12T00:53:13.778087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:53.889300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'348","reported_seq":1863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.366932+0000","last_change":"2024-09-12T00:11:47.935945+0000","last_active":"2024-09-12T00:53:14.366932+0000","last_peered":"2024-09-12T00:53:14.366932+0000","last_clean":"2024-09-12T00:53:14.366932+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:53:14.366932+0000","last_undegraded":"2024-09-12T00:53:14.366932+0000","last_fullsized":"2024-09-12T00:53:14.366932+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":300,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:14:30.085349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'340","reported_seq":1012,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.451895+0000","last_change":"2024-09-12T00:11:45.942994+0000","last_active":"2024-09-12T00:54:31.451895+0000","last_peered":"2024-09-12T00:54:31.451895+0000","last_clean":"2024-09-12T00:54:31.451895+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:54:31.451895+0000","last_undegraded":"2024-09-12T00:54:31.451895+0000","last_fullsized":"2024-09-12T00:54:31.451895+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:19:36.262305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":797,"num_read_kb":9288,"num_write":1291,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926444+0000","last_change":"2024-09-12T00:11:49.942679+0000","last_active":"2024-09-12T00:51:30.926444+0000","last_peered":"2024-09-12T00:51:30.926444+0000","last_clean":"2024-09-12T00:51:30.926444+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:51:30.926444+0000","last_undegraded":"2024-09-12T00:51:30.926444+0000","last_fullsized":"2024-09-12T00:51:30.926444+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:19.512522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'54","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.203822+0000","last_change":"2024-09-12T00:11:51.951112+0000","last_active":"2024-09-12T00:52:02.203822+0000","last_peered":"2024-09-12T00:52:02.203822+0000","last_clean":"2024-09-12T00:52:02.203822+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:52:02.203822+0000","last_undegraded":"2024-09-12T00:52:02.203822+0000","last_fullsized":"2024-09-12T00:52:02.203822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.473635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.122929+0000","last_change":"2024-09-12T00:11:53.965509+0000","last_active":"2024-09-12T00:51:36.122929+0000","last_peered":"2024-09-12T00:51:36.122929+0000","last_clean":"2024-09-12T00:51:36.122929+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:51:36.122929+0000","last_undegraded":"2024-09-12T00:51:36.122929+0000","last_fullsized":"2024-09-12T00:51:36.122929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:23.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'192","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.755700+0000","last_change":"2024-09-12T00:11:55.977952+0000","last_active":"2024-09-12T00:53:13.755700+0000","last_peered":"2024-09-12T00:53:13.755700+0000","last_clean":"2024-09-12T00:53:13.755700+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:53:13.755700+0000","last_undegraded":"2024-09-12T00:53:13.755700+0000","last_fullsized":"2024-09-12T00:53:13.755700+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'771","reported_seq":2184,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.245517+0000","last_change":"2024-09-12T00:11:47.926772+0000","last_active":"2024-09-12T00:53:00.245517+0000","last_peered":"2024-09-12T00:53:00.245517+0000","last_clean":"2024-09-12T00:53:00.245517+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:53:00.245517+0000","last_undegraded":"2024-09-12T00:53:00.245517+0000","last_fullsized":"2024-09-12T00:53:00.245517+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":700,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:28.725757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'193","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.263135+0000","last_change":"2024-09-12T00:11:45.915920+0000","last_active":"2024-09-12T00:54:31.263135+0000","last_peered":"2024-09-12T00:54:31.263135+0000","last_clean":"2024-09-12T00:54:31.263135+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:31.263135+0000","last_undegraded":"2024-09-12T00:54:31.263135+0000","last_fullsized":"2024-09-12T00:54:31.263135+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:07:59.681239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":25665,"num_write":923,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:31.121782+0000","last_change":"2024-09-12T00:11:49.923313+0000","last_active":"2024-09-12T00:51:31.121782+0000","last_peered":"2024-09-12T00:51:31.121782+0000","last_clean":"2024-09-12T00:51:31.121782+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:51:31.121782+0000","last_undegraded":"2024-09-12T00:51:31.121782+0000","last_fullsized":"2024-09-12T00:51:31.121782+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:40.513701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'177","reported_seq":766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.326255+0000","last_change":"2024-09-12T00:11:51.938094+0000","last_active":"2024-09-12T00:54:31.326255+0000","last_peered":"2024-09-12T00:54:31.326255+0000","last_clean":"2024-09-12T00:54:31.326255+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:54:31.326255+0000","last_undegraded":"2024-09-12T00:54:31.326255+0000","last_fullsized":"2024-09-12T00:54:31.326255+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":233,"num_read_kb":302,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104093+0000","last_change":"2024-09-12T00:11:53.955154+0000","last_active":"2024-09-12T00:51:36.104093+0000","last_peered":"2024-09-12T00:51:36.104093+0000","last_clean":"2024-09-12T00:51:36.104093+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:51:36.104093+0000","last_undegraded":"2024-09-12T00:51:36.104093+0000","last_fullsized":"2024-09-12T00:51:36.104093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:55.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'104","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.550126+0000","last_change":"2024-09-12T00:11:55.959282+0000","last_active":"2024-09-12T00:52:29.550126+0000","last_peered":"2024-09-12T00:52:29.550126+0000","last_clean":"2024-09-12T00:52:29.550126+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:52:29.550126+0000","last_undegraded":"2024-09-12T00:52:29.550126+0000","last_fullsized":"2024-09-12T00:52:29.550126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:03.301311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'808","reported_seq":2294,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.551364+0000","last_change":"2024-09-12T00:11:47.933067+0000","last_active":"2024-09-12T00:52:56.551364+0000","last_peered":"2024-09-12T00:52:56.551364+0000","last_clean":"2024-09-12T00:52:56.551364+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:52:56.551364+0000","last_undegraded":"2024-09-12T00:52:56.551364+0000","last_fullsized":"2024-09-12T00:52:56.551364+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":700,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:01.114451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'197","reported_seq":834,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.474168+0000","last_change":"2024-09-12T00:11:45.958369+0000","last_active":"2024-09-12T00:54:31.474168+0000","last_peered":"2024-09-12T00:54:31.474168+0000","last_clean":"2024-09-12T00:54:31.474168+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:54:31.474168+0000","last_undegraded":"2024-09-12T00:54:31.474168+0000","last_fullsized":"2024-09-12T00:54:31.474168+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:06.439973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":36400,"num_write":906,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.945612+0000","last_change":"2024-09-12T00:11:49.928504+0000","last_active":"2024-09-12T00:51:30.945612+0000","last_peered":"2024-09-12T00:51:30.945612+0000","last_clean":"2024-09-12T00:51:30.945612+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:51:30.945612+0000","last_undegraded":"2024-09-12T00:51:30.945612+0000","last_fullsized":"2024-09-12T00:51:30.945612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:00.545918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'131","reported_seq":692,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.297173+0000","last_change":"2024-09-12T00:11:51.951940+0000","last_active":"2024-09-12T00:54:31.297173+0000","last_peered":"2024-09-12T00:54:31.297173+0000","last_clean":"2024-09-12T00:54:31.297173+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:54:31.297173+0000","last_undegraded":"2024-09-12T00:54:31.297173+0000","last_fullsized":"2024-09-12T00:54:31.297173+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:41.384189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6499,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":240,"num_write":94,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926323+0000","last_change":"2024-09-12T00:11:53.970031+0000","last_active":"2024-09-12T00:51:35.926323+0000","last_peered":"2024-09-12T00:51:35.926323+0000","last_clean":"2024-09-12T00:51:35.926323+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:51:35.926323+0000","last_undegraded":"2024-09-12T00:51:35.926323+0000","last_fullsized":"2024-09-12T00:51:35.926323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.869156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'722","reported_seq":2103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.974112+0000","last_change":"2024-09-12T00:11:47.944209+0000","last_active":"2024-09-12T00:53:30.974112+0000","last_peered":"2024-09-12T00:53:30.974112+0000","last_clean":"2024-09-12T00:53:30.974112+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:53:30.974112+0000","last_undegraded":"2024-09-12T00:53:30.974112+0000","last_fullsized":"2024-09-12T00:53:30.974112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:07.479060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'194","reported_seq":812,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.518698+0000","last_change":"2024-09-12T00:11:45.967978+0000","last_active":"2024-09-12T00:54:31.518698+0000","last_peered":"2024-09-12T00:54:31.518698+0000","last_clean":"2024-09-12T00:54:31.518698+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:54:31.518698+0000","last_undegraded":"2024-09-12T00:54:31.518698+0000","last_fullsized":"2024-09-12T00:54:31.518698+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:15:25.205405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755647,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":8092,"num_write":868,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928734+0000","last_change":"2024-09-12T00:11:49.940476+0000","last_active":"2024-09-12T00:52:00.928734+0000","last_peered":"2024-09-12T00:52:00.928734+0000","last_clean":"2024-09-12T00:52:00.928734+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:52:00.928734+0000","last_undegraded":"2024-09-12T00:52:00.928734+0000","last_fullsized":"2024-09-12T00:52:00.928734+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:09:21.808496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'198","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.560580+0000","last_change":"2024-09-12T00:11:51.955207+0000","last_active":"2024-09-12T00:54:31.560580+0000","last_peered":"2024-09-12T00:54:31.560580+0000","last_clean":"2024-09-12T00:54:31.560580+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:54:31.560580+0000","last_undegraded":"2024-09-12T00:54:31.560580+0000","last_fullsized":"2024-09-12T00:54:31.560580+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:43.145562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19799,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":407,"num_write":194,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.127739+0000","last_change":"2024-09-12T00:11:53.970075+0000","last_active":"2024-09-12T00:51:56.127739+0000","last_peered":"2024-09-12T00:51:56.127739+0000","last_clean":"2024-09-12T00:51:56.127739+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:51:56.127739+0000","last_undegraded":"2024-09-12T00:51:56.127739+0000","last_fullsized":"2024-09-12T00:51:56.127739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.073296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'153","reported_seq":652,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967355+0000","last_change":"2024-09-12T00:11:55.983643+0000","last_active":"2024-09-12T00:53:59.967355+0000","last_peered":"2024-09-12T00:53:59.967355+0000","last_clean":"2024-09-12T00:53:59.967355+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:53:59.967355+0000","last_undegraded":"2024-09-12T00:53:59.967355+0000","last_fullsized":"2024-09-12T00:53:59.967355+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:01.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'499","reported_seq":2219,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.214803+0000","last_change":"2024-09-12T00:11:47.931274+0000","last_active":"2024-09-12T00:53:59.214803+0000","last_peered":"2024-09-12T00:53:59.214803+0000","last_clean":"2024-09-12T00:53:59.214803+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:53:59.214803+0000","last_undegraded":"2024-09-12T00:53:59.214803+0000","last_fullsized":"2024-09-12T00:53:59.214803+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:40:56.542635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'205","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.523363+0000","last_change":"2024-09-12T00:11:45.930986+0000","last_active":"2024-09-12T00:54:31.523363+0000","last_peered":"2024-09-12T00:54:31.523363+0000","last_clean":"2024-09-12T00:54:31.523363+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:54:31.523363+0000","last_undegraded":"2024-09-12T00:54:31.523363+0000","last_fullsized":"2024-09-12T00:54:31.523363+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:27:07.918577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":547,"num_read_kb":23120,"num_write":969,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:26.120894+0000","last_change":"2024-09-12T00:11:49.940474+0000","last_active":"2024-09-12T00:51:26.120894+0000","last_peered":"2024-09-12T00:51:26.120894+0000","last_clean":"2024-09-12T00:51:26.120894+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:51:26.120894+0000","last_undegraded":"2024-09-12T00:51:26.120894+0000","last_fullsized":"2024-09-12T00:51:26.120894+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:37.832060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'165","reported_seq":746,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.309896+0000","last_change":"2024-09-12T00:11:51.943970+0000","last_active":"2024-09-12T00:54:31.309896+0000","last_peered":"2024-09-12T00:54:31.309896+0000","last_clean":"2024-09-12T00:54:31.309896+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:54:31.309896+0000","last_undegraded":"2024-09-12T00:54:31.309896+0000","last_fullsized":"2024-09-12T00:54:31.309896+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:17.685375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7301,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":226,"num_read_kb":291,"num_write":146,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:54.937822+0000","last_change":"2024-09-12T00:11:53.969086+0000","last_active":"2024-09-12T00:51:54.937822+0000","last_peered":"2024-09-12T00:51:54.937822+0000","last_clean":"2024-09-12T00:51:54.937822+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:51:54.937822+0000","last_undegraded":"2024-09-12T00:51:54.937822+0000","last_fullsized":"2024-09-12T00:51:54.937822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.001970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.122045+0000","last_change":"2024-09-12T00:11:55.970975+0000","last_active":"2024-09-12T00:54:17.122045+0000","last_peered":"2024-09-12T00:54:17.122045+0000","last_clean":"2024-09-12T00:54:17.122045+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:54:17.122045+0000","last_undegraded":"2024-09-12T00:54:17.122045+0000","last_fullsized":"2024-09-12T00:54:17.122045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:19.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'810","reported_seq":2312,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749355+0000","last_change":"2024-09-12T00:11:47.946771+0000","last_active":"2024-09-12T00:53:13.749355+0000","last_peered":"2024-09-12T00:53:13.749355+0000","last_clean":"2024-09-12T00:53:13.749355+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:53:13.749355+0000","last_undegraded":"2024-09-12T00:53:13.749355+0000","last_fullsized":"2024-09-12T00:53:13.749355+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:47:20.616253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'210","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.400404+0000","last_change":"2024-09-12T00:11:45.950887+0000","last_active":"2024-09-12T00:54:31.400404+0000","last_peered":"2024-09-12T00:54:31.400404+0000","last_clean":"2024-09-12T00:54:31.400404+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:31.400404+0000","last_undegraded":"2024-09-12T00:54:31.400404+0000","last_fullsized":"2024-09-12T00:54:31.400404+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:39.570694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":380,"num_read_kb":5549,"num_write":1015,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126599+0000","last_change":"2024-09-12T00:11:49.932242+0000","last_active":"2024-09-12T00:51:51.126599+0000","last_peered":"2024-09-12T00:51:51.126599+0000","last_clean":"2024-09-12T00:51:51.126599+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:51:51.126599+0000","last_undegraded":"2024-09-12T00:51:51.126599+0000","last_fullsized":"2024-09-12T00:51:51.126599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:01.572248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'150","reported_seq":731,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.529052+0000","last_change":"2024-09-12T00:11:51.947579+0000","last_active":"2024-09-12T00:54:31.529052+0000","last_peered":"2024-09-12T00:54:31.529052+0000","last_clean":"2024-09-12T00:54:31.529052+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:54:31.529052+0000","last_undegraded":"2024-09-12T00:54:31.529052+0000","last_fullsized":"2024-09-12T00:54:31.529052+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:01.742280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":186,"num_read_kb":226,"num_write":104,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932799+0000","last_change":"2024-09-12T00:11:53.966010+0000","last_active":"2024-09-12T00:52:05.932799+0000","last_peered":"2024-09-12T00:52:05.932799+0000","last_clean":"2024-09-12T00:52:05.932799+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:52:05.932799+0000","last_undegraded":"2024-09-12T00:52:05.932799+0000","last_fullsized":"2024-09-12T00:52:05.932799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.714255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'153","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.341421+0000","last_change":"2024-09-12T00:11:55.984385+0000","last_active":"2024-09-12T00:54:18.341421+0000","last_peered":"2024-09-12T00:54:18.341421+0000","last_clean":"2024-09-12T00:54:18.341421+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:54:18.341421+0000","last_undegraded":"2024-09-12T00:54:18.341421+0000","last_fullsized":"2024-09-12T00:54:18.341421+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:18.613083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'789","reported_seq":2425,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981146+0000","last_change":"2024-09-12T00:11:47.953467+0000","last_active":"2024-09-12T00:53:01.981146+0000","last_peered":"2024-09-12T00:53:01.981146+0000","last_clean":"2024-09-12T00:53:01.981146+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:53:01.981146+0000","last_undegraded":"2024-09-12T00:53:01.981146+0000","last_fullsized":"2024-09-12T00:53:01.981146+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:27.239103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'210","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.438700+0000","last_change":"2024-09-12T00:11:45.933222+0000","last_active":"2024-09-12T00:54:31.438700+0000","last_peered":"2024-09-12T00:54:31.438700+0000","last_clean":"2024-09-12T00:54:31.438700+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:54:31.438700+0000","last_undegraded":"2024-09-12T00:54:31.438700+0000","last_fullsized":"2024-09-12T00:54:31.438700+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:11.850109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1993302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":30758,"num_write":1020,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931153+0000","last_change":"2024-09-12T00:11:49.944879+0000","last_active":"2024-09-12T00:51:50.931153+0000","last_peered":"2024-09-12T00:51:50.931153+0000","last_clean":"2024-09-12T00:51:50.931153+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:51:50.931153+0000","last_undegraded":"2024-09-12T00:51:50.931153+0000","last_fullsized":"2024-09-12T00:51:50.931153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.523417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'95","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954504+0000","last_change":"2024-09-12T00:11:51.938728+0000","last_active":"2024-09-12T00:52:05.954504+0000","last_peered":"2024-09-12T00:52:05.954504+0000","last_clean":"2024-09-12T00:52:05.954504+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:52:05.954504+0000","last_undegraded":"2024-09-12T00:52:05.954504+0000","last_fullsized":"2024-09-12T00:52:05.954504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:11.275648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'756","reported_seq":2389,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.012592+0000","last_change":"2024-09-12T00:11:53.945013+0000","last_active":"2024-09-12T00:54:31.012592+0000","last_peered":"2024-09-12T00:54:31.012592+0000","last_clean":"2024-09-12T00:54:31.012592+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:31.012592+0000","last_undegraded":"2024-09-12T00:54:31.012592+0000","last_fullsized":"2024-09-12T00:54:31.012592+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:55.474571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.361616+0000","last_change":"2024-09-12T00:11:55.961931+0000","last_active":"2024-09-12T00:53:14.361616+0000","last_peered":"2024-09-12T00:53:14.361616+0000","last_clean":"2024-09-12T00:53:14.361616+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:53:14.361616+0000","last_undegraded":"2024-09-12T00:53:14.361616+0000","last_fullsized":"2024-09-12T00:53:14.361616+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.615113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'464","reported_seq":1945,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.299711+0000","last_change":"2024-09-12T00:11:47.941918+0000","last_active":"2024-09-12T00:52:59.299711+0000","last_peered":"2024-09-12T00:52:59.299711+0000","last_clean":"2024-09-12T00:52:59.299711+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:52:59.299711+0000","last_undegraded":"2024-09-12T00:52:59.299711+0000","last_fullsized":"2024-09-12T00:52:59.299711+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":400,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:21.380303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'218","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.525916+0000","last_change":"2024-09-12T00:11:45.950800+0000","last_active":"2024-09-12T00:54:31.525916+0000","last_peered":"2024-09-12T00:54:31.525916+0000","last_clean":"2024-09-12T00:54:31.525916+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:31.525916+0000","last_undegraded":"2024-09-12T00:54:31.525916+0000","last_fullsized":"2024-09-12T00:54:31.525916+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:25.266687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457849,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":55718,"num_write":1000,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.107449+0000","last_change":"2024-09-12T00:11:49.920143+0000","last_active":"2024-09-12T00:51:51.107449+0000","last_peered":"2024-09-12T00:51:51.107449+0000","last_clean":"2024-09-12T00:51:51.107449+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:51:51.107449+0000","last_undegraded":"2024-09-12T00:51:51.107449+0000","last_fullsized":"2024-09-12T00:51:51.107449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:39:13.928120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'189","reported_seq":789,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.140500+0000","last_change":"2024-09-12T00:11:51.942692+0000","last_active":"2024-09-12T00:54:31.140500+0000","last_peered":"2024-09-12T00:54:31.140500+0000","last_clean":"2024-09-12T00:54:31.140500+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:54:31.140500+0000","last_undegraded":"2024-09-12T00:54:31.140500+0000","last_fullsized":"2024-09-12T00:54:31.140500+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.066244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":245,"num_read_kb":305,"num_write":140,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.913907+0000","last_change":"2024-09-12T00:11:53.968374+0000","last_active":"2024-09-12T00:50:35.913907+0000","last_peered":"2024-09-12T00:50:35.913907+0000","last_clean":"2024-09-12T00:50:35.913907+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:50:35.913907+0000","last_undegraded":"2024-09-12T00:50:35.913907+0000","last_fullsized":"2024-09-12T00:50:35.913907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:08.048773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'124","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.975045+0000","last_change":"2024-09-12T00:11:55.975761+0000","last_active":"2024-09-12T00:53:01.975045+0000","last_peered":"2024-09-12T00:53:01.975045+0000","last_clean":"2024-09-12T00:53:01.975045+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:53:01.975045+0000","last_undegraded":"2024-09-12T00:53:01.975045+0000","last_fullsized":"2024-09-12T00:53:01.975045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:21.563576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'923","reported_seq":2627,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.217609+0000","last_change":"2024-09-12T00:11:47.940921+0000","last_active":"2024-09-12T00:53:59.217609+0000","last_peered":"2024-09-12T00:53:59.217609+0000","last_clean":"2024-09-12T00:53:59.217609+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:53:59.217609+0000","last_undegraded":"2024-09-12T00:53:59.217609+0000","last_fullsized":"2024-09-12T00:53:59.217609+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":900,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:58.054782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'221","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.481363+0000","last_change":"2024-09-12T00:11:45.930250+0000","last_active":"2024-09-12T00:54:31.481363+0000","last_peered":"2024-09-12T00:54:31.481363+0000","last_clean":"2024-09-12T00:54:31.481363+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:54:31.481363+0000","last_undegraded":"2024-09-12T00:54:31.481363+0000","last_fullsized":"2024-09-12T00:54:31.481363+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:27:11.387922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":417,"num_read_kb":8883,"num_write":990,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126541+0000","last_change":"2024-09-12T00:11:49.932760+0000","last_active":"2024-09-12T00:51:51.126541+0000","last_peered":"2024-09-12T00:51:51.126541+0000","last_clean":"2024-09-12T00:51:51.126541+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:51:51.126541+0000","last_undegraded":"2024-09-12T00:51:51.126541+0000","last_fullsized":"2024-09-12T00:51:51.126541+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:03.502198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'132","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.168909+0000","last_change":"2024-09-12T00:11:51.948398+0000","last_active":"2024-09-12T00:54:31.168909+0000","last_peered":"2024-09-12T00:54:31.168909+0000","last_clean":"2024-09-12T00:54:31.168909+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:54:31.168909+0000","last_undegraded":"2024-09-12T00:54:31.168909+0000","last_fullsized":"2024-09-12T00:54:31.168909+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:24.018531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":258,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934303+0000","last_change":"2024-09-12T00:11:53.964372+0000","last_active":"2024-09-12T00:50:45.934303+0000","last_peered":"2024-09-12T00:50:45.934303+0000","last_clean":"2024-09-12T00:50:45.934303+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:50:45.934303+0000","last_undegraded":"2024-09-12T00:50:45.934303+0000","last_fullsized":"2024-09-12T00:50:45.934303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:46.181767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'122","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.250013+0000","last_change":"2024-09-12T00:11:55.983399+0000","last_active":"2024-09-12T00:53:00.250013+0000","last_peered":"2024-09-12T00:53:00.250013+0000","last_clean":"2024-09-12T00:53:00.250013+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:53:00.250013+0000","last_undegraded":"2024-09-12T00:53:00.250013+0000","last_fullsized":"2024-09-12T00:53:00.250013+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.340677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'510","reported_seq":2130,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981820+0000","last_change":"2024-09-12T00:11:47.945866+0000","last_active":"2024-09-12T00:53:01.981820+0000","last_peered":"2024-09-12T00:53:01.981820+0000","last_clean":"2024-09-12T00:53:01.981820+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:53:01.981820+0000","last_undegraded":"2024-09-12T00:53:01.981820+0000","last_fullsized":"2024-09-12T00:53:01.981820+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":400,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:11.670029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'213","reported_seq":830,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.197747+0000","last_change":"2024-09-12T00:11:45.965907+0000","last_active":"2024-09-12T00:54:31.197747+0000","last_peered":"2024-09-12T00:54:31.197747+0000","last_clean":"2024-09-12T00:54:31.197747+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:54:31.197747+0000","last_undegraded":"2024-09-12T00:54:31.197747+0000","last_fullsized":"2024-09-12T00:54:31.197747+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:27:25.908411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":6403,"num_write":967,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:31.087675+0000","last_change":"2024-09-12T00:11:49.916956+0000","last_active":"2024-09-12T00:50:31.087675+0000","last_peered":"2024-09-12T00:50:31.087675+0000","last_clean":"2024-09-12T00:50:31.087675+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:50:31.087675+0000","last_undegraded":"2024-09-12T00:50:31.087675+0000","last_fullsized":"2024-09-12T00:50:31.087675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:06:12.223448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'102","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.483283+0000","last_change":"2024-09-12T00:11:51.934188+0000","last_active":"2024-09-12T00:54:31.483283+0000","last_peered":"2024-09-12T00:54:31.483283+0000","last_clean":"2024-09-12T00:54:31.483283+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:31.483283+0000","last_undegraded":"2024-09-12T00:54:31.483283+0000","last_fullsized":"2024-09-12T00:54:31.483283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.730149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":203,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.951806+0000","last_change":"2024-09-12T00:11:53.953440+0000","last_active":"2024-09-12T00:51:55.951806+0000","last_peered":"2024-09-12T00:51:55.951806+0000","last_clean":"2024-09-12T00:51:55.951806+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:51:55.951806+0000","last_undegraded":"2024-09-12T00:51:55.951806+0000","last_fullsized":"2024-09-12T00:51:55.951806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:27.100590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'166","reported_seq":1291,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.040679+0000","last_change":"2024-09-12T00:11:55.977584+0000","last_active":"2024-09-12T00:53:12.040679+0000","last_peered":"2024-09-12T00:53:12.040679+0000","last_clean":"2024-09-12T00:53:12.040679+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:53:12.040679+0000","last_undegraded":"2024-09-12T00:53:12.040679+0000","last_fullsized":"2024-09-12T00:53:12.040679+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:56.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'389","reported_seq":1782,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.983959+0000","last_change":"2024-09-12T00:11:47.935949+0000","last_active":"2024-09-12T00:53:01.983959+0000","last_peered":"2024-09-12T00:53:01.983959+0000","last_clean":"2024-09-12T00:53:01.983959+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:53:01.983959+0000","last_undegraded":"2024-09-12T00:53:01.983959+0000","last_fullsized":"2024-09-12T00:53:01.983959+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":300,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:17.556138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'225","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.268960+0000","last_change":"2024-09-12T00:11:45.966312+0000","last_active":"2024-09-12T00:54:31.268960+0000","last_peered":"2024-09-12T00:54:31.268960+0000","last_clean":"2024-09-12T00:54:31.268960+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:54:31.268960+0000","last_undegraded":"2024-09-12T00:54:31.268960+0000","last_fullsized":"2024-09-12T00:54:31.268960+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:36:38.020981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":20983,"num_write":1046,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.915124+0000","last_change":"2024-09-12T00:11:49.935062+0000","last_active":"2024-09-12T00:50:40.915124+0000","last_peered":"2024-09-12T00:50:40.915124+0000","last_clean":"2024-09-12T00:50:40.915124+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:50:40.915124+0000","last_undegraded":"2024-09-12T00:50:40.915124+0000","last_fullsized":"2024-09-12T00:50:40.915124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:45.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'177","reported_seq":771,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.553317+0000","last_change":"2024-09-12T00:11:51.953534+0000","last_active":"2024-09-12T00:54:31.553317+0000","last_peered":"2024-09-12T00:54:31.553317+0000","last_clean":"2024-09-12T00:54:31.553317+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:54:31.553317+0000","last_undegraded":"2024-09-12T00:54:31.553317+0000","last_fullsized":"2024-09-12T00:54:31.553317+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:08.139733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9188,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":326,"num_write":136,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.932205+0000","last_change":"2024-09-12T00:11:53.964796+0000","last_active":"2024-09-12T00:51:55.932205+0000","last_peered":"2024-09-12T00:51:55.932205+0000","last_clean":"2024-09-12T00:51:55.932205+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:51:55.932205+0000","last_undegraded":"2024-09-12T00:51:55.932205+0000","last_fullsized":"2024-09-12T00:51:55.932205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:35.493703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'120","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.194988+0000","last_change":"2024-09-12T00:11:55.976617+0000","last_active":"2024-09-12T00:54:17.194988+0000","last_peered":"2024-09-12T00:54:17.194988+0000","last_clean":"2024-09-12T00:54:17.194988+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:54:17.194988+0000","last_undegraded":"2024-09-12T00:54:17.194988+0000","last_fullsized":"2024-09-12T00:54:17.194988+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:04.168911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'498","reported_seq":2023,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.933790+0000","last_change":"2024-09-12T00:11:47.934353+0000","last_active":"2024-09-12T00:53:00.933790+0000","last_peered":"2024-09-12T00:53:00.933790+0000","last_clean":"2024-09-12T00:53:00.933790+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:53:00.933790+0000","last_undegraded":"2024-09-12T00:53:00.933790+0000","last_fullsized":"2024-09-12T00:53:00.933790+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":400,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:35.038205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'193","reported_seq":845,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.454567+0000","last_change":"2024-09-12T00:11:45.927795+0000","last_active":"2024-09-12T00:54:31.454567+0000","last_peered":"2024-09-12T00:54:31.454567+0000","last_clean":"2024-09-12T00:54:31.454567+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:54:31.454567+0000","last_undegraded":"2024-09-12T00:54:31.454567+0000","last_fullsized":"2024-09-12T00:54:31.454567+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:34.884235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069312,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":61937,"num_write":920,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'816","reported_seq":2316,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.944422+0000","last_change":"2024-09-12T00:11:47.956154+0000","last_active":"2024-09-12T00:53:00.944422+0000","last_peered":"2024-09-12T00:53:00.944422+0000","last_clean":"2024-09-12T00:53:00.944422+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:53:00.944422+0000","last_undegraded":"2024-09-12T00:53:00.944422+0000","last_fullsized":"2024-09-12T00:53:00.944422+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":800,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:03.574450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'189","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.474003+0000","last_change":"2024-09-12T00:11:45.938208+0000","last_active":"2024-09-12T00:54:31.474003+0000","last_peered":"2024-09-12T00:54:31.474003+0000","last_clean":"2024-09-12T00:54:31.474003+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:54:31.474003+0000","last_undegraded":"2024-09-12T00:54:31.474003+0000","last_fullsized":"2024-09-12T00:54:31.474003+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:03.569205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":418,"num_read_kb":18747,"num_write":861,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1200","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.294002+0000","last_change":"2024-09-12T00:11:47.923352+0000","last_active":"2024-09-12T00:53:59.294002+0000","last_peered":"2024-09-12T00:53:59.294002+0000","last_clean":"2024-09-12T00:53:59.294002+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:53:59.294002+0000","last_undegraded":"2024-09-12T00:53:59.294002+0000","last_fullsized":"2024-09-12T00:53:59.294002+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'209","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.515104+0000","last_change":"2024-09-12T00:11:45.955798+0000","last_active":"2024-09-12T00:54:31.515104+0000","last_peered":"2024-09-12T00:54:31.515104+0000","last_clean":"2024-09-12T00:54:31.515104+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:54:31.515104+0000","last_undegraded":"2024-09-12T00:54:31.515104+0000","last_fullsized":"2024-09-12T00:54:31.515104+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:18:10.064782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753496,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":35398,"num_write":969,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'471","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.953028+0000","last_change":"2024-09-12T00:11:47.925461+0000","last_active":"2024-09-12T00:52:59.953028+0000","last_peered":"2024-09-12T00:52:59.953028+0000","last_clean":"2024-09-12T00:52:59.953028+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:52:59.953028+0000","last_undegraded":"2024-09-12T00:52:59.953028+0000","last_fullsized":"2024-09-12T00:52:59.953028+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":400,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:49:27.139459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'203","reported_seq":831,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.493874+0000","last_change":"2024-09-12T00:11:45.963753+0000","last_active":"2024-09-12T00:54:31.493874+0000","last_peered":"2024-09-12T00:54:31.493874+0000","last_clean":"2024-09-12T00:54:31.493874+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:54:31.493874+0000","last_undegraded":"2024-09-12T00:54:31.493874+0000","last_fullsized":"2024-09-12T00:54:31.493874+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:24:39.076031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":18770,"num_write":983,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'803","reported_seq":2332,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:39.962743+0000","last_change":"2024-09-12T00:11:47.933827+0000","last_active":"2024-09-12T00:53:39.962743+0000","last_peered":"2024-09-12T00:53:39.962743+0000","last_clean":"2024-09-12T00:53:39.962743+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:53:39.962743+0000","last_undegraded":"2024-09-12T00:53:39.962743+0000","last_fullsized":"2024-09-12T00:53:39.962743+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":700,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:55.730348+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'248","reported_seq":919,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.559059+0000","last_change":"2024-09-12T00:11:45.938920+0000","last_active":"2024-09-12T00:54:31.559059+0000","last_peered":"2024-09-12T00:54:31.559059+0000","last_clean":"2024-09-12T00:54:31.559059+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:54:31.559059+0000","last_undegraded":"2024-09-12T00:54:31.559059+0000","last_fullsized":"2024-09-12T00:54:31.559059+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:19.946280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":28384,"num_write":1056,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'476","reported_seq":1937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.369796+0000","last_change":"2024-09-12T00:11:47.930919+0000","last_active":"2024-09-12T00:53:14.369796+0000","last_peered":"2024-09-12T00:53:14.369796+0000","last_clean":"2024-09-12T00:53:14.369796+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:53:14.369796+0000","last_undegraded":"2024-09-12T00:53:14.369796+0000","last_fullsized":"2024-09-12T00:53:14.369796+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:51:25.247323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'293","reported_seq":1105,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.481078+0000","last_change":"2024-09-12T00:11:45.938219+0000","last_active":"2024-09-12T00:54:31.481078+0000","last_peered":"2024-09-12T00:54:31.481078+0000","last_clean":"2024-09-12T00:54:31.481078+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:54:31.481078+0000","last_undegraded":"2024-09-12T00:54:31.481078+0000","last_fullsized":"2024-09-12T00:54:31.481078+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.279970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1398,"num_read_kb":1619,"num_write":1277,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'611","reported_seq":2341,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.506794+0000","last_change":"2024-09-12T00:11:47.950515+0000","last_active":"2024-09-12T00:53:10.506794+0000","last_peered":"2024-09-12T00:53:10.506794+0000","last_clean":"2024-09-12T00:53:10.506794+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:53:10.506794+0000","last_undegraded":"2024-09-12T00:53:10.506794+0000","last_fullsized":"2024-09-12T00:53:10.506794+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":600,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:14.307717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'228","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.464733+0000","last_change":"2024-09-12T00:11:45.921722+0000","last_active":"2024-09-12T00:54:31.464733+0000","last_peered":"2024-09-12T00:54:31.464733+0000","last_clean":"2024-09-12T00:54:31.464733+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:31.464733+0000","last_undegraded":"2024-09-12T00:54:31.464733+0000","last_fullsized":"2024-09-12T00:54:31.464733+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:04.273504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7916704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":17177,"num_write":1053,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1255","reported_seq":3015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.372859+0000","last_change":"2024-09-12T00:11:47.924558+0000","last_active":"2024-09-12T00:53:14.372859+0000","last_peered":"2024-09-12T00:53:14.372859+0000","last_clean":"2024-09-12T00:53:14.372859+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:53:14.372859+0000","last_undegraded":"2024-09-12T00:53:14.372859+0000","last_fullsized":"2024-09-12T00:53:14.372859+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":1200,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:39.549706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'277","reported_seq":922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.462557+0000","last_change":"2024-09-12T00:11:45.965487+0000","last_active":"2024-09-12T00:54:31.462557+0000","last_peered":"2024-09-12T00:54:31.462557+0000","last_clean":"2024-09-12T00:54:31.462557+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:54:31.462557+0000","last_undegraded":"2024-09-12T00:54:31.462557+0000","last_fullsized":"2024-09-12T00:54:31.462557+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:11.343524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525343,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":15585,"num_write":1267,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'826","reported_seq":2402,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.503633+0000","last_change":"2024-09-12T00:11:47.951105+0000","last_active":"2024-09-12T00:53:10.503633+0000","last_peered":"2024-09-12T00:53:10.503633+0000","last_clean":"2024-09-12T00:53:10.503633+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:53:10.503633+0000","last_undegraded":"2024-09-12T00:53:10.503633+0000","last_fullsized":"2024-09-12T00:53:10.503633+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:51:49.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'251","reported_seq":892,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.483628+0000","last_change":"2024-09-12T00:11:45.963287+0000","last_active":"2024-09-12T00:54:31.483628+0000","last_peered":"2024-09-12T00:54:31.483628+0000","last_clean":"2024-09-12T00:54:31.483628+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:54:31.483628+0000","last_undegraded":"2024-09-12T00:54:31.483628+0000","last_fullsized":"2024-09-12T00:54:31.483628+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:21.996463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10118774,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":58641,"num_write":1118,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1327","reported_seq":2850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:50.955784+0000","last_change":"2024-09-12T00:11:47.934364+0000","last_active":"2024-09-12T00:53:50.955784+0000","last_peered":"2024-09-12T00:53:50.955784+0000","last_clean":"2024-09-12T00:53:50.955784+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:53:50.955784+0000","last_undegraded":"2024-09-12T00:53:50.955784+0000","last_fullsized":"2024-09-12T00:53:50.955784+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":1300,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:40:56.753028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'196","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.545578+0000","last_change":"2024-09-12T00:11:45.963871+0000","last_active":"2024-09-12T00:54:31.545578+0000","last_peered":"2024-09-12T00:54:31.545578+0000","last_clean":"2024-09-12T00:54:31.545578+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:54:31.545578+0000","last_undegraded":"2024-09-12T00:54:31.545578+0000","last_fullsized":"2024-09-12T00:54:31.545578+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.697592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262331,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":34280,"num_write":929,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'551","reported_seq":2098,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.490083+0000","last_change":"2024-09-12T00:11:47.935891+0000","last_active":"2024-09-12T00:53:10.490083+0000","last_peered":"2024-09-12T00:53:10.490083+0000","last_clean":"2024-09-12T00:53:10.490083+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:53:10.490083+0000","last_undegraded":"2024-09-12T00:53:10.490083+0000","last_fullsized":"2024-09-12T00:53:10.490083+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:40.527099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'229","reported_seq":964,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.549708+0000","last_change":"2024-09-12T00:11:45.923906+0000","last_active":"2024-09-12T00:54:31.549708+0000","last_peered":"2024-09-12T00:54:31.549708+0000","last_clean":"2024-09-12T00:54:31.549708+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:54:31.549708+0000","last_undegraded":"2024-09-12T00:54:31.549708+0000","last_fullsized":"2024-09-12T00:54:31.549708+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:44.019789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460242,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":746,"num_read_kb":61726,"num_write":1110,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'700","reported_seq":2497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.294051+0000","last_change":"2024-09-12T00:11:47.936000+0000","last_active":"2024-09-12T00:53:59.294051+0000","last_peered":"2024-09-12T00:53:59.294051+0000","last_clean":"2024-09-12T00:53:59.294051+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:53:59.294051+0000","last_undegraded":"2024-09-12T00:53:59.294051+0000","last_fullsized":"2024-09-12T00:53:59.294051+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":600,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'210","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.474405+0000","last_change":"2024-09-12T00:11:45.945290+0000","last_active":"2024-09-12T00:54:31.474405+0000","last_peered":"2024-09-12T00:54:31.474405+0000","last_clean":"2024-09-12T00:54:31.474405+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:54:31.474405+0000","last_undegraded":"2024-09-12T00:54:31.474405+0000","last_fullsized":"2024-09-12T00:54:31.474405+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:26.645752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457515,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":13749,"num_write":936,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'963","reported_seq":2518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.249189+0000","last_change":"2024-09-12T00:11:47.941903+0000","last_active":"2024-09-12T00:53:00.249189+0000","last_peered":"2024-09-12T00:53:00.249189+0000","last_clean":"2024-09-12T00:53:00.249189+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:53:00.249189+0000","last_undegraded":"2024-09-12T00:53:00.249189+0000","last_fullsized":"2024-09-12T00:53:00.249189+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":900,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'210","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.326424+0000","last_change":"2024-09-12T00:11:45.937710+0000","last_active":"2024-09-12T00:54:31.326424+0000","last_peered":"2024-09-12T00:54:31.326424+0000","last_clean":"2024-09-12T00:54:31.326424+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:54:31.326424+0000","last_undegraded":"2024-09-12T00:54:31.326424+0000","last_fullsized":"2024-09-12T00:54:31.326424+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:53.751417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":23861,"num_write":1050,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'752","reported_seq":2228,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981577+0000","last_change":"2024-09-12T00:11:47.940732+0000","last_active":"2024-09-12T00:53:01.981577+0000","last_peered":"2024-09-12T00:53:01.981577+0000","last_clean":"2024-09-12T00:53:01.981577+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:53:01.981577+0000","last_undegraded":"2024-09-12T00:53:01.981577+0000","last_fullsized":"2024-09-12T00:53:01.981577+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":700,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:13.413376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'164","reported_seq":767,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.113605+0000","last_change":"2024-09-12T00:11:45.934430+0000","last_active":"2024-09-12T00:54:31.113605+0000","last_peered":"2024-09-12T00:54:31.113605+0000","last_clean":"2024-09-12T00:54:31.113605+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:54:31.113605+0000","last_undegraded":"2024-09-12T00:54:31.113605+0000","last_fullsized":"2024-09-12T00:54:31.113605+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:04.951800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399130,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":3653,"num_write":817,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'834","reported_seq":2658,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.981867+0000","last_change":"2024-09-12T00:11:47.951096+0000","last_active":"2024-09-12T00:53:01.981867+0000","last_peered":"2024-09-12T00:53:01.981867+0000","last_clean":"2024-09-12T00:53:01.981867+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:53:01.981867+0000","last_undegraded":"2024-09-12T00:53:01.981867+0000","last_fullsized":"2024-09-12T00:53:01.981867+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":800,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:06.513554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'220","reported_seq":881,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.303023+0000","last_change":"2024-09-12T00:11:45.926172+0000","last_active":"2024-09-12T00:54:31.303023+0000","last_peered":"2024-09-12T00:54:31.303023+0000","last_clean":"2024-09-12T00:54:31.303023+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:54:31.303023+0000","last_undegraded":"2024-09-12T00:54:31.303023+0000","last_fullsized":"2024-09-12T00:54:31.303023+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:19:26.600245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430198,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":27002,"num_write":976,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'447","reported_seq":2066,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.036909+0000","last_change":"2024-09-12T00:11:47.941908+0000","last_active":"2024-09-12T00:52:49.036909+0000","last_peered":"2024-09-12T00:52:49.036909+0000","last_clean":"2024-09-12T00:52:49.036909+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:52:49.036909+0000","last_undegraded":"2024-09-12T00:52:49.036909+0000","last_fullsized":"2024-09-12T00:52:49.036909+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":400,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:16.535433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'186","reported_seq":808,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.306597+0000","last_change":"2024-09-12T00:11:45.964131+0000","last_active":"2024-09-12T00:54:31.306597+0000","last_peered":"2024-09-12T00:54:31.306597+0000","last_clean":"2024-09-12T00:54:31.306597+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:54:31.306597+0000","last_undegraded":"2024-09-12T00:54:31.306597+0000","last_fullsized":"2024-09-12T00:54:31.306597+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:06:45.901253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":12744,"num_write":922,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'226","reported_seq":876,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.523472+0000","last_change":"2024-09-12T00:11:45.935207+0000","last_active":"2024-09-12T00:54:31.523472+0000","last_peered":"2024-09-12T00:54:31.523472+0000","last_clean":"2024-09-12T00:54:31.523472+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:54:31.523472+0000","last_undegraded":"2024-09-12T00:54:31.523472+0000","last_fullsized":"2024-09-12T00:54:31.523472+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:45.585339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":71383,"num_write":1072,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'455","reported_seq":2138,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.502646+0000","last_change":"2024-09-12T00:11:47.953166+0000","last_active":"2024-09-12T00:53:10.502646+0000","last_peered":"2024-09-12T00:53:10.502646+0000","last_clean":"2024-09-12T00:53:10.502646+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:53:10.502646+0000","last_undegraded":"2024-09-12T00:53:10.502646+0000","last_fullsized":"2024-09-12T00:53:10.502646+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:29.576578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'208","reported_seq":958,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.512915+0000","last_change":"2024-09-12T00:11:45.965734+0000","last_active":"2024-09-12T00:54:31.512915+0000","last_peered":"2024-09-12T00:54:31.512915+0000","last_clean":"2024-09-12T00:54:31.512915+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:54:31.512915+0000","last_undegraded":"2024-09-12T00:54:31.512915+0000","last_fullsized":"2024-09-12T00:54:31.512915+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:44.866992+0000","last_clean_scrub_stamp":"2024-09-12T00:11:44.866992+0000","objects_scrubbed":0,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:58.306543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194359,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":710,"num_read_kb":180313,"num_write":963,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'926","reported_seq":2688,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.196736+0000","last_change":"2024-09-12T00:11:47.940663+0000","last_active":"2024-09-12T00:54:17.196736+0000","last_peered":"2024-09-12T00:54:17.196736+0000","last_clean":"2024-09-12T00:54:17.196736+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:17.196736+0000","last_undegraded":"2024-09-12T00:54:17.196736+0000","last_fullsized":"2024-09-12T00:54:17.196736+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":900,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:36:22.398957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":959,"ondisk_log_size":959,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1850,"ondisk_log_size":1850,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":658,"ondisk_log_size":658,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":338265,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8580,"num_read_kb":10748,"num_write":5747,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1985,"ondisk_log_size":1985,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3935,"ondisk_log_size":3935,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":104917588,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":33248,"num_read_kb":1979779,"num_write":63422,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159301632,"data_stored":159301632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4504,"ondisk_log_size":4504,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":190493,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":189755,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509960,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":216280,"kb_used_data":18528,"kb_used_omap":1,"kb_used_meta":197694,"kb_avail":94155560,"statfs":{"total":96636764160,"available":96415293440,"internally_reserved":0,"allocated":18972672,"data_stored":16979463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":202439114},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509961,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":88108,"kb_used_data":20768,"kb_used_omap":1,"kb_used_meta":67262,"kb_avail":94283732,"statfs":{"total":96636764160,"available":96546541568,"internally_reserved":0,"allocated":21266432,"data_stored":19245709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":68876742},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509962,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190628,"kb_used_data":28960,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94181212,"statfs":{"total":96636764160,"available":96441561088,"internally_reserved":0,"allocated":29655040,"data_stored":27647840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509962,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":226000,"kb_used_data":32336,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94145840,"statfs":{"total":96636764160,"available":96405340160,"internally_reserved":0,"allocated":33112064,"data_stored":31105721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509963,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123748,"kb_used_data":24512,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94248092,"statfs":{"total":96636764160,"available":96510046208,"internally_reserved":0,"allocated":25100288,"data_stored":23091639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509962,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289536,"kb_used_data":19496,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94082304,"statfs":{"total":96636764160,"available":96340279296,"internally_reserved":0,"allocated":19963904,"data_stored":17949977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509961,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127848,"kb_used_data":24440,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94243992,"statfs":{"total":96636764160,"available":96505847808,"internally_reserved":0,"allocated":25026560,"data_stored":23006958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542669,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246452,"kb_used_data":20840,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125388,"statfs":{"total":96636764160,"available":96384397312,"internally_reserved":0,"allocated":21340160,"data_stored":19331103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20770816,"data_stored":20770816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":15126528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20856832,"data_stored":20856832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28872704,"data_stored":28872704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25411584,"data_stored":25411584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16506880,"data_stored":16506880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17010688,"data_stored":17010688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14745600,"data_stored":14745600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:54:38.265 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.265 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.265 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.266 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.266 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.266 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.266 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.266 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.266 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.266 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.267 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.268 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.269 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.270 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.270 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.270 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.270 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.270 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.270 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.270 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.271 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.272 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.273 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.274 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.275 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.276 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.277 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.278 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.279 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.280 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.281 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.282 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.283 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.284 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.285 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.286 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.287 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.288 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.289 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.290 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.290 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.290 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.290 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.290 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.290 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.290 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.291 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.292 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.293 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.294 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.294 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.294 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.294 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.294 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.294 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.294 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.295 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.296 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.297 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-12T00:11:31.559084+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=31, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.298 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.299 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.300 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.301 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.302 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.303 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.304 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.305 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.306 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.307 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.308 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.309 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-12T00:11:44.866992+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=44, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:38.310 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:54:58.311 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:54:58.681 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:54:58.698 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:54:58.704 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1565,"stamp":"2024-09-12T00:54:57.369170+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105863228,"num_objects":726,"num_object_clones":0,"num_object_copies":1691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":278142,"num_read_kb":2586611,"num_write":143606,"num_write_kb":2344249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":530725,"num_omap_keys":1282,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14426,"ondisk_log_size":14426,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1516536,"kb_used_data":189880,"kb_used_omap":12,"kb_used_meta":1326515,"kb_avail":753458184,"statfs":{"total":773094113280,"available":771541180416,"internally_reserved":0,"allocated":194437120,"data_stored":178358410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1358351922},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":530725,"num_omap_keys":1282,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008786"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934222+0000","last_change":"2024-09-12T00:39:28.138350+0000","last_active":"2024-09-12T00:52:00.934222+0000","last_peered":"2024-09-12T00:52:00.934222+0000","last_clean":"2024-09-12T00:52:00.934222+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:52:00.934222+0000","last_undegraded":"2024-09-12T00:52:00.934222+0000","last_fullsized":"2024-09-12T00:52:00.934222+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:27:55.798857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.092228+0000","last_change":"2024-09-12T00:28:17.047281+0000","last_active":"2024-09-12T00:50:51.092228+0000","last_peered":"2024-09-12T00:50:51.092228+0000","last_clean":"2024-09-12T00:50:51.092228+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:50:51.092228+0000","last_undegraded":"2024-09-12T00:50:51.092228+0000","last_fullsized":"2024-09-12T00:50:51.092228+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:34:27.659088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.947765+0000","last_change":"2024-09-12T00:28:14.033426+0000","last_active":"2024-09-12T00:53:15.947765+0000","last_peered":"2024-09-12T00:53:15.947765+0000","last_clean":"2024-09-12T00:53:15.947765+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:53:15.947765+0000","last_undegraded":"2024-09-12T00:53:15.947765+0000","last_fullsized":"2024-09-12T00:53:15.947765+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:00:32.619191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931203+0000","last_change":"2024-09-12T00:26:48.570033+0000","last_active":"2024-09-12T00:51:50.931203+0000","last_peered":"2024-09-12T00:51:50.931203+0000","last_clean":"2024-09-12T00:51:50.931203+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:51:50.931203+0000","last_undegraded":"2024-09-12T00:51:50.931203+0000","last_fullsized":"2024-09-12T00:51:50.931203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.353377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928588+0000","last_change":"2024-09-12T00:39:28.129464+0000","last_active":"2024-09-12T00:52:00.928588+0000","last_peered":"2024-09-12T00:52:00.928588+0000","last_clean":"2024-09-12T00:52:00.928588+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:52:00.928588+0000","last_undegraded":"2024-09-12T00:52:00.928588+0000","last_fullsized":"2024-09-12T00:52:00.928588+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:48.897603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113095+0000","last_change":"2024-09-12T00:28:17.071932+0000","last_active":"2024-09-12T00:50:51.113095+0000","last_peered":"2024-09-12T00:50:51.113095+0000","last_clean":"2024-09-12T00:50:51.113095+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:50:51.113095+0000","last_undegraded":"2024-09-12T00:50:51.113095+0000","last_fullsized":"2024-09-12T00:50:51.113095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.458170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921118+0000","last_change":"2024-09-12T00:28:14.053061+0000","last_active":"2024-09-12T00:50:44.921118+0000","last_peered":"2024-09-12T00:50:44.921118+0000","last_clean":"2024-09-12T00:50:44.921118+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:50:44.921118+0000","last_undegraded":"2024-09-12T00:50:44.921118+0000","last_fullsized":"2024-09-12T00:50:44.921118+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.764170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:55.944912+0000","last_change":"2024-09-12T00:26:48.579305+0000","last_active":"2024-09-12T00:52:55.944912+0000","last_peered":"2024-09-12T00:52:55.944912+0000","last_clean":"2024-09-12T00:52:55.944912+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:52:55.944912+0000","last_undegraded":"2024-09-12T00:52:55.944912+0000","last_fullsized":"2024-09-12T00:52:55.944912+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.103970+0000","last_change":"2024-09-12T00:39:28.122188+0000","last_active":"2024-09-12T00:51:36.103970+0000","last_peered":"2024-09-12T00:51:36.103970+0000","last_clean":"2024-09-12T00:51:36.103970+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:51:36.103970+0000","last_undegraded":"2024-09-12T00:51:36.103970+0000","last_fullsized":"2024-09-12T00:51:36.103970+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:19.982189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928491+0000","last_change":"2024-09-12T00:28:17.054566+0000","last_active":"2024-09-12T00:51:14.928491+0000","last_peered":"2024-09-12T00:51:14.928491+0000","last_clean":"2024-09-12T00:51:14.928491+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:51:14.928491+0000","last_undegraded":"2024-09-12T00:51:14.928491+0000","last_fullsized":"2024-09-12T00:51:14.928491+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.840405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'3","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:20.962121+0000","last_change":"2024-09-12T00:28:14.047435+0000","last_active":"2024-09-12T00:54:20.962121+0000","last_peered":"2024-09-12T00:54:20.962121+0000","last_clean":"2024-09-12T00:54:20.962121+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:54:20.962121+0000","last_undegraded":"2024-09-12T00:54:20.962121+0000","last_fullsized":"2024-09-12T00:54:20.962121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:59.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":89,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.669268+0000","last_change":"2024-09-12T00:26:48.580614+0000","last_active":"2024-09-12T00:52:01.669268+0000","last_peered":"2024-09-12T00:52:01.669268+0000","last_clean":"2024-09-12T00:52:01.669268+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:52:01.669268+0000","last_undegraded":"2024-09-12T00:52:01.669268+0000","last_fullsized":"2024-09-12T00:52:01.669268+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:44.366801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934194+0000","last_change":"2024-09-12T00:39:28.125516+0000","last_active":"2024-09-12T00:51:39.934194+0000","last_peered":"2024-09-12T00:51:39.934194+0000","last_clean":"2024-09-12T00:51:39.934194+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:51:39.934194+0000","last_undegraded":"2024-09-12T00:51:39.934194+0000","last_fullsized":"2024-09-12T00:51:39.934194+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:50.627744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'5","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:24.978258+0000","last_change":"2024-09-12T00:28:17.052788+0000","last_active":"2024-09-12T00:54:24.978258+0000","last_peered":"2024-09-12T00:54:24.978258+0000","last_clean":"2024-09-12T00:54:24.978258+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:54:24.978258+0000","last_undegraded":"2024-09-12T00:54:24.978258+0000","last_fullsized":"2024-09-12T00:54:24.978258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.537154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.096647+0000","last_change":"2024-09-12T00:28:14.043102+0000","last_active":"2024-09-12T00:51:11.096647+0000","last_peered":"2024-09-12T00:51:11.096647+0000","last_clean":"2024-09-12T00:51:11.096647+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:51:11.096647+0000","last_undegraded":"2024-09-12T00:51:11.096647+0000","last_fullsized":"2024-09-12T00:51:11.096647+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:25:02.118617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926319+0000","last_change":"2024-09-12T00:26:48.582273+0000","last_active":"2024-09-12T00:51:50.926319+0000","last_peered":"2024-09-12T00:51:50.926319+0000","last_clean":"2024-09-12T00:51:50.926319+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:51:50.926319+0000","last_undegraded":"2024-09-12T00:51:50.926319+0000","last_fullsized":"2024-09-12T00:51:50.926319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:53:11.447704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926457+0000","last_change":"2024-09-12T00:39:28.140327+0000","last_active":"2024-09-12T00:51:35.926457+0000","last_peered":"2024-09-12T00:51:35.926457+0000","last_clean":"2024-09-12T00:51:35.926457+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:51:35.926457+0000","last_undegraded":"2024-09-12T00:51:35.926457+0000","last_fullsized":"2024-09-12T00:51:35.926457+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:53.703852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'2","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:35.941802+0000","last_change":"2024-09-12T00:28:17.062001+0000","last_active":"2024-09-12T00:52:35.941802+0000","last_peered":"2024-09-12T00:52:35.941802+0000","last_clean":"2024-09-12T00:52:35.941802+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:52:35.941802+0000","last_undegraded":"2024-09-12T00:52:35.941802+0000","last_fullsized":"2024-09-12T00:52:35.941802+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:35:27.953980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'9","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.182024+0000","last_change":"2024-09-12T00:28:14.043324+0000","last_active":"2024-09-12T00:54:31.182024+0000","last_peered":"2024-09-12T00:54:31.182024+0000","last_clean":"2024-09-12T00:54:31.182024+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:54:31.182024+0000","last_undegraded":"2024-09-12T00:54:31.182024+0000","last_fullsized":"2024-09-12T00:54:31.182024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":181,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.926176+0000","last_change":"2024-09-12T00:26:48.586853+0000","last_active":"2024-09-12T00:51:50.926176+0000","last_peered":"2024-09-12T00:51:50.926176+0000","last_clean":"2024-09-12T00:51:50.926176+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:51:50.926176+0000","last_undegraded":"2024-09-12T00:51:50.926176+0000","last_fullsized":"2024-09-12T00:51:50.926176+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:56.028583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933422+0000","last_change":"2024-09-12T00:39:28.107499+0000","last_active":"2024-09-12T00:52:00.933422+0000","last_peered":"2024-09-12T00:52:00.933422+0000","last_clean":"2024-09-12T00:52:00.933422+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:52:00.933422+0000","last_undegraded":"2024-09-12T00:52:00.933422+0000","last_fullsized":"2024-09-12T00:52:00.933422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:42.987392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'7","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.570891+0000","last_change":"2024-09-12T00:28:17.080528+0000","last_active":"2024-09-12T00:54:31.570891+0000","last_peered":"2024-09-12T00:54:31.570891+0000","last_clean":"2024-09-12T00:54:31.570891+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:54:31.570891+0000","last_undegraded":"2024-09-12T00:54:31.570891+0000","last_fullsized":"2024-09-12T00:54:31.570891+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":651,"num_write":12,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.493275+0000","last_change":"2024-09-12T00:28:14.045269+0000","last_active":"2024-09-12T00:54:31.493275+0000","last_peered":"2024-09-12T00:54:31.493275+0000","last_clean":"2024-09-12T00:54:31.493275+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:54:31.493275+0000","last_undegraded":"2024-09-12T00:54:31.493275+0000","last_fullsized":"2024-09-12T00:54:31.493275+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":239,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:33.892906+0000","last_change":"2024-09-12T00:26:48.573856+0000","last_active":"2024-09-12T00:52:33.892906+0000","last_peered":"2024-09-12T00:52:33.892906+0000","last_clean":"2024-09-12T00:52:33.892906+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:52:33.892906+0000","last_undegraded":"2024-09-12T00:52:33.892906+0000","last_fullsized":"2024-09-12T00:52:33.892906+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:31:49.201091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.128901+0000","last_change":"2024-09-12T00:39:28.140779+0000","last_active":"2024-09-12T00:52:01.128901+0000","last_peered":"2024-09-12T00:52:01.128901+0000","last_clean":"2024-09-12T00:52:01.128901+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:52:01.128901+0000","last_undegraded":"2024-09-12T00:52:01.128901+0000","last_fullsized":"2024-09-12T00:52:01.128901+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.223046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":33,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113042+0000","last_change":"2024-09-12T00:28:17.073306+0000","last_active":"2024-09-12T00:50:51.113042+0000","last_peered":"2024-09-12T00:50:51.113042+0000","last_clean":"2024-09-12T00:50:51.113042+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:50:51.113042+0000","last_undegraded":"2024-09-12T00:50:51.113042+0000","last_fullsized":"2024-09-12T00:50:51.113042+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:33.616512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917468+0000","last_change":"2024-09-12T00:28:14.036590+0000","last_active":"2024-09-12T00:50:45.917468+0000","last_peered":"2024-09-12T00:50:45.917468+0000","last_clean":"2024-09-12T00:50:45.917468+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:50:45.917468+0000","last_undegraded":"2024-09-12T00:50:45.917468+0000","last_fullsized":"2024-09-12T00:50:45.917468+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:05.374471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":190,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.485163+0000","last_change":"2024-09-12T00:26:48.567960+0000","last_active":"2024-09-12T00:52:37.485163+0000","last_peered":"2024-09-12T00:52:37.485163+0000","last_clean":"2024-09-12T00:52:37.485163+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:52:37.485163+0000","last_undegraded":"2024-09-12T00:52:37.485163+0000","last_fullsized":"2024-09-12T00:52:37.485163+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:55.486007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934433+0000","last_change":"2024-09-12T00:39:28.125474+0000","last_active":"2024-09-12T00:52:00.934433+0000","last_peered":"2024-09-12T00:52:00.934433+0000","last_clean":"2024-09-12T00:52:00.934433+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:52:00.934433+0000","last_undegraded":"2024-09-12T00:52:00.934433+0000","last_fullsized":"2024-09-12T00:52:00.934433+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:21:45.341353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916437+0000","last_change":"2024-09-12T00:28:17.074749+0000","last_active":"2024-09-12T00:50:50.916437+0000","last_peered":"2024-09-12T00:50:50.916437+0000","last_clean":"2024-09-12T00:50:50.916437+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:50:50.916437+0000","last_undegraded":"2024-09-12T00:50:50.916437+0000","last_fullsized":"2024-09-12T00:50:50.916437+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:59.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.944795+0000","last_change":"2024-09-12T00:28:14.050432+0000","last_active":"2024-09-12T00:53:15.944795+0000","last_peered":"2024-09-12T00:53:15.944795+0000","last_clean":"2024-09-12T00:53:15.944795+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:53:15.944795+0000","last_undegraded":"2024-09-12T00:53:15.944795+0000","last_fullsized":"2024-09-12T00:53:15.944795+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:30:50.652868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.914915+0000","last_change":"2024-09-12T00:26:48.576457+0000","last_active":"2024-09-12T00:51:00.914915+0000","last_peered":"2024-09-12T00:51:00.914915+0000","last_clean":"2024-09-12T00:51:00.914915+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:51:00.914915+0000","last_undegraded":"2024-09-12T00:51:00.914915+0000","last_fullsized":"2024-09-12T00:51:00.914915+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:18:50.385760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927145+0000","last_change":"2024-09-12T00:39:28.133363+0000","last_active":"2024-09-12T00:51:09.927145+0000","last_peered":"2024-09-12T00:51:09.927145+0000","last_clean":"2024-09-12T00:51:09.927145+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:51:09.927145+0000","last_undegraded":"2024-09-12T00:51:09.927145+0000","last_fullsized":"2024-09-12T00:51:09.927145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:45.885764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'10","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.512356+0000","last_change":"2024-09-12T00:28:17.078258+0000","last_active":"2024-09-12T00:54:31.512356+0000","last_peered":"2024-09-12T00:54:31.512356+0000","last_clean":"2024-09-12T00:54:31.512356+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:54:31.512356+0000","last_undegraded":"2024-09-12T00:54:31.512356+0000","last_fullsized":"2024-09-12T00:54:31.512356+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12306,"num_write":10,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947884+0000","last_change":"2024-09-12T00:28:14.046080+0000","last_active":"2024-09-12T00:51:40.947884+0000","last_peered":"2024-09-12T00:51:40.947884+0000","last_clean":"2024-09-12T00:51:40.947884+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:51:40.947884+0000","last_undegraded":"2024-09-12T00:51:40.947884+0000","last_fullsized":"2024-09-12T00:51:40.947884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.783103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":201,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.951659+0000","last_change":"2024-09-12T00:26:48.572423+0000","last_active":"2024-09-12T00:51:36.951659+0000","last_peered":"2024-09-12T00:51:36.951659+0000","last_clean":"2024-09-12T00:51:36.951659+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:51:36.951659+0000","last_undegraded":"2024-09-12T00:51:36.951659+0000","last_fullsized":"2024-09-12T00:51:36.951659+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:03.523286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917174+0000","last_change":"2024-09-12T00:39:28.115704+0000","last_active":"2024-09-12T00:51:10.917174+0000","last_peered":"2024-09-12T00:51:10.917174+0000","last_clean":"2024-09-12T00:51:10.917174+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:51:10.917174+0000","last_undegraded":"2024-09-12T00:51:10.917174+0000","last_fullsized":"2024-09-12T00:51:10.917174+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.301433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'4","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:04.968671+0000","last_change":"2024-09-12T00:28:17.068407+0000","last_active":"2024-09-12T00:54:04.968671+0000","last_peered":"2024-09-12T00:54:04.968671+0000","last_clean":"2024-09-12T00:54:04.968671+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:54:04.968671+0000","last_undegraded":"2024-09-12T00:54:04.968671+0000","last_fullsized":"2024-09-12T00:54:04.968671+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:04.370003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:25.939738+0000","last_change":"2024-09-12T00:28:14.033635+0000","last_active":"2024-09-12T00:52:25.939738+0000","last_peered":"2024-09-12T00:52:25.939738+0000","last_clean":"2024-09-12T00:52:25.939738+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:52:25.939738+0000","last_undegraded":"2024-09-12T00:52:25.939738+0000","last_fullsized":"2024-09-12T00:52:25.939738+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":126,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:37.729092+0000","last_change":"2024-09-12T00:26:48.579143+0000","last_active":"2024-09-12T00:52:37.729092+0000","last_peered":"2024-09-12T00:52:37.729092+0000","last_clean":"2024-09-12T00:52:37.729092+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:52:37.729092+0000","last_undegraded":"2024-09-12T00:52:37.729092+0000","last_fullsized":"2024-09-12T00:52:37.729092+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:06:58.299447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.117359+0000","last_change":"2024-09-12T00:39:28.143755+0000","last_active":"2024-09-12T00:51:11.117359+0000","last_peered":"2024-09-12T00:51:11.117359+0000","last_clean":"2024-09-12T00:51:11.117359+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:51:11.117359+0000","last_undegraded":"2024-09-12T00:51:11.117359+0000","last_fullsized":"2024-09-12T00:51:11.117359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:42.065287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.938200+0000","last_change":"2024-09-12T00:28:17.072223+0000","last_active":"2024-09-12T00:52:30.938200+0000","last_peered":"2024-09-12T00:52:30.938200+0000","last_clean":"2024-09-12T00:52:30.938200+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:52:30.938200+0000","last_undegraded":"2024-09-12T00:52:30.938200+0000","last_fullsized":"2024-09-12T00:52:30.938200+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'4","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.156383+0000","last_change":"2024-09-12T00:28:14.051773+0000","last_active":"2024-09-12T00:54:31.156383+0000","last_peered":"2024-09-12T00:54:31.156383+0000","last_clean":"2024-09-12T00:54:31.156383+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:54:31.156383+0000","last_undegraded":"2024-09-12T00:54:31.156383+0000","last_fullsized":"2024-09-12T00:54:31.156383+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":70,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:00.918732+0000","last_change":"2024-09-12T00:26:48.566905+0000","last_active":"2024-09-12T00:51:00.918732+0000","last_peered":"2024-09-12T00:51:00.918732+0000","last_clean":"2024-09-12T00:51:00.918732+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:51:00.918732+0000","last_undegraded":"2024-09-12T00:51:00.918732+0000","last_fullsized":"2024-09-12T00:51:00.918732+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:39:21.878822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.923092+0000","last_change":"2024-09-12T00:39:28.130382+0000","last_active":"2024-09-12T00:51:10.923092+0000","last_peered":"2024-09-12T00:51:10.923092+0000","last_clean":"2024-09-12T00:51:10.923092+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:51:10.923092+0000","last_undegraded":"2024-09-12T00:51:10.923092+0000","last_fullsized":"2024-09-12T00:51:10.923092+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:48:27.073020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'5","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.570317+0000","last_change":"2024-09-12T00:28:17.073824+0000","last_active":"2024-09-12T00:54:31.570317+0000","last_peered":"2024-09-12T00:54:31.570317+0000","last_clean":"2024-09-12T00:54:31.570317+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:54:31.570317+0000","last_undegraded":"2024-09-12T00:54:31.570317+0000","last_fullsized":"2024-09-12T00:54:31.570317+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.944878+0000","last_change":"2024-09-12T00:28:14.044796+0000","last_active":"2024-09-12T00:52:24.944878+0000","last_peered":"2024-09-12T00:52:24.944878+0000","last_clean":"2024-09-12T00:52:24.944878+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:52:24.944878+0000","last_undegraded":"2024-09-12T00:52:24.944878+0000","last_fullsized":"2024-09-12T00:52:24.944878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'113","reported_seq":400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.553520+0000","last_change":"2024-09-12T00:26:48.578346+0000","last_active":"2024-09-12T00:52:38.553520+0000","last_peered":"2024-09-12T00:52:38.553520+0000","last_clean":"2024-09-12T00:52:38.553520+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:52:38.553520+0000","last_undegraded":"2024-09-12T00:52:38.553520+0000","last_fullsized":"2024-09-12T00:52:38.553520+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933259+0000","last_change":"2024-09-12T00:39:28.130268+0000","last_active":"2024-09-12T00:51:34.933259+0000","last_peered":"2024-09-12T00:51:34.933259+0000","last_clean":"2024-09-12T00:51:34.933259+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:51:34.933259+0000","last_undegraded":"2024-09-12T00:51:34.933259+0000","last_fullsized":"2024-09-12T00:51:34.933259+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:22.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'4","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967275+0000","last_change":"2024-09-12T00:28:17.046685+0000","last_active":"2024-09-12T00:53:59.967275+0000","last_peered":"2024-09-12T00:53:59.967275+0000","last_clean":"2024-09-12T00:53:59.967275+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:53:59.967275+0000","last_undegraded":"2024-09-12T00:53:59.967275+0000","last_fullsized":"2024-09-12T00:53:59.967275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:31.104948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4468,"num_write":4,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104004+0000","last_change":"2024-09-12T00:28:14.032537+0000","last_active":"2024-09-12T00:51:36.104004+0000","last_peered":"2024-09-12T00:51:36.104004+0000","last_clean":"2024-09-12T00:51:36.104004+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:51:36.104004+0000","last_undegraded":"2024-09-12T00:51:36.104004+0000","last_fullsized":"2024-09-12T00:51:36.104004+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:30:02.020093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'133","reported_seq":450,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.961253+0000","last_change":"2024-09-12T00:26:48.579290+0000","last_active":"2024-09-12T00:52:30.961253+0000","last_peered":"2024-09-12T00:52:30.961253+0000","last_clean":"2024-09-12T00:52:30.961253+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:52:30.961253+0000","last_undegraded":"2024-09-12T00:52:30.961253+0000","last_fullsized":"2024-09-12T00:52:30.961253+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922871+0000","last_change":"2024-09-12T00:39:28.116214+0000","last_active":"2024-09-12T00:51:35.922871+0000","last_peered":"2024-09-12T00:51:35.922871+0000","last_clean":"2024-09-12T00:51:35.922871+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:51:35.922871+0000","last_undegraded":"2024-09-12T00:51:35.922871+0000","last_fullsized":"2024-09-12T00:51:35.922871+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.593460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934132+0000","last_change":"2024-09-12T00:28:17.059604+0000","last_active":"2024-09-12T00:51:39.934132+0000","last_peered":"2024-09-12T00:51:39.934132+0000","last_clean":"2024-09-12T00:51:39.934132+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:51:39.934132+0000","last_undegraded":"2024-09-12T00:51:39.934132+0000","last_fullsized":"2024-09-12T00:51:39.934132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:54.283922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933089+0000","last_change":"2024-09-12T00:28:14.043789+0000","last_active":"2024-09-12T00:51:34.933089+0000","last_peered":"2024-09-12T00:51:34.933089+0000","last_clean":"2024-09-12T00:51:34.933089+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:51:34.933089+0000","last_undegraded":"2024-09-12T00:51:34.933089+0000","last_fullsized":"2024-09-12T00:51:34.933089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.842950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.938036+0000","last_change":"2024-09-12T00:26:48.587469+0000","last_active":"2024-09-12T00:52:30.938036+0000","last_peered":"2024-09-12T00:52:30.938036+0000","last_clean":"2024-09-12T00:52:30.938036+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:52:30.938036+0000","last_undegraded":"2024-09-12T00:52:30.938036+0000","last_fullsized":"2024-09-12T00:52:30.938036+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923180+0000","last_change":"2024-09-12T00:39:28.116113+0000","last_active":"2024-09-12T00:51:15.923180+0000","last_peered":"2024-09-12T00:51:15.923180+0000","last_clean":"2024-09-12T00:51:15.923180+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:51:15.923180+0000","last_undegraded":"2024-09-12T00:51:15.923180+0000","last_fullsized":"2024-09-12T00:51:15.923180+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'7","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.162360+0000","last_change":"2024-09-12T00:28:17.077838+0000","last_active":"2024-09-12T00:54:31.162360+0000","last_peered":"2024-09-12T00:54:31.162360+0000","last_clean":"2024-09-12T00:54:31.162360+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:54:31.162360+0000","last_undegraded":"2024-09-12T00:54:31.162360+0000","last_fullsized":"2024-09-12T00:54:31.162360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.840518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'4","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.164217+0000","last_change":"2024-09-12T00:28:14.041233+0000","last_active":"2024-09-12T00:54:31.164217+0000","last_peered":"2024-09-12T00:54:31.164217+0000","last_clean":"2024-09-12T00:54:31.164217+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:54:31.164217+0000","last_undegraded":"2024-09-12T00:54:31.164217+0000","last_fullsized":"2024-09-12T00:54:31.164217+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:48.566724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":72,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:31.135733+0000","last_change":"2024-09-12T00:26:48.563874+0000","last_active":"2024-09-12T00:52:31.135733+0000","last_peered":"2024-09-12T00:52:31.135733+0000","last_clean":"2024-09-12T00:52:31.135733+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:52:31.135733+0000","last_undegraded":"2024-09-12T00:52:31.135733+0000","last_fullsized":"2024-09-12T00:52:31.135733+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922823+0000","last_change":"2024-09-12T00:39:28.107803+0000","last_active":"2024-09-12T00:51:35.922823+0000","last_peered":"2024-09-12T00:51:35.922823+0000","last_clean":"2024-09-12T00:51:35.922823+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:51:35.922823+0000","last_undegraded":"2024-09-12T00:51:35.922823+0000","last_fullsized":"2024-09-12T00:51:35.922823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.925644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947791+0000","last_change":"2024-09-12T00:28:17.071725+0000","last_active":"2024-09-12T00:51:40.947791+0000","last_peered":"2024-09-12T00:51:40.947791+0000","last_clean":"2024-09-12T00:51:40.947791+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:51:40.947791+0000","last_undegraded":"2024-09-12T00:51:40.947791+0000","last_fullsized":"2024-09-12T00:51:40.947791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:28.212664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'9","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.111411+0000","last_change":"2024-09-12T00:28:14.033365+0000","last_active":"2024-09-12T00:54:31.111411+0000","last_peered":"2024-09-12T00:54:31.111411+0000","last_clean":"2024-09-12T00:54:31.111411+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:54:31.111411+0000","last_undegraded":"2024-09-12T00:54:31.111411+0000","last_fullsized":"2024-09-12T00:54:31.111411+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:07.863908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21053,"num_write":14,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.937961+0000","last_change":"2024-09-12T00:26:48.584004+0000","last_active":"2024-09-12T00:52:30.937961+0000","last_peered":"2024-09-12T00:52:30.937961+0000","last_clean":"2024-09-12T00:52:30.937961+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:52:30.937961+0000","last_undegraded":"2024-09-12T00:52:30.937961+0000","last_fullsized":"2024-09-12T00:52:30.937961+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:34.947027+0000","last_change":"2024-09-12T00:39:28.127905+0000","last_active":"2024-09-12T00:52:34.947027+0000","last_peered":"2024-09-12T00:52:34.947027+0000","last_clean":"2024-09-12T00:52:34.947027+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:52:34.947027+0000","last_undegraded":"2024-09-12T00:52:34.947027+0000","last_fullsized":"2024-09-12T00:52:34.947027+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916546+0000","last_change":"2024-09-12T00:28:17.075169+0000","last_active":"2024-09-12T00:50:50.916546+0000","last_peered":"2024-09-12T00:50:50.916546+0000","last_clean":"2024-09-12T00:50:50.916546+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:50:50.916546+0000","last_undegraded":"2024-09-12T00:50:50.916546+0000","last_fullsized":"2024-09-12T00:50:50.916546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:26.934607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.141632+0000","last_change":"2024-09-12T00:28:14.015676+0000","last_active":"2024-09-12T00:53:01.141632+0000","last_peered":"2024-09-12T00:53:01.141632+0000","last_clean":"2024-09-12T00:53:01.141632+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:53:01.141632+0000","last_undegraded":"2024-09-12T00:53:01.141632+0000","last_fullsized":"2024-09-12T00:53:01.141632+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:44:53.120779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.927494+0000","last_change":"2024-09-12T00:26:48.573048+0000","last_active":"2024-09-12T00:51:40.927494+0000","last_peered":"2024-09-12T00:51:40.927494+0000","last_clean":"2024-09-12T00:51:40.927494+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:51:40.927494+0000","last_undegraded":"2024-09-12T00:51:40.927494+0000","last_fullsized":"2024-09-12T00:51:40.927494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:58.722904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.091062+0000","last_change":"2024-09-12T00:39:28.121616+0000","last_active":"2024-09-12T00:50:46.091062+0000","last_peered":"2024-09-12T00:50:46.091062+0000","last_clean":"2024-09-12T00:50:46.091062+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:50:46.091062+0000","last_undegraded":"2024-09-12T00:50:46.091062+0000","last_fullsized":"2024-09-12T00:50:46.091062+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:26:15.863877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916508+0000","last_change":"2024-09-12T00:28:17.074710+0000","last_active":"2024-09-12T00:50:50.916508+0000","last_peered":"2024-09-12T00:50:50.916508+0000","last_clean":"2024-09-12T00:50:50.916508+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:50:50.916508+0000","last_undegraded":"2024-09-12T00:50:50.916508+0000","last_fullsized":"2024-09-12T00:50:50.916508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:00.241439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'13","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.155718+0000","last_change":"2024-09-12T00:28:14.040584+0000","last_active":"2024-09-12T00:54:31.155718+0000","last_peered":"2024-09-12T00:54:31.155718+0000","last_clean":"2024-09-12T00:54:31.155718+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:54:31.155718+0000","last_undegraded":"2024-09-12T00:54:31.155718+0000","last_fullsized":"2024-09-12T00:54:31.155718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:08.411307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":18,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.946780+0000","last_change":"2024-09-12T00:26:48.585190+0000","last_active":"2024-09-12T00:51:35.946780+0000","last_peered":"2024-09-12T00:51:35.946780+0000","last_clean":"2024-09-12T00:51:35.946780+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:51:35.946780+0000","last_undegraded":"2024-09-12T00:51:35.946780+0000","last_fullsized":"2024-09-12T00:51:35.946780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:29.090617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.960990+0000","last_change":"2024-09-12T00:39:28.136382+0000","last_active":"2024-09-12T00:52:30.960990+0000","last_peered":"2024-09-12T00:52:30.960990+0000","last_clean":"2024-09-12T00:52:30.960990+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:52:30.960990+0000","last_undegraded":"2024-09-12T00:52:30.960990+0000","last_fullsized":"2024-09-12T00:52:30.960990+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.917696+0000","last_change":"2024-09-12T00:28:17.077942+0000","last_active":"2024-09-12T00:50:55.917696+0000","last_peered":"2024-09-12T00:50:55.917696+0000","last_clean":"2024-09-12T00:50:55.917696+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:50:55.917696+0000","last_undegraded":"2024-09-12T00:50:55.917696+0000","last_fullsized":"2024-09-12T00:50:55.917696+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:31.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.944447+0000","last_change":"2024-09-12T00:28:14.053908+0000","last_active":"2024-09-12T00:53:00.944447+0000","last_peered":"2024-09-12T00:53:00.944447+0000","last_clean":"2024-09-12T00:53:00.944447+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:53:00.944447+0000","last_undegraded":"2024-09-12T00:53:00.944447+0000","last_fullsized":"2024-09-12T00:53:00.944447+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:56.421414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":152,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104215+0000","last_change":"2024-09-12T00:26:48.567108+0000","last_active":"2024-09-12T00:51:36.104215+0000","last_peered":"2024-09-12T00:51:36.104215+0000","last_clean":"2024-09-12T00:51:36.104215+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:51:36.104215+0000","last_undegraded":"2024-09-12T00:51:36.104215+0000","last_fullsized":"2024-09-12T00:51:36.104215+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:04.721131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:31.115762+0000","last_change":"2024-09-12T00:39:28.116516+0000","last_active":"2024-09-12T00:52:31.115762+0000","last_peered":"2024-09-12T00:52:31.115762+0000","last_clean":"2024-09-12T00:52:31.115762+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:52:31.115762+0000","last_undegraded":"2024-09-12T00:52:31.115762+0000","last_fullsized":"2024-09-12T00:52:31.115762+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:49.922385+0000","last_change":"2024-09-12T00:28:17.060880+0000","last_active":"2024-09-12T00:50:49.922385+0000","last_peered":"2024-09-12T00:50:49.922385+0000","last_clean":"2024-09-12T00:50:49.922385+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:50:49.922385+0000","last_undegraded":"2024-09-12T00:50:49.922385+0000","last_fullsized":"2024-09-12T00:50:49.922385+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:02.004120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.183295+0000","last_change":"2024-09-12T00:28:14.053133+0000","last_active":"2024-09-12T00:54:31.183295+0000","last_peered":"2024-09-12T00:54:31.183295+0000","last_clean":"2024-09-12T00:54:31.183295+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:54:31.183295+0000","last_undegraded":"2024-09-12T00:54:31.183295+0000","last_fullsized":"2024-09-12T00:54:31.183295+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:54:48.456675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":111,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922780+0000","last_change":"2024-09-12T00:26:48.590043+0000","last_active":"2024-09-12T00:51:35.922780+0000","last_peered":"2024-09-12T00:51:35.922780+0000","last_clean":"2024-09-12T00:51:35.922780+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:51:35.922780+0000","last_undegraded":"2024-09-12T00:51:35.922780+0000","last_fullsized":"2024-09-12T00:51:35.922780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:33:36.146720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921176+0000","last_change":"2024-09-12T00:39:28.133468+0000","last_active":"2024-09-12T00:50:44.921176+0000","last_peered":"2024-09-12T00:50:44.921176+0000","last_clean":"2024-09-12T00:50:44.921176+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:50:44.921176+0000","last_undegraded":"2024-09-12T00:50:44.921176+0000","last_fullsized":"2024-09-12T00:50:44.921176+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:54:13.124886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'2","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:20.982962+0000","last_change":"2024-09-12T00:28:17.078262+0000","last_active":"2024-09-12T00:54:20.982962+0000","last_peered":"2024-09-12T00:54:20.982962+0000","last_clean":"2024-09-12T00:54:20.982962+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:54:20.982962+0000","last_undegraded":"2024-09-12T00:54:20.982962+0000","last_fullsized":"2024-09-12T00:54:20.982962+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:56.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932572+0000","last_change":"2024-09-12T00:28:14.039832+0000","last_active":"2024-09-12T00:52:05.932572+0000","last_peered":"2024-09-12T00:52:05.932572+0000","last_clean":"2024-09-12T00:52:05.932572+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:52:05.932572+0000","last_undegraded":"2024-09-12T00:52:05.932572+0000","last_fullsized":"2024-09-12T00:52:05.932572+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:53.914782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":86,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922721+0000","last_change":"2024-09-12T00:26:48.586236+0000","last_active":"2024-09-12T00:51:35.922721+0000","last_peered":"2024-09-12T00:51:35.922721+0000","last_clean":"2024-09-12T00:51:35.922721+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:51:35.922721+0000","last_undegraded":"2024-09-12T00:51:35.922721+0000","last_fullsized":"2024-09-12T00:51:35.922721+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:30:36.773801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113170+0000","last_change":"2024-09-12T00:39:28.126995+0000","last_active":"2024-09-12T00:50:51.113170+0000","last_peered":"2024-09-12T00:50:51.113170+0000","last_clean":"2024-09-12T00:50:51.113170+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:50:51.113170+0000","last_undegraded":"2024-09-12T00:50:51.113170+0000","last_fullsized":"2024-09-12T00:50:51.113170+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.631391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'8","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.520205+0000","last_change":"2024-09-12T00:28:17.067864+0000","last_active":"2024-09-12T00:54:31.520205+0000","last_peered":"2024-09-12T00:54:31.520205+0000","last_clean":"2024-09-12T00:54:31.520205+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:54:31.520205+0000","last_undegraded":"2024-09-12T00:54:31.520205+0000","last_fullsized":"2024-09-12T00:54:31.520205+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:01:00.110223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.154401+0000","last_change":"2024-09-12T00:28:14.042940+0000","last_active":"2024-09-12T00:54:31.154401+0000","last_peered":"2024-09-12T00:54:31.154401+0000","last_clean":"2024-09-12T00:54:31.154401+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:54:31.154401+0000","last_undegraded":"2024-09-12T00:54:31.154401+0000","last_fullsized":"2024-09-12T00:54:31.154401+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:51.011440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:46.111675+0000","last_change":"2024-09-12T00:26:48.568729+0000","last_active":"2024-09-12T00:50:46.111675+0000","last_peered":"2024-09-12T00:50:46.111675+0000","last_clean":"2024-09-12T00:50:46.111675+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:50:46.111675+0000","last_undegraded":"2024-09-12T00:50:46.111675+0000","last_fullsized":"2024-09-12T00:50:46.111675+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:40.684248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.917549+0000","last_change":"2024-09-12T00:39:28.130189+0000","last_active":"2024-09-12T00:50:45.917549+0000","last_peered":"2024-09-12T00:50:45.917549+0000","last_clean":"2024-09-12T00:50:45.917549+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:50:45.917549+0000","last_undegraded":"2024-09-12T00:50:45.917549+0000","last_fullsized":"2024-09-12T00:50:45.917549+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:58.938677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912817+0000","last_change":"2024-09-12T00:28:17.080617+0000","last_active":"2024-09-12T00:50:50.912817+0000","last_peered":"2024-09-12T00:50:50.912817+0000","last_clean":"2024-09-12T00:50:50.912817+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:50:50.912817+0000","last_undegraded":"2024-09-12T00:50:50.912817+0000","last_fullsized":"2024-09-12T00:50:50.912817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.933670+0000","last_change":"2024-09-12T00:28:14.047276+0000","last_active":"2024-09-12T00:52:10.933670+0000","last_peered":"2024-09-12T00:52:10.933670+0000","last_clean":"2024-09-12T00:52:10.933670+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:52:10.933670+0000","last_undegraded":"2024-09-12T00:52:10.933670+0000","last_fullsized":"2024-09-12T00:52:10.933670+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:28.302616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":124,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:39.919900+0000","last_change":"2024-09-12T00:26:48.570384+0000","last_active":"2024-09-12T00:50:39.919900+0000","last_peered":"2024-09-12T00:50:39.919900+0000","last_clean":"2024-09-12T00:50:39.919900+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:50:39.919900+0000","last_undegraded":"2024-09-12T00:50:39.919900+0000","last_fullsized":"2024-09-12T00:50:39.919900+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:45:52.851801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.915515+0000","last_change":"2024-09-12T00:39:28.139264+0000","last_active":"2024-09-12T00:50:45.915515+0000","last_peered":"2024-09-12T00:50:45.915515+0000","last_clean":"2024-09-12T00:50:45.915515+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:50:45.915515+0000","last_undegraded":"2024-09-12T00:50:45.915515+0000","last_fullsized":"2024-09-12T00:50:45.915515+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:33.394535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'4","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.167069+0000","last_change":"2024-09-12T00:28:17.064501+0000","last_active":"2024-09-12T00:54:31.167069+0000","last_peered":"2024-09-12T00:54:31.167069+0000","last_clean":"2024-09-12T00:54:31.167069+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:54:31.167069+0000","last_undegraded":"2024-09-12T00:54:31.167069+0000","last_fullsized":"2024-09-12T00:54:31.167069+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:53.028265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.967593+0000","last_change":"2024-09-12T00:28:14.045720+0000","last_active":"2024-09-12T00:53:00.967593+0000","last_peered":"2024-09-12T00:53:00.967593+0000","last_clean":"2024-09-12T00:53:00.967593+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:53:00.967593+0000","last_undegraded":"2024-09-12T00:53:00.967593+0000","last_fullsized":"2024-09-12T00:53:00.967593+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:44:24.935181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":73,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.916225+0000","last_change":"2024-09-12T00:26:48.572885+0000","last_active":"2024-09-12T00:50:40.916225+0000","last_peered":"2024-09-12T00:50:40.916225+0000","last_clean":"2024-09-12T00:50:40.916225+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:50:40.916225+0000","last_undegraded":"2024-09-12T00:50:40.916225+0000","last_fullsized":"2024-09-12T00:50:40.916225+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:04:04.826880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934275+0000","last_change":"2024-09-12T00:39:28.125866+0000","last_active":"2024-09-12T00:52:00.934275+0000","last_peered":"2024-09-12T00:52:00.934275+0000","last_clean":"2024-09-12T00:52:00.934275+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:52:00.934275+0000","last_undegraded":"2024-09-12T00:52:00.934275+0000","last_fullsized":"2024-09-12T00:52:00.934275+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:03.504703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:19.929554+0000","last_change":"2024-09-12T00:28:17.054632+0000","last_active":"2024-09-12T00:51:19.929554+0000","last_peered":"2024-09-12T00:51:19.929554+0000","last_clean":"2024-09-12T00:51:19.929554+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:51:19.929554+0000","last_undegraded":"2024-09-12T00:51:19.929554+0000","last_fullsized":"2024-09-12T00:51:19.929554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:40.665178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'7","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.970906+0000","last_change":"2024-09-12T00:28:14.035922+0000","last_active":"2024-09-12T00:53:15.970906+0000","last_peered":"2024-09-12T00:53:15.970906+0000","last_clean":"2024-09-12T00:53:15.970906+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:53:15.970906+0000","last_undegraded":"2024-09-12T00:53:15.970906+0000","last_fullsized":"2024-09-12T00:53:15.970906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:49.298722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":154,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:16.959193+0000","last_change":"2024-09-12T00:26:48.586797+0000","last_active":"2024-09-12T00:51:16.959193+0000","last_peered":"2024-09-12T00:51:16.959193+0000","last_clean":"2024-09-12T00:51:16.959193+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:51:16.959193+0000","last_undegraded":"2024-09-12T00:51:16.959193+0000","last_fullsized":"2024-09-12T00:51:16.959193+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:53:20.109038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.934301+0000","last_change":"2024-09-12T00:39:28.120562+0000","last_active":"2024-09-12T00:52:00.934301+0000","last_peered":"2024-09-12T00:52:00.934301+0000","last_clean":"2024-09-12T00:52:00.934301+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:52:00.934301+0000","last_undegraded":"2024-09-12T00:52:00.934301+0000","last_fullsized":"2024-09-12T00:52:00.934301+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:43:08.131360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928367+0000","last_change":"2024-09-12T00:28:17.068535+0000","last_active":"2024-09-12T00:51:14.928367+0000","last_peered":"2024-09-12T00:51:14.928367+0000","last_clean":"2024-09-12T00:51:14.928367+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:51:14.928367+0000","last_undegraded":"2024-09-12T00:51:14.928367+0000","last_fullsized":"2024-09-12T00:51:14.928367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.915337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:20.950508+0000","last_change":"2024-09-12T00:28:14.046616+0000","last_active":"2024-09-12T00:53:20.950508+0000","last_peered":"2024-09-12T00:53:20.950508+0000","last_clean":"2024-09-12T00:53:20.950508+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:53:20.950508+0000","last_undegraded":"2024-09-12T00:53:20.950508+0000","last_fullsized":"2024-09-12T00:53:20.950508+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.933281+0000","last_change":"2024-09-12T00:26:48.580888+0000","last_active":"2024-09-12T00:50:40.933281+0000","last_peered":"2024-09-12T00:50:40.933281+0000","last_clean":"2024-09-12T00:50:40.933281+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:50:40.933281+0000","last_undegraded":"2024-09-12T00:50:40.933281+0000","last_fullsized":"2024-09-12T00:50:40.933281+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:20.695674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.932994+0000","last_change":"2024-09-12T00:39:28.111443+0000","last_active":"2024-09-12T00:51:34.932994+0000","last_peered":"2024-09-12T00:51:34.932994+0000","last_clean":"2024-09-12T00:51:34.932994+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:51:34.932994+0000","last_undegraded":"2024-09-12T00:51:34.932994+0000","last_fullsized":"2024-09-12T00:51:34.932994+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:45.919919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'12","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.539513+0000","last_change":"2024-09-12T00:28:17.064371+0000","last_active":"2024-09-12T00:54:31.539513+0000","last_peered":"2024-09-12T00:54:31.539513+0000","last_clean":"2024-09-12T00:54:31.539513+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:54:31.539513+0000","last_undegraded":"2024-09-12T00:54:31.539513+0000","last_fullsized":"2024-09-12T00:54:31.539513+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:33.177694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":22,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:06.130194+0000","last_change":"2024-09-12T00:28:14.038263+0000","last_active":"2024-09-12T00:52:06.130194+0000","last_peered":"2024-09-12T00:52:06.130194+0000","last_clean":"2024-09-12T00:52:06.130194+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:52:06.130194+0000","last_undegraded":"2024-09-12T00:52:06.130194+0000","last_fullsized":"2024-09-12T00:52:06.130194+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:56:11.087385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":131,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.931038+0000","last_change":"2024-09-12T00:26:48.578925+0000","last_active":"2024-09-12T00:51:56.931038+0000","last_peered":"2024-09-12T00:51:56.931038+0000","last_clean":"2024-09-12T00:51:56.931038+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:51:56.931038+0000","last_undegraded":"2024-09-12T00:51:56.931038+0000","last_fullsized":"2024-09-12T00:51:56.931038+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:28.812698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.952894+0000","last_change":"2024-09-12T00:39:28.134519+0000","last_active":"2024-09-12T00:52:00.952894+0000","last_peered":"2024-09-12T00:52:00.952894+0000","last_clean":"2024-09-12T00:52:00.952894+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:52:00.952894+0000","last_undegraded":"2024-09-12T00:52:00.952894+0000","last_fullsized":"2024-09-12T00:52:00.952894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.950649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955943+0000","last_change":"2024-09-12T00:28:17.073665+0000","last_active":"2024-09-12T00:52:10.955943+0000","last_peered":"2024-09-12T00:52:10.955943+0000","last_clean":"2024-09-12T00:52:10.955943+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:52:10.955943+0000","last_undegraded":"2024-09-12T00:52:10.955943+0000","last_fullsized":"2024-09-12T00:52:10.955943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.110456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'6","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.981931+0000","last_change":"2024-09-12T00:28:14.044717+0000","last_active":"2024-09-12T00:54:15.981931+0000","last_peered":"2024-09-12T00:54:15.981931+0000","last_clean":"2024-09-12T00:54:15.981931+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:54:15.981931+0000","last_undegraded":"2024-09-12T00:54:15.981931+0000","last_fullsized":"2024-09-12T00:54:15.981931+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:17.236547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":155,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.929500+0000","last_change":"2024-09-12T00:26:48.578631+0000","last_active":"2024-09-12T00:51:50.929500+0000","last_peered":"2024-09-12T00:51:50.929500+0000","last_clean":"2024-09-12T00:51:50.929500+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:51:50.929500+0000","last_undegraded":"2024-09-12T00:51:50.929500+0000","last_fullsized":"2024-09-12T00:51:50.929500+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:02.001351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":21,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.938145+0000","last_change":"2024-09-12T00:39:28.145050+0000","last_active":"2024-09-12T00:52:30.938145+0000","last_peered":"2024-09-12T00:52:30.938145+0000","last_clean":"2024-09-12T00:52:30.938145+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:52:30.938145+0000","last_undegraded":"2024-09-12T00:52:30.938145+0000","last_fullsized":"2024-09-12T00:52:30.938145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:20.950384+0000","last_change":"2024-09-12T00:28:17.061641+0000","last_active":"2024-09-12T00:53:20.950384+0000","last_peered":"2024-09-12T00:53:20.950384+0000","last_clean":"2024-09-12T00:53:20.950384+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:53:20.950384+0000","last_undegraded":"2024-09-12T00:53:20.950384+0000","last_fullsized":"2024-09-12T00:53:20.950384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:36.317632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:21.158440+0000","last_change":"2024-09-12T00:28:14.038655+0000","last_active":"2024-09-12T00:54:21.158440+0000","last_peered":"2024-09-12T00:54:21.158440+0000","last_clean":"2024-09-12T00:54:21.158440+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:54:21.158440+0000","last_undegraded":"2024-09-12T00:54:21.158440+0000","last_fullsized":"2024-09-12T00:54:21.158440+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:26:19.550915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":107,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:51.126487+0000","last_change":"2024-09-12T00:26:48.570084+0000","last_active":"2024-09-12T00:51:51.126487+0000","last_peered":"2024-09-12T00:51:51.126487+0000","last_clean":"2024-09-12T00:51:51.126487+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:51:51.126487+0000","last_undegraded":"2024-09-12T00:51:51.126487+0000","last_fullsized":"2024-09-12T00:51:51.126487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:35.533768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.939816+0000","last_change":"2024-09-12T00:39:28.134280+0000","last_active":"2024-09-12T00:52:30.939816+0000","last_peered":"2024-09-12T00:52:30.939816+0000","last_clean":"2024-09-12T00:52:30.939816+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:52:30.939816+0000","last_undegraded":"2024-09-12T00:52:30.939816+0000","last_fullsized":"2024-09-12T00:52:30.939816+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'7","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:25.984189+0000","last_change":"2024-09-12T00:28:17.078304+0000","last_active":"2024-09-12T00:54:25.984189+0000","last_peered":"2024-09-12T00:54:25.984189+0000","last_clean":"2024-09-12T00:54:25.984189+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:54:25.984189+0000","last_undegraded":"2024-09-12T00:54:25.984189+0000","last_fullsized":"2024-09-12T00:54:25.984189+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.775329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.970680+0000","last_change":"2024-09-12T00:28:14.051795+0000","last_active":"2024-09-12T00:53:15.970680+0000","last_peered":"2024-09-12T00:53:15.970680+0000","last_clean":"2024-09-12T00:53:15.970680+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:53:15.970680+0000","last_undegraded":"2024-09-12T00:53:15.970680+0000","last_fullsized":"2024-09-12T00:53:15.970680+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950431+0000","last_change":"2024-09-12T00:26:48.572457+0000","last_active":"2024-09-12T00:51:50.950431+0000","last_peered":"2024-09-12T00:51:50.950431+0000","last_clean":"2024-09-12T00:51:50.950431+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:51:50.950431+0000","last_undegraded":"2024-09-12T00:51:50.950431+0000","last_fullsized":"2024-09-12T00:51:50.950431+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:54.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.938985+0000","last_change":"2024-09-12T00:39:28.125155+0000","last_active":"2024-09-12T00:51:59.938985+0000","last_peered":"2024-09-12T00:51:59.938985+0000","last_clean":"2024-09-12T00:51:59.938985+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:51:59.938985+0000","last_undegraded":"2024-09-12T00:51:59.938985+0000","last_fullsized":"2024-09-12T00:51:59.938985+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:43.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:21.145839+0000","last_change":"2024-09-12T00:28:17.074251+0000","last_active":"2024-09-12T00:53:21.145839+0000","last_peered":"2024-09-12T00:53:21.145839+0000","last_clean":"2024-09-12T00:53:21.145839+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:53:21.145839+0000","last_undegraded":"2024-09-12T00:53:21.145839+0000","last_fullsized":"2024-09-12T00:53:21.145839+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:14:25.385818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'19","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.944706+0000","last_change":"2024-09-12T00:28:14.035208+0000","last_active":"2024-09-12T00:53:15.944706+0000","last_peered":"2024-09-12T00:53:15.944706+0000","last_clean":"2024-09-12T00:53:15.944706+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:53:15.944706+0000","last_undegraded":"2024-09-12T00:53:15.944706+0000","last_fullsized":"2024-09-12T00:53:15.944706+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:19.116394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":30726,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950319+0000","last_change":"2024-09-12T00:26:48.568293+0000","last_active":"2024-09-12T00:51:50.950319+0000","last_peered":"2024-09-12T00:51:50.950319+0000","last_clean":"2024-09-12T00:51:50.950319+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:51:50.950319+0000","last_undegraded":"2024-09-12T00:51:50.950319+0000","last_fullsized":"2024-09-12T00:51:50.950319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:56.992825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954372+0000","last_change":"2024-09-12T00:39:28.135750+0000","last_active":"2024-09-12T00:52:05.954372+0000","last_peered":"2024-09-12T00:52:05.954372+0000","last_clean":"2024-09-12T00:52:05.954372+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:52:05.954372+0000","last_undegraded":"2024-09-12T00:52:05.954372+0000","last_fullsized":"2024-09-12T00:52:05.954372+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.659110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.538152+0000","last_change":"2024-09-12T00:28:17.067509+0000","last_active":"2024-09-12T00:54:31.538152+0000","last_peered":"2024-09-12T00:54:31.538152+0000","last_clean":"2024-09-12T00:54:31.538152+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:54:31.538152+0000","last_undegraded":"2024-09-12T00:54:31.538152+0000","last_fullsized":"2024-09-12T00:54:31.538152+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:22.107215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'5","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:16.124939+0000","last_change":"2024-09-12T00:28:14.047213+0000","last_active":"2024-09-12T00:53:16.124939+0000","last_peered":"2024-09-12T00:53:16.124939+0000","last_clean":"2024-09-12T00:53:16.124939+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:53:16.124939+0000","last_undegraded":"2024-09-12T00:53:16.124939+0000","last_fullsized":"2024-09-12T00:53:16.124939+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:39.487908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":69,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.140498+0000","last_change":"2024-09-12T00:26:48.572978+0000","last_active":"2024-09-12T00:52:56.140498+0000","last_peered":"2024-09-12T00:52:56.140498+0000","last_clean":"2024-09-12T00:52:56.140498+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:52:56.140498+0000","last_undegraded":"2024-09-12T00:52:56.140498+0000","last_fullsized":"2024-09-12T00:52:56.140498+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'262","reported_seq":914,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.990766+0000","last_change":"2024-09-12T00:54:44.990766+0000","last_active":"2024-09-12T00:54:44.990766+0000","last_peered":"2024-09-12T00:54:44.990766+0000","last_clean":"2024-09-12T00:54:44.990766+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:54:44.990766+0000","last_undegraded":"2024-09-12T00:54:44.990766+0000","last_fullsized":"2024-09-12T00:54:44.990766+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.990558+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:14.960131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":2922,"num_write":1055,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1208","reported_seq":2907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.457851+0000","last_change":"2024-09-12T00:54:49.457851+0000","last_active":"2024-09-12T00:54:49.457851+0000","last_peered":"2024-09-12T00:54:49.457851+0000","last_clean":"2024-09-12T00:54:49.457851+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:49.457851+0000","last_undegraded":"2024-09-12T00:54:49.457851+0000","last_fullsized":"2024-09-12T00:54:49.457851+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1208","last_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_deep_scrub":"266'1208","last_deep_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.457644+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:17.683296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'226","reported_seq":865,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.565409+0000","last_change":"2024-09-12T00:54:49.565409+0000","last_active":"2024-09-12T00:54:49.565409+0000","last_peered":"2024-09-12T00:54:49.565409+0000","last_clean":"2024-09-12T00:54:49.565409+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:54:49.565409+0000","last_undegraded":"2024-09-12T00:54:49.565409+0000","last_fullsized":"2024-09-12T00:54:49.565409+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.565191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:46.709139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":8607,"num_write":1041,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'455","reported_seq":2037,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:57.541162+0000","last_change":"2024-09-12T00:11:47.930458+0000","last_active":"2024-09-12T00:52:57.541162+0000","last_peered":"2024-09-12T00:52:57.541162+0000","last_clean":"2024-09-12T00:52:57.541162+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:52:57.541162+0000","last_undegraded":"2024-09-12T00:52:57.541162+0000","last_fullsized":"2024-09-12T00:52:57.541162+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":400,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:38:27.070919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'205","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.572828+0000","last_change":"2024-09-12T00:54:47.572828+0000","last_active":"2024-09-12T00:54:47.572828+0000","last_peered":"2024-09-12T00:54:47.572828+0000","last_clean":"2024-09-12T00:54:47.572828+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:54:47.572828+0000","last_undegraded":"2024-09-12T00:54:47.572828+0000","last_fullsized":"2024-09-12T00:54:47.572828+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.572612+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:38.077210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":9703,"num_write":942,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'469","reported_seq":2018,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.750311+0000","last_change":"2024-09-12T00:11:47.929458+0000","last_active":"2024-09-12T00:53:13.750311+0000","last_peered":"2024-09-12T00:53:13.750311+0000","last_clean":"2024-09-12T00:53:13.750311+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:53:13.750311+0000","last_undegraded":"2024-09-12T00:53:13.750311+0000","last_fullsized":"2024-09-12T00:53:13.750311+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":400,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:05:37.545862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'172","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.805793+0000","last_change":"2024-09-12T00:54:42.805793+0000","last_active":"2024-09-12T00:54:42.805793+0000","last_peered":"2024-09-12T00:54:42.805793+0000","last_clean":"2024-09-12T00:54:42.805793+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:54:42.805793+0000","last_undegraded":"2024-09-12T00:54:42.805793+0000","last_fullsized":"2024-09-12T00:54:42.805793+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'172","last_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_deep_scrub":"266'172","last_deep_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.805574+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:52.082618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3723389,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":16186,"num_write":899,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'824","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.771399+0000","last_change":"2024-09-12T00:54:52.771399+0000","last_active":"2024-09-12T00:54:52.771399+0000","last_peered":"2024-09-12T00:54:52.771399+0000","last_clean":"2024-09-12T00:54:52.771399+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:54:52.771399+0000","last_undegraded":"2024-09-12T00:54:52.771399+0000","last_fullsized":"2024-09-12T00:54:52.771399+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'824","last_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_deep_scrub":"266'824","last_deep_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.771212+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:46.148911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'190","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.992323+0000","last_change":"2024-09-12T00:54:43.992323+0000","last_active":"2024-09-12T00:54:43.992323+0000","last_peered":"2024-09-12T00:54:43.992323+0000","last_clean":"2024-09-12T00:54:43.992323+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:54:43.992323+0000","last_undegraded":"2024-09-12T00:54:43.992323+0000","last_fullsized":"2024-09-12T00:54:43.992323+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.991947+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:36.462643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569693,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":16314,"num_write":910,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'801","reported_seq":2293,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.039117+0000","last_change":"2024-09-12T00:54:48.039117+0000","last_active":"2024-09-12T00:54:48.039117+0000","last_peered":"2024-09-12T00:54:48.039117+0000","last_clean":"2024-09-12T00:54:48.039117+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:54:48.039117+0000","last_undegraded":"2024-09-12T00:54:48.039117+0000","last_fullsized":"2024-09-12T00:54:48.039117+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.038929+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:45.582305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'177","reported_seq":787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.699958+0000","last_change":"2024-09-12T00:54:39.699958+0000","last_active":"2024-09-12T00:54:39.699958+0000","last_peered":"2024-09-12T00:54:39.699958+0000","last_clean":"2024-09-12T00:54:39.699958+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:39.699958+0000","last_undegraded":"2024-09-12T00:54:39.699958+0000","last_fullsized":"2024-09-12T00:54:39.699958+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.699741+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.796747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":30215,"num_write":846,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'392","reported_seq":1915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.962955+0000","last_change":"2024-09-12T00:54:55.962955+0000","last_active":"2024-09-12T00:54:55.962955+0000","last_peered":"2024-09-12T00:54:55.962955+0000","last_clean":"2024-09-12T00:54:55.962955+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:54:55.962955+0000","last_undegraded":"2024-09-12T00:54:55.962955+0000","last_fullsized":"2024-09-12T00:54:55.962955+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.962710+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:54.934059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'229","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.012358+0000","last_change":"2024-09-12T00:54:40.012358+0000","last_active":"2024-09-12T00:54:40.012358+0000","last_peered":"2024-09-12T00:54:40.012358+0000","last_clean":"2024-09-12T00:54:40.012358+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:54:40.012358+0000","last_undegraded":"2024-09-12T00:54:40.012358+0000","last_fullsized":"2024-09-12T00:54:40.012358+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.012124+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:25.409967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924437,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":17813,"num_write":1032,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'991","reported_seq":2517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.695069+0000","last_change":"2024-09-12T00:54:48.695069+0000","last_active":"2024-09-12T00:54:48.695069+0000","last_peered":"2024-09-12T00:54:48.695069+0000","last_clean":"2024-09-12T00:54:48.695069+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:54:48.695069+0000","last_undegraded":"2024-09-12T00:54:48.695069+0000","last_fullsized":"2024-09-12T00:54:48.695069+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'991","last_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_deep_scrub":"266'991","last_deep_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.694882+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":900,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:30.875835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'182","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.568654+0000","last_change":"2024-09-12T00:54:48.568654+0000","last_active":"2024-09-12T00:54:48.568654+0000","last_peered":"2024-09-12T00:54:48.568654+0000","last_clean":"2024-09-12T00:54:48.568654+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:54:48.568654+0000","last_undegraded":"2024-09-12T00:54:48.568654+0000","last_fullsized":"2024-09-12T00:54:48.568654+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.568387+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:29.536238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":351,"num_read_kb":20841,"num_write":801,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2401,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.749106+0000","last_change":"2024-09-12T00:11:47.945525+0000","last_active":"2024-09-12T00:53:13.749106+0000","last_peered":"2024-09-12T00:53:13.749106+0000","last_clean":"2024-09-12T00:53:13.749106+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:53:13.749106+0000","last_undegraded":"2024-09-12T00:53:13.749106+0000","last_fullsized":"2024-09-12T00:53:13.749106+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:16.688767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'810","reported_seq":2356,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.198693+0000","last_change":"2024-09-12T00:11:47.933883+0000","last_active":"2024-09-12T00:54:17.198693+0000","last_peered":"2024-09-12T00:54:17.198693+0000","last_clean":"2024-09-12T00:54:17.198693+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:17.198693+0000","last_undegraded":"2024-09-12T00:54:17.198693+0000","last_fullsized":"2024-09-12T00:54:17.198693+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":700,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:41:49.403220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'281","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.282873+0000","last_change":"2024-09-12T00:54:40.282873+0000","last_active":"2024-09-12T00:54:40.282873+0000","last_peered":"2024-09-12T00:54:40.282873+0000","last_clean":"2024-09-12T00:54:40.282873+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:54:40.282873+0000","last_undegraded":"2024-09-12T00:54:40.282873+0000","last_fullsized":"2024-09-12T00:54:40.282873+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'281","last_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_deep_scrub":"266'281","last_deep_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.282649+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:52.630575+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351099,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":931,"num_read_kb":25081,"num_write":1230,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2594,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.064930+0000","last_change":"2024-09-12T00:54:47.064930+0000","last_active":"2024-09-12T00:54:47.064930+0000","last_peered":"2024-09-12T00:54:47.064930+0000","last_clean":"2024-09-12T00:54:47.064930+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:47.064930+0000","last_undegraded":"2024-09-12T00:54:47.064930+0000","last_fullsized":"2024-09-12T00:54:47.064930+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1096","last_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_deep_scrub":"266'1096","last_deep_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.064751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:16.284275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'183","reported_seq":813,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.027152+0000","last_change":"2024-09-12T00:54:41.027152+0000","last_active":"2024-09-12T00:54:41.027152+0000","last_peered":"2024-09-12T00:54:41.027152+0000","last_clean":"2024-09-12T00:54:41.027152+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:41.027152+0000","last_undegraded":"2024-09-12T00:54:41.027152+0000","last_fullsized":"2024-09-12T00:54:41.027152+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.026921+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:42.983840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":23009,"num_write":868,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'442","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.423768+0000","last_change":"2024-09-12T00:54:45.423768+0000","last_active":"2024-09-12T00:54:45.423768+0000","last_peered":"2024-09-12T00:54:45.423768+0000","last_clean":"2024-09-12T00:54:45.423768+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:45.423768+0000","last_undegraded":"2024-09-12T00:54:45.423768+0000","last_fullsized":"2024-09-12T00:54:45.423768+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'442","last_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_deep_scrub":"266'442","last_deep_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.423598+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:38.014555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'192","reported_seq":822,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.994046+0000","last_change":"2024-09-12T00:54:41.994046+0000","last_active":"2024-09-12T00:54:41.994046+0000","last_peered":"2024-09-12T00:54:41.994046+0000","last_clean":"2024-09-12T00:54:41.994046+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:54:41.994046+0000","last_undegraded":"2024-09-12T00:54:41.994046+0000","last_fullsized":"2024-09-12T00:54:41.994046+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'192","last_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_deep_scrub":"266'192","last_deep_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.993748+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:48.875430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129095,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":15824,"num_write":919,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'555","reported_seq":2163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.584583+0000","last_change":"2024-09-12T00:54:51.584583+0000","last_active":"2024-09-12T00:54:51.584583+0000","last_peered":"2024-09-12T00:54:51.584583+0000","last_clean":"2024-09-12T00:54:51.584583+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:54:51.584583+0000","last_undegraded":"2024-09-12T00:54:51.584583+0000","last_fullsized":"2024-09-12T00:54:51.584583+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'555","last_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_deep_scrub":"266'555","last_deep_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.584300+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:27.384007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":877,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'211","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.978773+0000","last_change":"2024-09-12T00:54:42.978773+0000","last_active":"2024-09-12T00:54:42.978773+0000","last_peered":"2024-09-12T00:54:42.978773+0000","last_clean":"2024-09-12T00:54:42.978773+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:54:42.978773+0000","last_undegraded":"2024-09-12T00:54:42.978773+0000","last_fullsized":"2024-09-12T00:54:42.978773+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.978525+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:06.511163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924468,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":26404,"num_write":991,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'628","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.967393+0000","last_change":"2024-09-12T00:11:47.924685+0000","last_active":"2024-09-12T00:53:01.967393+0000","last_peered":"2024-09-12T00:53:01.967393+0000","last_clean":"2024-09-12T00:53:01.967393+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:53:01.967393+0000","last_undegraded":"2024-09-12T00:53:01.967393+0000","last_fullsized":"2024-09-12T00:53:01.967393+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":600,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:06.368642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'186","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.583757+0000","last_change":"2024-09-12T00:54:44.583757+0000","last_active":"2024-09-12T00:54:44.583757+0000","last_peered":"2024-09-12T00:54:44.583757+0000","last_clean":"2024-09-12T00:54:44.583757+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:54:44.583757+0000","last_undegraded":"2024-09-12T00:54:44.583757+0000","last_fullsized":"2024-09-12T00:54:44.583757+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.583505+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:41.416586+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":395,"num_read_kb":19556,"num_write":891,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1216","reported_seq":2920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.381975+0000","last_change":"2024-09-12T00:54:46.381975+0000","last_active":"2024-09-12T00:54:46.381975+0000","last_peered":"2024-09-12T00:54:46.381975+0000","last_clean":"2024-09-12T00:54:46.381975+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:46.381975+0000","last_undegraded":"2024-09-12T00:54:46.381975+0000","last_fullsized":"2024-09-12T00:54:46.381975+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1216","last_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_deep_scrub":"266'1216","last_deep_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.381745+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:02.347559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2038,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'206","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.526531+0000","last_change":"2024-09-12T00:54:43.526531+0000","last_active":"2024-09-12T00:54:43.526531+0000","last_peered":"2024-09-12T00:54:43.526531+0000","last_clean":"2024-09-12T00:54:43.526531+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:43.526531+0000","last_undegraded":"2024-09-12T00:54:43.526531+0000","last_fullsized":"2024-09-12T00:54:43.526531+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.526312+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:10.785471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":13603,"num_write":999,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'158","reported_seq":655,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.440855+0000","last_change":"2024-09-12T00:11:55.962848+0000","last_active":"2024-09-12T00:53:14.440855+0000","last_peered":"2024-09-12T00:53:14.440855+0000","last_clean":"2024-09-12T00:53:14.440855+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:53:14.440855+0000","last_undegraded":"2024-09-12T00:53:14.440855+0000","last_fullsized":"2024-09-12T00:53:14.440855+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":100,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:04.549126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'432","reported_seq":1957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.583276+0000","last_change":"2024-09-12T00:54:49.583276+0000","last_active":"2024-09-12T00:54:49.583276+0000","last_peered":"2024-09-12T00:54:49.583276+0000","last_clean":"2024-09-12T00:54:49.583276+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:54:49.583276+0000","last_undegraded":"2024-09-12T00:54:49.583276+0000","last_fullsized":"2024-09-12T00:54:49.583276+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'432","last_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_deep_scrub":"266'432","last_deep_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.583097+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:25.325862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'200","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.527392+0000","last_change":"2024-09-12T00:54:39.527392+0000","last_active":"2024-09-12T00:54:39.527392+0000","last_peered":"2024-09-12T00:54:39.527392+0000","last_clean":"2024-09-12T00:54:39.527392+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:54:39.527392+0000","last_undegraded":"2024-09-12T00:54:39.527392+0000","last_fullsized":"2024-09-12T00:54:39.527392+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.527188+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.380120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1954,"num_write":1014,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930718+0000","last_change":"2024-09-12T00:11:49.940927+0000","last_active":"2024-09-12T00:50:30.930718+0000","last_peered":"2024-09-12T00:50:30.930718+0000","last_clean":"2024-09-12T00:50:30.930718+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:50:30.930718+0000","last_undegraded":"2024-09-12T00:50:30.930718+0000","last_fullsized":"2024-09-12T00:50:30.930718+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:54.486050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'200","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.386046+0000","last_change":"2024-09-12T00:11:51.947651+0000","last_active":"2024-09-12T00:54:31.386046+0000","last_peered":"2024-09-12T00:54:31.386046+0000","last_clean":"2024-09-12T00:54:31.386046+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:54:31.386046+0000","last_undegraded":"2024-09-12T00:54:31.386046+0000","last_fullsized":"2024-09-12T00:54:31.386046+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:29.585593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":272,"num_read_kb":332,"num_write":160,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089124+0000","last_change":"2024-09-12T00:11:53.948633+0000","last_active":"2024-09-12T00:50:36.089124+0000","last_peered":"2024-09-12T00:50:36.089124+0000","last_clean":"2024-09-12T00:50:36.089124+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:50:36.089124+0000","last_undegraded":"2024-09-12T00:50:36.089124+0000","last_fullsized":"2024-09-12T00:50:36.089124+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:50:09.362747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2472","reported_seq":4364,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.220805+0000","last_change":"2024-09-12T00:11:55.974612+0000","last_active":"2024-09-12T00:53:59.220805+0000","last_peered":"2024-09-12T00:53:59.220805+0000","last_clean":"2024-09-12T00:53:59.220805+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:53:59.220805+0000","last_undegraded":"2024-09-12T00:53:59.220805+0000","last_fullsized":"2024-09-12T00:53:59.220805+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":2400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:52:50.591689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'466","reported_seq":1922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.189586+0000","last_change":"2024-09-12T00:54:55.189586+0000","last_active":"2024-09-12T00:54:55.189586+0000","last_peered":"2024-09-12T00:54:55.189586+0000","last_clean":"2024-09-12T00:54:55.189586+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:55.189586+0000","last_undegraded":"2024-09-12T00:54:55.189586+0000","last_fullsized":"2024-09-12T00:54:55.189586+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'466","last_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_deep_scrub":"266'466","last_deep_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.189400+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.744860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'244","reported_seq":940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.557769+0000","last_change":"2024-09-12T00:54:37.557769+0000","last_active":"2024-09-12T00:54:37.557769+0000","last_peered":"2024-09-12T00:54:37.557769+0000","last_clean":"2024-09-12T00:54:37.557769+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:54:37.557769+0000","last_undegraded":"2024-09-12T00:54:37.557769+0000","last_fullsized":"2024-09-12T00:54:37.557769+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'244","last_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_deep_scrub":"266'244","last_deep_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.557554+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:58.369323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49242,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":71900,"num_write":1168,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.928736+0000","last_change":"2024-09-12T00:11:49.928414+0000","last_active":"2024-09-12T00:51:40.928736+0000","last_peered":"2024-09-12T00:51:40.928736+0000","last_clean":"2024-09-12T00:51:40.928736+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:51:40.928736+0000","last_undegraded":"2024-09-12T00:51:40.928736+0000","last_fullsized":"2024-09-12T00:51:40.928736+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:55:35.325652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'95","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.581870+0000","last_change":"2024-09-12T00:54:55.581870+0000","last_active":"2024-09-12T00:54:55.581870+0000","last_peered":"2024-09-12T00:54:55.581870+0000","last_clean":"2024-09-12T00:54:55.581870+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:54:55.581870+0000","last_undegraded":"2024-09-12T00:54:55.581870+0000","last_fullsized":"2024-09-12T00:54:55.581870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'95","last_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_deep_scrub":"266'95","last_deep_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.581679+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:01.848720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:36.089023+0000","last_change":"2024-09-12T00:11:53.948950+0000","last_active":"2024-09-12T00:50:36.089023+0000","last_peered":"2024-09-12T00:50:36.089023+0000","last_clean":"2024-09-12T00:50:36.089023+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:50:36.089023+0000","last_undegraded":"2024-09-12T00:50:36.089023+0000","last_fullsized":"2024-09-12T00:50:36.089023+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:49:44.328086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'155","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:56.554087+0000","last_change":"2024-09-12T00:11:55.974329+0000","last_active":"2024-09-12T00:52:56.554087+0000","last_peered":"2024-09-12T00:52:56.554087+0000","last_clean":"2024-09-12T00:52:56.554087+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:52:56.554087+0000","last_undegraded":"2024-09-12T00:52:56.554087+0000","last_fullsized":"2024-09-12T00:52:56.554087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:22.758032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'565","reported_seq":2053,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.733246+0000","last_change":"2024-09-12T00:11:47.935137+0000","last_active":"2024-09-12T00:53:13.733246+0000","last_peered":"2024-09-12T00:53:13.733246+0000","last_clean":"2024-09-12T00:53:13.733246+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:53:13.733246+0000","last_undegraded":"2024-09-12T00:53:13.733246+0000","last_fullsized":"2024-09-12T00:53:13.733246+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":500,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:43:52.622836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'235","reported_seq":875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.252201+0000","last_change":"2024-09-12T00:54:44.252201+0000","last_active":"2024-09-12T00:54:44.252201+0000","last_peered":"2024-09-12T00:54:44.252201+0000","last_clean":"2024-09-12T00:54:44.252201+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:54:44.252201+0000","last_undegraded":"2024-09-12T00:54:44.252201+0000","last_fullsized":"2024-09-12T00:54:44.252201+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.251990+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:21.780768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":11769,"num_write":1011,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.912975+0000","last_change":"2024-09-12T00:11:49.946026+0000","last_active":"2024-09-12T00:50:30.912975+0000","last_peered":"2024-09-12T00:50:30.912975+0000","last_clean":"2024-09-12T00:50:30.912975+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:50:30.912975+0000","last_undegraded":"2024-09-12T00:50:30.912975+0000","last_fullsized":"2024-09-12T00:50:30.912975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:45:31.002432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'128","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:34.133774+0000","last_change":"2024-09-12T00:11:51.952490+0000","last_active":"2024-09-12T00:52:34.133774+0000","last_peered":"2024-09-12T00:52:34.133774+0000","last_clean":"2024-09-12T00:52:34.133774+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:52:34.133774+0000","last_undegraded":"2024-09-12T00:52:34.133774+0000","last_fullsized":"2024-09-12T00:52:34.133774+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":100,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:12.676121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'779","reported_seq":2216,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.974520+0000","last_change":"2024-09-12T00:11:53.963903+0000","last_active":"2024-09-12T00:54:30.974520+0000","last_peered":"2024-09-12T00:54:30.974520+0000","last_clean":"2024-09-12T00:54:30.974520+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:54:30.974520+0000","last_undegraded":"2024-09-12T00:54:30.974520+0000","last_fullsized":"2024-09-12T00:54:30.974520+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":700,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:11.131097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'218","reported_seq":1048,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.508260+0000","last_change":"2024-09-12T00:11:55.967351+0000","last_active":"2024-09-12T00:53:14.508260+0000","last_peered":"2024-09-12T00:53:14.508260+0000","last_clean":"2024-09-12T00:53:14.508260+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:53:14.508260+0000","last_undegraded":"2024-09-12T00:53:14.508260+0000","last_fullsized":"2024-09-12T00:53:14.508260+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:25:31.864573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'341","reported_seq":1787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.481419+0000","last_change":"2024-09-12T00:54:52.481419+0000","last_active":"2024-09-12T00:54:52.481419+0000","last_peered":"2024-09-12T00:54:52.481419+0000","last_clean":"2024-09-12T00:54:52.481419+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:54:52.481419+0000","last_undegraded":"2024-09-12T00:54:52.481419+0000","last_fullsized":"2024-09-12T00:54:52.481419+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'341","last_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_deep_scrub":"266'341","last_deep_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.481235+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.223578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'204","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.252728+0000","last_change":"2024-09-12T00:54:36.252728+0000","last_active":"2024-09-12T00:54:36.252728+0000","last_peered":"2024-09-12T00:54:36.252728+0000","last_clean":"2024-09-12T00:54:36.252728+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:54:36.252728+0000","last_undegraded":"2024-09-12T00:54:36.252728+0000","last_fullsized":"2024-09-12T00:54:36.252728+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.252593+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:55.096253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5525,"num_write":929,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:30.930757+0000","last_change":"2024-09-12T00:11:49.936925+0000","last_active":"2024-09-12T00:50:30.930757+0000","last_peered":"2024-09-12T00:50:30.930757+0000","last_clean":"2024-09-12T00:50:30.930757+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:50:30.930757+0000","last_undegraded":"2024-09-12T00:50:30.930757+0000","last_fullsized":"2024-09-12T00:50:30.930757+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:17:31.835956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'125","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.736749+0000","last_change":"2024-09-12T00:54:54.736749+0000","last_active":"2024-09-12T00:54:54.736749+0000","last_peered":"2024-09-12T00:54:54.736749+0000","last_clean":"2024-09-12T00:54:54.736749+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:54.736749+0000","last_undegraded":"2024-09-12T00:54:54.736749+0000","last_fullsized":"2024-09-12T00:54:54.736749+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'125","last_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_deep_scrub":"266'125","last_deep_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.736531+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:19.668088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":150,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'790","reported_seq":2259,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.981859+0000","last_change":"2024-09-12T00:11:53.966127+0000","last_active":"2024-09-12T00:54:30.981859+0000","last_peered":"2024-09-12T00:54:30.981859+0000","last_clean":"2024-09-12T00:54:30.981859+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:54:30.981859+0000","last_undegraded":"2024-09-12T00:54:30.981859+0000","last_fullsized":"2024-09-12T00:54:30.981859+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:51:51.057133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'541","reported_seq":2424,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.233588+0000","last_change":"2024-09-12T00:54:53.233588+0000","last_active":"2024-09-12T00:54:53.233588+0000","last_peered":"2024-09-12T00:54:53.233588+0000","last_clean":"2024-09-12T00:54:53.233588+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:54:53.233588+0000","last_undegraded":"2024-09-12T00:54:53.233588+0000","last_fullsized":"2024-09-12T00:54:53.233588+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'541","last_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_deep_scrub":"266'541","last_deep_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.233406+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:22.797998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'243","reported_seq":908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.022640+0000","last_change":"2024-09-12T00:54:37.022589+0000","last_active":"2024-09-12T00:54:37.022640+0000","last_peered":"2024-09-12T00:54:37.022640+0000","last_clean":"2024-09-12T00:54:37.022640+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:54:37.022640+0000","last_undegraded":"2024-09-12T00:54:37.022640+0000","last_fullsized":"2024-09-12T00:54:37.022640+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.022508+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:27.678475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639369,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":593,"num_read_kb":40518,"num_write":1099,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":510,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.462947+0000","last_change":"2024-09-12T00:54:52.462947+0000","last_active":"2024-09-12T00:54:52.462947+0000","last_peered":"2024-09-12T00:54:52.462947+0000","last_clean":"2024-09-12T00:54:52.462947+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:54:52.462947+0000","last_undegraded":"2024-09-12T00:54:52.462947+0000","last_fullsized":"2024-09-12T00:54:52.462947+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.462775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.499387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'229","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.012090+0000","last_change":"2024-09-12T00:54:53.012090+0000","last_active":"2024-09-12T00:54:53.012090+0000","last_peered":"2024-09-12T00:54:53.012090+0000","last_clean":"2024-09-12T00:54:53.012090+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:54:53.012090+0000","last_undegraded":"2024-09-12T00:54:53.012090+0000","last_fullsized":"2024-09-12T00:54:53.012090+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.011878+0000","objects_scrubbed":10,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:32.987361+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":300,"num_read_kb":365,"num_write":178,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":490,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:25.933769+0000","last_change":"2024-09-12T00:11:53.969081+0000","last_active":"2024-09-12T00:52:25.933769+0000","last_peered":"2024-09-12T00:52:25.933769+0000","last_clean":"2024-09-12T00:52:25.933769+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:52:25.933769+0000","last_undegraded":"2024-09-12T00:52:25.933769+0000","last_fullsized":"2024-09-12T00:52:25.933769+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'542","reported_seq":1368,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.342188+0000","last_change":"2024-09-12T00:11:55.961717+0000","last_active":"2024-09-12T00:54:18.342188+0000","last_peered":"2024-09-12T00:54:18.342188+0000","last_clean":"2024-09-12T00:54:18.342188+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:54:18.342188+0000","last_undegraded":"2024-09-12T00:54:18.342188+0000","last_fullsized":"2024-09-12T00:54:18.342188+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":500,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:47.402164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'848","reported_seq":2499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.377977+0000","last_change":"2024-09-12T00:54:43.377977+0000","last_active":"2024-09-12T00:54:43.377977+0000","last_peered":"2024-09-12T00:54:43.377977+0000","last_clean":"2024-09-12T00:54:43.377977+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:54:43.377977+0000","last_undegraded":"2024-09-12T00:54:43.377977+0000","last_fullsized":"2024-09-12T00:54:43.377977+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'848","last_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_deep_scrub":"266'848","last_deep_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.377796+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:14.837239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":722,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'191","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.713942+0000","last_change":"2024-09-12T00:54:37.713942+0000","last_active":"2024-09-12T00:54:37.713942+0000","last_peered":"2024-09-12T00:54:37.713942+0000","last_clean":"2024-09-12T00:54:37.713942+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:37.713942+0000","last_undegraded":"2024-09-12T00:54:37.713942+0000","last_fullsized":"2024-09-12T00:54:37.713942+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.713849+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.923192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399155,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":818,"num_read_kb":32535,"num_write":884,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.551709+0000","last_change":"2024-09-12T00:54:52.551709+0000","last_active":"2024-09-12T00:54:52.551709+0000","last_peered":"2024-09-12T00:54:52.551709+0000","last_clean":"2024-09-12T00:54:52.551709+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:54:52.551709+0000","last_undegraded":"2024-09-12T00:54:52.551709+0000","last_fullsized":"2024-09-12T00:54:52.551709+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.551408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.893833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'129","reported_seq":705,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.187343+0000","last_change":"2024-09-12T00:11:51.947825+0000","last_active":"2024-09-12T00:54:31.187343+0000","last_peered":"2024-09-12T00:54:31.187343+0000","last_clean":"2024-09-12T00:54:31.187343+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:54:31.187343+0000","last_undegraded":"2024-09-12T00:54:31.187343+0000","last_fullsized":"2024-09-12T00:54:31.187343+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":100,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":236,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":491,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:05.920875+0000","last_change":"2024-09-12T00:11:53.971538+0000","last_active":"2024-09-12T00:51:05.920875+0000","last_peered":"2024-09-12T00:51:05.920875+0000","last_clean":"2024-09-12T00:51:05.920875+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:51:05.920875+0000","last_undegraded":"2024-09-12T00:51:05.920875+0000","last_fullsized":"2024-09-12T00:51:05.920875+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:15.262175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'143","reported_seq":696,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:41.129296+0000","last_change":"2024-09-12T00:11:55.983166+0000","last_active":"2024-09-12T00:53:41.129296+0000","last_peered":"2024-09-12T00:53:41.129296+0000","last_clean":"2024-09-12T00:53:41.129296+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:53:41.129296+0000","last_undegraded":"2024-09-12T00:53:41.129296+0000","last_fullsized":"2024-09-12T00:53:41.129296+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:55.841060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'473","reported_seq":1973,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.800905+0000","last_change":"2024-09-12T00:54:43.800905+0000","last_active":"2024-09-12T00:54:43.800905+0000","last_peered":"2024-09-12T00:54:43.800905+0000","last_clean":"2024-09-12T00:54:43.800905+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:54:43.800905+0000","last_undegraded":"2024-09-12T00:54:43.800905+0000","last_fullsized":"2024-09-12T00:54:43.800905+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.800712+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:56.152735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'169","reported_seq":791,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.292864+0000","last_change":"2024-09-12T00:54:43.292864+0000","last_active":"2024-09-12T00:54:43.292864+0000","last_peered":"2024-09-12T00:54:43.292864+0000","last_clean":"2024-09-12T00:54:43.292864+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:54:43.292864+0000","last_undegraded":"2024-09-12T00:54:43.292864+0000","last_fullsized":"2024-09-12T00:54:43.292864+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'169","last_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_deep_scrub":"266'169","last_deep_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.292636+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:50.241174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263229,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":53604,"num_write":798,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:19.943503+0000","last_change":"2024-09-12T00:11:49.936538+0000","last_active":"2024-09-12T00:52:19.943503+0000","last_peered":"2024-09-12T00:52:19.943503+0000","last_clean":"2024-09-12T00:52:19.943503+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:52:19.943503+0000","last_undegraded":"2024-09-12T00:52:19.943503+0000","last_fullsized":"2024-09-12T00:52:19.943503+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:29.358717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'165","reported_seq":760,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.468527+0000","last_change":"2024-09-12T00:11:51.935323+0000","last_active":"2024-09-12T00:54:31.468527+0000","last_peered":"2024-09-12T00:54:31.468527+0000","last_clean":"2024-09-12T00:54:31.468527+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:54:31.468527+0000","last_undegraded":"2024-09-12T00:54:31.468527+0000","last_fullsized":"2024-09-12T00:54:31.468527+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:42.661049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":225,"num_read_kb":295,"num_write":126,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'789","reported_seq":4497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.984194+0000","last_change":"2024-09-12T00:11:53.965915+0000","last_active":"2024-09-12T00:54:30.984194+0000","last_peered":"2024-09-12T00:54:30.984194+0000","last_clean":"2024-09-12T00:54:30.984194+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:54:30.984194+0000","last_undegraded":"2024-09-12T00:54:30.984194+0000","last_fullsized":"2024-09-12T00:54:30.984194+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":700,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:56:41.284890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'110","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.118486+0000","last_change":"2024-09-12T00:11:55.974936+0000","last_active":"2024-09-12T00:54:17.118486+0000","last_peered":"2024-09-12T00:54:17.118486+0000","last_clean":"2024-09-12T00:54:17.118486+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:54:17.118486+0000","last_undegraded":"2024-09-12T00:54:17.118486+0000","last_fullsized":"2024-09-12T00:54:17.118486+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":110,"log_dups_size":0,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:43.028796+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.521426+0000","last_change":"2024-09-12T00:54:50.521426+0000","last_active":"2024-09-12T00:54:50.521426+0000","last_peered":"2024-09-12T00:54:50.521426+0000","last_clean":"2024-09-12T00:54:50.521426+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:54:50.521426+0000","last_undegraded":"2024-09-12T00:54:50.521426+0000","last_fullsized":"2024-09-12T00:54:50.521426+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.521244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:58.029014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'206","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.986855+0000","last_change":"2024-09-12T00:54:35.986855+0000","last_active":"2024-09-12T00:54:35.986855+0000","last_peered":"2024-09-12T00:54:35.986855+0000","last_clean":"2024-09-12T00:54:35.986855+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:54:35.986855+0000","last_undegraded":"2024-09-12T00:54:35.986855+0000","last_fullsized":"2024-09-12T00:54:35.986855+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.986557+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:47.032800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263232,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":7228,"num_write":905,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.541065+0000","last_change":"2024-09-12T00:54:53.541065+0000","last_active":"2024-09-12T00:54:53.541065+0000","last_peered":"2024-09-12T00:54:53.541065+0000","last_clean":"2024-09-12T00:54:53.541065+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:54:53.541065+0000","last_undegraded":"2024-09-12T00:54:53.541065+0000","last_fullsized":"2024-09-12T00:54:53.541065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.540887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:37.677352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'221","reported_seq":863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.504002+0000","last_change":"2024-09-12T00:11:51.953736+0000","last_active":"2024-09-12T00:54:31.504002+0000","last_peered":"2024-09-12T00:54:31.504002+0000","last_clean":"2024-09-12T00:54:31.504002+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:54:31.504002+0000","last_undegraded":"2024-09-12T00:54:31.504002+0000","last_fullsized":"2024-09-12T00:54:31.504002+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:45:45.844572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17671,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":453,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923531+0000","last_change":"2024-09-12T00:11:53.953180+0000","last_active":"2024-09-12T00:50:54.923531+0000","last_peered":"2024-09-12T00:50:54.923531+0000","last_clean":"2024-09-12T00:50:54.923531+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:50:54.923531+0000","last_undegraded":"2024-09-12T00:50:54.923531+0000","last_fullsized":"2024-09-12T00:50:54.923531+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:40:30.341688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'167","reported_seq":695,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.573638+0000","last_change":"2024-09-12T00:11:55.974975+0000","last_active":"2024-09-12T00:53:13.573638+0000","last_peered":"2024-09-12T00:53:13.573638+0000","last_clean":"2024-09-12T00:53:13.573638+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:53:13.573638+0000","last_undegraded":"2024-09-12T00:53:13.573638+0000","last_fullsized":"2024-09-12T00:53:13.573638+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":100,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:15:59.474049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'473","reported_seq":1914,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.024560+0000","last_change":"2024-09-12T00:54:46.024560+0000","last_active":"2024-09-12T00:54:46.024560+0000","last_peered":"2024-09-12T00:54:46.024560+0000","last_clean":"2024-09-12T00:54:46.024560+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:54:46.024560+0000","last_undegraded":"2024-09-12T00:54:46.024560+0000","last_fullsized":"2024-09-12T00:54:46.024560+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.024305+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:36.127769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'213","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.570214+0000","last_change":"2024-09-12T00:54:39.570214+0000","last_active":"2024-09-12T00:54:39.570214+0000","last_peered":"2024-09-12T00:54:39.570214+0000","last_clean":"2024-09-12T00:54:39.570214+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:54:39.570214+0000","last_undegraded":"2024-09-12T00:54:39.570214+0000","last_fullsized":"2024-09-12T00:54:39.570214+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.570000+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:44.813413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1957,"num_write":1001,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"266'4","reported_seq":982,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.606327+0000","last_change":"2024-09-12T00:54:51.606327+0000","last_active":"2024-09-12T00:54:51.606327+0000","last_peered":"2024-09-12T00:54:51.606327+0000","last_clean":"2024-09-12T00:54:51.606327+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:51.606327+0000","last_undegraded":"2024-09-12T00:54:51.606327+0000","last_fullsized":"2024-09-12T00:54:51.606327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.606222+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:53.762430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'164","reported_seq":748,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.277538+0000","last_change":"2024-09-12T00:11:51.927031+0000","last_active":"2024-09-12T00:54:31.277538+0000","last_peered":"2024-09-12T00:54:31.277538+0000","last_clean":"2024-09-12T00:54:31.277538+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:31.277538+0000","last_undegraded":"2024-09-12T00:54:31.277538+0000","last_fullsized":"2024-09-12T00:54:31.277538+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8234,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":271,"num_write":174,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.536437+0000","last_change":"2024-09-12T00:54:55.536437+0000","last_active":"2024-09-12T00:54:55.536437+0000","last_peered":"2024-09-12T00:54:55.536437+0000","last_clean":"2024-09-12T00:54:55.536437+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:54:55.536437+0000","last_undegraded":"2024-09-12T00:54:55.536437+0000","last_fullsized":"2024-09-12T00:54:55.536437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.536271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:31.775278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'111","reported_seq":608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:07.371379+0000","last_change":"2024-09-12T00:11:55.962445+0000","last_active":"2024-09-12T00:54:07.371379+0000","last_peered":"2024-09-12T00:54:07.371379+0000","last_clean":"2024-09-12T00:54:07.371379+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:54:07.371379+0000","last_undegraded":"2024-09-12T00:54:07.371379+0000","last_fullsized":"2024-09-12T00:54:07.371379+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":100,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:04.195407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'361","reported_seq":1774,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.211004+0000","last_change":"2024-09-12T00:54:54.211004+0000","last_active":"2024-09-12T00:54:54.211004+0000","last_peered":"2024-09-12T00:54:54.211004+0000","last_clean":"2024-09-12T00:54:54.211004+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:54:54.211004+0000","last_undegraded":"2024-09-12T00:54:54.211004+0000","last_fullsized":"2024-09-12T00:54:54.211004+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'361","last_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_deep_scrub":"266'361","last_deep_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.210799+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:50.984927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'180","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.277780+0000","last_change":"2024-09-12T00:54:42.277780+0000","last_active":"2024-09-12T00:54:42.277780+0000","last_peered":"2024-09-12T00:54:42.277780+0000","last_clean":"2024-09-12T00:54:42.277780+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:54:42.277780+0000","last_undegraded":"2024-09-12T00:54:42.277780+0000","last_fullsized":"2024-09-12T00:54:42.277780+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.277535+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:04.627342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029147,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":98751,"num_write":852,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:19.943556+0000","last_change":"2024-09-12T00:11:49.929321+0000","last_active":"2024-09-12T00:52:19.943556+0000","last_peered":"2024-09-12T00:52:19.943556+0000","last_clean":"2024-09-12T00:52:19.943556+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:52:19.943556+0000","last_undegraded":"2024-09-12T00:52:19.943556+0000","last_fullsized":"2024-09-12T00:52:19.943556+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:41.401304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'146","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.123485+0000","last_change":"2024-09-12T00:11:51.944644+0000","last_active":"2024-09-12T00:54:31.123485+0000","last_peered":"2024-09-12T00:54:31.123485+0000","last_clean":"2024-09-12T00:54:31.123485+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:54:31.123485+0000","last_undegraded":"2024-09-12T00:54:31.123485+0000","last_fullsized":"2024-09-12T00:54:31.123485+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":100,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4675,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":249,"num_write":108,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'760","reported_seq":4280,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.563296+0000","last_change":"2024-09-12T00:54:54.563296+0000","last_active":"2024-09-12T00:54:54.563296+0000","last_peered":"2024-09-12T00:54:54.563296+0000","last_clean":"2024-09-12T00:54:54.563296+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:54.563296+0000","last_undegraded":"2024-09-12T00:54:54.563296+0000","last_fullsized":"2024-09-12T00:54:54.563296+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'760","last_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_deep_scrub":"266'760","last_deep_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.563105+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.533407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'131","reported_seq":622,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.447365+0000","last_change":"2024-09-12T00:11:55.980382+0000","last_active":"2024-09-12T00:53:14.447365+0000","last_peered":"2024-09-12T00:53:14.447365+0000","last_clean":"2024-09-12T00:53:14.447365+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:53:14.447365+0000","last_undegraded":"2024-09-12T00:53:14.447365+0000","last_fullsized":"2024-09-12T00:53:14.447365+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":100,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:50:00.118353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.827777+0000","last_change":"2024-09-12T00:54:44.827777+0000","last_active":"2024-09-12T00:54:44.827777+0000","last_peered":"2024-09-12T00:54:44.827777+0000","last_clean":"2024-09-12T00:54:44.827777+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:54:44.827777+0000","last_undegraded":"2024-09-12T00:54:44.827777+0000","last_fullsized":"2024-09-12T00:54:44.827777+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.827583+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:48.105846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'205","reported_seq":968,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.316896+0000","last_change":"2024-09-12T00:54:41.316896+0000","last_active":"2024-09-12T00:54:41.316896+0000","last_peered":"2024-09-12T00:54:41.316896+0000","last_clean":"2024-09-12T00:54:41.316896+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:54:41.316896+0000","last_undegraded":"2024-09-12T00:54:41.316896+0000","last_fullsized":"2024-09-12T00:54:41.316896+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.316614+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.862723+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3292722,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":199371,"num_write":991,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1457,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.467529+0000","last_change":"2024-09-12T00:54:50.467529+0000","last_active":"2024-09-12T00:54:50.467529+0000","last_peered":"2024-09-12T00:54:50.467529+0000","last_clean":"2024-09-12T00:54:50.467529+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:50.467529+0000","last_undegraded":"2024-09-12T00:54:50.467529+0000","last_fullsized":"2024-09-12T00:54:50.467529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.467357+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:26.686465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'72","reported_seq":591,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.211527+0000","last_change":"2024-09-12T00:11:51.935418+0000","last_active":"2024-09-12T00:54:17.211527+0000","last_peered":"2024-09-12T00:54:17.211527+0000","last_clean":"2024-09-12T00:54:17.211527+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:54:17.211527+0000","last_undegraded":"2024-09-12T00:54:17.211527+0000","last_fullsized":"2024-09-12T00:54:17.211527+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'798","reported_seq":2242,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.582361+0000","last_change":"2024-09-12T00:11:53.957570+0000","last_active":"2024-09-12T00:54:31.582361+0000","last_peered":"2024-09-12T00:54:31.582361+0000","last_clean":"2024-09-12T00:54:31.582361+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:31.582361+0000","last_undegraded":"2024-09-12T00:54:31.582361+0000","last_fullsized":"2024-09-12T00:54:31.582361+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":97,"log_dups_size":701,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.135829+0000","last_change":"2024-09-12T00:11:55.975495+0000","last_active":"2024-09-12T00:52:29.135829+0000","last_peered":"2024-09-12T00:52:29.135829+0000","last_clean":"2024-09-12T00:52:29.135829+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:52:29.135829+0000","last_undegraded":"2024-09-12T00:52:29.135829+0000","last_fullsized":"2024-09-12T00:52:29.135829+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:52:54.293878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'761","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.666891+0000","last_change":"2024-09-12T00:54:43.666617+0000","last_active":"2024-09-12T00:54:43.666891+0000","last_peered":"2024-09-12T00:54:43.666891+0000","last_clean":"2024-09-12T00:54:43.666891+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:54:43.666891+0000","last_undegraded":"2024-09-12T00:54:43.666891+0000","last_fullsized":"2024-09-12T00:54:43.666891+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'761","last_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_deep_scrub":"266'761","last_deep_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.666383+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.971115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'218","reported_seq":872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.748564+0000","last_change":"2024-09-12T00:54:39.748564+0000","last_active":"2024-09-12T00:54:39.748564+0000","last_peered":"2024-09-12T00:54:39.748564+0000","last_clean":"2024-09-12T00:54:39.748564+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:54:39.748564+0000","last_undegraded":"2024-09-12T00:54:39.748564+0000","last_fullsized":"2024-09-12T00:54:39.748564+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.748286+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:20.574571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263224,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":31245,"num_write":954,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:20.958586+0000","last_change":"2024-09-12T00:11:49.941210+0000","last_active":"2024-09-12T00:52:20.958586+0000","last_peered":"2024-09-12T00:52:20.958586+0000","last_clean":"2024-09-12T00:52:20.958586+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:52:20.958586+0000","last_undegraded":"2024-09-12T00:52:20.958586+0000","last_fullsized":"2024-09-12T00:52:20.958586+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:35:16.438093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'230","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.555251+0000","last_change":"2024-09-12T00:54:54.555251+0000","last_active":"2024-09-12T00:54:54.555251+0000","last_peered":"2024-09-12T00:54:54.555251+0000","last_clean":"2024-09-12T00:54:54.555251+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:54.555251+0000","last_undegraded":"2024-09-12T00:54:54.555251+0000","last_fullsized":"2024-09-12T00:54:54.555251+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.555026+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:19.736607+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":871,"num_read_kb":936,"num_write":1362,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:26.134678+0000","last_change":"2024-09-12T00:11:53.957928+0000","last_active":"2024-09-12T00:52:26.134678+0000","last_peered":"2024-09-12T00:52:26.134678+0000","last_clean":"2024-09-12T00:52:26.134678+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:52:26.134678+0000","last_undegraded":"2024-09-12T00:52:26.134678+0000","last_fullsized":"2024-09-12T00:52:26.134678+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'106","reported_seq":598,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.427213+0000","last_change":"2024-09-12T00:11:55.978414+0000","last_active":"2024-09-12T00:53:12.427213+0000","last_peered":"2024-09-12T00:53:12.427213+0000","last_clean":"2024-09-12T00:53:12.427213+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:53:12.427213+0000","last_undegraded":"2024-09-12T00:53:12.427213+0000","last_fullsized":"2024-09-12T00:53:12.427213+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:27.992033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'793","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.287495+0000","last_change":"2024-09-12T00:54:52.287495+0000","last_active":"2024-09-12T00:54:52.287495+0000","last_peered":"2024-09-12T00:54:52.287495+0000","last_clean":"2024-09-12T00:54:52.287495+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:54:52.287495+0000","last_undegraded":"2024-09-12T00:54:52.287495+0000","last_fullsized":"2024-09-12T00:54:52.287495+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.287309+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:21.498590+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.224884+0000","last_change":"2024-09-12T00:54:35.224884+0000","last_active":"2024-09-12T00:54:35.224884+0000","last_peered":"2024-09-12T00:54:35.224884+0000","last_clean":"2024-09-12T00:54:35.224884+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:54:35.224884+0000","last_undegraded":"2024-09-12T00:54:35.224884+0000","last_fullsized":"2024-09-12T00:54:35.224884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.224815+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:03.397008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.274584+0000","last_change":"2024-09-12T00:54:38.274584+0000","last_active":"2024-09-12T00:54:38.274584+0000","last_peered":"2024-09-12T00:54:38.274584+0000","last_clean":"2024-09-12T00:54:38.274584+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:54:38.274584+0000","last_undegraded":"2024-09-12T00:54:38.274584+0000","last_fullsized":"2024-09-12T00:54:38.274584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.274494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.201817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'188","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.789217+0000","last_change":"2024-09-12T00:54:42.789217+0000","last_active":"2024-09-12T00:54:42.789217+0000","last_peered":"2024-09-12T00:54:42.789217+0000","last_clean":"2024-09-12T00:54:42.789217+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:54:42.789217+0000","last_undegraded":"2024-09-12T00:54:42.789217+0000","last_fullsized":"2024-09-12T00:54:42.789217+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.788986+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:41.647136+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829240,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":15296,"num_write":922,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"266'5","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.966425+0000","last_change":"2024-09-12T00:54:51.966425+0000","last_active":"2024-09-12T00:54:51.966425+0000","last_peered":"2024-09-12T00:54:51.966425+0000","last_clean":"2024-09-12T00:54:51.966425+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:51.966425+0000","last_undegraded":"2024-09-12T00:54:51.966425+0000","last_fullsized":"2024-09-12T00:54:51.966425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.966203+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:02.641365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'303","reported_seq":1008,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.573889+0000","last_change":"2024-09-12T00:11:51.936332+0000","last_active":"2024-09-12T00:54:31.573889+0000","last_peered":"2024-09-12T00:54:31.573889+0000","last_clean":"2024-09-12T00:54:31.573889+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:54:31.573889+0000","last_undegraded":"2024-09-12T00:54:31.573889+0000","last_fullsized":"2024-09-12T00:54:31.573889+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":103,"log_dups_size":200,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:41:22.288477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38032,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":812,"num_write":452,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:54.923847+0000","last_change":"2024-09-12T00:11:53.937970+0000","last_active":"2024-09-12T00:50:54.923847+0000","last_peered":"2024-09-12T00:50:54.923847+0000","last_clean":"2024-09-12T00:50:54.923847+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:50:54.923847+0000","last_undegraded":"2024-09-12T00:50:54.923847+0000","last_fullsized":"2024-09-12T00:50:54.923847+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:46:32.585484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'188","reported_seq":887,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.171716+0000","last_change":"2024-09-12T00:11:55.972904+0000","last_active":"2024-09-12T00:53:13.171716+0000","last_peered":"2024-09-12T00:53:13.171716+0000","last_clean":"2024-09-12T00:53:13.171716+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:53:13.171716+0000","last_undegraded":"2024-09-12T00:53:13.171716+0000","last_fullsized":"2024-09-12T00:53:13.171716+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:08.248837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'456","reported_seq":1927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.519310+0000","last_change":"2024-09-12T00:54:51.519310+0000","last_active":"2024-09-12T00:54:51.519310+0000","last_peered":"2024-09-12T00:54:51.519310+0000","last_clean":"2024-09-12T00:54:51.519310+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:54:51.519310+0000","last_undegraded":"2024-09-12T00:54:51.519310+0000","last_fullsized":"2024-09-12T00:54:51.519310+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.519121+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:49.830324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.242615+0000","last_change":"2024-09-12T00:54:37.242615+0000","last_active":"2024-09-12T00:54:37.242615+0000","last_peered":"2024-09-12T00:54:37.242615+0000","last_clean":"2024-09-12T00:54:37.242615+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:54:37.242615+0000","last_undegraded":"2024-09-12T00:54:37.242615+0000","last_fullsized":"2024-09-12T00:54:37.242615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.242525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:38.015711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'204","reported_seq":822,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.526486+0000","last_change":"2024-09-12T00:54:42.526486+0000","last_active":"2024-09-12T00:54:42.526486+0000","last_peered":"2024-09-12T00:54:42.526486+0000","last_clean":"2024-09-12T00:54:42.526486+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:54:42.526486+0000","last_undegraded":"2024-09-12T00:54:42.526486+0000","last_fullsized":"2024-09-12T00:54:42.526486+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.526184+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:15.774324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306325,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":403,"num_read_kb":6581,"num_write":989,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.935730+0000","last_change":"2024-09-12T00:11:49.935780+0000","last_active":"2024-09-12T00:50:50.935730+0000","last_peered":"2024-09-12T00:50:50.935730+0000","last_clean":"2024-09-12T00:50:50.935730+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:50:50.935730+0000","last_undegraded":"2024-09-12T00:50:50.935730+0000","last_fullsized":"2024-09-12T00:50:50.935730+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:17:52.785961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'853","reported_seq":2314,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.624156+0000","last_change":"2024-09-12T00:54:53.624156+0000","last_active":"2024-09-12T00:54:53.624156+0000","last_peered":"2024-09-12T00:54:53.624156+0000","last_clean":"2024-09-12T00:54:53.624156+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:53.624156+0000","last_undegraded":"2024-09-12T00:54:53.624156+0000","last_fullsized":"2024-09-12T00:54:53.624156+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'853","last_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_deep_scrub":"266'853","last_deep_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.623958+0000","objects_scrubbed":12,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:03.095882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66079,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1175,"num_read_kb":1468,"num_write":286,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":490,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947961+0000","last_change":"2024-09-12T00:11:53.962102+0000","last_active":"2024-09-12T00:51:40.947961+0000","last_peered":"2024-09-12T00:51:40.947961+0000","last_clean":"2024-09-12T00:51:40.947961+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:51:40.947961+0000","last_undegraded":"2024-09-12T00:51:40.947961+0000","last_fullsized":"2024-09-12T00:51:40.947961+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:36:40.329220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'206","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:31.450664+0000","last_change":"2024-09-12T00:11:55.982765+0000","last_active":"2024-09-12T00:52:31.450664+0000","last_peered":"2024-09-12T00:52:31.450664+0000","last_clean":"2024-09-12T00:52:31.450664+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:52:31.450664+0000","last_undegraded":"2024-09-12T00:52:31.450664+0000","last_fullsized":"2024-09-12T00:52:31.450664+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.734557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'995","reported_seq":2853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.579986+0000","last_change":"2024-09-12T00:54:48.579986+0000","last_active":"2024-09-12T00:54:48.579986+0000","last_peered":"2024-09-12T00:54:48.579986+0000","last_clean":"2024-09-12T00:54:48.579986+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:54:48.579986+0000","last_undegraded":"2024-09-12T00:54:48.579986+0000","last_fullsized":"2024-09-12T00:54:48.579986+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'995","last_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_deep_scrub":"266'995","last_deep_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.579784+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:38.249646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.545567+0000","last_change":"2024-09-12T00:54:38.545567+0000","last_active":"2024-09-12T00:54:38.545567+0000","last_peered":"2024-09-12T00:54:38.545567+0000","last_clean":"2024-09-12T00:54:38.545567+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:54:38.545567+0000","last_undegraded":"2024-09-12T00:54:38.545567+0000","last_fullsized":"2024-09-12T00:54:38.545567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.545294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:50.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'191","reported_seq":813,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.551347+0000","last_change":"2024-09-12T00:54:38.551347+0000","last_active":"2024-09-12T00:54:38.551347+0000","last_peered":"2024-09-12T00:54:38.551347+0000","last_clean":"2024-09-12T00:54:38.551347+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:54:38.551347+0000","last_undegraded":"2024-09-12T00:54:38.551347+0000","last_fullsized":"2024-09-12T00:54:38.551347+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.551135+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:39.228607+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399318,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":402,"num_read_kb":16624,"num_write":912,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.576517+0000","last_change":"2024-09-12T00:54:50.576517+0000","last_active":"2024-09-12T00:54:50.576517+0000","last_peered":"2024-09-12T00:54:50.576517+0000","last_clean":"2024-09-12T00:54:50.576517+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:54:50.576517+0000","last_undegraded":"2024-09-12T00:54:50.576517+0000","last_fullsized":"2024-09-12T00:54:50.576517+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.576297+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.163460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'231","reported_seq":1283,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.391143+0000","last_change":"2024-09-12T00:11:51.950048+0000","last_active":"2024-09-12T00:54:15.391143+0000","last_peered":"2024-09-12T00:54:15.391143+0000","last_clean":"2024-09-12T00:54:15.391143+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:15.391143+0000","last_undegraded":"2024-09-12T00:54:15.391143+0000","last_fullsized":"2024-09-12T00:54:15.391143+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":200,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:35:06.199752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926496+0000","last_change":"2024-09-12T00:11:53.968069+0000","last_active":"2024-09-12T00:51:30.926496+0000","last_peered":"2024-09-12T00:51:30.926496+0000","last_clean":"2024-09-12T00:51:30.926496+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:51:30.926496+0000","last_undegraded":"2024-09-12T00:51:30.926496+0000","last_fullsized":"2024-09-12T00:51:30.926496+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:02.100203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'312","reported_seq":935,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.561689+0000","last_change":"2024-09-12T00:11:55.967123+0000","last_active":"2024-09-12T00:53:14.561689+0000","last_peered":"2024-09-12T00:53:14.561689+0000","last_clean":"2024-09-12T00:53:14.561689+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:53:14.561689+0000","last_undegraded":"2024-09-12T00:53:14.561689+0000","last_fullsized":"2024-09-12T00:53:14.561689+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":300,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'380","reported_seq":1793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.548188+0000","last_change":"2024-09-12T00:54:47.548188+0000","last_active":"2024-09-12T00:54:47.548188+0000","last_peered":"2024-09-12T00:54:47.548188+0000","last_clean":"2024-09-12T00:54:47.548188+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:54:47.548188+0000","last_undegraded":"2024-09-12T00:54:47.548188+0000","last_fullsized":"2024-09-12T00:54:47.548188+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.548014+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:48.760777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.197440+0000","last_change":"2024-09-12T00:54:36.197440+0000","last_active":"2024-09-12T00:54:36.197440+0000","last_peered":"2024-09-12T00:54:36.197440+0000","last_clean":"2024-09-12T00:54:36.197440+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:54:36.197440+0000","last_undegraded":"2024-09-12T00:54:36.197440+0000","last_fullsized":"2024-09-12T00:54:36.197440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.197360+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.561316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'279","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:34.999658+0000","last_change":"2024-09-12T00:54:34.999658+0000","last_active":"2024-09-12T00:54:34.999658+0000","last_peered":"2024-09-12T00:54:34.999658+0000","last_clean":"2024-09-12T00:54:34.999658+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:54:34.999658+0000","last_undegraded":"2024-09-12T00:54:34.999658+0000","last_fullsized":"2024-09-12T00:54:34.999658+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'279","last_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_deep_scrub":"266'279","last_deep_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_clean_scrub_stamp":"2024-09-12T00:54:34.999451+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:22.247017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":17781,"num_write":1208,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.529558+0000","last_change":"2024-09-12T00:54:49.529558+0000","last_active":"2024-09-12T00:54:49.529558+0000","last_peered":"2024-09-12T00:54:49.529558+0000","last_clean":"2024-09-12T00:54:49.529558+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:54:49.529558+0000","last_undegraded":"2024-09-12T00:54:49.529558+0000","last_fullsized":"2024-09-12T00:54:49.529558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.529356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:46.730267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'109","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:04.954400+0000","last_change":"2024-09-12T00:11:51.944099+0000","last_active":"2024-09-12T00:53:04.954400+0000","last_peered":"2024-09-12T00:53:04.954400+0000","last_clean":"2024-09-12T00:53:04.954400+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:53:04.954400+0000","last_undegraded":"2024-09-12T00:53:04.954400+0000","last_fullsized":"2024-09-12T00:53:04.954400+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:44.853682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.936964+0000","last_change":"2024-09-12T00:11:53.964265+0000","last_active":"2024-09-12T00:50:55.936964+0000","last_peered":"2024-09-12T00:50:55.936964+0000","last_clean":"2024-09-12T00:50:55.936964+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:50:55.936964+0000","last_undegraded":"2024-09-12T00:50:55.936964+0000","last_fullsized":"2024-09-12T00:50:55.936964+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:02.137660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":656,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:06.122873+0000","last_change":"2024-09-12T00:11:55.974232+0000","last_active":"2024-09-12T00:53:06.122873+0000","last_peered":"2024-09-12T00:53:06.122873+0000","last_clean":"2024-09-12T00:53:06.122873+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:53:06.122873+0000","last_undegraded":"2024-09-12T00:53:06.122873+0000","last_fullsized":"2024-09-12T00:53:06.122873+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:29:18.700290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'427","reported_seq":1936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.584085+0000","last_change":"2024-09-12T00:54:46.584085+0000","last_active":"2024-09-12T00:54:46.584085+0000","last_peered":"2024-09-12T00:54:46.584085+0000","last_clean":"2024-09-12T00:54:46.584085+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:46.584085+0000","last_undegraded":"2024-09-12T00:54:46.584085+0000","last_fullsized":"2024-09-12T00:54:46.584085+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'427","last_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_deep_scrub":"266'427","last_deep_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.583899+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:29.567951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'194","reported_seq":926,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.728711+0000","last_change":"2024-09-12T00:54:35.728711+0000","last_active":"2024-09-12T00:54:35.728711+0000","last_peered":"2024-09-12T00:54:35.728711+0000","last_clean":"2024-09-12T00:54:35.728711+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:35.728711+0000","last_undegraded":"2024-09-12T00:54:35.728711+0000","last_fullsized":"2024-09-12T00:54:35.728711+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.728619+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:56.800395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":917,"num_read_kb":23524,"num_write":944,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.582880+0000","last_change":"2024-09-12T00:54:37.582880+0000","last_active":"2024-09-12T00:54:37.582880+0000","last_peered":"2024-09-12T00:54:37.582880+0000","last_clean":"2024-09-12T00:54:37.582880+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:54:37.582880+0000","last_undegraded":"2024-09-12T00:54:37.582880+0000","last_fullsized":"2024-09-12T00:54:37.582880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.582700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:21.296604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.770670+0000","last_change":"2024-09-12T00:54:54.770670+0000","last_active":"2024-09-12T00:54:54.770670+0000","last_peered":"2024-09-12T00:54:54.770670+0000","last_clean":"2024-09-12T00:54:54.770670+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:54:54.770670+0000","last_undegraded":"2024-09-12T00:54:54.770670+0000","last_fullsized":"2024-09-12T00:54:54.770670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.770488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:04.172382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'283","reported_seq":965,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.642804+0000","last_change":"2024-09-12T00:54:52.642804+0000","last_active":"2024-09-12T00:54:52.642804+0000","last_peered":"2024-09-12T00:54:52.642804+0000","last_clean":"2024-09-12T00:54:52.642804+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:52.642804+0000","last_undegraded":"2024-09-12T00:54:52.642804+0000","last_fullsized":"2024-09-12T00:54:52.642804+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'283","last_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_deep_scrub":"266'283","last_deep_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.642577+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.027888+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26101,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":392,"num_read_kb":552,"num_write":218,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.721716+0000","last_change":"2024-09-12T00:54:55.721716+0000","last_active":"2024-09-12T00:54:55.721716+0000","last_peered":"2024-09-12T00:54:55.721716+0000","last_clean":"2024-09-12T00:54:55.721716+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:54:55.721716+0000","last_undegraded":"2024-09-12T00:54:55.721716+0000","last_fullsized":"2024-09-12T00:54:55.721716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.721527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'149","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:54.704245+0000","last_change":"2024-09-12T00:11:55.982508+0000","last_active":"2024-09-12T00:52:54.704245+0000","last_peered":"2024-09-12T00:52:54.704245+0000","last_clean":"2024-09-12T00:52:54.704245+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:52:54.704245+0000","last_undegraded":"2024-09-12T00:52:54.704245+0000","last_fullsized":"2024-09-12T00:52:54.704245+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":49,"log_dups_size":100,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'459","reported_seq":2086,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.594823+0000","last_change":"2024-09-12T00:54:45.594823+0000","last_active":"2024-09-12T00:54:45.594823+0000","last_peered":"2024-09-12T00:54:45.594823+0000","last_clean":"2024-09-12T00:54:45.594823+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:45.594823+0000","last_undegraded":"2024-09-12T00:54:45.594823+0000","last_fullsized":"2024-09-12T00:54:45.594823+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.594645+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:35.357485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'218","reported_seq":848,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.561566+0000","last_change":"2024-09-12T00:54:38.561566+0000","last_active":"2024-09-12T00:54:38.561566+0000","last_peered":"2024-09-12T00:54:38.561566+0000","last_clean":"2024-09-12T00:54:38.561566+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:54:38.561566+0000","last_undegraded":"2024-09-12T00:54:38.561566+0000","last_fullsized":"2024-09-12T00:54:38.561566+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.561353+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.740390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":428,"num_read_kb":4575,"num_write":1019,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.323452+0000","last_change":"2024-09-12T00:54:39.323452+0000","last_active":"2024-09-12T00:54:39.323452+0000","last_peered":"2024-09-12T00:54:39.323452+0000","last_clean":"2024-09-12T00:54:39.323452+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:54:39.323452+0000","last_undegraded":"2024-09-12T00:54:39.323452+0000","last_fullsized":"2024-09-12T00:54:39.323452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.323253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.936694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.968184+0000","last_change":"2024-09-12T00:54:53.968184+0000","last_active":"2024-09-12T00:54:53.968184+0000","last_peered":"2024-09-12T00:54:53.968184+0000","last_clean":"2024-09-12T00:54:53.968184+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:54:53.968184+0000","last_undegraded":"2024-09-12T00:54:53.968184+0000","last_fullsized":"2024-09-12T00:54:53.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.967996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:51.436997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'179","reported_seq":747,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:29.368057+0000","last_change":"2024-09-12T00:11:51.941186+0000","last_active":"2024-09-12T00:53:29.368057+0000","last_peered":"2024-09-12T00:53:29.368057+0000","last_clean":"2024-09-12T00:53:29.368057+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:53:29.368057+0000","last_undegraded":"2024-09-12T00:53:29.368057+0000","last_fullsized":"2024-09-12T00:53:29.368057+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":100,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:09:41.525044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'800","reported_seq":2667,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.972868+0000","last_change":"2024-09-12T00:11:53.946719+0000","last_active":"2024-09-12T00:54:30.972868+0000","last_peered":"2024-09-12T00:54:30.972868+0000","last_clean":"2024-09-12T00:54:30.972868+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:30.972868+0000","last_undegraded":"2024-09-12T00:54:30.972868+0000","last_fullsized":"2024-09-12T00:54:30.972868+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":99,"log_dups_size":701,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:54.556954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'113","reported_seq":613,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.345670+0000","last_change":"2024-09-12T00:11:55.974820+0000","last_active":"2024-09-12T00:54:18.345670+0000","last_peered":"2024-09-12T00:54:18.345670+0000","last_clean":"2024-09-12T00:54:18.345670+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:54:18.345670+0000","last_undegraded":"2024-09-12T00:54:18.345670+0000","last_fullsized":"2024-09-12T00:54:18.345670+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'451","reported_seq":1864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.779886+0000","last_change":"2024-09-12T00:54:44.779886+0000","last_active":"2024-09-12T00:54:44.779886+0000","last_peered":"2024-09-12T00:54:44.779886+0000","last_clean":"2024-09-12T00:54:44.779886+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:54:44.779886+0000","last_undegraded":"2024-09-12T00:54:44.779886+0000","last_fullsized":"2024-09-12T00:54:44.779886+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.779697+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.485479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'250","reported_seq":919,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.720957+0000","last_change":"2024-09-12T00:54:38.720957+0000","last_active":"2024-09-12T00:54:38.720957+0000","last_peered":"2024-09-12T00:54:38.720957+0000","last_clean":"2024-09-12T00:54:38.720957+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:54:38.720957+0000","last_undegraded":"2024-09-12T00:54:38.720957+0000","last_fullsized":"2024-09-12T00:54:38.720957+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'250","last_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_deep_scrub":"266'250","last_deep_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.720733+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.451856+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337134,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":14953,"num_write":1330,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.712764+0000","last_change":"2024-09-12T00:54:36.712634+0000","last_active":"2024-09-12T00:54:36.712764+0000","last_peered":"2024-09-12T00:54:36.712764+0000","last_clean":"2024-09-12T00:54:36.712764+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:54:36.712764+0000","last_undegraded":"2024-09-12T00:54:36.712764+0000","last_fullsized":"2024-09-12T00:54:36.712764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.712454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:05.577210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:25.944327+0000","last_change":"2024-09-12T00:11:49.929660+0000","last_active":"2024-09-12T00:51:25.944327+0000","last_peered":"2024-09-12T00:51:25.944327+0000","last_clean":"2024-09-12T00:51:25.944327+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:51:25.944327+0000","last_undegraded":"2024-09-12T00:51:25.944327+0000","last_fullsized":"2024-09-12T00:51:25.944327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:22:57.921925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'109","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:28.252812+0000","last_change":"2024-09-12T00:11:51.947657+0000","last_active":"2024-09-12T00:52:28.252812+0000","last_peered":"2024-09-12T00:52:28.252812+0000","last_clean":"2024-09-12T00:52:28.252812+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:52:28.252812+0000","last_undegraded":"2024-09-12T00:52:28.252812+0000","last_fullsized":"2024-09-12T00:52:28.252812+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":109,"log_dups_size":0,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:12.346313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'789","reported_seq":2343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:30.978202+0000","last_change":"2024-09-12T00:11:53.968955+0000","last_active":"2024-09-12T00:54:30.978202+0000","last_peered":"2024-09-12T00:54:30.978202+0000","last_clean":"2024-09-12T00:54:30.978202+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:54:30.978202+0000","last_undegraded":"2024-09-12T00:54:30.978202+0000","last_fullsized":"2024-09-12T00:54:30.978202+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":701,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:21:38.698679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'188","reported_seq":693,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:47.810204+0000","last_change":"2024-09-12T00:11:55.972707+0000","last_active":"2024-09-12T00:52:47.810204+0000","last_peered":"2024-09-12T00:52:47.810204+0000","last_clean":"2024-09-12T00:52:47.810204+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:52:47.810204+0000","last_undegraded":"2024-09-12T00:52:47.810204+0000","last_fullsized":"2024-09-12T00:52:47.810204+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'483","reported_seq":2177,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.777384+0000","last_change":"2024-09-12T00:54:41.777384+0000","last_active":"2024-09-12T00:54:41.777384+0000","last_peered":"2024-09-12T00:54:41.777384+0000","last_clean":"2024-09-12T00:54:41.777384+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:41.777384+0000","last_undegraded":"2024-09-12T00:54:41.777384+0000","last_fullsized":"2024-09-12T00:54:41.777384+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.777199+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:25.825062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'218","reported_seq":878,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.708851+0000","last_change":"2024-09-12T00:54:40.708851+0000","last_active":"2024-09-12T00:54:40.708851+0000","last_peered":"2024-09-12T00:54:40.708851+0000","last_clean":"2024-09-12T00:54:40.708851+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:54:40.708851+0000","last_undegraded":"2024-09-12T00:54:40.708851+0000","last_fullsized":"2024-09-12T00:54:40.708851+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.708626+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.336367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5989411,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":60723,"num_write":949,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.310540+0000","last_change":"2024-09-12T00:54:40.310420+0000","last_active":"2024-09-12T00:54:40.310540+0000","last_peered":"2024-09-12T00:54:40.310540+0000","last_clean":"2024-09-12T00:54:40.310540+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:54:40.310540+0000","last_undegraded":"2024-09-12T00:54:40.310540+0000","last_fullsized":"2024-09-12T00:54:40.310540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.310255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:59.694076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.797268+0000","last_change":"2024-09-12T00:54:53.797268+0000","last_active":"2024-09-12T00:54:53.797268+0000","last_peered":"2024-09-12T00:54:53.797268+0000","last_clean":"2024-09-12T00:54:53.797268+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:54:53.797268+0000","last_undegraded":"2024-09-12T00:54:53.797268+0000","last_fullsized":"2024-09-12T00:54:53.797268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.797085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:00.567896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'349","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.942474+0000","last_change":"2024-09-12T00:54:50.942474+0000","last_active":"2024-09-12T00:54:50.942474+0000","last_peered":"2024-09-12T00:54:50.942474+0000","last_clean":"2024-09-12T00:54:50.942474+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:50.942474+0000","last_undegraded":"2024-09-12T00:54:50.942474+0000","last_fullsized":"2024-09-12T00:54:50.942474+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.942260+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:21.958753+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32232,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":703,"num_write":258,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.926396+0000","last_change":"2024-09-12T00:11:53.959232+0000","last_active":"2024-09-12T00:51:30.926396+0000","last_peered":"2024-09-12T00:51:30.926396+0000","last_clean":"2024-09-12T00:51:30.926396+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:51:30.926396+0000","last_undegraded":"2024-09-12T00:51:30.926396+0000","last_fullsized":"2024-09-12T00:51:30.926396+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:44:48.119897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'91","reported_seq":582,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:49.060918+0000","last_change":"2024-09-12T00:11:55.977283+0000","last_active":"2024-09-12T00:52:49.060918+0000","last_peered":"2024-09-12T00:52:49.060918+0000","last_clean":"2024-09-12T00:52:49.060918+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:52:49.060918+0000","last_undegraded":"2024-09-12T00:52:49.060918+0000","last_fullsized":"2024-09-12T00:52:49.060918+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'150","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.512255+0000","last_change":"2024-09-12T00:11:55.987098+0000","last_active":"2024-09-12T00:53:14.512255+0000","last_peered":"2024-09-12T00:53:14.512255+0000","last_clean":"2024-09-12T00:53:14.512255+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:53:14.512255+0000","last_undegraded":"2024-09-12T00:53:14.512255+0000","last_fullsized":"2024-09-12T00:53:14.512255+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:02:47.859646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'406","reported_seq":1803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.789222+0000","last_change":"2024-09-12T00:54:45.789222+0000","last_active":"2024-09-12T00:54:45.789222+0000","last_peered":"2024-09-12T00:54:45.789222+0000","last_clean":"2024-09-12T00:54:45.789222+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:54:45.789222+0000","last_undegraded":"2024-09-12T00:54:45.789222+0000","last_fullsized":"2024-09-12T00:54:45.789222+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.789043+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.351155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'186","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.238029+0000","last_change":"2024-09-12T00:54:45.238029+0000","last_active":"2024-09-12T00:54:45.238029+0000","last_peered":"2024-09-12T00:54:45.238029+0000","last_clean":"2024-09-12T00:54:45.238029+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:54:45.238029+0000","last_undegraded":"2024-09-12T00:54:45.238029+0000","last_fullsized":"2024-09-12T00:54:45.238029+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.237784+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.782035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33239,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":101459,"num_write":845,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.524132+0000","last_change":"2024-09-12T00:54:54.524132+0000","last_active":"2024-09-12T00:54:54.524132+0000","last_peered":"2024-09-12T00:54:54.524132+0000","last_clean":"2024-09-12T00:54:54.524132+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:54:54.524132+0000","last_undegraded":"2024-09-12T00:54:54.524132+0000","last_fullsized":"2024-09-12T00:54:54.524132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.523944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.210297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'143","reported_seq":722,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.455425+0000","last_change":"2024-09-12T00:11:51.929179+0000","last_active":"2024-09-12T00:54:31.455425+0000","last_peered":"2024-09-12T00:54:31.455425+0000","last_clean":"2024-09-12T00:54:31.455425+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:54:31.455425+0000","last_undegraded":"2024-09-12T00:54:31.455425+0000","last_fullsized":"2024-09-12T00:54:31.455425+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":100,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:30:47.615364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13149,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":189,"num_read_kb":268,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926201+0000","last_change":"2024-09-12T00:11:53.965867+0000","last_active":"2024-09-12T00:51:35.926201+0000","last_peered":"2024-09-12T00:51:35.926201+0000","last_clean":"2024-09-12T00:51:35.926201+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:51:35.926201+0000","last_undegraded":"2024-09-12T00:51:35.926201+0000","last_fullsized":"2024-09-12T00:51:35.926201+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:46.503762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.778087+0000","last_change":"2024-09-12T00:11:55.975673+0000","last_active":"2024-09-12T00:53:13.778087+0000","last_peered":"2024-09-12T00:53:13.778087+0000","last_clean":"2024-09-12T00:53:13.778087+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:53:13.778087+0000","last_undegraded":"2024-09-12T00:53:13.778087+0000","last_fullsized":"2024-09-12T00:53:13.778087+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:44:53.889300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'349","reported_seq":1872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.754171+0000","last_change":"2024-09-12T00:54:46.754171+0000","last_active":"2024-09-12T00:54:46.754171+0000","last_peered":"2024-09-12T00:54:46.754171+0000","last_clean":"2024-09-12T00:54:46.754171+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:54:46.754171+0000","last_undegraded":"2024-09-12T00:54:46.754171+0000","last_fullsized":"2024-09-12T00:54:46.754171+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.753992+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.515601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'340","reported_seq":1020,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.976334+0000","last_change":"2024-09-12T00:54:37.976334+0000","last_active":"2024-09-12T00:54:37.976334+0000","last_peered":"2024-09-12T00:54:37.976334+0000","last_clean":"2024-09-12T00:54:37.976334+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:54:37.976334+0000","last_undegraded":"2024-09-12T00:54:37.976334+0000","last_fullsized":"2024-09-12T00:54:37.976334+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'340","last_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_deep_scrub":"266'340","last_deep_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.976207+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.328642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":797,"num_read_kb":9288,"num_write":1291,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.735034+0000","last_change":"2024-09-12T00:54:55.735034+0000","last_active":"2024-09-12T00:54:55.735034+0000","last_peered":"2024-09-12T00:54:55.735034+0000","last_clean":"2024-09-12T00:54:55.735034+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:54:55.735034+0000","last_undegraded":"2024-09-12T00:54:55.735034+0000","last_fullsized":"2024-09-12T00:54:55.735034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.734861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:10.701469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'54","reported_seq":558,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:02.203822+0000","last_change":"2024-09-12T00:11:51.951112+0000","last_active":"2024-09-12T00:52:02.203822+0000","last_peered":"2024-09-12T00:52:02.203822+0000","last_clean":"2024-09-12T00:52:02.203822+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:52:02.203822+0000","last_undegraded":"2024-09-12T00:52:02.203822+0000","last_fullsized":"2024-09-12T00:52:02.203822+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:36:54.473635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":486,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.122929+0000","last_change":"2024-09-12T00:11:53.965509+0000","last_active":"2024-09-12T00:51:36.122929+0000","last_peered":"2024-09-12T00:51:36.122929+0000","last_clean":"2024-09-12T00:51:36.122929+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:51:36.122929+0000","last_undegraded":"2024-09-12T00:51:36.122929+0000","last_fullsized":"2024-09-12T00:51:36.122929+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:23.935186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'192","reported_seq":714,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:13.755700+0000","last_change":"2024-09-12T00:11:55.977952+0000","last_active":"2024-09-12T00:53:13.755700+0000","last_peered":"2024-09-12T00:53:13.755700+0000","last_clean":"2024-09-12T00:53:13.755700+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:53:13.755700+0000","last_undegraded":"2024-09-12T00:53:13.755700+0000","last_fullsized":"2024-09-12T00:53:13.755700+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:49:33.175924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'774","reported_seq":2195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.737013+0000","last_change":"2024-09-12T00:54:45.737013+0000","last_active":"2024-09-12T00:54:45.737013+0000","last_peered":"2024-09-12T00:54:45.737013+0000","last_clean":"2024-09-12T00:54:45.737013+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:54:45.737013+0000","last_undegraded":"2024-09-12T00:54:45.737013+0000","last_fullsized":"2024-09-12T00:54:45.737013+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.736834+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.215351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'193","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.705674+0000","last_change":"2024-09-12T00:54:36.705674+0000","last_active":"2024-09-12T00:54:36.705674+0000","last_peered":"2024-09-12T00:54:36.705674+0000","last_clean":"2024-09-12T00:54:36.705674+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:36.705674+0000","last_undegraded":"2024-09-12T00:54:36.705674+0000","last_fullsized":"2024-09-12T00:54:36.705674+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.705560+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:37.794357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":25665,"num_write":923,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.705205+0000","last_change":"2024-09-12T00:54:49.705205+0000","last_active":"2024-09-12T00:54:49.705205+0000","last_peered":"2024-09-12T00:54:49.705205+0000","last_clean":"2024-09-12T00:54:49.705205+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:54:49.705205+0000","last_undegraded":"2024-09-12T00:54:49.705205+0000","last_fullsized":"2024-09-12T00:54:49.705205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.704924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:10.256859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'177","reported_seq":766,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.326255+0000","last_change":"2024-09-12T00:11:51.938094+0000","last_active":"2024-09-12T00:54:31.326255+0000","last_peered":"2024-09-12T00:54:31.326255+0000","last_clean":"2024-09-12T00:54:31.326255+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:54:31.326255+0000","last_undegraded":"2024-09-12T00:54:31.326255+0000","last_fullsized":"2024-09-12T00:54:31.326255+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:52.983563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":233,"num_read_kb":302,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.104093+0000","last_change":"2024-09-12T00:11:53.955154+0000","last_active":"2024-09-12T00:51:36.104093+0000","last_peered":"2024-09-12T00:51:36.104093+0000","last_clean":"2024-09-12T00:51:36.104093+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:51:36.104093+0000","last_undegraded":"2024-09-12T00:51:36.104093+0000","last_fullsized":"2024-09-12T00:51:36.104093+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:48:55.932244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'104","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.550126+0000","last_change":"2024-09-12T00:11:55.959282+0000","last_active":"2024-09-12T00:52:29.550126+0000","last_peered":"2024-09-12T00:52:29.550126+0000","last_clean":"2024-09-12T00:52:29.550126+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:52:29.550126+0000","last_undegraded":"2024-09-12T00:52:29.550126+0000","last_fullsized":"2024-09-12T00:52:29.550126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:03.301311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'809","reported_seq":2303,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.643771+0000","last_change":"2024-09-12T00:54:44.643771+0000","last_active":"2024-09-12T00:54:44.643771+0000","last_peered":"2024-09-12T00:54:44.643771+0000","last_clean":"2024-09-12T00:54:44.643771+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:54:44.643771+0000","last_undegraded":"2024-09-12T00:54:44.643771+0000","last_fullsized":"2024-09-12T00:54:44.643771+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'809","last_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_deep_scrub":"266'809","last_deep_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.643588+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.445327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'197","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.551664+0000","last_change":"2024-09-12T00:54:39.551664+0000","last_active":"2024-09-12T00:54:39.551664+0000","last_peered":"2024-09-12T00:54:39.551664+0000","last_clean":"2024-09-12T00:54:39.551664+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:54:39.551664+0000","last_undegraded":"2024-09-12T00:54:39.551664+0000","last_fullsized":"2024-09-12T00:54:39.551664+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'197","last_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_deep_scrub":"266'197","last_deep_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.551438+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.232360+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":36400,"num_write":906,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:30.945612+0000","last_change":"2024-09-12T00:11:49.928504+0000","last_active":"2024-09-12T00:51:30.945612+0000","last_peered":"2024-09-12T00:51:30.945612+0000","last_clean":"2024-09-12T00:51:30.945612+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:51:30.945612+0000","last_undegraded":"2024-09-12T00:51:30.945612+0000","last_fullsized":"2024-09-12T00:51:30.945612+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:00.545918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'134","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.006533+0000","last_change":"2024-09-12T00:54:55.006533+0000","last_active":"2024-09-12T00:54:55.006533+0000","last_peered":"2024-09-12T00:54:55.006533+0000","last_clean":"2024-09-12T00:54:55.006533+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:54:55.006533+0000","last_undegraded":"2024-09-12T00:54:55.006533+0000","last_fullsized":"2024-09-12T00:54:55.006533+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.006347+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:12.305618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6499,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":240,"num_write":94,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926323+0000","last_change":"2024-09-12T00:11:53.970031+0000","last_active":"2024-09-12T00:51:35.926323+0000","last_peered":"2024-09-12T00:51:35.926323+0000","last_clean":"2024-09-12T00:51:35.926323+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:51:35.926323+0000","last_undegraded":"2024-09-12T00:51:35.926323+0000","last_fullsized":"2024-09-12T00:51:35.926323+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:27:04.869156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'722","reported_seq":2103,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:30.974112+0000","last_change":"2024-09-12T00:11:47.944209+0000","last_active":"2024-09-12T00:53:30.974112+0000","last_peered":"2024-09-12T00:53:30.974112+0000","last_clean":"2024-09-12T00:53:30.974112+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:53:30.974112+0000","last_undegraded":"2024-09-12T00:53:30.974112+0000","last_fullsized":"2024-09-12T00:53:30.974112+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":700,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:29:07.479060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'194","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.582437+0000","last_change":"2024-09-12T00:54:40.582437+0000","last_active":"2024-09-12T00:54:40.582437+0000","last_peered":"2024-09-12T00:54:40.582437+0000","last_clean":"2024-09-12T00:54:40.582437+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:54:40.582437+0000","last_undegraded":"2024-09-12T00:54:40.582437+0000","last_fullsized":"2024-09-12T00:54:40.582437+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.582154+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.450282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755647,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":8092,"num_write":868,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.539786+0000","last_change":"2024-09-12T00:54:55.539786+0000","last_active":"2024-09-12T00:54:55.539786+0000","last_peered":"2024-09-12T00:54:55.539786+0000","last_clean":"2024-09-12T00:54:55.539786+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:54:55.539786+0000","last_undegraded":"2024-09-12T00:54:55.539786+0000","last_fullsized":"2024-09-12T00:54:55.539786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.539573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:02.177277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'198","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.560580+0000","last_change":"2024-09-12T00:11:51.955207+0000","last_active":"2024-09-12T00:54:31.560580+0000","last_peered":"2024-09-12T00:54:31.560580+0000","last_clean":"2024-09-12T00:54:31.560580+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:54:31.560580+0000","last_undegraded":"2024-09-12T00:54:31.560580+0000","last_fullsized":"2024-09-12T00:54:31.560580+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":98,"log_dups_size":100,"ondisk_log_size":98,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:01:43.145562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19799,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":407,"num_write":194,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":485,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:56.127739+0000","last_change":"2024-09-12T00:11:53.970075+0000","last_active":"2024-09-12T00:51:56.127739+0000","last_peered":"2024-09-12T00:51:56.127739+0000","last_clean":"2024-09-12T00:51:56.127739+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:51:56.127739+0000","last_undegraded":"2024-09-12T00:51:56.127739+0000","last_fullsized":"2024-09-12T00:51:56.127739+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:43.073296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'153","reported_seq":652,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967355+0000","last_change":"2024-09-12T00:11:55.983643+0000","last_active":"2024-09-12T00:53:59.967355+0000","last_peered":"2024-09-12T00:53:59.967355+0000","last_clean":"2024-09-12T00:53:59.967355+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:53:59.967355+0000","last_undegraded":"2024-09-12T00:53:59.967355+0000","last_fullsized":"2024-09-12T00:53:59.967355+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:01.938989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'503","reported_seq":2231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.793156+0000","last_change":"2024-09-12T00:54:49.793156+0000","last_active":"2024-09-12T00:54:49.793156+0000","last_peered":"2024-09-12T00:54:49.793156+0000","last_clean":"2024-09-12T00:54:49.793156+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:54:49.793156+0000","last_undegraded":"2024-09-12T00:54:49.793156+0000","last_fullsized":"2024-09-12T00:54:49.793156+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'503","last_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_deep_scrub":"266'503","last_deep_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.792973+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.396328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3754,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'205","reported_seq":880,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.723164+0000","last_change":"2024-09-12T00:54:37.723164+0000","last_active":"2024-09-12T00:54:37.723164+0000","last_peered":"2024-09-12T00:54:37.723164+0000","last_clean":"2024-09-12T00:54:37.723164+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:54:37.723164+0000","last_undegraded":"2024-09-12T00:54:37.723164+0000","last_fullsized":"2024-09-12T00:54:37.723164+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.722978+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.296272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":547,"num_read_kb":23120,"num_write":969,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.723086+0000","last_change":"2024-09-12T00:54:53.723086+0000","last_active":"2024-09-12T00:54:53.723086+0000","last_peered":"2024-09-12T00:54:53.723086+0000","last_clean":"2024-09-12T00:54:53.723086+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:54:53.723086+0000","last_undegraded":"2024-09-12T00:54:53.723086+0000","last_fullsized":"2024-09-12T00:54:53.723086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.722892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.871247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'165","reported_seq":746,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.309896+0000","last_change":"2024-09-12T00:11:51.943970+0000","last_active":"2024-09-12T00:54:31.309896+0000","last_peered":"2024-09-12T00:54:31.309896+0000","last_clean":"2024-09-12T00:54:31.309896+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:54:31.309896+0000","last_undegraded":"2024-09-12T00:54:31.309896+0000","last_fullsized":"2024-09-12T00:54:31.309896+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":100,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:17.685375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7301,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":226,"num_read_kb":291,"num_write":146,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:54.937822+0000","last_change":"2024-09-12T00:11:53.969086+0000","last_active":"2024-09-12T00:51:54.937822+0000","last_peered":"2024-09-12T00:51:54.937822+0000","last_clean":"2024-09-12T00:51:54.937822+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:51:54.937822+0000","last_undegraded":"2024-09-12T00:51:54.937822+0000","last_fullsized":"2024-09-12T00:51:54.937822+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:51:41.001970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.122045+0000","last_change":"2024-09-12T00:11:55.970975+0000","last_active":"2024-09-12T00:54:17.122045+0000","last_peered":"2024-09-12T00:54:17.122045+0000","last_clean":"2024-09-12T00:54:17.122045+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:54:17.122045+0000","last_undegraded":"2024-09-12T00:54:17.122045+0000","last_fullsized":"2024-09-12T00:54:17.122045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:19.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'811","reported_seq":2321,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.633649+0000","last_change":"2024-09-12T00:54:45.633649+0000","last_active":"2024-09-12T00:54:45.633649+0000","last_peered":"2024-09-12T00:54:45.633649+0000","last_clean":"2024-09-12T00:54:45.633649+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:54:45.633649+0000","last_undegraded":"2024-09-12T00:54:45.633649+0000","last_fullsized":"2024-09-12T00:54:45.633649+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'811","last_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_deep_scrub":"266'811","last_deep_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.633450+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:59.575094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'210","reported_seq":822,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.236261+0000","last_change":"2024-09-12T00:54:38.236261+0000","last_active":"2024-09-12T00:54:38.236261+0000","last_peered":"2024-09-12T00:54:38.236261+0000","last_clean":"2024-09-12T00:54:38.236261+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:38.236261+0000","last_undegraded":"2024-09-12T00:54:38.236261+0000","last_fullsized":"2024-09-12T00:54:38.236261+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.236030+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:45.112722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":380,"num_read_kb":5549,"num_write":1015,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.754225+0000","last_change":"2024-09-12T00:54:51.754225+0000","last_active":"2024-09-12T00:54:51.754225+0000","last_peered":"2024-09-12T00:54:51.754225+0000","last_clean":"2024-09-12T00:54:51.754225+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:54:51.754225+0000","last_undegraded":"2024-09-12T00:54:51.754225+0000","last_fullsized":"2024-09-12T00:54:51.754225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.753927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:23.486364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'150","reported_seq":731,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.529052+0000","last_change":"2024-09-12T00:11:51.947579+0000","last_active":"2024-09-12T00:54:31.529052+0000","last_peered":"2024-09-12T00:54:31.529052+0000","last_clean":"2024-09-12T00:54:31.529052+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:54:31.529052+0000","last_undegraded":"2024-09-12T00:54:31.529052+0000","last_fullsized":"2024-09-12T00:54:31.529052+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":100,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:33:01.742280+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":186,"num_read_kb":226,"num_write":104,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":492,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.932799+0000","last_change":"2024-09-12T00:11:53.966010+0000","last_active":"2024-09-12T00:52:05.932799+0000","last_peered":"2024-09-12T00:52:05.932799+0000","last_clean":"2024-09-12T00:52:05.932799+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:52:05.932799+0000","last_undegraded":"2024-09-12T00:52:05.932799+0000","last_fullsized":"2024-09-12T00:52:05.932799+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:56.714255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'153","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.341421+0000","last_change":"2024-09-12T00:11:55.984385+0000","last_active":"2024-09-12T00:54:18.341421+0000","last_peered":"2024-09-12T00:54:18.341421+0000","last_clean":"2024-09-12T00:54:18.341421+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:54:18.341421+0000","last_undegraded":"2024-09-12T00:54:18.341421+0000","last_fullsized":"2024-09-12T00:54:18.341421+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:18.613083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'791","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.743302+0000","last_change":"2024-09-12T00:54:47.743302+0000","last_active":"2024-09-12T00:54:47.743302+0000","last_peered":"2024-09-12T00:54:47.743302+0000","last_clean":"2024-09-12T00:54:47.743302+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:54:47.743302+0000","last_undegraded":"2024-09-12T00:54:47.743302+0000","last_fullsized":"2024-09-12T00:54:47.743302+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.743080+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.272707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'210","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.734334+0000","last_change":"2024-09-12T00:54:41.734334+0000","last_active":"2024-09-12T00:54:41.734334+0000","last_peered":"2024-09-12T00:54:41.734334+0000","last_clean":"2024-09-12T00:54:41.734334+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:54:41.734334+0000","last_undegraded":"2024-09-12T00:54:41.734334+0000","last_fullsized":"2024-09-12T00:54:41.734334+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.734103+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.931010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1993302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":30758,"num_write":1020,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931153+0000","last_change":"2024-09-12T00:11:49.944879+0000","last_active":"2024-09-12T00:51:50.931153+0000","last_peered":"2024-09-12T00:51:50.931153+0000","last_clean":"2024-09-12T00:51:50.931153+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:51:50.931153+0000","last_undegraded":"2024-09-12T00:51:50.931153+0000","last_fullsized":"2024-09-12T00:51:50.931153+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:50.523417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'95","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954504+0000","last_change":"2024-09-12T00:11:51.938728+0000","last_active":"2024-09-12T00:52:05.954504+0000","last_peered":"2024-09-12T00:52:05.954504+0000","last_clean":"2024-09-12T00:52:05.954504+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:52:05.954504+0000","last_undegraded":"2024-09-12T00:52:05.954504+0000","last_fullsized":"2024-09-12T00:52:05.954504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:11.275648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'756","reported_seq":2389,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.012592+0000","last_change":"2024-09-12T00:11:53.945013+0000","last_active":"2024-09-12T00:54:31.012592+0000","last_peered":"2024-09-12T00:54:31.012592+0000","last_clean":"2024-09-12T00:54:31.012592+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:31.012592+0000","last_undegraded":"2024-09-12T00:54:31.012592+0000","last_fullsized":"2024-09-12T00:54:31.012592+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:13:55.474571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.361616+0000","last_change":"2024-09-12T00:11:55.961931+0000","last_active":"2024-09-12T00:53:14.361616+0000","last_peered":"2024-09-12T00:53:14.361616+0000","last_clean":"2024-09-12T00:53:14.361616+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:53:14.361616+0000","last_undegraded":"2024-09-12T00:53:14.361616+0000","last_fullsized":"2024-09-12T00:53:14.361616+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.615113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'465","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.746619+0000","last_change":"2024-09-12T00:54:46.746619+0000","last_active":"2024-09-12T00:54:46.746619+0000","last_peered":"2024-09-12T00:54:46.746619+0000","last_clean":"2024-09-12T00:54:46.746619+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:54:46.746619+0000","last_undegraded":"2024-09-12T00:54:46.746619+0000","last_fullsized":"2024-09-12T00:54:46.746619+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'465","last_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_deep_scrub":"266'465","last_deep_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.746430+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:31.460666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'218","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.261923+0000","last_change":"2024-09-12T00:54:39.261923+0000","last_active":"2024-09-12T00:54:39.261923+0000","last_peered":"2024-09-12T00:54:39.261923+0000","last_clean":"2024-09-12T00:54:39.261923+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:39.261923+0000","last_undegraded":"2024-09-12T00:54:39.261923+0000","last_fullsized":"2024-09-12T00:54:39.261923+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.261665+0000","objects_scrubbed":10,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:35.988750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457849,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":55718,"num_write":1000,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.492143+0000","last_change":"2024-09-12T00:54:53.492143+0000","last_active":"2024-09-12T00:54:53.492143+0000","last_peered":"2024-09-12T00:54:53.492143+0000","last_clean":"2024-09-12T00:54:53.492143+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:54:53.492143+0000","last_undegraded":"2024-09-12T00:54:53.492143+0000","last_fullsized":"2024-09-12T00:54:53.492143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.491956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:33.502230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'189","reported_seq":789,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.140500+0000","last_change":"2024-09-12T00:11:51.942692+0000","last_active":"2024-09-12T00:54:31.140500+0000","last_peered":"2024-09-12T00:54:31.140500+0000","last_clean":"2024-09-12T00:54:31.140500+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:54:31.140500+0000","last_undegraded":"2024-09-12T00:54:31.140500+0000","last_fullsized":"2024-09-12T00:54:31.140500+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:27.066244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":245,"num_read_kb":305,"num_write":140,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:35.913907+0000","last_change":"2024-09-12T00:11:53.968374+0000","last_active":"2024-09-12T00:50:35.913907+0000","last_peered":"2024-09-12T00:50:35.913907+0000","last_clean":"2024-09-12T00:50:35.913907+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:50:35.913907+0000","last_undegraded":"2024-09-12T00:50:35.913907+0000","last_fullsized":"2024-09-12T00:50:35.913907+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:08.048773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'124","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:01.975045+0000","last_change":"2024-09-12T00:11:55.975761+0000","last_active":"2024-09-12T00:53:01.975045+0000","last_peered":"2024-09-12T00:53:01.975045+0000","last_clean":"2024-09-12T00:53:01.975045+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:53:01.975045+0000","last_undegraded":"2024-09-12T00:53:01.975045+0000","last_fullsized":"2024-09-12T00:53:01.975045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:01:21.563576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'929","reported_seq":2641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.729243+0000","last_change":"2024-09-12T00:54:50.729243+0000","last_active":"2024-09-12T00:54:50.729243+0000","last_peered":"2024-09-12T00:54:50.729243+0000","last_clean":"2024-09-12T00:54:50.729243+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:54:50.729243+0000","last_undegraded":"2024-09-12T00:54:50.729243+0000","last_fullsized":"2024-09-12T00:54:50.729243+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.729071+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:45.264752+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":930,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'221","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.188603+0000","last_change":"2024-09-12T00:54:47.188603+0000","last_active":"2024-09-12T00:54:47.188603+0000","last_peered":"2024-09-12T00:54:47.188603+0000","last_clean":"2024-09-12T00:54:47.188603+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:54:47.188603+0000","last_undegraded":"2024-09-12T00:54:47.188603+0000","last_fullsized":"2024-09-12T00:54:47.188603+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.188407+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:18.153988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":417,"num_read_kb":8883,"num_write":990,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.762197+0000","last_change":"2024-09-12T00:54:52.762197+0000","last_active":"2024-09-12T00:54:52.762197+0000","last_peered":"2024-09-12T00:54:52.762197+0000","last_clean":"2024-09-12T00:54:52.762197+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:54:52.762197+0000","last_undegraded":"2024-09-12T00:54:52.762197+0000","last_fullsized":"2024-09-12T00:54:52.762197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.761997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:26.003820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'132","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.168909+0000","last_change":"2024-09-12T00:11:51.948398+0000","last_active":"2024-09-12T00:54:31.168909+0000","last_peered":"2024-09-12T00:54:31.168909+0000","last_clean":"2024-09-12T00:54:31.168909+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:54:31.168909+0000","last_undegraded":"2024-09-12T00:54:31.168909+0000","last_fullsized":"2024-09-12T00:54:31.168909+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":100,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:50:24.018531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":258,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934303+0000","last_change":"2024-09-12T00:11:53.964372+0000","last_active":"2024-09-12T00:50:45.934303+0000","last_peered":"2024-09-12T00:50:45.934303+0000","last_clean":"2024-09-12T00:50:45.934303+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:50:45.934303+0000","last_undegraded":"2024-09-12T00:50:45.934303+0000","last_fullsized":"2024-09-12T00:50:45.934303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:46.181767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'122","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.250013+0000","last_change":"2024-09-12T00:11:55.983399+0000","last_active":"2024-09-12T00:53:00.250013+0000","last_peered":"2024-09-12T00:53:00.250013+0000","last_clean":"2024-09-12T00:53:00.250013+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:53:00.250013+0000","last_undegraded":"2024-09-12T00:53:00.250013+0000","last_fullsized":"2024-09-12T00:53:00.250013+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.340677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'511","reported_seq":2139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.644781+0000","last_change":"2024-09-12T00:54:42.644781+0000","last_active":"2024-09-12T00:54:42.644781+0000","last_peered":"2024-09-12T00:54:42.644781+0000","last_clean":"2024-09-12T00:54:42.644781+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:54:42.644781+0000","last_undegraded":"2024-09-12T00:54:42.644781+0000","last_fullsized":"2024-09-12T00:54:42.644781+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.644589+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":400,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:44.947353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'213","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.537375+0000","last_change":"2024-09-12T00:54:41.537375+0000","last_active":"2024-09-12T00:54:41.537375+0000","last_peered":"2024-09-12T00:54:41.537375+0000","last_clean":"2024-09-12T00:54:41.537375+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:54:41.537375+0000","last_undegraded":"2024-09-12T00:54:41.537375+0000","last_fullsized":"2024-09-12T00:54:41.537375+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.537037+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:47.685748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":6403,"num_write":967,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.497088+0000","last_change":"2024-09-12T00:54:51.497088+0000","last_active":"2024-09-12T00:54:51.497088+0000","last_peered":"2024-09-12T00:54:51.497088+0000","last_clean":"2024-09-12T00:54:51.497088+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:54:51.497088+0000","last_undegraded":"2024-09-12T00:54:51.497088+0000","last_fullsized":"2024-09-12T00:54:51.497088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.496915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.499895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'102","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.483283+0000","last_change":"2024-09-12T00:11:51.934188+0000","last_active":"2024-09-12T00:54:31.483283+0000","last_peered":"2024-09-12T00:54:31.483283+0000","last_clean":"2024-09-12T00:54:31.483283+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:31.483283+0000","last_undegraded":"2024-09-12T00:54:31.483283+0000","last_fullsized":"2024-09-12T00:54:31.483283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":102,"log_dups_size":0,"ondisk_log_size":102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:44:43.730149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":203,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.951806+0000","last_change":"2024-09-12T00:11:53.953440+0000","last_active":"2024-09-12T00:51:55.951806+0000","last_peered":"2024-09-12T00:51:55.951806+0000","last_clean":"2024-09-12T00:51:55.951806+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:51:55.951806+0000","last_undegraded":"2024-09-12T00:51:55.951806+0000","last_fullsized":"2024-09-12T00:51:55.951806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:27.100590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'166","reported_seq":1291,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.040679+0000","last_change":"2024-09-12T00:11:55.977584+0000","last_active":"2024-09-12T00:53:12.040679+0000","last_peered":"2024-09-12T00:53:12.040679+0000","last_clean":"2024-09-12T00:53:12.040679+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:53:12.040679+0000","last_undegraded":"2024-09-12T00:53:12.040679+0000","last_fullsized":"2024-09-12T00:53:12.040679+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:56.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'393","reported_seq":1794,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.733121+0000","last_change":"2024-09-12T00:54:47.733121+0000","last_active":"2024-09-12T00:54:47.733121+0000","last_peered":"2024-09-12T00:54:47.733121+0000","last_clean":"2024-09-12T00:54:47.733121+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:54:47.733121+0000","last_undegraded":"2024-09-12T00:54:47.733121+0000","last_fullsized":"2024-09-12T00:54:47.733121+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.732939+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.184825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'225","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.578362+0000","last_change":"2024-09-12T00:54:44.578362+0000","last_active":"2024-09-12T00:54:44.578362+0000","last_peered":"2024-09-12T00:54:44.578362+0000","last_clean":"2024-09-12T00:54:44.578362+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:54:44.578362+0000","last_undegraded":"2024-09-12T00:54:44.578362+0000","last_fullsized":"2024-09-12T00:54:44.578362+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'225","last_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_deep_scrub":"266'225","last_deep_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.577941+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:23.931116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":20983,"num_write":1046,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"30'1","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:40.915124+0000","last_change":"2024-09-12T00:11:49.935062+0000","last_active":"2024-09-12T00:50:40.915124+0000","last_peered":"2024-09-12T00:50:40.915124+0000","last_clean":"2024-09-12T00:50:40.915124+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:50:40.915124+0000","last_undegraded":"2024-09-12T00:50:40.915124+0000","last_fullsized":"2024-09-12T00:50:40.915124+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:48.894530+0000","last_clean_scrub_stamp":"2024-09-12T00:11:48.894530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:08:45.647589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'177","reported_seq":771,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.553317+0000","last_change":"2024-09-12T00:11:51.953534+0000","last_active":"2024-09-12T00:54:31.553317+0000","last_peered":"2024-09-12T00:54:31.553317+0000","last_clean":"2024-09-12T00:54:31.553317+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:54:31.553317+0000","last_undegraded":"2024-09-12T00:54:31.553317+0000","last_fullsized":"2024-09-12T00:54:31.553317+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:50.900582+0000","last_clean_scrub_stamp":"2024-09-12T00:11:50.900582+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:28:08.139733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9188,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":326,"num_write":136,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":489,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.932205+0000","last_change":"2024-09-12T00:11:53.964796+0000","last_active":"2024-09-12T00:51:55.932205+0000","last_peered":"2024-09-12T00:51:55.932205+0000","last_clean":"2024-09-12T00:51:55.932205+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:51:55.932205+0000","last_undegraded":"2024-09-12T00:51:55.932205+0000","last_fullsized":"2024-09-12T00:51:55.932205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:12:35.493703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'120","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.194988+0000","last_change":"2024-09-12T00:11:55.976617+0000","last_active":"2024-09-12T00:54:17.194988+0000","last_peered":"2024-09-12T00:54:17.194988+0000","last_clean":"2024-09-12T00:54:17.194988+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:54:17.194988+0000","last_undegraded":"2024-09-12T00:54:17.194988+0000","last_fullsized":"2024-09-12T00:54:17.194988+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":100,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:04.168911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'499","reported_seq":2032,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.741666+0000","last_change":"2024-09-12T00:54:48.741666+0000","last_active":"2024-09-12T00:54:48.741666+0000","last_peered":"2024-09-12T00:54:48.741666+0000","last_clean":"2024-09-12T00:54:48.741666+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:54:48.741666+0000","last_undegraded":"2024-09-12T00:54:48.741666+0000","last_fullsized":"2024-09-12T00:54:48.741666+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.741497+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:24.293528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'193","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.747873+0000","last_change":"2024-09-12T00:54:40.747873+0000","last_active":"2024-09-12T00:54:40.747873+0000","last_peered":"2024-09-12T00:54:40.747873+0000","last_clean":"2024-09-12T00:54:40.747873+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:54:40.747873+0000","last_undegraded":"2024-09-12T00:54:40.747873+0000","last_fullsized":"2024-09-12T00:54:40.747873+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.747645+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:07.125444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069312,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":61937,"num_write":920,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'819","reported_seq":2327,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.636159+0000","last_change":"2024-09-12T00:54:46.636159+0000","last_active":"2024-09-12T00:54:46.636159+0000","last_peered":"2024-09-12T00:54:46.636159+0000","last_clean":"2024-09-12T00:54:46.636159+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:54:46.636159+0000","last_undegraded":"2024-09-12T00:54:46.636159+0000","last_fullsized":"2024-09-12T00:54:46.636159+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'819","last_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_deep_scrub":"266'819","last_deep_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.635949+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:39.192196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1184,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'189","reported_seq":831,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.614805+0000","last_change":"2024-09-12T00:54:40.614805+0000","last_active":"2024-09-12T00:54:40.614805+0000","last_peered":"2024-09-12T00:54:40.614805+0000","last_clean":"2024-09-12T00:54:40.614805+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:54:40.614805+0000","last_undegraded":"2024-09-12T00:54:40.614805+0000","last_fullsized":"2024-09-12T00:54:40.614805+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'189","last_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_deep_scrub":"266'189","last_deep_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.614609+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:12.172432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":418,"num_read_kb":18747,"num_write":861,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1200","reported_seq":2879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.294002+0000","last_change":"2024-09-12T00:11:47.923352+0000","last_active":"2024-09-12T00:53:59.294002+0000","last_peered":"2024-09-12T00:53:59.294002+0000","last_clean":"2024-09-12T00:53:59.294002+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:53:59.294002+0000","last_undegraded":"2024-09-12T00:53:59.294002+0000","last_fullsized":"2024-09-12T00:53:59.294002+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":100,"log_dups_size":1100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:19.576732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'209","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.227154+0000","last_change":"2024-09-12T00:54:46.227154+0000","last_active":"2024-09-12T00:54:46.227154+0000","last_peered":"2024-09-12T00:54:46.227154+0000","last_clean":"2024-09-12T00:54:46.227154+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:54:46.227154+0000","last_undegraded":"2024-09-12T00:54:46.227154+0000","last_fullsized":"2024-09-12T00:54:46.227154+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'209","last_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_deep_scrub":"266'209","last_deep_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.226930+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:33.782653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753496,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":35398,"num_write":969,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'475","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.528895+0000","last_change":"2024-09-12T00:54:54.528895+0000","last_active":"2024-09-12T00:54:54.528895+0000","last_peered":"2024-09-12T00:54:54.528895+0000","last_clean":"2024-09-12T00:54:54.528895+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:54:54.528895+0000","last_undegraded":"2024-09-12T00:54:54.528895+0000","last_fullsized":"2024-09-12T00:54:54.528895+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'475","last_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_deep_scrub":"266'475","last_deep_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.528706+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:14.173614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2762,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'203","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.586198+0000","last_change":"2024-09-12T00:54:42.586198+0000","last_active":"2024-09-12T00:54:42.586198+0000","last_peered":"2024-09-12T00:54:42.586198+0000","last_clean":"2024-09-12T00:54:42.586198+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:54:42.586198+0000","last_undegraded":"2024-09-12T00:54:42.586198+0000","last_fullsized":"2024-09-12T00:54:42.586198+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.585972+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.593597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":18770,"num_write":983,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'806","reported_seq":2343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.489353+0000","last_change":"2024-09-12T00:54:53.489353+0000","last_active":"2024-09-12T00:54:53.489353+0000","last_peered":"2024-09-12T00:54:53.489353+0000","last_clean":"2024-09-12T00:54:53.489353+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:54:53.489353+0000","last_undegraded":"2024-09-12T00:54:53.489353+0000","last_fullsized":"2024-09-12T00:54:53.489353+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'806","last_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_deep_scrub":"266'806","last_deep_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.489176+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.643319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'248","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.497352+0000","last_change":"2024-09-12T00:54:40.497352+0000","last_active":"2024-09-12T00:54:40.497352+0000","last_peered":"2024-09-12T00:54:40.497352+0000","last_clean":"2024-09-12T00:54:40.497352+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:54:40.497352+0000","last_undegraded":"2024-09-12T00:54:40.497352+0000","last_fullsized":"2024-09-12T00:54:40.497352+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.497103+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:25.148164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":28384,"num_write":1056,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'478","reported_seq":1947,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.025475+0000","last_change":"2024-09-12T00:54:49.025475+0000","last_active":"2024-09-12T00:54:49.025475+0000","last_peered":"2024-09-12T00:54:49.025475+0000","last_clean":"2024-09-12T00:54:49.025475+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:54:49.025475+0000","last_undegraded":"2024-09-12T00:54:49.025475+0000","last_fullsized":"2024-09-12T00:54:49.025475+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.025287+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.458555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'293","reported_seq":1113,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.540937+0000","last_change":"2024-09-12T00:54:41.540937+0000","last_active":"2024-09-12T00:54:41.540937+0000","last_peered":"2024-09-12T00:54:41.540937+0000","last_clean":"2024-09-12T00:54:41.540937+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:54:41.540937+0000","last_undegraded":"2024-09-12T00:54:41.540937+0000","last_fullsized":"2024-09-12T00:54:41.540937+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'293","last_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_deep_scrub":"266'293","last_deep_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.540710+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:24.383696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1398,"num_read_kb":1619,"num_write":1277,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'613","reported_seq":2351,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.590571+0000","last_change":"2024-09-12T00:54:50.590571+0000","last_active":"2024-09-12T00:54:50.590571+0000","last_peered":"2024-09-12T00:54:50.590571+0000","last_clean":"2024-09-12T00:54:50.590571+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:54:50.590571+0000","last_undegraded":"2024-09-12T00:54:50.590571+0000","last_fullsized":"2024-09-12T00:54:50.590571+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'613","last_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_deep_scrub":"266'613","last_deep_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.590357+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:41.152978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'228","reported_seq":850,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.694245+0000","last_change":"2024-09-12T00:54:38.694245+0000","last_active":"2024-09-12T00:54:38.694245+0000","last_peered":"2024-09-12T00:54:38.694245+0000","last_clean":"2024-09-12T00:54:38.694245+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:38.694245+0000","last_undegraded":"2024-09-12T00:54:38.694245+0000","last_fullsized":"2024-09-12T00:54:38.694245+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.693931+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:45.558338+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7916704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":17177,"num_write":1053,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1256","reported_seq":3024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.314574+0000","last_change":"2024-09-12T00:54:41.314574+0000","last_active":"2024-09-12T00:54:41.314574+0000","last_peered":"2024-09-12T00:54:41.314574+0000","last_clean":"2024-09-12T00:54:41.314574+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:54:41.314574+0000","last_undegraded":"2024-09-12T00:54:41.314574+0000","last_fullsized":"2024-09-12T00:54:41.314574+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1256","last_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_deep_scrub":"266'1256","last_deep_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.314407+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":1200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:58.492484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'277","reported_seq":930,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.614374+0000","last_change":"2024-09-12T00:54:43.614374+0000","last_active":"2024-09-12T00:54:43.614374+0000","last_peered":"2024-09-12T00:54:43.614374+0000","last_clean":"2024-09-12T00:54:43.614374+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:54:43.614374+0000","last_undegraded":"2024-09-12T00:54:43.614374+0000","last_fullsized":"2024-09-12T00:54:43.614374+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'277","last_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_deep_scrub":"266'277","last_deep_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.614131+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:24.435399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525343,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":15585,"num_write":1267,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'829","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.567505+0000","last_change":"2024-09-12T00:54:48.567505+0000","last_active":"2024-09-12T00:54:48.567505+0000","last_peered":"2024-09-12T00:54:48.567505+0000","last_clean":"2024-09-12T00:54:48.567505+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:54:48.567505+0000","last_undegraded":"2024-09-12T00:54:48.567505+0000","last_fullsized":"2024-09-12T00:54:48.567505+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.567318+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:51.422110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'251","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.243735+0000","last_change":"2024-09-12T00:54:48.243735+0000","last_active":"2024-09-12T00:54:48.243735+0000","last_peered":"2024-09-12T00:54:48.243735+0000","last_clean":"2024-09-12T00:54:48.243735+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:54:48.243735+0000","last_undegraded":"2024-09-12T00:54:48.243735+0000","last_fullsized":"2024-09-12T00:54:48.243735+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'251","last_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_deep_scrub":"266'251","last_deep_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.243504+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:31.911455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10118774,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":58641,"num_write":1118,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1328","reported_seq":2859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.982053+0000","last_change":"2024-09-12T00:54:49.982053+0000","last_active":"2024-09-12T00:54:49.982053+0000","last_peered":"2024-09-12T00:54:49.982053+0000","last_clean":"2024-09-12T00:54:49.982053+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:54:49.982053+0000","last_undegraded":"2024-09-12T00:54:49.982053+0000","last_fullsized":"2024-09-12T00:54:49.982053+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1328","last_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_deep_scrub":"266'1328","last_deep_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.981823+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":1300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:42.896076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'196","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.530369+0000","last_change":"2024-09-12T00:54:45.530369+0000","last_active":"2024-09-12T00:54:45.530369+0000","last_peered":"2024-09-12T00:54:45.530369+0000","last_clean":"2024-09-12T00:54:45.530369+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:54:45.530369+0000","last_undegraded":"2024-09-12T00:54:45.530369+0000","last_fullsized":"2024-09-12T00:54:45.530369+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.530104+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:31.515428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262331,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":34280,"num_write":929,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'551","reported_seq":2099,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:10.502645+0000","last_change":"2024-09-12T00:11:47.935891+0000","last_active":"2024-09-12T00:53:10.502645+0000","last_peered":"2024-09-12T00:53:10.502645+0000","last_clean":"2024-09-12T00:53:10.502645+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:53:10.502645+0000","last_undegraded":"2024-09-12T00:53:10.502645+0000","last_fullsized":"2024-09-12T00:53:10.502645+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:46.887296+0000","last_clean_scrub_stamp":"2024-09-12T00:11:46.887296+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":500,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'229","reported_seq":972,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.285793+0000","last_change":"2024-09-12T00:54:37.285793+0000","last_active":"2024-09-12T00:54:37.285793+0000","last_peered":"2024-09-12T00:54:37.285793+0000","last_clean":"2024-09-12T00:54:37.285793+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:54:37.285793+0000","last_undegraded":"2024-09-12T00:54:37.285793+0000","last_fullsized":"2024-09-12T00:54:37.285793+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.285624+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.468189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460242,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":746,"num_read_kb":61726,"num_write":1110,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'703","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.427718+0000","last_change":"2024-09-12T00:54:47.427718+0000","last_active":"2024-09-12T00:54:47.427718+0000","last_peered":"2024-09-12T00:54:47.427718+0000","last_clean":"2024-09-12T00:54:47.427718+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:54:47.427718+0000","last_undegraded":"2024-09-12T00:54:47.427718+0000","last_fullsized":"2024-09-12T00:54:47.427718+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'703","last_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_deep_scrub":"266'703","last_deep_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.427536+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:27.740664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'210","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.759263+0000","last_change":"2024-09-12T00:54:43.759263+0000","last_active":"2024-09-12T00:54:43.759263+0000","last_peered":"2024-09-12T00:54:43.759263+0000","last_clean":"2024-09-12T00:54:43.759263+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:54:43.759263+0000","last_undegraded":"2024-09-12T00:54:43.759263+0000","last_fullsized":"2024-09-12T00:54:43.759263+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.758895+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:11.039233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457515,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":13749,"num_write":936,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'966","reported_seq":2529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.413623+0000","last_change":"2024-09-12T00:54:44.413623+0000","last_active":"2024-09-12T00:54:44.413623+0000","last_peered":"2024-09-12T00:54:44.413623+0000","last_clean":"2024-09-12T00:54:44.413623+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:54:44.413623+0000","last_undegraded":"2024-09-12T00:54:44.413623+0000","last_fullsized":"2024-09-12T00:54:44.413623+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'966","last_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_deep_scrub":"266'966","last_deep_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.413459+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.872760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'210","reported_seq":897,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.004309+0000","last_change":"2024-09-12T00:54:39.004309+0000","last_active":"2024-09-12T00:54:39.004309+0000","last_peered":"2024-09-12T00:54:39.004309+0000","last_clean":"2024-09-12T00:54:39.004309+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:54:39.004309+0000","last_undegraded":"2024-09-12T00:54:39.004309+0000","last_fullsized":"2024-09-12T00:54:39.004309+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.004060+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:37.718332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":23861,"num_write":1050,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'754","reported_seq":2238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.590559+0000","last_change":"2024-09-12T00:54:47.590559+0000","last_active":"2024-09-12T00:54:47.590559+0000","last_peered":"2024-09-12T00:54:47.590559+0000","last_clean":"2024-09-12T00:54:47.590559+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:54:47.590559+0000","last_undegraded":"2024-09-12T00:54:47.590559+0000","last_fullsized":"2024-09-12T00:54:47.590559+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'754","last_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_deep_scrub":"266'754","last_deep_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.590381+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:16.432151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'164","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.259884+0000","last_change":"2024-09-12T00:54:49.259884+0000","last_active":"2024-09-12T00:54:49.259884+0000","last_peered":"2024-09-12T00:54:49.259884+0000","last_clean":"2024-09-12T00:54:49.259884+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:54:49.259884+0000","last_undegraded":"2024-09-12T00:54:49.259884+0000","last_fullsized":"2024-09-12T00:54:49.259884+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'164","last_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_deep_scrub":"266'164","last_deep_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.259672+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:01.483020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399130,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":3653,"num_write":817,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'837","reported_seq":2669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.793185+0000","last_change":"2024-09-12T00:54:50.793185+0000","last_active":"2024-09-12T00:54:50.793185+0000","last_peered":"2024-09-12T00:54:50.793185+0000","last_clean":"2024-09-12T00:54:50.793185+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:54:50.793185+0000","last_undegraded":"2024-09-12T00:54:50.793185+0000","last_fullsized":"2024-09-12T00:54:50.793185+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'837","last_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_deep_scrub":"266'837","last_deep_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.792947+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:52.531844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2733,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'220","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.603322+0000","last_change":"2024-09-12T00:54:41.603322+0000","last_active":"2024-09-12T00:54:41.603322+0000","last_peered":"2024-09-12T00:54:41.603322+0000","last_clean":"2024-09-12T00:54:41.603322+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:54:41.603322+0000","last_undegraded":"2024-09-12T00:54:41.603322+0000","last_fullsized":"2024-09-12T00:54:41.603322+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'220","last_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_deep_scrub":"266'220","last_deep_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.603085+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:05.399778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430198,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":27002,"num_write":976,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'448","reported_seq":2075,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.356125+0000","last_change":"2024-09-12T00:54:42.356125+0000","last_active":"2024-09-12T00:54:42.356125+0000","last_peered":"2024-09-12T00:54:42.356125+0000","last_clean":"2024-09-12T00:54:42.356125+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:54:42.356125+0000","last_undegraded":"2024-09-12T00:54:42.356125+0000","last_fullsized":"2024-09-12T00:54:42.356125+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.355937+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:01.881468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'186","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.293468+0000","last_change":"2024-09-12T00:54:50.293468+0000","last_active":"2024-09-12T00:54:50.293468+0000","last_peered":"2024-09-12T00:54:50.293468+0000","last_clean":"2024-09-12T00:54:50.293468+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:54:50.293468+0000","last_undegraded":"2024-09-12T00:54:50.293468+0000","last_fullsized":"2024-09-12T00:54:50.293468+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.293253+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:08.784599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":12744,"num_write":922,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.268108+0000","last_change":"2024-09-12T00:54:51.268108+0000","last_active":"2024-09-12T00:54:51.268108+0000","last_peered":"2024-09-12T00:54:51.268108+0000","last_clean":"2024-09-12T00:54:51.268108+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:54:51.268108+0000","last_undegraded":"2024-09-12T00:54:51.268108+0000","last_fullsized":"2024-09-12T00:54:51.268108+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.267890+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:47.302659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":71383,"num_write":1072,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'456","reported_seq":2147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.803256+0000","last_change":"2024-09-12T00:54:51.803256+0000","last_active":"2024-09-12T00:54:51.803256+0000","last_peered":"2024-09-12T00:54:51.803256+0000","last_clean":"2024-09-12T00:54:51.803256+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:54:51.803256+0000","last_undegraded":"2024-09-12T00:54:51.803256+0000","last_fullsized":"2024-09-12T00:54:51.803256+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.803069+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:01.594700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'208","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.549008+0000","last_change":"2024-09-12T00:54:46.549008+0000","last_active":"2024-09-12T00:54:46.549008+0000","last_peered":"2024-09-12T00:54:46.549008+0000","last_clean":"2024-09-12T00:54:46.549008+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:54:46.549008+0000","last_undegraded":"2024-09-12T00:54:46.549008+0000","last_fullsized":"2024-09-12T00:54:46.549008+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.548801+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.676960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194359,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":710,"num_read_kb":180313,"num_write":963,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'929","reported_seq":2699,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.418811+0000","last_change":"2024-09-12T00:54:48.418811+0000","last_active":"2024-09-12T00:54:48.418811+0000","last_peered":"2024-09-12T00:54:48.418811+0000","last_clean":"2024-09-12T00:54:48.418811+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:48.418811+0000","last_undegraded":"2024-09-12T00:54:48.418811+0000","last_fullsized":"2024-09-12T00:54:48.418811+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.418615+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:00.299961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":959,"ondisk_log_size":959,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1850,"ondisk_log_size":1850,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":658,"ondisk_log_size":658,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":338265,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8580,"num_read_kb":10748,"num_write":5747,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":497746,"num_omap_keys":1148,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2036,"ondisk_log_size":2036,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":32979,"num_omap_keys":134,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4062,"ondisk_log_size":4062,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":104917588,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":33248,"num_read_kb":1979779,"num_write":63422,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159301632,"data_stored":159301632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4504,"ondisk_log_size":4504,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":190493,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":189755,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509964,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220400,"kb_used_data":18528,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94151440,"statfs":{"total":96636764160,"available":96411074560,"internally_reserved":0,"allocated":18972672,"data_stored":16979463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509965,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92208,"kb_used_data":20768,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94279632,"statfs":{"total":96636764160,"available":96542343168,"internally_reserved":0,"allocated":21266432,"data_stored":19245709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509966,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190576,"kb_used_data":28960,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94181264,"statfs":{"total":96636764160,"available":96441614336,"internally_reserved":0,"allocated":29655040,"data_stored":27647840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509966,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225952,"kb_used_data":32336,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94145888,"statfs":{"total":96636764160,"available":96405389312,"internally_reserved":0,"allocated":33112064,"data_stored":31105721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509967,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123728,"kb_used_data":24512,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94248112,"statfs":{"total":96636764160,"available":96510066688,"internally_reserved":0,"allocated":25100288,"data_stored":23091639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509966,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":289464,"kb_used_data":19496,"kb_used_omap":1,"kb_used_meta":269950,"kb_avail":94082376,"statfs":{"total":96636764160,"available":96340353024,"internally_reserved":0,"allocated":19963904,"data_stored":17949977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":276429255},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509965,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127816,"kb_used_data":24440,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94244024,"statfs":{"total":96636764160,"available":96505880576,"internally_reserved":0,"allocated":25026560,"data_stored":23006958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542673,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246392,"kb_used_data":20840,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125448,"statfs":{"total":96636764160,"available":96384458752,"internally_reserved":0,"allocated":21340160,"data_stored":19331103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20770816,"data_stored":20770816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":15126528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20856832,"data_stored":20856832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28872704,"data_stored":28872704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25411584,"data_stored":25411584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16506880,"data_stored":16506880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17010688,"data_stored":17010688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14745600,"data_stored":14745600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:54:58.782 INFO:tasks.ceph:pgid 68.1a last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.783 INFO:tasks.ceph:pgid 67.1d last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.783 INFO:tasks.ceph:pgid 66.1c last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.783 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.783 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.783 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.783 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.783 INFO:tasks.ceph:pgid 65.1e last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 68.18 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 65.1d last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 66.1f last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.784 INFO:tasks.ceph:pgid 65.1c last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 67.19 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 65.1b last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.785 INFO:tasks.ceph:pgid 65.1a last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 67.1b last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 66.1a last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 65.19 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 68.1d last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 66.1b last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.786 INFO:tasks.ceph:pgid 65.18 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 66.15 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.787 INFO:tasks.ceph:pgid 65.16 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 66.16 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 65.15 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 68.11 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 67.16 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.788 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 66.10 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.789 INFO:tasks.ceph:pgid 65.12 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 66.12 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 65.11 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 66.13 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.790 INFO:tasks.ceph:pgid 65.10 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 66.c last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 65.f last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 68.b last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 66.d last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.791 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 66.e last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 65.d last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 68.9 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 66.f last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 65.c last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.792 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 66.8 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 65.b last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 67.8 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 65.a last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.793 INFO:tasks.ceph:pgid 68.c last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.794 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.794 INFO:tasks.ceph:pgid 66.a last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.794 INFO:tasks.ceph:pgid 65.9 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.794 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.794 INFO:tasks.ceph:pgid 67.a last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.794 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.794 INFO:tasks.ceph:pgid 65.8 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.795 INFO:tasks.ceph:pgid 68.2 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.795 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.795 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.795 INFO:tasks.ceph:pgid 65.7 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.795 INFO:tasks.ceph:pgid 68.3 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.795 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.795 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 67.7 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 66.6 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 65.5 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.796 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 65.4 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 66.0 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 65.3 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.797 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 67.3 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 66.2 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 67.2 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.798 INFO:tasks.ceph:pgid 66.3 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.799 INFO:tasks.ceph:pgid 65.0 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.799 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.799 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.799 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.799 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.800 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.800 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.800 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.800 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.800 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.800 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.800 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.801 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.801 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.801 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.801 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.801 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.801 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.801 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.802 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.802 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.802 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.802 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.802 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.802 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.802 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.803 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.803 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.803 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.803 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.803 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.803 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.803 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.804 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.804 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.804 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.804 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.804 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.804 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.805 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.805 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.805 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.805 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.805 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.805 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.805 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.806 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.806 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.806 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.806 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.806 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.806 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.806 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.807 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.807 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.807 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.807 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.807 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.807 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.807 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.808 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.808 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.808 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.808 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.808 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.808 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.808 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.809 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.809 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.809 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.809 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.809 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.809 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.809 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.810 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.810 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.810 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.810 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.810 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.810 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.810 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.811 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.811 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.811 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.811 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.811 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.811 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.811 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.812 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.812 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.812 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.812 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.812 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.812 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.812 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.813 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.813 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.813 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.813 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.813 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.813 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.813 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-12T00:11:48.894530+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=48, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.814 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-12T00:11:50.900582+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=50, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.814 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.814 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.814 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.814 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-12T00:11:46.887296+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=46, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:54:58.815 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:55:18.816 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:55:19.185 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:55:19.197 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:55:19.199 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1575,"stamp":"2024-09-12T00:55:17.383526+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105863228,"num_objects":726,"num_object_clones":0,"num_object_copies":1691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":278142,"num_read_kb":2586611,"num_write":143606,"num_write_kb":2344249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":717929,"num_omap_keys":1746,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14277,"ondisk_log_size":14277,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1520696,"kb_used_data":189880,"kb_used_omap":12,"kb_used_meta":1330675,"kb_avail":753454024,"statfs":{"total":773094113280,"available":771536920576,"internally_reserved":0,"allocated":194437120,"data_stored":178358410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1362611762},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":145612,"num_omap_keys":345,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.008175"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.229682+0000","last_change":"2024-09-12T00:55:14.229682+0000","last_active":"2024-09-12T00:55:14.229682+0000","last_peered":"2024-09-12T00:55:14.229682+0000","last_clean":"2024-09-12T00:55:14.229682+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:55:14.229682+0000","last_undegraded":"2024-09-12T00:55:14.229682+0000","last_fullsized":"2024-09-12T00:55:14.229682+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.229499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.229499+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.229499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:15.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.793177+0000","last_change":"2024-09-12T00:55:12.793177+0000","last_active":"2024-09-12T00:55:12.793177+0000","last_peered":"2024-09-12T00:55:12.793177+0000","last_clean":"2024-09-12T00:55:12.793177+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:55:12.793177+0000","last_undegraded":"2024-09-12T00:55:12.793177+0000","last_fullsized":"2024-09-12T00:55:12.793177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T00:55:12.792992+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T00:55:12.792992+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.792992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:14.486725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.766882+0000","last_change":"2024-09-12T00:55:14.766882+0000","last_active":"2024-09-12T00:55:14.766882+0000","last_peered":"2024-09-12T00:55:14.766882+0000","last_clean":"2024-09-12T00:55:14.766882+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:55:14.766882+0000","last_undegraded":"2024-09-12T00:55:14.766882+0000","last_fullsized":"2024-09-12T00:55:14.766882+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.766689+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.766689+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.766689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:34.013158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":74,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.931203+0000","last_change":"2024-09-12T00:26:48.570033+0000","last_active":"2024-09-12T00:51:50.931203+0000","last_peered":"2024-09-12T00:51:50.931203+0000","last_clean":"2024-09-12T00:51:50.931203+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:51:50.931203+0000","last_undegraded":"2024-09-12T00:51:50.931203+0000","last_fullsized":"2024-09-12T00:51:50.931203+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:41:29.353377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.928588+0000","last_change":"2024-09-12T00:39:28.129464+0000","last_active":"2024-09-12T00:52:00.928588+0000","last_peered":"2024-09-12T00:52:00.928588+0000","last_clean":"2024-09-12T00:52:00.928588+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:52:00.928588+0000","last_undegraded":"2024-09-12T00:52:00.928588+0000","last_fullsized":"2024-09-12T00:52:00.928588+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:48.897603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113095+0000","last_change":"2024-09-12T00:28:17.071932+0000","last_active":"2024-09-12T00:50:51.113095+0000","last_peered":"2024-09-12T00:50:51.113095+0000","last_clean":"2024-09-12T00:50:51.113095+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:50:51.113095+0000","last_undegraded":"2024-09-12T00:50:51.113095+0000","last_fullsized":"2024-09-12T00:50:51.113095+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:24:22.458170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:44.921118+0000","last_change":"2024-09-12T00:28:14.053061+0000","last_active":"2024-09-12T00:50:44.921118+0000","last_peered":"2024-09-12T00:50:44.921118+0000","last_clean":"2024-09-12T00:50:44.921118+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:50:44.921118+0000","last_undegraded":"2024-09-12T00:50:44.921118+0000","last_fullsized":"2024-09-12T00:50:44.921118+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:29:44.764170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.800503+0000","last_change":"2024-09-12T00:55:15.800503+0000","last_active":"2024-09-12T00:55:15.800503+0000","last_peered":"2024-09-12T00:55:15.800503+0000","last_clean":"2024-09-12T00:55:15.800503+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:55:15.800503+0000","last_undegraded":"2024-09-12T00:55:15.800503+0000","last_fullsized":"2024-09-12T00:55:15.800503+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'43","last_scrub_stamp":"2024-09-12T00:55:15.800318+0000","last_deep_scrub":"266'43","last_deep_scrub_stamp":"2024-09-12T00:55:15.800318+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.800318+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.404637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.816681+0000","last_change":"2024-09-12T00:55:15.816681+0000","last_active":"2024-09-12T00:55:15.816681+0000","last_peered":"2024-09-12T00:55:15.816681+0000","last_clean":"2024-09-12T00:55:15.816681+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:55:15.816681+0000","last_undegraded":"2024-09-12T00:55:15.816681+0000","last_fullsized":"2024-09-12T00:55:15.816681+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:15.816508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:15.816508+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.816508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:11.337625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928491+0000","last_change":"2024-09-12T00:28:17.054566+0000","last_active":"2024-09-12T00:51:14.928491+0000","last_peered":"2024-09-12T00:51:14.928491+0000","last_clean":"2024-09-12T00:51:14.928491+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:51:14.928491+0000","last_undegraded":"2024-09-12T00:51:14.928491+0000","last_fullsized":"2024-09-12T00:51:14.928491+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:23:42.840405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'3","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:20.962121+0000","last_change":"2024-09-12T00:28:14.047435+0000","last_active":"2024-09-12T00:54:20.962121+0000","last_peered":"2024-09-12T00:54:20.962121+0000","last_clean":"2024-09-12T00:54:20.962121+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:54:20.962121+0000","last_undegraded":"2024-09-12T00:54:20.962121+0000","last_fullsized":"2024-09-12T00:54:20.962121+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:57:59.650613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.577866+0000","last_change":"2024-09-12T00:55:11.577866+0000","last_active":"2024-09-12T00:55:11.577866+0000","last_peered":"2024-09-12T00:55:11.577866+0000","last_clean":"2024-09-12T00:55:11.577866+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:55:11.577866+0000","last_undegraded":"2024-09-12T00:55:11.577866+0000","last_fullsized":"2024-09-12T00:55:11.577866+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T00:55:11.577697+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T00:55:11.577697+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.577697+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:39.149200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934194+0000","last_change":"2024-09-12T00:39:28.125516+0000","last_active":"2024-09-12T00:51:39.934194+0000","last_peered":"2024-09-12T00:51:39.934194+0000","last_clean":"2024-09-12T00:51:39.934194+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:51:39.934194+0000","last_undegraded":"2024-09-12T00:51:39.934194+0000","last_fullsized":"2024-09-12T00:51:39.934194+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:50.627744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'5","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:24.978258+0000","last_change":"2024-09-12T00:28:17.052788+0000","last_active":"2024-09-12T00:54:24.978258+0000","last_peered":"2024-09-12T00:54:24.978258+0000","last_clean":"2024-09-12T00:54:24.978258+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:54:24.978258+0000","last_undegraded":"2024-09-12T00:54:24.978258+0000","last_fullsized":"2024-09-12T00:54:24.978258+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:17:18.537154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.724516+0000","last_change":"2024-09-12T00:55:10.724516+0000","last_active":"2024-09-12T00:55:10.724516+0000","last_peered":"2024-09-12T00:55:10.724516+0000","last_clean":"2024-09-12T00:55:10.724516+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:55:10.724516+0000","last_undegraded":"2024-09-12T00:55:10.724516+0000","last_fullsized":"2024-09-12T00:55:10.724516+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T00:55:10.724330+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T00:55:10.724330+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.724330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:21.498427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.605078+0000","last_change":"2024-09-12T00:55:13.605078+0000","last_active":"2024-09-12T00:55:13.605078+0000","last_peered":"2024-09-12T00:55:13.605078+0000","last_clean":"2024-09-12T00:55:13.605078+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:55:13.605078+0000","last_undegraded":"2024-09-12T00:55:13.605078+0000","last_fullsized":"2024-09-12T00:55:13.605078+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'56","last_scrub_stamp":"2024-09-12T00:55:13.604900+0000","last_deep_scrub":"266'56","last_deep_scrub_stamp":"2024-09-12T00:55:13.604900+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.604900+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:03.425227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.926457+0000","last_change":"2024-09-12T00:39:28.140327+0000","last_active":"2024-09-12T00:51:35.926457+0000","last_peered":"2024-09-12T00:51:35.926457+0000","last_clean":"2024-09-12T00:51:35.926457+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:51:35.926457+0000","last_undegraded":"2024-09-12T00:51:35.926457+0000","last_fullsized":"2024-09-12T00:51:35.926457+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:56:53.703852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.158610+0000","last_change":"2024-09-12T00:55:08.158610+0000","last_active":"2024-09-12T00:55:08.158610+0000","last_peered":"2024-09-12T00:55:08.158610+0000","last_clean":"2024-09-12T00:55:08.158610+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:55:08.158610+0000","last_undegraded":"2024-09-12T00:55:08.158610+0000","last_fullsized":"2024-09-12T00:55:08.158610+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:08.158395+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.158395+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.158395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.464176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'9","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.182024+0000","last_change":"2024-09-12T00:28:14.043324+0000","last_active":"2024-09-12T00:54:31.182024+0000","last_peered":"2024-09-12T00:54:31.182024+0000","last_clean":"2024-09-12T00:54:31.182024+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:54:31.182024+0000","last_undegraded":"2024-09-12T00:54:31.182024+0000","last_fullsized":"2024-09-12T00:54:31.182024+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":189,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.623494+0000","last_change":"2024-09-12T00:55:10.623494+0000","last_active":"2024-09-12T00:55:10.623494+0000","last_peered":"2024-09-12T00:55:10.623494+0000","last_clean":"2024-09-12T00:55:10.623494+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:55:10.623494+0000","last_undegraded":"2024-09-12T00:55:10.623494+0000","last_fullsized":"2024-09-12T00:55:10.623494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'48","last_scrub_stamp":"2024-09-12T00:55:10.623317+0000","last_deep_scrub":"266'48","last_deep_scrub_stamp":"2024-09-12T00:55:10.623317+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.623317+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:54.480935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.933422+0000","last_change":"2024-09-12T00:39:28.107499+0000","last_active":"2024-09-12T00:52:00.933422+0000","last_peered":"2024-09-12T00:52:00.933422+0000","last_clean":"2024-09-12T00:52:00.933422+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:52:00.933422+0000","last_undegraded":"2024-09-12T00:52:00.933422+0000","last_fullsized":"2024-09-12T00:52:00.933422+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:42.987392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'7","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.570891+0000","last_change":"2024-09-12T00:28:17.080528+0000","last_active":"2024-09-12T00:54:31.570891+0000","last_peered":"2024-09-12T00:54:31.570891+0000","last_clean":"2024-09-12T00:54:31.570891+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:54:31.570891+0000","last_undegraded":"2024-09-12T00:54:31.570891+0000","last_fullsized":"2024-09-12T00:54:31.570891+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":651,"num_write":12,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.493275+0000","last_change":"2024-09-12T00:28:14.045269+0000","last_active":"2024-09-12T00:54:31.493275+0000","last_peered":"2024-09-12T00:54:31.493275+0000","last_clean":"2024-09-12T00:54:31.493275+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:54:31.493275+0000","last_undegraded":"2024-09-12T00:54:31.493275+0000","last_fullsized":"2024-09-12T00:54:31.493275+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.742145+0000","last_change":"2024-09-12T00:55:10.742145+0000","last_active":"2024-09-12T00:55:10.742145+0000","last_peered":"2024-09-12T00:55:10.742145+0000","last_clean":"2024-09-12T00:55:10.742145+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:55:10.742145+0000","last_undegraded":"2024-09-12T00:55:10.742145+0000","last_fullsized":"2024-09-12T00:55:10.742145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'71","last_scrub_stamp":"2024-09-12T00:55:10.741944+0000","last_deep_scrub":"266'71","last_deep_scrub_stamp":"2024-09-12T00:55:10.741944+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.741944+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:45.667086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:01.128901+0000","last_change":"2024-09-12T00:39:28.140779+0000","last_active":"2024-09-12T00:52:01.128901+0000","last_peered":"2024-09-12T00:52:01.128901+0000","last_clean":"2024-09-12T00:52:01.128901+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:52:01.128901+0000","last_undegraded":"2024-09-12T00:52:01.128901+0000","last_fullsized":"2024-09-12T00:52:01.128901+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:54.223046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.816234+0000","last_change":"2024-09-12T00:55:13.816234+0000","last_active":"2024-09-12T00:55:13.816234+0000","last_peered":"2024-09-12T00:55:13.816234+0000","last_clean":"2024-09-12T00:55:13.816234+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:55:13.816234+0000","last_undegraded":"2024-09-12T00:55:13.816234+0000","last_fullsized":"2024-09-12T00:55:13.816234+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:13.816054+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:13.816054+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.816054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:51.920762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.133568+0000","last_change":"2024-09-12T00:55:02.133568+0000","last_active":"2024-09-12T00:55:02.133568+0000","last_peered":"2024-09-12T00:55:02.133568+0000","last_clean":"2024-09-12T00:55:02.133568+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:55:02.133568+0000","last_undegraded":"2024-09-12T00:55:02.133568+0000","last_fullsized":"2024-09-12T00:55:02.133568+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.133361+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:41.589597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.705902+0000","last_change":"2024-09-12T00:55:10.705902+0000","last_active":"2024-09-12T00:55:10.705902+0000","last_peered":"2024-09-12T00:55:10.705902+0000","last_clean":"2024-09-12T00:55:10.705902+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:55:10.705902+0000","last_undegraded":"2024-09-12T00:55:10.705902+0000","last_fullsized":"2024-09-12T00:55:10.705902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'54","last_scrub_stamp":"2024-09-12T00:55:10.705720+0000","last_deep_scrub":"266'54","last_deep_scrub_stamp":"2024-09-12T00:55:10.705720+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.705720+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:30.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.226312+0000","last_change":"2024-09-12T00:55:15.226312+0000","last_active":"2024-09-12T00:55:15.226312+0000","last_peered":"2024-09-12T00:55:15.226312+0000","last_clean":"2024-09-12T00:55:15.226312+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:55:15.226312+0000","last_undegraded":"2024-09-12T00:55:15.226312+0000","last_fullsized":"2024-09-12T00:55:15.226312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:15.225979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:15.225979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.225979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:36.693603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916437+0000","last_change":"2024-09-12T00:28:17.074749+0000","last_active":"2024-09-12T00:50:50.916437+0000","last_peered":"2024-09-12T00:50:50.916437+0000","last_clean":"2024-09-12T00:50:50.916437+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:50:50.916437+0000","last_undegraded":"2024-09-12T00:50:50.916437+0000","last_fullsized":"2024-09-12T00:50:50.916437+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:41:59.263048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.579199+0000","last_change":"2024-09-12T00:55:14.579199+0000","last_active":"2024-09-12T00:55:14.579199+0000","last_peered":"2024-09-12T00:55:14.579199+0000","last_clean":"2024-09-12T00:55:14.579199+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:55:14.579199+0000","last_undegraded":"2024-09-12T00:55:14.579199+0000","last_fullsized":"2024-09-12T00:55:14.579199+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.579021+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.579021+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.579021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.763959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.645511+0000","last_change":"2024-09-12T00:55:09.645511+0000","last_active":"2024-09-12T00:55:09.645511+0000","last_peered":"2024-09-12T00:55:09.645511+0000","last_clean":"2024-09-12T00:55:09.645511+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:55:09.645511+0000","last_undegraded":"2024-09-12T00:55:09.645511+0000","last_fullsized":"2024-09-12T00:55:09.645511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T00:55:09.645339+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T00:55:09.645339+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.645339+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:52.501367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:09.927145+0000","last_change":"2024-09-12T00:39:28.133363+0000","last_active":"2024-09-12T00:51:09.927145+0000","last_peered":"2024-09-12T00:51:09.927145+0000","last_clean":"2024-09-12T00:51:09.927145+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:51:09.927145+0000","last_undegraded":"2024-09-12T00:51:09.927145+0000","last_fullsized":"2024-09-12T00:51:09.927145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:45.885764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'10","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.512356+0000","last_change":"2024-09-12T00:28:17.078258+0000","last_active":"2024-09-12T00:54:31.512356+0000","last_peered":"2024-09-12T00:54:31.512356+0000","last_clean":"2024-09-12T00:54:31.512356+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:54:31.512356+0000","last_undegraded":"2024-09-12T00:54:31.512356+0000","last_fullsized":"2024-09-12T00:54:31.512356+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12306,"num_write":10,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947884+0000","last_change":"2024-09-12T00:28:14.046080+0000","last_active":"2024-09-12T00:51:40.947884+0000","last_peered":"2024-09-12T00:51:40.947884+0000","last_clean":"2024-09-12T00:51:40.947884+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:51:40.947884+0000","last_undegraded":"2024-09-12T00:51:40.947884+0000","last_fullsized":"2024-09-12T00:51:40.947884+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:00:54.783103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":201,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:36.951659+0000","last_change":"2024-09-12T00:26:48.572423+0000","last_active":"2024-09-12T00:51:36.951659+0000","last_peered":"2024-09-12T00:51:36.951659+0000","last_clean":"2024-09-12T00:51:36.951659+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:51:36.951659+0000","last_undegraded":"2024-09-12T00:51:36.951659+0000","last_fullsized":"2024-09-12T00:51:36.951659+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:56:03.523286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:10.917174+0000","last_change":"2024-09-12T00:39:28.115704+0000","last_active":"2024-09-12T00:51:10.917174+0000","last_peered":"2024-09-12T00:51:10.917174+0000","last_clean":"2024-09-12T00:51:10.917174+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:51:10.917174+0000","last_undegraded":"2024-09-12T00:51:10.917174+0000","last_fullsized":"2024-09-12T00:51:10.917174+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:19.301433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'4","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:04.968671+0000","last_change":"2024-09-12T00:28:17.068407+0000","last_active":"2024-09-12T00:54:04.968671+0000","last_peered":"2024-09-12T00:54:04.968671+0000","last_clean":"2024-09-12T00:54:04.968671+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:54:04.968671+0000","last_undegraded":"2024-09-12T00:54:04.968671+0000","last_fullsized":"2024-09-12T00:54:04.968671+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:31:04.370003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.119784+0000","last_change":"2024-09-12T00:55:04.119784+0000","last_active":"2024-09-12T00:55:04.119784+0000","last_peered":"2024-09-12T00:55:04.119784+0000","last_clean":"2024-09-12T00:55:04.119784+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:55:04.119784+0000","last_undegraded":"2024-09-12T00:55:04.119784+0000","last_fullsized":"2024-09-12T00:55:04.119784+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:04.119583+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:04.119583+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.119583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:17.216020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.784196+0000","last_change":"2024-09-12T00:55:14.784196+0000","last_active":"2024-09-12T00:55:14.784196+0000","last_peered":"2024-09-12T00:55:14.784196+0000","last_clean":"2024-09-12T00:55:14.784196+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:55:14.784196+0000","last_undegraded":"2024-09-12T00:55:14.784196+0000","last_fullsized":"2024-09-12T00:55:14.784196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T00:55:14.783979+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T00:55:14.783979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.783979+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.709781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:11.117359+0000","last_change":"2024-09-12T00:39:28.143755+0000","last_active":"2024-09-12T00:51:11.117359+0000","last_peered":"2024-09-12T00:51:11.117359+0000","last_clean":"2024-09-12T00:51:11.117359+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:51:11.117359+0000","last_undegraded":"2024-09-12T00:51:11.117359+0000","last_fullsized":"2024-09-12T00:51:11.117359+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:42.065287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.938200+0000","last_change":"2024-09-12T00:28:17.072223+0000","last_active":"2024-09-12T00:52:30.938200+0000","last_peered":"2024-09-12T00:52:30.938200+0000","last_clean":"2024-09-12T00:52:30.938200+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:52:30.938200+0000","last_undegraded":"2024-09-12T00:52:30.938200+0000","last_fullsized":"2024-09-12T00:52:30.938200+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'4","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.761776+0000","last_change":"2024-09-12T00:55:15.761776+0000","last_active":"2024-09-12T00:55:15.761776+0000","last_peered":"2024-09-12T00:55:15.761776+0000","last_clean":"2024-09-12T00:55:15.761776+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:55:15.761776+0000","last_undegraded":"2024-09-12T00:55:15.761776+0000","last_fullsized":"2024-09-12T00:55:15.761776+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:15.761591+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:15.761591+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.761591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:00.967840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.651822+0000","last_change":"2024-09-12T00:55:08.651822+0000","last_active":"2024-09-12T00:55:08.651822+0000","last_peered":"2024-09-12T00:55:08.651822+0000","last_clean":"2024-09-12T00:55:08.651822+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:55:08.651822+0000","last_undegraded":"2024-09-12T00:55:08.651822+0000","last_fullsized":"2024-09-12T00:55:08.651822+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:08.651514+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:08.651514+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.651514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:09.199043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.195342+0000","last_change":"2024-09-12T00:55:11.195342+0000","last_active":"2024-09-12T00:55:11.195342+0000","last_peered":"2024-09-12T00:55:11.195342+0000","last_clean":"2024-09-12T00:55:11.195342+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:55:11.195342+0000","last_undegraded":"2024-09-12T00:55:11.195342+0000","last_fullsized":"2024-09-12T00:55:11.195342+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:11.195162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:11.195162+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.195162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:41.794941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.168868+0000","last_change":"2024-09-12T00:55:12.168868+0000","last_active":"2024-09-12T00:55:12.168868+0000","last_peered":"2024-09-12T00:55:12.168868+0000","last_clean":"2024-09-12T00:55:12.168868+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:55:12.168868+0000","last_undegraded":"2024-09-12T00:55:12.168868+0000","last_fullsized":"2024-09-12T00:55:12.168868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:12.168690+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:12.168690+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.168690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:45.567507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:24.944878+0000","last_change":"2024-09-12T00:28:14.044796+0000","last_active":"2024-09-12T00:52:24.944878+0000","last_peered":"2024-09-12T00:52:24.944878+0000","last_clean":"2024-09-12T00:52:24.944878+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:52:24.944878+0000","last_undegraded":"2024-09-12T00:52:24.944878+0000","last_fullsized":"2024-09-12T00:52:24.944878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'113","reported_seq":400,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:38.553520+0000","last_change":"2024-09-12T00:26:48.578346+0000","last_active":"2024-09-12T00:52:38.553520+0000","last_peered":"2024-09-12T00:52:38.553520+0000","last_clean":"2024-09-12T00:52:38.553520+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:52:38.553520+0000","last_undegraded":"2024-09-12T00:52:38.553520+0000","last_fullsized":"2024-09-12T00:52:38.553520+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":100,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933259+0000","last_change":"2024-09-12T00:39:28.130268+0000","last_active":"2024-09-12T00:51:34.933259+0000","last_peered":"2024-09-12T00:51:34.933259+0000","last_clean":"2024-09-12T00:51:34.933259+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:51:34.933259+0000","last_undegraded":"2024-09-12T00:51:34.933259+0000","last_fullsized":"2024-09-12T00:51:34.933259+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:22.655818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'4","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:59.967275+0000","last_change":"2024-09-12T00:28:17.046685+0000","last_active":"2024-09-12T00:53:59.967275+0000","last_peered":"2024-09-12T00:53:59.967275+0000","last_clean":"2024-09-12T00:53:59.967275+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:53:59.967275+0000","last_undegraded":"2024-09-12T00:53:59.967275+0000","last_fullsized":"2024-09-12T00:53:59.967275+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:31.104948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4468,"num_write":4,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.715773+0000","last_change":"2024-09-12T00:55:08.715773+0000","last_active":"2024-09-12T00:55:08.715773+0000","last_peered":"2024-09-12T00:55:08.715773+0000","last_clean":"2024-09-12T00:55:08.715773+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:55:08.715773+0000","last_undegraded":"2024-09-12T00:55:08.715773+0000","last_fullsized":"2024-09-12T00:55:08.715773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:08.715567+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.715567+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.715567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:39.116238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'133","reported_seq":450,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.961253+0000","last_change":"2024-09-12T00:26:48.579290+0000","last_active":"2024-09-12T00:52:30.961253+0000","last_peered":"2024-09-12T00:52:30.961253+0000","last_clean":"2024-09-12T00:52:30.961253+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:52:30.961253+0000","last_undegraded":"2024-09-12T00:52:30.961253+0000","last_fullsized":"2024-09-12T00:52:30.961253+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":100,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922871+0000","last_change":"2024-09-12T00:39:28.116214+0000","last_active":"2024-09-12T00:51:35.922871+0000","last_peered":"2024-09-12T00:51:35.922871+0000","last_clean":"2024-09-12T00:51:35.922871+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:51:35.922871+0000","last_undegraded":"2024-09-12T00:51:35.922871+0000","last_fullsized":"2024-09-12T00:51:35.922871+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:51:23.593460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934132+0000","last_change":"2024-09-12T00:28:17.059604+0000","last_active":"2024-09-12T00:51:39.934132+0000","last_peered":"2024-09-12T00:51:39.934132+0000","last_clean":"2024-09-12T00:51:39.934132+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:51:39.934132+0000","last_undegraded":"2024-09-12T00:51:39.934132+0000","last_fullsized":"2024-09-12T00:51:39.934132+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:58:54.283922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.933089+0000","last_change":"2024-09-12T00:28:14.043789+0000","last_active":"2024-09-12T00:51:34.933089+0000","last_peered":"2024-09-12T00:51:34.933089+0000","last_clean":"2024-09-12T00:51:34.933089+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:51:34.933089+0000","last_undegraded":"2024-09-12T00:51:34.933089+0000","last_fullsized":"2024-09-12T00:51:34.933089+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:01:33.842950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.647408+0000","last_change":"2024-09-12T00:55:07.647408+0000","last_active":"2024-09-12T00:55:07.647408+0000","last_peered":"2024-09-12T00:55:07.647408+0000","last_clean":"2024-09-12T00:55:07.647408+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:55:07.647408+0000","last_undegraded":"2024-09-12T00:55:07.647408+0000","last_fullsized":"2024-09-12T00:55:07.647408+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.647104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.647104+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.647104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:53.415759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"265'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:15.923180+0000","last_change":"2024-09-12T00:39:28.116113+0000","last_active":"2024-09-12T00:51:15.923180+0000","last_peered":"2024-09-12T00:51:15.923180+0000","last_clean":"2024-09-12T00:51:15.923180+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:51:15.923180+0000","last_undegraded":"2024-09-12T00:51:15.923180+0000","last_fullsized":"2024-09-12T00:51:15.923180+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:30.528893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'7","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.162360+0000","last_change":"2024-09-12T00:28:17.077838+0000","last_active":"2024-09-12T00:54:31.162360+0000","last_peered":"2024-09-12T00:54:31.162360+0000","last_clean":"2024-09-12T00:54:31.162360+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:54:31.162360+0000","last_undegraded":"2024-09-12T00:54:31.162360+0000","last_fullsized":"2024-09-12T00:54:31.162360+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:18:59.840518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'4","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.772562+0000","last_change":"2024-09-12T00:55:11.772562+0000","last_active":"2024-09-12T00:55:11.772562+0000","last_peered":"2024-09-12T00:55:11.772562+0000","last_clean":"2024-09-12T00:55:11.772562+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:55:11.772562+0000","last_undegraded":"2024-09-12T00:55:11.772562+0000","last_fullsized":"2024-09-12T00:55:11.772562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:11.772354+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:11.772354+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.772354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:25.452055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.684806+0000","last_change":"2024-09-12T00:55:06.684806+0000","last_active":"2024-09-12T00:55:06.684806+0000","last_peered":"2024-09-12T00:55:06.684806+0000","last_clean":"2024-09-12T00:55:06.684806+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:55:06.684806+0000","last_undegraded":"2024-09-12T00:55:06.684806+0000","last_fullsized":"2024-09-12T00:55:06.684806+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T00:55:06.684571+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T00:55:06.684571+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.684571+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:12.401931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'1","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.922823+0000","last_change":"2024-09-12T00:39:28.107803+0000","last_active":"2024-09-12T00:51:35.922823+0000","last_peered":"2024-09-12T00:51:35.922823+0000","last_clean":"2024-09-12T00:51:35.922823+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:51:35.922823+0000","last_undegraded":"2024-09-12T00:51:35.922823+0000","last_fullsized":"2024-09-12T00:51:35.922823+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:00:47.925644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947791+0000","last_change":"2024-09-12T00:28:17.071725+0000","last_active":"2024-09-12T00:51:40.947791+0000","last_peered":"2024-09-12T00:51:40.947791+0000","last_clean":"2024-09-12T00:51:40.947791+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:51:40.947791+0000","last_undegraded":"2024-09-12T00:51:40.947791+0000","last_fullsized":"2024-09-12T00:51:40.947791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:28.212664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'9","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.756608+0000","last_change":"2024-09-12T00:55:09.756608+0000","last_active":"2024-09-12T00:55:09.756608+0000","last_peered":"2024-09-12T00:55:09.756608+0000","last_clean":"2024-09-12T00:55:09.756608+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:55:09.756608+0000","last_undegraded":"2024-09-12T00:55:09.756608+0000","last_fullsized":"2024-09-12T00:55:09.756608+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T00:55:09.756432+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T00:55:09.756432+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.756432+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:40.453032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21053,"num_write":14,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":121,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.651000+0000","last_change":"2024-09-12T00:55:05.651000+0000","last_active":"2024-09-12T00:55:05.651000+0000","last_peered":"2024-09-12T00:55:05.651000+0000","last_clean":"2024-09-12T00:55:05.651000+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:55:05.651000+0000","last_undegraded":"2024-09-12T00:55:05.651000+0000","last_fullsized":"2024-09-12T00:55:05.651000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T00:55:05.650820+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T00:55:05.650820+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.650820+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:21.508950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:34.947027+0000","last_change":"2024-09-12T00:39:28.127905+0000","last_active":"2024-09-12T00:52:34.947027+0000","last_peered":"2024-09-12T00:52:34.947027+0000","last_clean":"2024-09-12T00:52:34.947027+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:52:34.947027+0000","last_undegraded":"2024-09-12T00:52:34.947027+0000","last_fullsized":"2024-09-12T00:52:34.947027+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916546+0000","last_change":"2024-09-12T00:28:17.075169+0000","last_active":"2024-09-12T00:50:50.916546+0000","last_peered":"2024-09-12T00:50:50.916546+0000","last_clean":"2024-09-12T00:50:50.916546+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:50:50.916546+0000","last_undegraded":"2024-09-12T00:50:50.916546+0000","last_fullsized":"2024-09-12T00:50:50.916546+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:10:26.934607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.780153+0000","last_change":"2024-09-12T00:55:14.779965+0000","last_active":"2024-09-12T00:55:14.780153+0000","last_peered":"2024-09-12T00:55:14.780153+0000","last_clean":"2024-09-12T00:55:14.780153+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:55:14.780153+0000","last_undegraded":"2024-09-12T00:55:14.780153+0000","last_fullsized":"2024-09-12T00:55:14.780153+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.779773+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.779773+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.779773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:06.125955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.661387+0000","last_change":"2024-09-12T00:55:06.661387+0000","last_active":"2024-09-12T00:55:06.661387+0000","last_peered":"2024-09-12T00:55:06.661387+0000","last_clean":"2024-09-12T00:55:06.661387+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:55:06.661387+0000","last_undegraded":"2024-09-12T00:55:06.661387+0000","last_fullsized":"2024-09-12T00:55:06.661387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:06.661170+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:06.661170+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.661170+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:34.081658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.844282+0000","last_change":"2024-09-12T00:55:14.844152+0000","last_active":"2024-09-12T00:55:14.844282+0000","last_peered":"2024-09-12T00:55:14.844282+0000","last_clean":"2024-09-12T00:55:14.844282+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:55:14.844282+0000","last_undegraded":"2024-09-12T00:55:14.844282+0000","last_fullsized":"2024-09-12T00:55:14.844282+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.843969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.843969+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.843969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:01.964336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":34,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.916508+0000","last_change":"2024-09-12T00:28:17.074710+0000","last_active":"2024-09-12T00:50:50.916508+0000","last_peered":"2024-09-12T00:50:50.916508+0000","last_clean":"2024-09-12T00:50:50.916508+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:50:50.916508+0000","last_undegraded":"2024-09-12T00:50:50.916508+0000","last_fullsized":"2024-09-12T00:50:50.916508+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:56:00.241439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'13","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.553718+0000","last_change":"2024-09-12T00:55:15.553524+0000","last_active":"2024-09-12T00:55:15.553718+0000","last_peered":"2024-09-12T00:55:15.553718+0000","last_clean":"2024-09-12T00:55:15.553718+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:55:15.553718+0000","last_undegraded":"2024-09-12T00:55:15.553718+0000","last_fullsized":"2024-09-12T00:55:15.553718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T00:55:15.553347+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T00:55:15.553347+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.553347+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:57.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":18,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:35.946780+0000","last_change":"2024-09-12T00:26:48.585190+0000","last_active":"2024-09-12T00:51:35.946780+0000","last_peered":"2024-09-12T00:51:35.946780+0000","last_clean":"2024-09-12T00:51:35.946780+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:51:35.946780+0000","last_undegraded":"2024-09-12T00:51:35.946780+0000","last_fullsized":"2024-09-12T00:51:35.946780+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:29.090617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.960990+0000","last_change":"2024-09-12T00:39:28.136382+0000","last_active":"2024-09-12T00:52:30.960990+0000","last_peered":"2024-09-12T00:52:30.960990+0000","last_clean":"2024-09-12T00:52:30.960990+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:52:30.960990+0000","last_undegraded":"2024-09-12T00:52:30.960990+0000","last_fullsized":"2024-09-12T00:52:30.960990+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:55.917696+0000","last_change":"2024-09-12T00:28:17.077942+0000","last_active":"2024-09-12T00:50:55.917696+0000","last_peered":"2024-09-12T00:50:55.917696+0000","last_clean":"2024-09-12T00:50:55.917696+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:50:55.917696+0000","last_undegraded":"2024-09-12T00:50:55.917696+0000","last_fullsized":"2024-09-12T00:50:55.917696+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:53:31.793012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.705450+0000","last_change":"2024-09-12T00:55:11.705316+0000","last_active":"2024-09-12T00:55:11.705450+0000","last_peered":"2024-09-12T00:55:11.705450+0000","last_clean":"2024-09-12T00:55:11.705450+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:55:11.705450+0000","last_undegraded":"2024-09-12T00:55:11.705450+0000","last_fullsized":"2024-09-12T00:55:11.705450+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:11.705125+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:11.705125+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.705125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:16.644347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":160,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.679487+0000","last_change":"2024-09-12T00:55:06.679487+0000","last_active":"2024-09-12T00:55:06.679487+0000","last_peered":"2024-09-12T00:55:06.679487+0000","last_clean":"2024-09-12T00:55:06.679487+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:55:06.679487+0000","last_undegraded":"2024-09-12T00:55:06.679487+0000","last_fullsized":"2024-09-12T00:55:06.679487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'41","last_scrub_stamp":"2024-09-12T00:55:06.679274+0000","last_deep_scrub":"266'41","last_deep_scrub_stamp":"2024-09-12T00:55:06.679274+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.679274+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:30.604913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.795156+0000","last_change":"2024-09-12T00:55:13.795156+0000","last_active":"2024-09-12T00:55:13.795156+0000","last_peered":"2024-09-12T00:55:13.795156+0000","last_clean":"2024-09-12T00:55:13.795156+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:55:13.795156+0000","last_undegraded":"2024-09-12T00:55:13.795156+0000","last_fullsized":"2024-09-12T00:55:13.795156+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:13.794974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:13.794974+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.794974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:01.424754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:49.922385+0000","last_change":"2024-09-12T00:28:17.060880+0000","last_active":"2024-09-12T00:50:49.922385+0000","last_peered":"2024-09-12T00:50:49.922385+0000","last_clean":"2024-09-12T00:50:49.922385+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:50:49.922385+0000","last_undegraded":"2024-09-12T00:50:49.922385+0000","last_fullsized":"2024-09-12T00:50:49.922385+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:30:02.004120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'7","reported_seq":56,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.742221+0000","last_change":"2024-09-12T00:55:13.742221+0000","last_active":"2024-09-12T00:55:13.742221+0000","last_peered":"2024-09-12T00:55:13.742221+0000","last_clean":"2024-09-12T00:55:13.742221+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:55:13.742221+0000","last_undegraded":"2024-09-12T00:55:13.742221+0000","last_fullsized":"2024-09-12T00:55:13.742221+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:13.742049+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:13.742049+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.742049+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:19.515727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.692338+0000","last_change":"2024-09-12T00:55:08.692338+0000","last_active":"2024-09-12T00:55:08.692338+0000","last_peered":"2024-09-12T00:55:08.692338+0000","last_clean":"2024-09-12T00:55:08.692338+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:55:08.692338+0000","last_undegraded":"2024-09-12T00:55:08.692338+0000","last_fullsized":"2024-09-12T00:55:08.692338+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'27","last_scrub_stamp":"2024-09-12T00:55:08.692158+0000","last_deep_scrub":"266'27","last_deep_scrub_stamp":"2024-09-12T00:55:08.692158+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.692158+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:48.050746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:59.953104+0000","last_change":"2024-09-12T00:39:28.133468+0000","last_active":"2024-09-12T00:52:59.953104+0000","last_peered":"2024-09-12T00:52:59.953104+0000","last_clean":"2024-09-12T00:52:59.953104+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:52:59.953104+0000","last_undegraded":"2024-09-12T00:52:59.953104+0000","last_fullsized":"2024-09-12T00:52:59.953104+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'2","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:20.982962+0000","last_change":"2024-09-12T00:28:17.078262+0000","last_active":"2024-09-12T00:54:20.982962+0000","last_peered":"2024-09-12T00:54:20.982962+0000","last_clean":"2024-09-12T00:54:20.982962+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:54:20.982962+0000","last_undegraded":"2024-09-12T00:54:20.982962+0000","last_fullsized":"2024-09-12T00:54:20.982962+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:56.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.692162+0000","last_change":"2024-09-12T00:55:09.692162+0000","last_active":"2024-09-12T00:55:09.692162+0000","last_peered":"2024-09-12T00:55:09.692162+0000","last_clean":"2024-09-12T00:55:09.692162+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:55:09.692162+0000","last_undegraded":"2024-09-12T00:55:09.692162+0000","last_fullsized":"2024-09-12T00:55:09.692162+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.691980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.691980+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.691980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:20.998646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":94,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.729908+0000","last_change":"2024-09-12T00:55:07.729908+0000","last_active":"2024-09-12T00:55:07.729908+0000","last_peered":"2024-09-12T00:55:07.729908+0000","last_clean":"2024-09-12T00:55:07.729908+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:55:07.729908+0000","last_undegraded":"2024-09-12T00:55:07.729908+0000","last_fullsized":"2024-09-12T00:55:07.729908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'18","last_scrub_stamp":"2024-09-12T00:55:07.729701+0000","last_deep_scrub":"266'18","last_deep_scrub_stamp":"2024-09-12T00:55:07.729701+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.729701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:38.152765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:51.113170+0000","last_change":"2024-09-12T00:39:28.126995+0000","last_active":"2024-09-12T00:50:51.113170+0000","last_peered":"2024-09-12T00:50:51.113170+0000","last_clean":"2024-09-12T00:50:51.113170+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:50:51.113170+0000","last_undegraded":"2024-09-12T00:50:51.113170+0000","last_fullsized":"2024-09-12T00:50:51.113170+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:30.631391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'8","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.801386+0000","last_change":"2024-09-12T00:55:12.801386+0000","last_active":"2024-09-12T00:55:12.801386+0000","last_peered":"2024-09-12T00:55:12.801386+0000","last_clean":"2024-09-12T00:55:12.801386+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:55:12.801386+0000","last_undegraded":"2024-09-12T00:55:12.801386+0000","last_fullsized":"2024-09-12T00:55:12.801386+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T00:55:12.801203+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T00:55:12.801203+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.801203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.463086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.154401+0000","last_change":"2024-09-12T00:28:14.042940+0000","last_active":"2024-09-12T00:54:31.154401+0000","last_peered":"2024-09-12T00:54:31.154401+0000","last_clean":"2024-09-12T00:54:31.154401+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:54:31.154401+0000","last_undegraded":"2024-09-12T00:54:31.154401+0000","last_fullsized":"2024-09-12T00:54:31.154401+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:48:51.011440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.655760+0000","last_change":"2024-09-12T00:55:07.655760+0000","last_active":"2024-09-12T00:55:07.655760+0000","last_peered":"2024-09-12T00:55:07.655760+0000","last_clean":"2024-09-12T00:55:07.655760+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:55:07.655760+0000","last_undegraded":"2024-09-12T00:55:07.655760+0000","last_fullsized":"2024-09-12T00:55:07.655760+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'22","last_scrub_stamp":"2024-09-12T00:55:07.655523+0000","last_deep_scrub":"266'22","last_deep_scrub_stamp":"2024-09-12T00:55:07.655523+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.655523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:11.716375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.187270+0000","last_change":"2024-09-12T00:55:13.187143+0000","last_active":"2024-09-12T00:55:13.187270+0000","last_peered":"2024-09-12T00:55:13.187270+0000","last_clean":"2024-09-12T00:55:13.187270+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:55:13.187270+0000","last_undegraded":"2024-09-12T00:55:13.187270+0000","last_fullsized":"2024-09-12T00:55:13.187270+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:13.186952+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:13.186952+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.186952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:19.346141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:50.912817+0000","last_change":"2024-09-12T00:28:17.080617+0000","last_active":"2024-09-12T00:50:50.912817+0000","last_peered":"2024-09-12T00:50:50.912817+0000","last_clean":"2024-09-12T00:50:50.912817+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:50:50.912817+0000","last_undegraded":"2024-09-12T00:50:50.912817+0000","last_fullsized":"2024-09-12T00:50:50.912817+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:51.287293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.716361+0000","last_change":"2024-09-12T00:55:12.716361+0000","last_active":"2024-09-12T00:55:12.716361+0000","last_peered":"2024-09-12T00:55:12.716361+0000","last_clean":"2024-09-12T00:55:12.716361+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:55:12.716361+0000","last_undegraded":"2024-09-12T00:55:12.716361+0000","last_fullsized":"2024-09-12T00:55:12.716361+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:12.716166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:12.716166+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.716166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:00.539699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.321305+0000","last_change":"2024-09-12T00:55:14.321305+0000","last_active":"2024-09-12T00:55:14.321305+0000","last_peered":"2024-09-12T00:55:14.321305+0000","last_clean":"2024-09-12T00:55:14.321305+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:55:14.321305+0000","last_undegraded":"2024-09-12T00:55:14.321305+0000","last_fullsized":"2024-09-12T00:55:14.321305+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'29","last_scrub_stamp":"2024-09-12T00:55:14.321114+0000","last_deep_scrub":"266'29","last_deep_scrub_stamp":"2024-09-12T00:55:14.321114+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.321114+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:04.333451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.944366+0000","last_change":"2024-09-12T00:39:28.139264+0000","last_active":"2024-09-12T00:53:00.944366+0000","last_peered":"2024-09-12T00:53:00.944366+0000","last_clean":"2024-09-12T00:53:00.944366+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:53:00.944366+0000","last_undegraded":"2024-09-12T00:53:00.944366+0000","last_fullsized":"2024-09-12T00:53:00.944366+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'4","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.136408+0000","last_change":"2024-09-12T00:55:05.136408+0000","last_active":"2024-09-12T00:55:05.136408+0000","last_peered":"2024-09-12T00:55:05.136408+0000","last_clean":"2024-09-12T00:55:05.136408+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:55:05.136408+0000","last_undegraded":"2024-09-12T00:55:05.136408+0000","last_fullsized":"2024-09-12T00:55:05.136408+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:05.136223+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:05.136223+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.136223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:30.134780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'2","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.316405+0000","last_change":"2024-09-12T00:28:14.045720+0000","last_active":"2024-09-12T00:54:31.316405+0000","last_peered":"2024-09-12T00:54:31.316405+0000","last_clean":"2024-09-12T00:54:31.316405+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:54:31.316405+0000","last_undegraded":"2024-09-12T00:54:31.316405+0000","last_fullsized":"2024-09-12T00:54:31.316405+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.121114+0000","last_change":"2024-09-12T00:55:07.121114+0000","last_active":"2024-09-12T00:55:07.121114+0000","last_peered":"2024-09-12T00:55:07.121114+0000","last_clean":"2024-09-12T00:55:07.121114+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:55:07.121114+0000","last_undegraded":"2024-09-12T00:55:07.121114+0000","last_fullsized":"2024-09-12T00:55:07.121114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'11","last_scrub_stamp":"2024-09-12T00:55:07.120938+0000","last_deep_scrub":"266'11","last_deep_scrub_stamp":"2024-09-12T00:55:07.120938+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.120938+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:34.007816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.180044+0000","last_change":"2024-09-12T00:55:09.180044+0000","last_active":"2024-09-12T00:55:09.180044+0000","last_peered":"2024-09-12T00:55:09.180044+0000","last_clean":"2024-09-12T00:55:09.180044+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:55:09.180044+0000","last_undegraded":"2024-09-12T00:55:09.180044+0000","last_fullsized":"2024-09-12T00:55:09.180044+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.179784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.179784+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.179784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:38.105314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":36,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:19.929554+0000","last_change":"2024-09-12T00:28:17.054632+0000","last_active":"2024-09-12T00:51:19.929554+0000","last_peered":"2024-09-12T00:51:19.929554+0000","last_clean":"2024-09-12T00:51:19.929554+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:51:19.929554+0000","last_undegraded":"2024-09-12T00:51:19.929554+0000","last_fullsized":"2024-09-12T00:51:19.929554+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:53:40.665178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'7","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.970906+0000","last_change":"2024-09-12T00:28:14.035922+0000","last_active":"2024-09-12T00:53:15.970906+0000","last_peered":"2024-09-12T00:53:15.970906+0000","last_clean":"2024-09-12T00:53:15.970906+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:53:15.970906+0000","last_undegraded":"2024-09-12T00:53:15.970906+0000","last_fullsized":"2024-09-12T00:53:15.970906+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:25:49.298722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.736727+0000","last_change":"2024-09-12T00:55:13.736727+0000","last_active":"2024-09-12T00:55:13.736727+0000","last_peered":"2024-09-12T00:55:13.736727+0000","last_clean":"2024-09-12T00:55:13.736727+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:55:13.736727+0000","last_undegraded":"2024-09-12T00:55:13.736727+0000","last_fullsized":"2024-09-12T00:55:13.736727+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T00:55:13.736493+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T00:55:13.736493+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.736493+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:57.884773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.157652+0000","last_change":"2024-09-12T00:55:06.157652+0000","last_active":"2024-09-12T00:55:06.157652+0000","last_peered":"2024-09-12T00:55:06.157652+0000","last_clean":"2024-09-12T00:55:06.157652+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:55:06.157652+0000","last_undegraded":"2024-09-12T00:55:06.157652+0000","last_fullsized":"2024-09-12T00:55:06.157652+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.157463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.157463+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.157463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:30.183129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:14.928367+0000","last_change":"2024-09-12T00:28:17.068535+0000","last_active":"2024-09-12T00:51:14.928367+0000","last_peered":"2024-09-12T00:51:14.928367+0000","last_clean":"2024-09-12T00:51:14.928367+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:51:14.928367+0000","last_undegraded":"2024-09-12T00:51:14.928367+0000","last_fullsized":"2024-09-12T00:51:14.928367+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:16:00.915337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'2","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:20.950508+0000","last_change":"2024-09-12T00:28:14.046616+0000","last_active":"2024-09-12T00:53:20.950508+0000","last_peered":"2024-09-12T00:53:20.950508+0000","last_clean":"2024-09-12T00:53:20.950508+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:53:20.950508+0000","last_undegraded":"2024-09-12T00:53:20.950508+0000","last_fullsized":"2024-09-12T00:53:20.950508+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:18.026298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":170,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:50.966103+0000","last_change":"2024-09-12T00:26:48.580888+0000","last_active":"2024-09-12T00:52:50.966103+0000","last_peered":"2024-09-12T00:52:50.966103+0000","last_clean":"2024-09-12T00:52:50.966103+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:52:50.966103+0000","last_undegraded":"2024-09-12T00:52:50.966103+0000","last_fullsized":"2024-09-12T00:52:50.966103+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:34.932994+0000","last_change":"2024-09-12T00:39:28.111443+0000","last_active":"2024-09-12T00:51:34.932994+0000","last_peered":"2024-09-12T00:51:34.932994+0000","last_clean":"2024-09-12T00:51:34.932994+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:51:34.932994+0000","last_undegraded":"2024-09-12T00:51:34.932994+0000","last_fullsized":"2024-09-12T00:51:34.932994+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:06:45.919919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'12","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.224919+0000","last_change":"2024-09-12T00:55:10.224919+0000","last_active":"2024-09-12T00:55:10.224919+0000","last_peered":"2024-09-12T00:55:10.224919+0000","last_clean":"2024-09-12T00:55:10.224919+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:55:10.224919+0000","last_undegraded":"2024-09-12T00:55:10.224919+0000","last_fullsized":"2024-09-12T00:55:10.224919+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'12","last_scrub_stamp":"2024-09-12T00:55:10.224731+0000","last_deep_scrub":"266'12","last_deep_scrub_stamp":"2024-09-12T00:55:10.224731+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.224731+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:41.204090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":22,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.720155+0000","last_change":"2024-09-12T00:55:09.720155+0000","last_active":"2024-09-12T00:55:09.720155+0000","last_peered":"2024-09-12T00:55:09.720155+0000","last_clean":"2024-09-12T00:55:09.720155+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:55:09.720155+0000","last_undegraded":"2024-09-12T00:55:09.720155+0000","last_fullsized":"2024-09-12T00:55:09.720155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:09.719977+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:09.719977+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.719977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:00.827899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.626270+0000","last_change":"2024-09-12T00:55:04.626270+0000","last_active":"2024-09-12T00:55:04.626270+0000","last_peered":"2024-09-12T00:55:04.626270+0000","last_clean":"2024-09-12T00:55:04.626270+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:55:04.626270+0000","last_undegraded":"2024-09-12T00:55:04.626270+0000","last_fullsized":"2024-09-12T00:55:04.626270+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T00:55:04.625979+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T00:55:04.625979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.625979+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:29.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.952894+0000","last_change":"2024-09-12T00:39:28.134519+0000","last_active":"2024-09-12T00:52:00.952894+0000","last_peered":"2024-09-12T00:52:00.952894+0000","last_clean":"2024-09-12T00:52:00.952894+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:52:00.952894+0000","last_undegraded":"2024-09-12T00:52:00.952894+0000","last_fullsized":"2024-09-12T00:52:00.952894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.950649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955943+0000","last_change":"2024-09-12T00:28:17.073665+0000","last_active":"2024-09-12T00:52:10.955943+0000","last_peered":"2024-09-12T00:52:10.955943+0000","last_clean":"2024-09-12T00:52:10.955943+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:52:10.955943+0000","last_undegraded":"2024-09-12T00:52:10.955943+0000","last_fullsized":"2024-09-12T00:52:10.955943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.110456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'6","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:15.981931+0000","last_change":"2024-09-12T00:28:14.044717+0000","last_active":"2024-09-12T00:54:15.981931+0000","last_peered":"2024-09-12T00:54:15.981931+0000","last_clean":"2024-09-12T00:54:15.981931+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:54:15.981931+0000","last_undegraded":"2024-09-12T00:54:15.981931+0000","last_fullsized":"2024-09-12T00:54:15.981931+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:37:17.236547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.617279+0000","last_change":"2024-09-12T00:55:04.617279+0000","last_active":"2024-09-12T00:55:04.617279+0000","last_peered":"2024-09-12T00:55:04.617279+0000","last_clean":"2024-09-12T00:55:04.617279+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:55:04.617279+0000","last_undegraded":"2024-09-12T00:55:04.617279+0000","last_fullsized":"2024-09-12T00:55:04.617279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'42","last_scrub_stamp":"2024-09-12T00:55:04.617031+0000","last_deep_scrub":"266'42","last_deep_scrub_stamp":"2024-09-12T00:55:04.617031+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.617031+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:14.514351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"265'1","reported_seq":21,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.938145+0000","last_change":"2024-09-12T00:39:28.145050+0000","last_active":"2024-09-12T00:52:30.938145+0000","last_peered":"2024-09-12T00:52:30.938145+0000","last_clean":"2024-09-12T00:52:30.938145+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:52:30.938145+0000","last_undegraded":"2024-09-12T00:52:30.938145+0000","last_fullsized":"2024-09-12T00:52:30.938145+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:20.950384+0000","last_change":"2024-09-12T00:28:17.061641+0000","last_active":"2024-09-12T00:53:20.950384+0000","last_peered":"2024-09-12T00:53:20.950384+0000","last_clean":"2024-09-12T00:53:20.950384+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:53:20.950384+0000","last_undegraded":"2024-09-12T00:53:20.950384+0000","last_fullsized":"2024-09-12T00:53:20.950384+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:23:36.317632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.672398+0000","last_change":"2024-09-12T00:55:08.672398+0000","last_active":"2024-09-12T00:55:08.672398+0000","last_peered":"2024-09-12T00:55:08.672398+0000","last_clean":"2024-09-12T00:55:08.672398+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:55:08.672398+0000","last_undegraded":"2024-09-12T00:55:08.672398+0000","last_fullsized":"2024-09-12T00:55:08.672398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:08.672210+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.672210+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.672210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:14.072302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.668573+0000","last_change":"2024-09-12T00:55:05.668573+0000","last_active":"2024-09-12T00:55:05.668573+0000","last_peered":"2024-09-12T00:55:05.668573+0000","last_clean":"2024-09-12T00:55:05.668573+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:55:05.668573+0000","last_undegraded":"2024-09-12T00:55:05.668573+0000","last_fullsized":"2024-09-12T00:55:05.668573+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'23","last_scrub_stamp":"2024-09-12T00:55:05.668399+0000","last_deep_scrub":"266'23","last_deep_scrub_stamp":"2024-09-12T00:55:05.668399+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.668399+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:21.157528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.939816+0000","last_change":"2024-09-12T00:39:28.134280+0000","last_active":"2024-09-12T00:52:30.939816+0000","last_peered":"2024-09-12T00:52:30.939816+0000","last_clean":"2024-09-12T00:52:30.939816+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:52:30.939816+0000","last_undegraded":"2024-09-12T00:52:30.939816+0000","last_fullsized":"2024-09-12T00:52:30.939816+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'7","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:25.984189+0000","last_change":"2024-09-12T00:28:17.078304+0000","last_active":"2024-09-12T00:54:25.984189+0000","last_peered":"2024-09-12T00:54:25.984189+0000","last_clean":"2024-09-12T00:54:25.984189+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:54:25.984189+0000","last_undegraded":"2024-09-12T00:54:25.984189+0000","last_fullsized":"2024-09-12T00:54:25.984189+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:27.775329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:15.970680+0000","last_change":"2024-09-12T00:28:14.051795+0000","last_active":"2024-09-12T00:53:15.970680+0000","last_peered":"2024-09-12T00:53:15.970680+0000","last_clean":"2024-09-12T00:53:15.970680+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:53:15.970680+0000","last_undegraded":"2024-09-12T00:53:15.970680+0000","last_fullsized":"2024-09-12T00:53:15.970680+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:12.974322+0000","last_clean_scrub_stamp":"2024-09-12T00:28:12.974322+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:15:32.379425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":161,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950431+0000","last_change":"2024-09-12T00:26:48.572457+0000","last_active":"2024-09-12T00:51:50.950431+0000","last_peered":"2024-09-12T00:51:50.950431+0000","last_clean":"2024-09-12T00:51:50.950431+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:51:50.950431+0000","last_undegraded":"2024-09-12T00:51:50.950431+0000","last_fullsized":"2024-09-12T00:51:50.950431+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:29:54.941464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:59.938985+0000","last_change":"2024-09-12T00:39:28.125155+0000","last_active":"2024-09-12T00:51:59.938985+0000","last_peered":"2024-09-12T00:51:59.938985+0000","last_clean":"2024-09-12T00:51:59.938985+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:51:59.938985+0000","last_undegraded":"2024-09-12T00:51:59.938985+0000","last_fullsized":"2024-09-12T00:51:59.938985+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:33:43.283516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.782238+0000","last_change":"2024-09-12T00:55:11.782238+0000","last_active":"2024-09-12T00:55:11.782238+0000","last_peered":"2024-09-12T00:55:11.782238+0000","last_clean":"2024-09-12T00:55:11.782238+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:55:11.782238+0000","last_undegraded":"2024-09-12T00:55:11.782238+0000","last_fullsized":"2024-09-12T00:55:11.782238+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:11.781949+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:11.781949+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.781949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:38.253665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'19","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.575080+0000","last_change":"2024-09-12T00:55:12.575080+0000","last_active":"2024-09-12T00:55:12.575080+0000","last_peered":"2024-09-12T00:55:12.575080+0000","last_clean":"2024-09-12T00:55:12.575080+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:55:12.575080+0000","last_undegraded":"2024-09-12T00:55:12.575080+0000","last_fullsized":"2024-09-12T00:55:12.575080+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T00:55:12.574902+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T00:55:12.574902+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.574902+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.400789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":30726,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":87,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:50.950319+0000","last_change":"2024-09-12T00:26:48.568293+0000","last_active":"2024-09-12T00:51:50.950319+0000","last_peered":"2024-09-12T00:51:50.950319+0000","last_clean":"2024-09-12T00:51:50.950319+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:51:50.950319+0000","last_undegraded":"2024-09-12T00:51:50.950319+0000","last_fullsized":"2024-09-12T00:51:50.950319+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:26:47.513620+0000","last_clean_scrub_stamp":"2024-09-12T00:26:47.513620+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:16:56.992825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954372+0000","last_change":"2024-09-12T00:39:28.135750+0000","last_active":"2024-09-12T00:52:05.954372+0000","last_peered":"2024-09-12T00:52:05.954372+0000","last_clean":"2024-09-12T00:52:05.954372+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:52:05.954372+0000","last_undegraded":"2024-09-12T00:52:05.954372+0000","last_fullsized":"2024-09-12T00:52:05.954372+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.659110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'5","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.760957+0000","last_change":"2024-09-12T00:55:15.760957+0000","last_active":"2024-09-12T00:55:15.760957+0000","last_peered":"2024-09-12T00:55:15.760957+0000","last_clean":"2024-09-12T00:55:15.760957+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:55:15.760957+0000","last_undegraded":"2024-09-12T00:55:15.760957+0000","last_fullsized":"2024-09-12T00:55:15.760957+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:15.760771+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:15.760771+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.760771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.038208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.705878+0000","last_change":"2024-09-12T00:55:07.705878+0000","last_active":"2024-09-12T00:55:07.705878+0000","last_peered":"2024-09-12T00:55:07.705878+0000","last_clean":"2024-09-12T00:55:07.705878+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:55:07.705878+0000","last_undegraded":"2024-09-12T00:55:07.705878+0000","last_fullsized":"2024-09-12T00:55:07.705878+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:07.705704+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:07.705704+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.705704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.429168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.617600+0000","last_change":"2024-09-12T00:55:03.617600+0000","last_active":"2024-09-12T00:55:03.617600+0000","last_peered":"2024-09-12T00:55:03.617600+0000","last_clean":"2024-09-12T00:55:03.617600+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:55:03.617600+0000","last_undegraded":"2024-09-12T00:55:03.617600+0000","last_fullsized":"2024-09-12T00:55:03.617600+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T00:55:03.617423+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T00:55:03.617423+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.617423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:18.987923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'262","reported_seq":914,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.990766+0000","last_change":"2024-09-12T00:54:44.990766+0000","last_active":"2024-09-12T00:54:44.990766+0000","last_peered":"2024-09-12T00:54:44.990766+0000","last_clean":"2024-09-12T00:54:44.990766+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:54:44.990766+0000","last_undegraded":"2024-09-12T00:54:44.990766+0000","last_fullsized":"2024-09-12T00:54:44.990766+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.990558+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:14.960131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":2922,"num_write":1055,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1208","reported_seq":2907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.457851+0000","last_change":"2024-09-12T00:54:49.457851+0000","last_active":"2024-09-12T00:54:49.457851+0000","last_peered":"2024-09-12T00:54:49.457851+0000","last_clean":"2024-09-12T00:54:49.457851+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:49.457851+0000","last_undegraded":"2024-09-12T00:54:49.457851+0000","last_fullsized":"2024-09-12T00:54:49.457851+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1208","last_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_deep_scrub":"266'1208","last_deep_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.457644+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:17.683296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'226","reported_seq":865,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.565409+0000","last_change":"2024-09-12T00:54:49.565409+0000","last_active":"2024-09-12T00:54:49.565409+0000","last_peered":"2024-09-12T00:54:49.565409+0000","last_clean":"2024-09-12T00:54:49.565409+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:54:49.565409+0000","last_undegraded":"2024-09-12T00:54:49.565409+0000","last_fullsized":"2024-09-12T00:54:49.565409+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.565191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:46.709139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":8607,"num_write":1041,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'457","reported_seq":2047,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.210682+0000","last_change":"2024-09-12T00:54:59.210682+0000","last_active":"2024-09-12T00:54:59.210682+0000","last_peered":"2024-09-12T00:54:59.210682+0000","last_clean":"2024-09-12T00:54:59.210682+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:54:59.210682+0000","last_undegraded":"2024-09-12T00:54:59.210682+0000","last_fullsized":"2024-09-12T00:54:59.210682+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T00:54:59.210500+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T00:54:59.210500+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.210500+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:15.276452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3035,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'205","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.572828+0000","last_change":"2024-09-12T00:54:47.572828+0000","last_active":"2024-09-12T00:54:47.572828+0000","last_peered":"2024-09-12T00:54:47.572828+0000","last_clean":"2024-09-12T00:54:47.572828+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:54:47.572828+0000","last_undegraded":"2024-09-12T00:54:47.572828+0000","last_fullsized":"2024-09-12T00:54:47.572828+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.572612+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:38.077210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":9703,"num_write":942,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'472","reported_seq":2029,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.252532+0000","last_change":"2024-09-12T00:55:00.252532+0000","last_active":"2024-09-12T00:55:00.252532+0000","last_peered":"2024-09-12T00:55:00.252532+0000","last_clean":"2024-09-12T00:55:00.252532+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:55:00.252532+0000","last_undegraded":"2024-09-12T00:55:00.252532+0000","last_fullsized":"2024-09-12T00:55:00.252532+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'472","last_scrub_stamp":"2024-09-12T00:55:00.252348+0000","last_deep_scrub":"266'472","last_deep_scrub_stamp":"2024-09-12T00:55:00.252348+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.252348+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:31.620465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'172","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.805793+0000","last_change":"2024-09-12T00:54:42.805793+0000","last_active":"2024-09-12T00:54:42.805793+0000","last_peered":"2024-09-12T00:54:42.805793+0000","last_clean":"2024-09-12T00:54:42.805793+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:54:42.805793+0000","last_undegraded":"2024-09-12T00:54:42.805793+0000","last_fullsized":"2024-09-12T00:54:42.805793+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'172","last_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_deep_scrub":"266'172","last_deep_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.805574+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:52.082618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3723389,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":16186,"num_write":899,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'824","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.771399+0000","last_change":"2024-09-12T00:54:52.771399+0000","last_active":"2024-09-12T00:54:52.771399+0000","last_peered":"2024-09-12T00:54:52.771399+0000","last_clean":"2024-09-12T00:54:52.771399+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:54:52.771399+0000","last_undegraded":"2024-09-12T00:54:52.771399+0000","last_fullsized":"2024-09-12T00:54:52.771399+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'824","last_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_deep_scrub":"266'824","last_deep_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.771212+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:46.148911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'190","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.992323+0000","last_change":"2024-09-12T00:54:43.992323+0000","last_active":"2024-09-12T00:54:43.992323+0000","last_peered":"2024-09-12T00:54:43.992323+0000","last_clean":"2024-09-12T00:54:43.992323+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:54:43.992323+0000","last_undegraded":"2024-09-12T00:54:43.992323+0000","last_fullsized":"2024-09-12T00:54:43.992323+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.991947+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:36.462643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569693,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":16314,"num_write":910,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'801","reported_seq":2293,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.039117+0000","last_change":"2024-09-12T00:54:48.039117+0000","last_active":"2024-09-12T00:54:48.039117+0000","last_peered":"2024-09-12T00:54:48.039117+0000","last_clean":"2024-09-12T00:54:48.039117+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:54:48.039117+0000","last_undegraded":"2024-09-12T00:54:48.039117+0000","last_fullsized":"2024-09-12T00:54:48.039117+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.038929+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:45.582305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'177","reported_seq":787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.699958+0000","last_change":"2024-09-12T00:54:39.699958+0000","last_active":"2024-09-12T00:54:39.699958+0000","last_peered":"2024-09-12T00:54:39.699958+0000","last_clean":"2024-09-12T00:54:39.699958+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:39.699958+0000","last_undegraded":"2024-09-12T00:54:39.699958+0000","last_fullsized":"2024-09-12T00:54:39.699958+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.699741+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.796747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":30215,"num_write":846,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'392","reported_seq":1915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.962955+0000","last_change":"2024-09-12T00:54:55.962955+0000","last_active":"2024-09-12T00:54:55.962955+0000","last_peered":"2024-09-12T00:54:55.962955+0000","last_clean":"2024-09-12T00:54:55.962955+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:54:55.962955+0000","last_undegraded":"2024-09-12T00:54:55.962955+0000","last_fullsized":"2024-09-12T00:54:55.962955+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.962710+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:54.934059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'229","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.012358+0000","last_change":"2024-09-12T00:54:40.012358+0000","last_active":"2024-09-12T00:54:40.012358+0000","last_peered":"2024-09-12T00:54:40.012358+0000","last_clean":"2024-09-12T00:54:40.012358+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:54:40.012358+0000","last_undegraded":"2024-09-12T00:54:40.012358+0000","last_fullsized":"2024-09-12T00:54:40.012358+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.012124+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:25.409967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924437,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":17813,"num_write":1032,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'991","reported_seq":2517,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.695069+0000","last_change":"2024-09-12T00:54:48.695069+0000","last_active":"2024-09-12T00:54:48.695069+0000","last_peered":"2024-09-12T00:54:48.695069+0000","last_clean":"2024-09-12T00:54:48.695069+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:54:48.695069+0000","last_undegraded":"2024-09-12T00:54:48.695069+0000","last_fullsized":"2024-09-12T00:54:48.695069+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'991","last_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_deep_scrub":"266'991","last_deep_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.694882+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":900,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:30.875835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'182","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.568654+0000","last_change":"2024-09-12T00:54:48.568654+0000","last_active":"2024-09-12T00:54:48.568654+0000","last_peered":"2024-09-12T00:54:48.568654+0000","last_clean":"2024-09-12T00:54:48.568654+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:54:48.568654+0000","last_undegraded":"2024-09-12T00:54:48.568654+0000","last_fullsized":"2024-09-12T00:54:48.568654+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.568387+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:29.536238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":351,"num_read_kb":20841,"num_write":801,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2409,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.505321+0000","last_change":"2024-09-12T00:54:58.505321+0000","last_active":"2024-09-12T00:54:58.505321+0000","last_peered":"2024-09-12T00:54:58.505321+0000","last_clean":"2024-09-12T00:54:58.505321+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:54:58.505321+0000","last_undegraded":"2024-09-12T00:54:58.505321+0000","last_fullsized":"2024-09-12T00:54:58.505321+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'826","last_scrub_stamp":"2024-09-12T00:54:58.505112+0000","last_deep_scrub":"266'826","last_deep_scrub_stamp":"2024-09-12T00:54:58.505112+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.505112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:50.859376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'813","reported_seq":2367,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.177379+0000","last_change":"2024-09-12T00:54:58.177379+0000","last_active":"2024-09-12T00:54:58.177379+0000","last_peered":"2024-09-12T00:54:58.177379+0000","last_clean":"2024-09-12T00:54:58.177379+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:58.177379+0000","last_undegraded":"2024-09-12T00:54:58.177379+0000","last_fullsized":"2024-09-12T00:54:58.177379+0000","mapping_epoch":27,"log_start":"266'801","ondisk_log_start":"266'801","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'813","last_scrub_stamp":"2024-09-12T00:54:58.177199+0000","last_deep_scrub":"266'813","last_deep_scrub_stamp":"2024-09-12T00:54:58.177199+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.177199+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":801,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:36.178190+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'281","reported_seq":1013,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.282873+0000","last_change":"2024-09-12T00:54:40.282873+0000","last_active":"2024-09-12T00:54:40.282873+0000","last_peered":"2024-09-12T00:54:40.282873+0000","last_clean":"2024-09-12T00:54:40.282873+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:54:40.282873+0000","last_undegraded":"2024-09-12T00:54:40.282873+0000","last_fullsized":"2024-09-12T00:54:40.282873+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'281","last_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_deep_scrub":"266'281","last_deep_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.282649+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:52.630575+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351099,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":931,"num_read_kb":25081,"num_write":1230,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2594,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.064930+0000","last_change":"2024-09-12T00:54:47.064930+0000","last_active":"2024-09-12T00:54:47.064930+0000","last_peered":"2024-09-12T00:54:47.064930+0000","last_clean":"2024-09-12T00:54:47.064930+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:47.064930+0000","last_undegraded":"2024-09-12T00:54:47.064930+0000","last_fullsized":"2024-09-12T00:54:47.064930+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1096","last_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_deep_scrub":"266'1096","last_deep_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.064751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:16.284275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'183","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.027292+0000","last_change":"2024-09-12T00:54:41.027152+0000","last_active":"2024-09-12T00:54:41.027292+0000","last_peered":"2024-09-12T00:54:41.027292+0000","last_clean":"2024-09-12T00:54:41.027292+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:41.027292+0000","last_undegraded":"2024-09-12T00:54:41.027292+0000","last_fullsized":"2024-09-12T00:54:41.027292+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.026921+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:42.983840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":23009,"num_write":868,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'442","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.423768+0000","last_change":"2024-09-12T00:54:45.423768+0000","last_active":"2024-09-12T00:54:45.423768+0000","last_peered":"2024-09-12T00:54:45.423768+0000","last_clean":"2024-09-12T00:54:45.423768+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:45.423768+0000","last_undegraded":"2024-09-12T00:54:45.423768+0000","last_fullsized":"2024-09-12T00:54:45.423768+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'442","last_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_deep_scrub":"266'442","last_deep_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.423598+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:38.014555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'192","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.994296+0000","last_change":"2024-09-12T00:54:41.994046+0000","last_active":"2024-09-12T00:54:41.994296+0000","last_peered":"2024-09-12T00:54:41.994296+0000","last_clean":"2024-09-12T00:54:41.994296+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:54:41.994296+0000","last_undegraded":"2024-09-12T00:54:41.994296+0000","last_fullsized":"2024-09-12T00:54:41.994296+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'192","last_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_deep_scrub":"266'192","last_deep_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.993748+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:48.875430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129095,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":15824,"num_write":919,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'555","reported_seq":2163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.584583+0000","last_change":"2024-09-12T00:54:51.584583+0000","last_active":"2024-09-12T00:54:51.584583+0000","last_peered":"2024-09-12T00:54:51.584583+0000","last_clean":"2024-09-12T00:54:51.584583+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:54:51.584583+0000","last_undegraded":"2024-09-12T00:54:51.584583+0000","last_fullsized":"2024-09-12T00:54:51.584583+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'555","last_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_deep_scrub":"266'555","last_deep_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.584300+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:27.384007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":877,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'211","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.978919+0000","last_change":"2024-09-12T00:54:42.978773+0000","last_active":"2024-09-12T00:54:42.978919+0000","last_peered":"2024-09-12T00:54:42.978919+0000","last_clean":"2024-09-12T00:54:42.978919+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:54:42.978919+0000","last_undegraded":"2024-09-12T00:54:42.978919+0000","last_fullsized":"2024-09-12T00:54:42.978919+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.978525+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:06.511163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924468,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":26404,"num_write":991,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'629","reported_seq":2259,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.506768+0000","last_change":"2024-09-12T00:54:57.506768+0000","last_active":"2024-09-12T00:54:57.506768+0000","last_peered":"2024-09-12T00:54:57.506768+0000","last_clean":"2024-09-12T00:54:57.506768+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:54:57.506768+0000","last_undegraded":"2024-09-12T00:54:57.506768+0000","last_fullsized":"2024-09-12T00:54:57.506768+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'629","last_scrub_stamp":"2024-09-12T00:54:57.506590+0000","last_deep_scrub":"266'629","last_deep_scrub_stamp":"2024-09-12T00:54:57.506590+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.506590+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.590029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'186","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.583910+0000","last_change":"2024-09-12T00:54:44.583757+0000","last_active":"2024-09-12T00:54:44.583910+0000","last_peered":"2024-09-12T00:54:44.583910+0000","last_clean":"2024-09-12T00:54:44.583910+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:54:44.583910+0000","last_undegraded":"2024-09-12T00:54:44.583910+0000","last_fullsized":"2024-09-12T00:54:44.583910+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.583505+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:41.416586+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":395,"num_read_kb":19556,"num_write":891,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1216","reported_seq":2920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.381975+0000","last_change":"2024-09-12T00:54:46.381975+0000","last_active":"2024-09-12T00:54:46.381975+0000","last_peered":"2024-09-12T00:54:46.381975+0000","last_clean":"2024-09-12T00:54:46.381975+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:46.381975+0000","last_undegraded":"2024-09-12T00:54:46.381975+0000","last_fullsized":"2024-09-12T00:54:46.381975+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1216","last_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_deep_scrub":"266'1216","last_deep_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.381745+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:02.347559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2038,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'206","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.526531+0000","last_change":"2024-09-12T00:54:43.526531+0000","last_active":"2024-09-12T00:54:43.526531+0000","last_peered":"2024-09-12T00:54:43.526531+0000","last_clean":"2024-09-12T00:54:43.526531+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:43.526531+0000","last_undegraded":"2024-09-12T00:54:43.526531+0000","last_fullsized":"2024-09-12T00:54:43.526531+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.526312+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:10.785471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":13603,"num_write":999,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'159","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.155812+0000","last_change":"2024-09-12T00:55:03.155812+0000","last_active":"2024-09-12T00:55:03.155812+0000","last_peered":"2024-09-12T00:55:03.155812+0000","last_clean":"2024-09-12T00:55:03.155812+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:55:03.155812+0000","last_undegraded":"2024-09-12T00:55:03.155812+0000","last_fullsized":"2024-09-12T00:55:03.155812+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'159","last_scrub_stamp":"2024-09-12T00:55:03.155627+0000","last_deep_scrub":"266'159","last_deep_scrub_stamp":"2024-09-12T00:55:03.155627+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.155627+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:21.467016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'432","reported_seq":1957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.583276+0000","last_change":"2024-09-12T00:54:49.583276+0000","last_active":"2024-09-12T00:54:49.583276+0000","last_peered":"2024-09-12T00:54:49.583276+0000","last_clean":"2024-09-12T00:54:49.583276+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:54:49.583276+0000","last_undegraded":"2024-09-12T00:54:49.583276+0000","last_fullsized":"2024-09-12T00:54:49.583276+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'432","last_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_deep_scrub":"266'432","last_deep_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.583097+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:25.325862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'200","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.527392+0000","last_change":"2024-09-12T00:54:39.527392+0000","last_active":"2024-09-12T00:54:39.527392+0000","last_peered":"2024-09-12T00:54:39.527392+0000","last_clean":"2024-09-12T00:54:39.527392+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:54:39.527392+0000","last_undegraded":"2024-09-12T00:54:39.527392+0000","last_fullsized":"2024-09-12T00:54:39.527392+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.527188+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.380120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1954,"num_write":1014,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.240645+0000","last_change":"2024-09-12T00:55:05.240645+0000","last_active":"2024-09-12T00:55:05.240645+0000","last_peered":"2024-09-12T00:55:05.240645+0000","last_clean":"2024-09-12T00:55:05.240645+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:55:05.240645+0000","last_undegraded":"2024-09-12T00:55:05.240645+0000","last_fullsized":"2024-09-12T00:55:05.240645+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:05.240468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:05.240468+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.240468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:34.522701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'206","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.674338+0000","last_change":"2024-09-12T00:55:04.674338+0000","last_active":"2024-09-12T00:55:04.674338+0000","last_peered":"2024-09-12T00:55:04.674338+0000","last_clean":"2024-09-12T00:55:04.674338+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:55:04.674338+0000","last_undegraded":"2024-09-12T00:55:04.674338+0000","last_fullsized":"2024-09-12T00:55:04.674338+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:55:04.674010+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:55:04.674010+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.674010+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:58.102887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":272,"num_read_kb":332,"num_write":160,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.612871+0000","last_change":"2024-09-12T00:55:00.612871+0000","last_active":"2024-09-12T00:55:00.612871+0000","last_peered":"2024-09-12T00:55:00.612871+0000","last_clean":"2024-09-12T00:55:00.612871+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:55:00.612871+0000","last_undegraded":"2024-09-12T00:55:00.612871+0000","last_fullsized":"2024-09-12T00:55:00.612871+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:00.612535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:00.612535+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.612535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.509961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2476","reported_seq":4376,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.652238+0000","last_change":"2024-09-12T00:55:05.652238+0000","last_active":"2024-09-12T00:55:05.652238+0000","last_peered":"2024-09-12T00:55:05.652238+0000","last_clean":"2024-09-12T00:55:05.652238+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:55:05.652238+0000","last_undegraded":"2024-09-12T00:55:05.652238+0000","last_fullsized":"2024-09-12T00:55:05.652238+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2476","last_scrub_stamp":"2024-09-12T00:55:05.652034+0000","last_deep_scrub":"266'2476","last_deep_scrub_stamp":"2024-09-12T00:55:05.652034+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.652034+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:50.117470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'466","reported_seq":1922,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.189586+0000","last_change":"2024-09-12T00:54:55.189586+0000","last_active":"2024-09-12T00:54:55.189586+0000","last_peered":"2024-09-12T00:54:55.189586+0000","last_clean":"2024-09-12T00:54:55.189586+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:55.189586+0000","last_undegraded":"2024-09-12T00:54:55.189586+0000","last_fullsized":"2024-09-12T00:54:55.189586+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'466","last_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_deep_scrub":"266'466","last_deep_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.189400+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.744860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'244","reported_seq":940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.557769+0000","last_change":"2024-09-12T00:54:37.557769+0000","last_active":"2024-09-12T00:54:37.557769+0000","last_peered":"2024-09-12T00:54:37.557769+0000","last_clean":"2024-09-12T00:54:37.557769+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:54:37.557769+0000","last_undegraded":"2024-09-12T00:54:37.557769+0000","last_fullsized":"2024-09-12T00:54:37.557769+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'244","last_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_deep_scrub":"266'244","last_deep_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.557554+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:58.369323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49242,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":71900,"num_write":1168,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.780257+0000","last_change":"2024-09-12T00:54:56.780257+0000","last_active":"2024-09-12T00:54:56.780257+0000","last_peered":"2024-09-12T00:54:56.780257+0000","last_clean":"2024-09-12T00:54:56.780257+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:54:56.780257+0000","last_undegraded":"2024-09-12T00:54:56.780257+0000","last_fullsized":"2024-09-12T00:54:56.780257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:56.780049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:56.780049+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.780049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:46.069418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'95","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.581870+0000","last_change":"2024-09-12T00:54:55.581870+0000","last_active":"2024-09-12T00:54:55.581870+0000","last_peered":"2024-09-12T00:54:55.581870+0000","last_clean":"2024-09-12T00:54:55.581870+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:54:55.581870+0000","last_undegraded":"2024-09-12T00:54:55.581870+0000","last_fullsized":"2024-09-12T00:54:55.581870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'95","last_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_deep_scrub":"266'95","last_deep_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.581679+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:01.848720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.574205+0000","last_change":"2024-09-12T00:55:01.574205+0000","last_active":"2024-09-12T00:55:01.574205+0000","last_peered":"2024-09-12T00:55:01.574205+0000","last_clean":"2024-09-12T00:55:01.574205+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:55:01.574205+0000","last_undegraded":"2024-09-12T00:55:01.574205+0000","last_fullsized":"2024-09-12T00:55:01.574205+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:01.574021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:01.574021+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.574021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.759800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'161","reported_seq":679,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.681813+0000","last_change":"2024-09-12T00:55:05.681813+0000","last_active":"2024-09-12T00:55:05.681813+0000","last_peered":"2024-09-12T00:55:05.681813+0000","last_clean":"2024-09-12T00:55:05.681813+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:55:05.681813+0000","last_undegraded":"2024-09-12T00:55:05.681813+0000","last_fullsized":"2024-09-12T00:55:05.681813+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'161","last_scrub_stamp":"2024-09-12T00:55:05.681606+0000","last_deep_scrub":"266'161","last_deep_scrub_stamp":"2024-09-12T00:55:05.681606+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.681606+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:52.851058+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'568","reported_seq":2064,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.496091+0000","last_change":"2024-09-12T00:54:55.496091+0000","last_active":"2024-09-12T00:54:55.496091+0000","last_peered":"2024-09-12T00:54:55.496091+0000","last_clean":"2024-09-12T00:54:55.496091+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:54:55.496091+0000","last_undegraded":"2024-09-12T00:54:55.496091+0000","last_fullsized":"2024-09-12T00:54:55.496091+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'568","last_scrub_stamp":"2024-09-12T00:54:55.495889+0000","last_deep_scrub":"266'568","last_deep_scrub_stamp":"2024-09-12T00:54:55.495889+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.495889+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:02.338433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'235","reported_seq":875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.252201+0000","last_change":"2024-09-12T00:54:44.252201+0000","last_active":"2024-09-12T00:54:44.252201+0000","last_peered":"2024-09-12T00:54:44.252201+0000","last_clean":"2024-09-12T00:54:44.252201+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:54:44.252201+0000","last_undegraded":"2024-09-12T00:54:44.252201+0000","last_fullsized":"2024-09-12T00:54:44.252201+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.251990+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:21.780768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":11769,"num_write":1011,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.788234+0000","last_change":"2024-09-12T00:54:57.788234+0000","last_active":"2024-09-12T00:54:57.788234+0000","last_peered":"2024-09-12T00:54:57.788234+0000","last_clean":"2024-09-12T00:54:57.788234+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:54:57.788234+0000","last_undegraded":"2024-09-12T00:54:57.788234+0000","last_fullsized":"2024-09-12T00:54:57.788234+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.788032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.788032+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.788032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:57.817885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'135","reported_seq":690,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.716139+0000","last_change":"2024-09-12T00:55:03.716139+0000","last_active":"2024-09-12T00:55:03.716139+0000","last_peered":"2024-09-12T00:55:03.716139+0000","last_clean":"2024-09-12T00:55:03.716139+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:55:03.716139+0000","last_undegraded":"2024-09-12T00:55:03.716139+0000","last_fullsized":"2024-09-12T00:55:03.716139+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'135","last_scrub_stamp":"2024-09-12T00:55:03.715942+0000","last_deep_scrub":"266'135","last_deep_scrub_stamp":"2024-09-12T00:55:03.715942+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.715942+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:21.099760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'780","reported_seq":2225,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.256620+0000","last_change":"2024-09-12T00:55:15.256620+0000","last_active":"2024-09-12T00:55:15.256620+0000","last_peered":"2024-09-12T00:55:15.256620+0000","last_clean":"2024-09-12T00:55:15.256620+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:55:15.256620+0000","last_undegraded":"2024-09-12T00:55:15.256620+0000","last_fullsized":"2024-09-12T00:55:15.256620+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'780","last_scrub_stamp":"2024-09-12T00:55:15.256431+0000","last_deep_scrub":"266'780","last_deep_scrub_stamp":"2024-09-12T00:55:15.256431+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.256431+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:50.511293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'220","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.633267+0000","last_change":"2024-09-12T00:55:02.633267+0000","last_active":"2024-09-12T00:55:02.633267+0000","last_peered":"2024-09-12T00:55:02.633267+0000","last_clean":"2024-09-12T00:55:02.633267+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:55:02.633267+0000","last_undegraded":"2024-09-12T00:55:02.633267+0000","last_fullsized":"2024-09-12T00:55:02.633267+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'220","last_scrub_stamp":"2024-09-12T00:55:02.633094+0000","last_deep_scrub":"266'220","last_deep_scrub_stamp":"2024-09-12T00:55:02.633094+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.633094+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:18.981830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'341","reported_seq":1787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.481419+0000","last_change":"2024-09-12T00:54:52.481419+0000","last_active":"2024-09-12T00:54:52.481419+0000","last_peered":"2024-09-12T00:54:52.481419+0000","last_clean":"2024-09-12T00:54:52.481419+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:54:52.481419+0000","last_undegraded":"2024-09-12T00:54:52.481419+0000","last_fullsized":"2024-09-12T00:54:52.481419+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'341","last_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_deep_scrub":"266'341","last_deep_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.481235+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.223578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'204","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.252728+0000","last_change":"2024-09-12T00:54:36.252728+0000","last_active":"2024-09-12T00:54:36.252728+0000","last_peered":"2024-09-12T00:54:36.252728+0000","last_clean":"2024-09-12T00:54:36.252728+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:54:36.252728+0000","last_undegraded":"2024-09-12T00:54:36.252728+0000","last_fullsized":"2024-09-12T00:54:36.252728+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.252593+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:55.096253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5525,"num_write":929,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":503,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.214591+0000","last_change":"2024-09-12T00:55:06.214591+0000","last_active":"2024-09-12T00:55:06.214591+0000","last_peered":"2024-09-12T00:55:06.214591+0000","last_clean":"2024-09-12T00:55:06.214591+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:55:06.214591+0000","last_undegraded":"2024-09-12T00:55:06.214591+0000","last_fullsized":"2024-09-12T00:55:06.214591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.214415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.214415+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.214415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:10.611172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'125","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.736749+0000","last_change":"2024-09-12T00:54:54.736749+0000","last_active":"2024-09-12T00:54:54.736749+0000","last_peered":"2024-09-12T00:54:54.736749+0000","last_clean":"2024-09-12T00:54:54.736749+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:54.736749+0000","last_undegraded":"2024-09-12T00:54:54.736749+0000","last_fullsized":"2024-09-12T00:54:54.736749+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'125","last_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_deep_scrub":"266'125","last_deep_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.736531+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:19.668088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":150,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'791","reported_seq":2268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.269631+0000","last_change":"2024-09-12T00:55:11.269631+0000","last_active":"2024-09-12T00:55:11.269631+0000","last_peered":"2024-09-12T00:55:11.269631+0000","last_clean":"2024-09-12T00:55:11.269631+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:55:11.269631+0000","last_undegraded":"2024-09-12T00:55:11.269631+0000","last_fullsized":"2024-09-12T00:55:11.269631+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T00:55:11.269441+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T00:55:11.269441+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.269441+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:34.272360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'541","reported_seq":2425,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.233737+0000","last_change":"2024-09-12T00:54:53.233588+0000","last_active":"2024-09-12T00:54:53.233737+0000","last_peered":"2024-09-12T00:54:53.233737+0000","last_clean":"2024-09-12T00:54:53.233737+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:54:53.233737+0000","last_undegraded":"2024-09-12T00:54:53.233737+0000","last_fullsized":"2024-09-12T00:54:53.233737+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'541","last_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_deep_scrub":"266'541","last_deep_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.233406+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:22.797998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'243","reported_seq":908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.022640+0000","last_change":"2024-09-12T00:54:37.022589+0000","last_active":"2024-09-12T00:54:37.022640+0000","last_peered":"2024-09-12T00:54:37.022640+0000","last_clean":"2024-09-12T00:54:37.022640+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:54:37.022640+0000","last_undegraded":"2024-09-12T00:54:37.022640+0000","last_fullsized":"2024-09-12T00:54:37.022640+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.022508+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:27.678475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639369,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":593,"num_read_kb":40518,"num_write":1099,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.463094+0000","last_change":"2024-09-12T00:54:52.462947+0000","last_active":"2024-09-12T00:54:52.463094+0000","last_peered":"2024-09-12T00:54:52.463094+0000","last_clean":"2024-09-12T00:54:52.463094+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:54:52.463094+0000","last_undegraded":"2024-09-12T00:54:52.463094+0000","last_fullsized":"2024-09-12T00:54:52.463094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.462775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.499387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'229","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.012090+0000","last_change":"2024-09-12T00:54:53.012090+0000","last_active":"2024-09-12T00:54:53.012090+0000","last_peered":"2024-09-12T00:54:53.012090+0000","last_clean":"2024-09-12T00:54:53.012090+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:54:53.012090+0000","last_undegraded":"2024-09-12T00:54:53.012090+0000","last_fullsized":"2024-09-12T00:54:53.012090+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.011878+0000","objects_scrubbed":10,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:32.987361+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":300,"num_read_kb":365,"num_write":178,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.649950+0000","last_change":"2024-09-12T00:55:02.649950+0000","last_active":"2024-09-12T00:55:02.649950+0000","last_peered":"2024-09-12T00:55:02.649950+0000","last_clean":"2024-09-12T00:55:02.649950+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:55:02.649950+0000","last_undegraded":"2024-09-12T00:55:02.649950+0000","last_fullsized":"2024-09-12T00:55:02.649950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.649779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.649779+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.649779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:36.061666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'547","reported_seq":1381,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.636228+0000","last_change":"2024-09-12T00:55:00.636228+0000","last_active":"2024-09-12T00:55:00.636228+0000","last_peered":"2024-09-12T00:55:00.636228+0000","last_clean":"2024-09-12T00:55:00.636228+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:55:00.636228+0000","last_undegraded":"2024-09-12T00:55:00.636228+0000","last_fullsized":"2024-09-12T00:55:00.636228+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'547","last_scrub_stamp":"2024-09-12T00:55:00.636015+0000","last_deep_scrub":"266'547","last_deep_scrub_stamp":"2024-09-12T00:55:00.636015+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.636015+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:11.319690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'848","reported_seq":2500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.378138+0000","last_change":"2024-09-12T00:54:43.377977+0000","last_active":"2024-09-12T00:54:43.378138+0000","last_peered":"2024-09-12T00:54:43.378138+0000","last_clean":"2024-09-12T00:54:43.378138+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:54:43.378138+0000","last_undegraded":"2024-09-12T00:54:43.378138+0000","last_fullsized":"2024-09-12T00:54:43.378138+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'848","last_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_deep_scrub":"266'848","last_deep_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.377796+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:14.837239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":722,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'191","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.713942+0000","last_change":"2024-09-12T00:54:37.713942+0000","last_active":"2024-09-12T00:54:37.713942+0000","last_peered":"2024-09-12T00:54:37.713942+0000","last_clean":"2024-09-12T00:54:37.713942+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:37.713942+0000","last_undegraded":"2024-09-12T00:54:37.713942+0000","last_fullsized":"2024-09-12T00:54:37.713942+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.713849+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.923192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399155,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":818,"num_read_kb":32535,"num_write":884,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.551937+0000","last_change":"2024-09-12T00:54:52.551709+0000","last_active":"2024-09-12T00:54:52.551937+0000","last_peered":"2024-09-12T00:54:52.551937+0000","last_clean":"2024-09-12T00:54:52.551937+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:54:52.551937+0000","last_undegraded":"2024-09-12T00:54:52.551937+0000","last_fullsized":"2024-09-12T00:54:52.551937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.551408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.893833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'134","reported_seq":718,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.735836+0000","last_change":"2024-09-12T00:55:01.735836+0000","last_active":"2024-09-12T00:55:01.735836+0000","last_peered":"2024-09-12T00:55:01.735836+0000","last_clean":"2024-09-12T00:55:01.735836+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:55:01.735836+0000","last_undegraded":"2024-09-12T00:55:01.735836+0000","last_fullsized":"2024-09-12T00:55:01.735836+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:55:01.735648+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:55:01.735648+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.735648+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:25.065258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":236,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.620579+0000","last_change":"2024-09-12T00:55:08.620579+0000","last_active":"2024-09-12T00:55:08.620579+0000","last_peered":"2024-09-12T00:55:08.620579+0000","last_clean":"2024-09-12T00:55:08.620579+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:55:08.620579+0000","last_undegraded":"2024-09-12T00:55:08.620579+0000","last_fullsized":"2024-09-12T00:55:08.620579+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:08.620388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:08.620388+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.620388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:01.875295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'145","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.626619+0000","last_change":"2024-09-12T00:55:02.626619+0000","last_active":"2024-09-12T00:55:02.626619+0000","last_peered":"2024-09-12T00:55:02.626619+0000","last_clean":"2024-09-12T00:55:02.626619+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:55:02.626619+0000","last_undegraded":"2024-09-12T00:55:02.626619+0000","last_fullsized":"2024-09-12T00:55:02.626619+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'145","last_scrub_stamp":"2024-09-12T00:55:02.626426+0000","last_deep_scrub":"266'145","last_deep_scrub_stamp":"2024-09-12T00:55:02.626426+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.626426+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:50.334371+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'473","reported_seq":1974,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.801043+0000","last_change":"2024-09-12T00:54:43.800905+0000","last_active":"2024-09-12T00:54:43.801043+0000","last_peered":"2024-09-12T00:54:43.801043+0000","last_clean":"2024-09-12T00:54:43.801043+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:54:43.801043+0000","last_undegraded":"2024-09-12T00:54:43.801043+0000","last_fullsized":"2024-09-12T00:54:43.801043+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.800712+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:56.152735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'169","reported_seq":791,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.292864+0000","last_change":"2024-09-12T00:54:43.292864+0000","last_active":"2024-09-12T00:54:43.292864+0000","last_peered":"2024-09-12T00:54:43.292864+0000","last_clean":"2024-09-12T00:54:43.292864+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:54:43.292864+0000","last_undegraded":"2024-09-12T00:54:43.292864+0000","last_fullsized":"2024-09-12T00:54:43.292864+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'169","last_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_deep_scrub":"266'169","last_deep_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.292636+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:50.241174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263229,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":53604,"num_write":798,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.466853+0000","last_change":"2024-09-12T00:54:59.466853+0000","last_active":"2024-09-12T00:54:59.466853+0000","last_peered":"2024-09-12T00:54:59.466853+0000","last_clean":"2024-09-12T00:54:59.466853+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:54:59.466853+0000","last_undegraded":"2024-09-12T00:54:59.466853+0000","last_fullsized":"2024-09-12T00:54:59.466853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.466666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.466666+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.466666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.960894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'174","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.204352+0000","last_change":"2024-09-12T00:55:08.204100+0000","last_active":"2024-09-12T00:55:08.204352+0000","last_peered":"2024-09-12T00:55:08.204352+0000","last_clean":"2024-09-12T00:55:08.204352+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:55:08.204352+0000","last_undegraded":"2024-09-12T00:55:08.204352+0000","last_fullsized":"2024-09-12T00:55:08.204352+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'174","last_scrub_stamp":"2024-09-12T00:55:08.203826+0000","last_deep_scrub":"266'174","last_deep_scrub_stamp":"2024-09-12T00:55:08.203826+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.203826+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:09.697458+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":225,"num_read_kb":295,"num_write":126,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'790","reported_seq":4507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.375288+0000","last_change":"2024-09-12T00:55:06.375133+0000","last_active":"2024-09-12T00:55:06.375288+0000","last_peered":"2024-09-12T00:55:06.375288+0000","last_clean":"2024-09-12T00:55:06.375288+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:55:06.375288+0000","last_undegraded":"2024-09-12T00:55:06.375288+0000","last_fullsized":"2024-09-12T00:55:06.375288+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'790","last_scrub_stamp":"2024-09-12T00:55:06.374948+0000","last_deep_scrub":"266'790","last_deep_scrub_stamp":"2024-09-12T00:55:06.374948+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.374948+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:20.260953+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.674167+0000","last_change":"2024-09-12T00:55:04.674028+0000","last_active":"2024-09-12T00:55:04.674167+0000","last_peered":"2024-09-12T00:55:04.674167+0000","last_clean":"2024-09-12T00:55:04.674167+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:55:04.674167+0000","last_undegraded":"2024-09-12T00:55:04.674167+0000","last_fullsized":"2024-09-12T00:55:04.674167+0000","mapping_epoch":35,"log_start":"266'101","ondisk_log_start":"266'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'112","last_scrub_stamp":"2024-09-12T00:55:04.673811+0000","last_deep_scrub":"266'112","last_deep_scrub_stamp":"2024-09-12T00:55:04.673811+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.673811+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:11.571983+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.521426+0000","last_change":"2024-09-12T00:54:50.521426+0000","last_active":"2024-09-12T00:54:50.521426+0000","last_peered":"2024-09-12T00:54:50.521426+0000","last_clean":"2024-09-12T00:54:50.521426+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:54:50.521426+0000","last_undegraded":"2024-09-12T00:54:50.521426+0000","last_fullsized":"2024-09-12T00:54:50.521426+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.521244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:58.029014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'206","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.986855+0000","last_change":"2024-09-12T00:54:35.986855+0000","last_active":"2024-09-12T00:54:35.986855+0000","last_peered":"2024-09-12T00:54:35.986855+0000","last_clean":"2024-09-12T00:54:35.986855+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:54:35.986855+0000","last_undegraded":"2024-09-12T00:54:35.986855+0000","last_fullsized":"2024-09-12T00:54:35.986855+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.986557+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:47.032800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263232,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":7228,"num_write":905,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.541065+0000","last_change":"2024-09-12T00:54:53.541065+0000","last_active":"2024-09-12T00:54:53.541065+0000","last_peered":"2024-09-12T00:54:53.541065+0000","last_clean":"2024-09-12T00:54:53.541065+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:54:53.541065+0000","last_undegraded":"2024-09-12T00:54:53.541065+0000","last_fullsized":"2024-09-12T00:54:53.541065+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.540887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:37.677352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'226","reported_seq":877,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.727373+0000","last_change":"2024-09-12T00:55:00.727231+0000","last_active":"2024-09-12T00:55:00.727373+0000","last_peered":"2024-09-12T00:55:00.727373+0000","last_clean":"2024-09-12T00:55:00.727373+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:55:00.727373+0000","last_undegraded":"2024-09-12T00:55:00.727373+0000","last_fullsized":"2024-09-12T00:55:00.727373+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:55:00.727049+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:55:00.727049+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.727049+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:25.809988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17671,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":453,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.421594+0000","last_change":"2024-09-12T00:55:05.421439+0000","last_active":"2024-09-12T00:55:05.421594+0000","last_peered":"2024-09-12T00:55:05.421594+0000","last_clean":"2024-09-12T00:55:05.421594+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:55:05.421594+0000","last_undegraded":"2024-09-12T00:55:05.421594+0000","last_fullsized":"2024-09-12T00:55:05.421594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:05.421260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:05.421260+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.421260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:18.381893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'168","reported_seq":705,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.585645+0000","last_change":"2024-09-12T00:55:01.585367+0000","last_active":"2024-09-12T00:55:01.585645+0000","last_peered":"2024-09-12T00:55:01.585645+0000","last_clean":"2024-09-12T00:55:01.585645+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:55:01.585645+0000","last_undegraded":"2024-09-12T00:55:01.585645+0000","last_fullsized":"2024-09-12T00:55:01.585645+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'168","last_scrub_stamp":"2024-09-12T00:55:01.585026+0000","last_deep_scrub":"266'168","last_deep_scrub_stamp":"2024-09-12T00:55:01.585026+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.585026+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:53.787732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'473","reported_seq":1914,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.024560+0000","last_change":"2024-09-12T00:54:46.024560+0000","last_active":"2024-09-12T00:54:46.024560+0000","last_peered":"2024-09-12T00:54:46.024560+0000","last_clean":"2024-09-12T00:54:46.024560+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:54:46.024560+0000","last_undegraded":"2024-09-12T00:54:46.024560+0000","last_fullsized":"2024-09-12T00:54:46.024560+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.024305+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:36.127769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'213","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.570214+0000","last_change":"2024-09-12T00:54:39.570214+0000","last_active":"2024-09-12T00:54:39.570214+0000","last_peered":"2024-09-12T00:54:39.570214+0000","last_clean":"2024-09-12T00:54:39.570214+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:54:39.570214+0000","last_undegraded":"2024-09-12T00:54:39.570214+0000","last_fullsized":"2024-09-12T00:54:39.570214+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.570000+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:44.813413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1957,"num_write":1001,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"266'4","reported_seq":982,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.606327+0000","last_change":"2024-09-12T00:54:51.606327+0000","last_active":"2024-09-12T00:54:51.606327+0000","last_peered":"2024-09-12T00:54:51.606327+0000","last_clean":"2024-09-12T00:54:51.606327+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:51.606327+0000","last_undegraded":"2024-09-12T00:54:51.606327+0000","last_fullsized":"2024-09-12T00:54:51.606327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.606222+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:53.762430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'170","reported_seq":762,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.619760+0000","last_change":"2024-09-12T00:54:57.619760+0000","last_active":"2024-09-12T00:54:57.619760+0000","last_peered":"2024-09-12T00:54:57.619760+0000","last_clean":"2024-09-12T00:54:57.619760+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:57.619760+0000","last_undegraded":"2024-09-12T00:54:57.619760+0000","last_fullsized":"2024-09-12T00:54:57.619760+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T00:54:57.619550+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T00:54:57.619550+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.619550+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:58.330414+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8234,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":271,"num_write":174,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.536437+0000","last_change":"2024-09-12T00:54:55.536437+0000","last_active":"2024-09-12T00:54:55.536437+0000","last_peered":"2024-09-12T00:54:55.536437+0000","last_clean":"2024-09-12T00:54:55.536437+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:54:55.536437+0000","last_undegraded":"2024-09-12T00:54:55.536437+0000","last_fullsized":"2024-09-12T00:54:55.536437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.536271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:31.775278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'115","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.302070+0000","last_change":"2024-09-12T00:55:08.302070+0000","last_active":"2024-09-12T00:55:08.302070+0000","last_peered":"2024-09-12T00:55:08.302070+0000","last_clean":"2024-09-12T00:55:08.302070+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:55:08.302070+0000","last_undegraded":"2024-09-12T00:55:08.302070+0000","last_fullsized":"2024-09-12T00:55:08.302070+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:08.301877+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:08.301877+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.301877+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:27.663319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'361","reported_seq":1774,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.211004+0000","last_change":"2024-09-12T00:54:54.211004+0000","last_active":"2024-09-12T00:54:54.211004+0000","last_peered":"2024-09-12T00:54:54.211004+0000","last_clean":"2024-09-12T00:54:54.211004+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:54:54.211004+0000","last_undegraded":"2024-09-12T00:54:54.211004+0000","last_fullsized":"2024-09-12T00:54:54.211004+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'361","last_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_deep_scrub":"266'361","last_deep_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.210799+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:50.984927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'180","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.277922+0000","last_change":"2024-09-12T00:54:42.277780+0000","last_active":"2024-09-12T00:54:42.277922+0000","last_peered":"2024-09-12T00:54:42.277922+0000","last_clean":"2024-09-12T00:54:42.277922+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:54:42.277922+0000","last_undegraded":"2024-09-12T00:54:42.277922+0000","last_fullsized":"2024-09-12T00:54:42.277922+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.277535+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:04.627342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029147,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":98751,"num_write":852,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.466092+0000","last_change":"2024-09-12T00:55:00.466092+0000","last_active":"2024-09-12T00:55:00.466092+0000","last_peered":"2024-09-12T00:55:00.466092+0000","last_clean":"2024-09-12T00:55:00.466092+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:55:00.466092+0000","last_undegraded":"2024-09-12T00:55:00.466092+0000","last_fullsized":"2024-09-12T00:55:00.466092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:00.465889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:00.465889+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.465889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:55.760477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'153","reported_seq":744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.481188+0000","last_change":"2024-09-12T00:55:02.481188+0000","last_active":"2024-09-12T00:55:02.481188+0000","last_peered":"2024-09-12T00:55:02.481188+0000","last_clean":"2024-09-12T00:55:02.481188+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:55:02.481188+0000","last_undegraded":"2024-09-12T00:55:02.481188+0000","last_fullsized":"2024-09-12T00:55:02.481188+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T00:55:02.480984+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T00:55:02.480984+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.480984+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.612551+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4675,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":249,"num_write":108,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'760","reported_seq":4280,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.563296+0000","last_change":"2024-09-12T00:54:54.563296+0000","last_active":"2024-09-12T00:54:54.563296+0000","last_peered":"2024-09-12T00:54:54.563296+0000","last_clean":"2024-09-12T00:54:54.563296+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:54.563296+0000","last_undegraded":"2024-09-12T00:54:54.563296+0000","last_fullsized":"2024-09-12T00:54:54.563296+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'760","last_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_deep_scrub":"266'760","last_deep_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.563105+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.533407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'136","reported_seq":635,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.671646+0000","last_change":"2024-09-12T00:55:03.671646+0000","last_active":"2024-09-12T00:55:03.671646+0000","last_peered":"2024-09-12T00:55:03.671646+0000","last_clean":"2024-09-12T00:55:03.671646+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:55:03.671646+0000","last_undegraded":"2024-09-12T00:55:03.671646+0000","last_fullsized":"2024-09-12T00:55:03.671646+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'136","last_scrub_stamp":"2024-09-12T00:55:03.671538+0000","last_deep_scrub":"266'136","last_deep_scrub_stamp":"2024-09-12T00:55:03.671538+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.671538+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:14.251070+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.827777+0000","last_change":"2024-09-12T00:54:44.827777+0000","last_active":"2024-09-12T00:54:44.827777+0000","last_peered":"2024-09-12T00:54:44.827777+0000","last_clean":"2024-09-12T00:54:44.827777+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:54:44.827777+0000","last_undegraded":"2024-09-12T00:54:44.827777+0000","last_fullsized":"2024-09-12T00:54:44.827777+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.827583+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:48.105846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'205","reported_seq":969,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.317059+0000","last_change":"2024-09-12T00:54:41.316896+0000","last_active":"2024-09-12T00:54:41.317059+0000","last_peered":"2024-09-12T00:54:41.317059+0000","last_clean":"2024-09-12T00:54:41.317059+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:54:41.317059+0000","last_undegraded":"2024-09-12T00:54:41.317059+0000","last_fullsized":"2024-09-12T00:54:41.317059+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.316614+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.862723+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3292722,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":199371,"num_write":991,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1457,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.467529+0000","last_change":"2024-09-12T00:54:50.467529+0000","last_active":"2024-09-12T00:54:50.467529+0000","last_peered":"2024-09-12T00:54:50.467529+0000","last_clean":"2024-09-12T00:54:50.467529+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:50.467529+0000","last_undegraded":"2024-09-12T00:54:50.467529+0000","last_fullsized":"2024-09-12T00:54:50.467529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.467357+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:26.686465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'77","reported_seq":604,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.575276+0000","last_change":"2024-09-12T00:54:57.575276+0000","last_active":"2024-09-12T00:54:57.575276+0000","last_peered":"2024-09-12T00:54:57.575276+0000","last_clean":"2024-09-12T00:54:57.575276+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:54:57.575276+0000","last_undegraded":"2024-09-12T00:54:57.575276+0000","last_fullsized":"2024-09-12T00:54:57.575276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T00:54:57.575036+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T00:54:57.575036+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.575036+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:26.524340+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'798","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.634055+0000","last_change":"2024-09-12T00:54:58.634055+0000","last_active":"2024-09-12T00:54:58.634055+0000","last_peered":"2024-09-12T00:54:58.634055+0000","last_clean":"2024-09-12T00:54:58.634055+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:58.634055+0000","last_undegraded":"2024-09-12T00:54:58.634055+0000","last_fullsized":"2024-09-12T00:54:58.634055+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T00:54:58.633950+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T00:54:58.633950+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.633950+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":701,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:30.165647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.675774+0000","last_change":"2024-09-12T00:54:59.675774+0000","last_active":"2024-09-12T00:54:59.675774+0000","last_peered":"2024-09-12T00:54:59.675774+0000","last_clean":"2024-09-12T00:54:59.675774+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:54:59.675774+0000","last_undegraded":"2024-09-12T00:54:59.675774+0000","last_fullsized":"2024-09-12T00:54:59.675774+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'151","last_scrub_stamp":"2024-09-12T00:54:59.675592+0000","last_deep_scrub":"266'151","last_deep_scrub_stamp":"2024-09-12T00:54:59.675592+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.675592+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:49.816081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'761","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.666891+0000","last_change":"2024-09-12T00:54:43.666617+0000","last_active":"2024-09-12T00:54:43.666891+0000","last_peered":"2024-09-12T00:54:43.666891+0000","last_clean":"2024-09-12T00:54:43.666891+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:54:43.666891+0000","last_undegraded":"2024-09-12T00:54:43.666891+0000","last_fullsized":"2024-09-12T00:54:43.666891+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'761","last_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_deep_scrub":"266'761","last_deep_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.666383+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.971115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'218","reported_seq":873,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.748716+0000","last_change":"2024-09-12T00:54:39.748564+0000","last_active":"2024-09-12T00:54:39.748716+0000","last_peered":"2024-09-12T00:54:39.748716+0000","last_clean":"2024-09-12T00:54:39.748716+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:54:39.748716+0000","last_undegraded":"2024-09-12T00:54:39.748716+0000","last_fullsized":"2024-09-12T00:54:39.748716+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.748286+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:20.574571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263224,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":31245,"num_write":954,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.283527+0000","last_change":"2024-09-12T00:55:02.283527+0000","last_active":"2024-09-12T00:55:02.283527+0000","last_peered":"2024-09-12T00:55:02.283527+0000","last_clean":"2024-09-12T00:55:02.283527+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:55:02.283527+0000","last_undegraded":"2024-09-12T00:55:02.283527+0000","last_fullsized":"2024-09-12T00:55:02.283527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.283345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.283345+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.283345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:27.352193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'230","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.555251+0000","last_change":"2024-09-12T00:54:54.555251+0000","last_active":"2024-09-12T00:54:54.555251+0000","last_peered":"2024-09-12T00:54:54.555251+0000","last_clean":"2024-09-12T00:54:54.555251+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:54.555251+0000","last_undegraded":"2024-09-12T00:54:54.555251+0000","last_fullsized":"2024-09-12T00:54:54.555251+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.555026+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:19.736607+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":871,"num_read_kb":936,"num_write":1362,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.686865+0000","last_change":"2024-09-12T00:54:56.686865+0000","last_active":"2024-09-12T00:54:56.686865+0000","last_peered":"2024-09-12T00:54:56.686865+0000","last_clean":"2024-09-12T00:54:56.686865+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:54:56.686865+0000","last_undegraded":"2024-09-12T00:54:56.686865+0000","last_fullsized":"2024-09-12T00:54:56.686865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:56.686680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:56.686680+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.686680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:52.673507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'108","reported_seq":608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.567791+0000","last_change":"2024-09-12T00:55:00.567791+0000","last_active":"2024-09-12T00:55:00.567791+0000","last_peered":"2024-09-12T00:55:00.567791+0000","last_clean":"2024-09-12T00:55:00.567791+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:55:00.567791+0000","last_undegraded":"2024-09-12T00:55:00.567791+0000","last_fullsized":"2024-09-12T00:55:00.567791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T00:55:00.567594+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T00:55:00.567594+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.567594+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:14.526248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'793","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.287495+0000","last_change":"2024-09-12T00:54:52.287495+0000","last_active":"2024-09-12T00:54:52.287495+0000","last_peered":"2024-09-12T00:54:52.287495+0000","last_clean":"2024-09-12T00:54:52.287495+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:54:52.287495+0000","last_undegraded":"2024-09-12T00:54:52.287495+0000","last_fullsized":"2024-09-12T00:54:52.287495+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.287309+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:21.498590+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":630,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.224884+0000","last_change":"2024-09-12T00:54:35.224884+0000","last_active":"2024-09-12T00:54:35.224884+0000","last_peered":"2024-09-12T00:54:35.224884+0000","last_clean":"2024-09-12T00:54:35.224884+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:54:35.224884+0000","last_undegraded":"2024-09-12T00:54:35.224884+0000","last_fullsized":"2024-09-12T00:54:35.224884+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.224815+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:03.397008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.274584+0000","last_change":"2024-09-12T00:54:38.274584+0000","last_active":"2024-09-12T00:54:38.274584+0000","last_peered":"2024-09-12T00:54:38.274584+0000","last_clean":"2024-09-12T00:54:38.274584+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:54:38.274584+0000","last_undegraded":"2024-09-12T00:54:38.274584+0000","last_fullsized":"2024-09-12T00:54:38.274584+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.274494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.201817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'188","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.789217+0000","last_change":"2024-09-12T00:54:42.789217+0000","last_active":"2024-09-12T00:54:42.789217+0000","last_peered":"2024-09-12T00:54:42.789217+0000","last_clean":"2024-09-12T00:54:42.789217+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:54:42.789217+0000","last_undegraded":"2024-09-12T00:54:42.789217+0000","last_fullsized":"2024-09-12T00:54:42.789217+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.788986+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:41.647136+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829240,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":15296,"num_write":922,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"266'5","reported_seq":975,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.966425+0000","last_change":"2024-09-12T00:54:51.966425+0000","last_active":"2024-09-12T00:54:51.966425+0000","last_peered":"2024-09-12T00:54:51.966425+0000","last_clean":"2024-09-12T00:54:51.966425+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:51.966425+0000","last_undegraded":"2024-09-12T00:54:51.966425+0000","last_fullsized":"2024-09-12T00:54:51.966425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.966203+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:02.641365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'310","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.211022+0000","last_change":"2024-09-12T00:55:07.210862+0000","last_active":"2024-09-12T00:55:07.211022+0000","last_peered":"2024-09-12T00:55:07.211022+0000","last_clean":"2024-09-12T00:55:07.211022+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:55:07.211022+0000","last_undegraded":"2024-09-12T00:55:07.211022+0000","last_fullsized":"2024-09-12T00:55:07.211022+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'310","last_scrub_stamp":"2024-09-12T00:55:07.210646+0000","last_deep_scrub":"266'310","last_deep_scrub_stamp":"2024-09-12T00:55:07.210646+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.210646+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:27.265745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38032,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":812,"num_write":452,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89064,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.421374+0000","last_change":"2024-09-12T00:55:04.421246+0000","last_active":"2024-09-12T00:55:04.421374+0000","last_peered":"2024-09-12T00:55:04.421374+0000","last_clean":"2024-09-12T00:55:04.421374+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:55:04.421374+0000","last_undegraded":"2024-09-12T00:55:04.421374+0000","last_fullsized":"2024-09-12T00:55:04.421374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:04.421057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:04.421057+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.421057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:46.700027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'191","reported_seq":899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.081768+0000","last_change":"2024-09-12T00:55:00.081610+0000","last_active":"2024-09-12T00:55:00.081768+0000","last_peered":"2024-09-12T00:55:00.081768+0000","last_clean":"2024-09-12T00:55:00.081768+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:55:00.081768+0000","last_undegraded":"2024-09-12T00:55:00.081768+0000","last_fullsized":"2024-09-12T00:55:00.081768+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:55:00.081425+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:55:00.081425+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.081425+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:07.440493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'456","reported_seq":1928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.519445+0000","last_change":"2024-09-12T00:54:51.519310+0000","last_active":"2024-09-12T00:54:51.519445+0000","last_peered":"2024-09-12T00:54:51.519445+0000","last_clean":"2024-09-12T00:54:51.519445+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:54:51.519445+0000","last_undegraded":"2024-09-12T00:54:51.519445+0000","last_fullsized":"2024-09-12T00:54:51.519445+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.519121+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:49.830324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.242615+0000","last_change":"2024-09-12T00:54:37.242615+0000","last_active":"2024-09-12T00:54:37.242615+0000","last_peered":"2024-09-12T00:54:37.242615+0000","last_clean":"2024-09-12T00:54:37.242615+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:54:37.242615+0000","last_undegraded":"2024-09-12T00:54:37.242615+0000","last_fullsized":"2024-09-12T00:54:37.242615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.242525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:38.015711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'204","reported_seq":822,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.526486+0000","last_change":"2024-09-12T00:54:42.526486+0000","last_active":"2024-09-12T00:54:42.526486+0000","last_peered":"2024-09-12T00:54:42.526486+0000","last_clean":"2024-09-12T00:54:42.526486+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:54:42.526486+0000","last_undegraded":"2024-09-12T00:54:42.526486+0000","last_fullsized":"2024-09-12T00:54:42.526486+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.526184+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:15.774324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306325,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":403,"num_read_kb":6581,"num_write":989,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.310008+0000","last_change":"2024-09-12T00:55:03.309849+0000","last_active":"2024-09-12T00:55:03.310008+0000","last_peered":"2024-09-12T00:55:03.310008+0000","last_clean":"2024-09-12T00:55:03.310008+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:55:03.310008+0000","last_undegraded":"2024-09-12T00:55:03.310008+0000","last_fullsized":"2024-09-12T00:55:03.310008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:03.309659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:03.309659+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.309659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:36.319439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'853","reported_seq":2314,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.624156+0000","last_change":"2024-09-12T00:54:53.624156+0000","last_active":"2024-09-12T00:54:53.624156+0000","last_peered":"2024-09-12T00:54:53.624156+0000","last_clean":"2024-09-12T00:54:53.624156+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:53.624156+0000","last_undegraded":"2024-09-12T00:54:53.624156+0000","last_fullsized":"2024-09-12T00:54:53.624156+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'853","last_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_deep_scrub":"266'853","last_deep_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.623958+0000","objects_scrubbed":12,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:03.095882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66079,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1175,"num_read_kb":1468,"num_write":286,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.270242+0000","last_change":"2024-09-12T00:55:13.270242+0000","last_active":"2024-09-12T00:55:13.270242+0000","last_peered":"2024-09-12T00:55:13.270242+0000","last_clean":"2024-09-12T00:55:13.270242+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:55:13.270242+0000","last_undegraded":"2024-09-12T00:55:13.270242+0000","last_fullsized":"2024-09-12T00:55:13.270242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:13.269978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:13.269978+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.269978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:52.961298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'209","reported_seq":733,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.291393+0000","last_change":"2024-09-12T00:55:09.291393+0000","last_active":"2024-09-12T00:55:09.291393+0000","last_peered":"2024-09-12T00:55:09.291393+0000","last_clean":"2024-09-12T00:55:09.291393+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:55:09.291393+0000","last_undegraded":"2024-09-12T00:55:09.291393+0000","last_fullsized":"2024-09-12T00:55:09.291393+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'209","last_scrub_stamp":"2024-09-12T00:55:09.291169+0000","last_deep_scrub":"266'209","last_deep_scrub_stamp":"2024-09-12T00:55:09.291169+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.291169+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:41.354281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'995","reported_seq":2854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.580114+0000","last_change":"2024-09-12T00:54:48.579986+0000","last_active":"2024-09-12T00:54:48.580114+0000","last_peered":"2024-09-12T00:54:48.580114+0000","last_clean":"2024-09-12T00:54:48.580114+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:54:48.580114+0000","last_undegraded":"2024-09-12T00:54:48.580114+0000","last_fullsized":"2024-09-12T00:54:48.580114+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'995","last_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_deep_scrub":"266'995","last_deep_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.579784+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:38.249646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":530,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.545567+0000","last_change":"2024-09-12T00:54:38.545567+0000","last_active":"2024-09-12T00:54:38.545567+0000","last_peered":"2024-09-12T00:54:38.545567+0000","last_clean":"2024-09-12T00:54:38.545567+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:54:38.545567+0000","last_undegraded":"2024-09-12T00:54:38.545567+0000","last_fullsized":"2024-09-12T00:54:38.545567+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.545294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:50.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'191","reported_seq":813,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.551347+0000","last_change":"2024-09-12T00:54:38.551347+0000","last_active":"2024-09-12T00:54:38.551347+0000","last_peered":"2024-09-12T00:54:38.551347+0000","last_clean":"2024-09-12T00:54:38.551347+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:54:38.551347+0000","last_undegraded":"2024-09-12T00:54:38.551347+0000","last_fullsized":"2024-09-12T00:54:38.551347+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.551135+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:39.228607+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399318,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":402,"num_read_kb":16624,"num_write":912,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.576791+0000","last_change":"2024-09-12T00:54:50.576517+0000","last_active":"2024-09-12T00:54:50.576791+0000","last_peered":"2024-09-12T00:54:50.576791+0000","last_clean":"2024-09-12T00:54:50.576791+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:54:50.576791+0000","last_undegraded":"2024-09-12T00:54:50.576791+0000","last_fullsized":"2024-09-12T00:54:50.576791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.576297+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.163460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'240","reported_seq":1300,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.014557+0000","last_change":"2024-09-12T00:54:57.014557+0000","last_active":"2024-09-12T00:54:57.014557+0000","last_peered":"2024-09-12T00:54:57.014557+0000","last_clean":"2024-09-12T00:54:57.014557+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:57.014557+0000","last_undegraded":"2024-09-12T00:54:57.014557+0000","last_fullsized":"2024-09-12T00:54:57.014557+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'240","last_scrub_stamp":"2024-09-12T00:54:57.014349+0000","last_deep_scrub":"266'240","last_deep_scrub_stamp":"2024-09-12T00:54:57.014349+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.014349+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:47.882649+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.624108+0000","last_change":"2024-09-12T00:55:06.624108+0000","last_active":"2024-09-12T00:55:06.624108+0000","last_peered":"2024-09-12T00:55:06.624108+0000","last_clean":"2024-09-12T00:55:06.624108+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:55:06.624108+0000","last_undegraded":"2024-09-12T00:55:06.624108+0000","last_fullsized":"2024-09-12T00:55:06.624108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.623930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.623930+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.623930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:33.032507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'315","reported_seq":946,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.714992+0000","last_change":"2024-09-12T00:55:11.714992+0000","last_active":"2024-09-12T00:55:11.714992+0000","last_peered":"2024-09-12T00:55:11.714992+0000","last_clean":"2024-09-12T00:55:11.714992+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:55:11.714992+0000","last_undegraded":"2024-09-12T00:55:11.714992+0000","last_fullsized":"2024-09-12T00:55:11.714992+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'315","last_scrub_stamp":"2024-09-12T00:55:11.714813+0000","last_deep_scrub":"266'315","last_deep_scrub_stamp":"2024-09-12T00:55:11.714813+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.714813+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:49.232900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'380","reported_seq":1793,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.548188+0000","last_change":"2024-09-12T00:54:47.548188+0000","last_active":"2024-09-12T00:54:47.548188+0000","last_peered":"2024-09-12T00:54:47.548188+0000","last_clean":"2024-09-12T00:54:47.548188+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:54:47.548188+0000","last_undegraded":"2024-09-12T00:54:47.548188+0000","last_fullsized":"2024-09-12T00:54:47.548188+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.548014+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:48.760777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.197440+0000","last_change":"2024-09-12T00:54:36.197440+0000","last_active":"2024-09-12T00:54:36.197440+0000","last_peered":"2024-09-12T00:54:36.197440+0000","last_clean":"2024-09-12T00:54:36.197440+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:54:36.197440+0000","last_undegraded":"2024-09-12T00:54:36.197440+0000","last_fullsized":"2024-09-12T00:54:36.197440+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.197360+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.561316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'279","reported_seq":960,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:34.999658+0000","last_change":"2024-09-12T00:54:34.999658+0000","last_active":"2024-09-12T00:54:34.999658+0000","last_peered":"2024-09-12T00:54:34.999658+0000","last_clean":"2024-09-12T00:54:34.999658+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:54:34.999658+0000","last_undegraded":"2024-09-12T00:54:34.999658+0000","last_fullsized":"2024-09-12T00:54:34.999658+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'279","last_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_deep_scrub":"266'279","last_deep_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_clean_scrub_stamp":"2024-09-12T00:54:34.999451+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:22.247017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":17781,"num_write":1208,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.529558+0000","last_change":"2024-09-12T00:54:49.529558+0000","last_active":"2024-09-12T00:54:49.529558+0000","last_peered":"2024-09-12T00:54:49.529558+0000","last_clean":"2024-09-12T00:54:49.529558+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:54:49.529558+0000","last_undegraded":"2024-09-12T00:54:49.529558+0000","last_fullsized":"2024-09-12T00:54:49.529558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.529356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:46.730267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'116","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.514099+0000","last_change":"2024-09-12T00:55:01.513954+0000","last_active":"2024-09-12T00:55:01.514099+0000","last_peered":"2024-09-12T00:55:01.514099+0000","last_clean":"2024-09-12T00:55:01.514099+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:55:01.514099+0000","last_undegraded":"2024-09-12T00:55:01.514099+0000","last_fullsized":"2024-09-12T00:55:01.514099+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'116","last_scrub_stamp":"2024-09-12T00:55:01.513747+0000","last_deep_scrub":"266'116","last_deep_scrub_stamp":"2024-09-12T00:55:01.513747+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.513747+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:25.060624+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.276690+0000","last_change":"2024-09-12T00:55:14.276537+0000","last_active":"2024-09-12T00:55:14.276690+0000","last_peered":"2024-09-12T00:55:14.276690+0000","last_clean":"2024-09-12T00:55:14.276690+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:55:14.276690+0000","last_undegraded":"2024-09-12T00:55:14.276690+0000","last_fullsized":"2024-09-12T00:55:14.276690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.276365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.276365+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.276365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:47.649896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.609090+0000","last_change":"2024-09-12T00:55:03.608951+0000","last_active":"2024-09-12T00:55:03.609090+0000","last_peered":"2024-09-12T00:55:03.609090+0000","last_clean":"2024-09-12T00:55:03.609090+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:55:03.609090+0000","last_undegraded":"2024-09-12T00:55:03.609090+0000","last_fullsized":"2024-09-12T00:55:03.609090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'107","last_scrub_stamp":"2024-09-12T00:55:03.608770+0000","last_deep_scrub":"266'107","last_deep_scrub_stamp":"2024-09-12T00:55:03.608770+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.608770+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.097958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'427","reported_seq":1936,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.584085+0000","last_change":"2024-09-12T00:54:46.584085+0000","last_active":"2024-09-12T00:54:46.584085+0000","last_peered":"2024-09-12T00:54:46.584085+0000","last_clean":"2024-09-12T00:54:46.584085+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:46.584085+0000","last_undegraded":"2024-09-12T00:54:46.584085+0000","last_fullsized":"2024-09-12T00:54:46.584085+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'427","last_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_deep_scrub":"266'427","last_deep_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.583899+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:29.567951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'194","reported_seq":926,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.728711+0000","last_change":"2024-09-12T00:54:35.728711+0000","last_active":"2024-09-12T00:54:35.728711+0000","last_peered":"2024-09-12T00:54:35.728711+0000","last_clean":"2024-09-12T00:54:35.728711+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:35.728711+0000","last_undegraded":"2024-09-12T00:54:35.728711+0000","last_fullsized":"2024-09-12T00:54:35.728711+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.728619+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:56.800395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":917,"num_read_kb":23524,"num_write":944,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.582880+0000","last_change":"2024-09-12T00:54:37.582880+0000","last_active":"2024-09-12T00:54:37.582880+0000","last_peered":"2024-09-12T00:54:37.582880+0000","last_clean":"2024-09-12T00:54:37.582880+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:54:37.582880+0000","last_undegraded":"2024-09-12T00:54:37.582880+0000","last_fullsized":"2024-09-12T00:54:37.582880+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.582700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:21.296604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.770670+0000","last_change":"2024-09-12T00:54:54.770670+0000","last_active":"2024-09-12T00:54:54.770670+0000","last_peered":"2024-09-12T00:54:54.770670+0000","last_clean":"2024-09-12T00:54:54.770670+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:54:54.770670+0000","last_undegraded":"2024-09-12T00:54:54.770670+0000","last_fullsized":"2024-09-12T00:54:54.770670+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.770488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:04.172382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'283","reported_seq":965,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.642804+0000","last_change":"2024-09-12T00:54:52.642804+0000","last_active":"2024-09-12T00:54:52.642804+0000","last_peered":"2024-09-12T00:54:52.642804+0000","last_clean":"2024-09-12T00:54:52.642804+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:52.642804+0000","last_undegraded":"2024-09-12T00:54:52.642804+0000","last_fullsized":"2024-09-12T00:54:52.642804+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'283","last_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_deep_scrub":"266'283","last_deep_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.642577+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.027888+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26101,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":392,"num_read_kb":552,"num_write":218,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.721716+0000","last_change":"2024-09-12T00:54:55.721716+0000","last_active":"2024-09-12T00:54:55.721716+0000","last_peered":"2024-09-12T00:54:55.721716+0000","last_clean":"2024-09-12T00:54:55.721716+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:54:55.721716+0000","last_undegraded":"2024-09-12T00:54:55.721716+0000","last_fullsized":"2024-09-12T00:54:55.721716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.721527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'152","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.296106+0000","last_change":"2024-09-12T00:55:12.296106+0000","last_active":"2024-09-12T00:55:12.296106+0000","last_peered":"2024-09-12T00:55:12.296106+0000","last_clean":"2024-09-12T00:55:12.296106+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:55:12.296106+0000","last_undegraded":"2024-09-12T00:55:12.296106+0000","last_fullsized":"2024-09-12T00:55:12.296106+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T00:55:12.295901+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T00:55:12.295901+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.295901+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:00.516313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'459","reported_seq":2086,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.594823+0000","last_change":"2024-09-12T00:54:45.594823+0000","last_active":"2024-09-12T00:54:45.594823+0000","last_peered":"2024-09-12T00:54:45.594823+0000","last_clean":"2024-09-12T00:54:45.594823+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:45.594823+0000","last_undegraded":"2024-09-12T00:54:45.594823+0000","last_fullsized":"2024-09-12T00:54:45.594823+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.594645+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:35.357485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'218","reported_seq":848,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.561566+0000","last_change":"2024-09-12T00:54:38.561566+0000","last_active":"2024-09-12T00:54:38.561566+0000","last_peered":"2024-09-12T00:54:38.561566+0000","last_clean":"2024-09-12T00:54:38.561566+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:54:38.561566+0000","last_undegraded":"2024-09-12T00:54:38.561566+0000","last_fullsized":"2024-09-12T00:54:38.561566+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.561353+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.740390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":428,"num_read_kb":4575,"num_write":1019,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.323452+0000","last_change":"2024-09-12T00:54:39.323452+0000","last_active":"2024-09-12T00:54:39.323452+0000","last_peered":"2024-09-12T00:54:39.323452+0000","last_clean":"2024-09-12T00:54:39.323452+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:54:39.323452+0000","last_undegraded":"2024-09-12T00:54:39.323452+0000","last_fullsized":"2024-09-12T00:54:39.323452+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.323253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.936694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.968184+0000","last_change":"2024-09-12T00:54:53.968184+0000","last_active":"2024-09-12T00:54:53.968184+0000","last_peered":"2024-09-12T00:54:53.968184+0000","last_clean":"2024-09-12T00:54:53.968184+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:54:53.968184+0000","last_undegraded":"2024-09-12T00:54:53.968184+0000","last_fullsized":"2024-09-12T00:54:53.968184+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.967996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:51.436997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'188","reported_seq":764,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.580854+0000","last_change":"2024-09-12T00:54:56.580854+0000","last_active":"2024-09-12T00:54:56.580854+0000","last_peered":"2024-09-12T00:54:56.580854+0000","last_clean":"2024-09-12T00:54:56.580854+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:54:56.580854+0000","last_undegraded":"2024-09-12T00:54:56.580854+0000","last_fullsized":"2024-09-12T00:54:56.580854+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T00:54:56.580514+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T00:54:56.580514+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.580514+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.929018+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'800","reported_seq":2675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.597567+0000","last_change":"2024-09-12T00:54:56.597567+0000","last_active":"2024-09-12T00:54:56.597567+0000","last_peered":"2024-09-12T00:54:56.597567+0000","last_clean":"2024-09-12T00:54:56.597567+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:56.597567+0000","last_undegraded":"2024-09-12T00:54:56.597567+0000","last_fullsized":"2024-09-12T00:54:56.597567+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'800","last_scrub_stamp":"2024-09-12T00:54:56.597386+0000","last_deep_scrub":"266'800","last_deep_scrub_stamp":"2024-09-12T00:54:56.597386+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.597386+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":701,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.113206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'115","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.635235+0000","last_change":"2024-09-12T00:55:02.635235+0000","last_active":"2024-09-12T00:55:02.635235+0000","last_peered":"2024-09-12T00:55:02.635235+0000","last_clean":"2024-09-12T00:55:02.635235+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:55:02.635235+0000","last_undegraded":"2024-09-12T00:55:02.635235+0000","last_fullsized":"2024-09-12T00:55:02.635235+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:02.635060+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:02.635060+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.635060+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:00.741162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'451","reported_seq":1864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.779886+0000","last_change":"2024-09-12T00:54:44.779886+0000","last_active":"2024-09-12T00:54:44.779886+0000","last_peered":"2024-09-12T00:54:44.779886+0000","last_clean":"2024-09-12T00:54:44.779886+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:54:44.779886+0000","last_undegraded":"2024-09-12T00:54:44.779886+0000","last_fullsized":"2024-09-12T00:54:44.779886+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.779697+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.485479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'250","reported_seq":920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.721106+0000","last_change":"2024-09-12T00:54:38.720957+0000","last_active":"2024-09-12T00:54:38.721106+0000","last_peered":"2024-09-12T00:54:38.721106+0000","last_clean":"2024-09-12T00:54:38.721106+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:54:38.721106+0000","last_undegraded":"2024-09-12T00:54:38.721106+0000","last_fullsized":"2024-09-12T00:54:38.721106+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'250","last_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_deep_scrub":"266'250","last_deep_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.720733+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.451856+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337134,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":14953,"num_write":1330,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.712764+0000","last_change":"2024-09-12T00:54:36.712634+0000","last_active":"2024-09-12T00:54:36.712764+0000","last_peered":"2024-09-12T00:54:36.712764+0000","last_clean":"2024-09-12T00:54:36.712764+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:54:36.712764+0000","last_undegraded":"2024-09-12T00:54:36.712764+0000","last_fullsized":"2024-09-12T00:54:36.712764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.712454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:05.577210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.294322+0000","last_change":"2024-09-12T00:55:01.294322+0000","last_active":"2024-09-12T00:55:01.294322+0000","last_peered":"2024-09-12T00:55:01.294322+0000","last_clean":"2024-09-12T00:55:01.294322+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:55:01.294322+0000","last_undegraded":"2024-09-12T00:55:01.294322+0000","last_fullsized":"2024-09-12T00:55:01.294322+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:01.294142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:01.294142+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.294142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:59.069922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'115","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.263231+0000","last_change":"2024-09-12T00:55:10.263231+0000","last_active":"2024-09-12T00:55:10.263231+0000","last_peered":"2024-09-12T00:55:10.263231+0000","last_clean":"2024-09-12T00:55:10.263231+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:55:10.263231+0000","last_undegraded":"2024-09-12T00:55:10.263231+0000","last_fullsized":"2024-09-12T00:55:10.263231+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:10.263055+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:10.263055+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.263055+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:20.196677+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'790","reported_seq":2352,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.453945+0000","last_change":"2024-09-12T00:55:03.453945+0000","last_active":"2024-09-12T00:55:03.453945+0000","last_peered":"2024-09-12T00:55:03.453945+0000","last_clean":"2024-09-12T00:55:03.453945+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:55:03.453945+0000","last_undegraded":"2024-09-12T00:55:03.453945+0000","last_fullsized":"2024-09-12T00:55:03.453945+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'790","last_scrub_stamp":"2024-09-12T00:55:03.453762+0000","last_deep_scrub":"266'790","last_deep_scrub_stamp":"2024-09-12T00:55:03.453762+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.453762+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":701,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:30.381039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'190","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.254611+0000","last_change":"2024-09-12T00:55:10.254611+0000","last_active":"2024-09-12T00:55:10.254611+0000","last_peered":"2024-09-12T00:55:10.254611+0000","last_clean":"2024-09-12T00:55:10.254611+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:55:10.254611+0000","last_undegraded":"2024-09-12T00:55:10.254611+0000","last_fullsized":"2024-09-12T00:55:10.254611+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T00:55:10.254291+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T00:55:10.254291+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.254291+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:19.599040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'483","reported_seq":2177,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.777384+0000","last_change":"2024-09-12T00:54:41.777384+0000","last_active":"2024-09-12T00:54:41.777384+0000","last_peered":"2024-09-12T00:54:41.777384+0000","last_clean":"2024-09-12T00:54:41.777384+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:41.777384+0000","last_undegraded":"2024-09-12T00:54:41.777384+0000","last_fullsized":"2024-09-12T00:54:41.777384+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.777199+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:25.825062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'218","reported_seq":879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.709035+0000","last_change":"2024-09-12T00:54:40.708851+0000","last_active":"2024-09-12T00:54:40.709035+0000","last_peered":"2024-09-12T00:54:40.709035+0000","last_clean":"2024-09-12T00:54:40.709035+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:54:40.709035+0000","last_undegraded":"2024-09-12T00:54:40.709035+0000","last_fullsized":"2024-09-12T00:54:40.709035+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.708626+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.336367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5989411,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":60723,"num_write":949,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.310540+0000","last_change":"2024-09-12T00:54:40.310420+0000","last_active":"2024-09-12T00:54:40.310540+0000","last_peered":"2024-09-12T00:54:40.310540+0000","last_clean":"2024-09-12T00:54:40.310540+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:54:40.310540+0000","last_undegraded":"2024-09-12T00:54:40.310540+0000","last_fullsized":"2024-09-12T00:54:40.310540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.310255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:59.694076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.797268+0000","last_change":"2024-09-12T00:54:53.797268+0000","last_active":"2024-09-12T00:54:53.797268+0000","last_peered":"2024-09-12T00:54:53.797268+0000","last_clean":"2024-09-12T00:54:53.797268+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:54:53.797268+0000","last_undegraded":"2024-09-12T00:54:53.797268+0000","last_fullsized":"2024-09-12T00:54:53.797268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.797085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:00.567896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'349","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.942474+0000","last_change":"2024-09-12T00:54:50.942474+0000","last_active":"2024-09-12T00:54:50.942474+0000","last_peered":"2024-09-12T00:54:50.942474+0000","last_clean":"2024-09-12T00:54:50.942474+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:50.942474+0000","last_undegraded":"2024-09-12T00:54:50.942474+0000","last_fullsized":"2024-09-12T00:54:50.942474+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.942260+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:21.958753+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32232,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":703,"num_write":258,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.650462+0000","last_change":"2024-09-12T00:55:07.650462+0000","last_active":"2024-09-12T00:55:07.650462+0000","last_peered":"2024-09-12T00:55:07.650462+0000","last_clean":"2024-09-12T00:55:07.650462+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:55:07.650462+0000","last_undegraded":"2024-09-12T00:55:07.650462+0000","last_fullsized":"2024-09-12T00:55:07.650462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.650237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.650237+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.650237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:51.752192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'94","reported_seq":593,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.591231+0000","last_change":"2024-09-12T00:55:01.591231+0000","last_active":"2024-09-12T00:55:01.591231+0000","last_peered":"2024-09-12T00:55:01.591231+0000","last_clean":"2024-09-12T00:55:01.591231+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:55:01.591231+0000","last_undegraded":"2024-09-12T00:55:01.591231+0000","last_fullsized":"2024-09-12T00:55:01.591231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'94","last_scrub_stamp":"2024-09-12T00:55:01.591042+0000","last_deep_scrub":"266'94","last_deep_scrub_stamp":"2024-09-12T00:55:01.591042+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.591042+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:48.103864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'152","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.753121+0000","last_change":"2024-09-12T00:55:12.753121+0000","last_active":"2024-09-12T00:55:12.753121+0000","last_peered":"2024-09-12T00:55:12.753121+0000","last_clean":"2024-09-12T00:55:12.753121+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:55:12.753121+0000","last_undegraded":"2024-09-12T00:55:12.753121+0000","last_fullsized":"2024-09-12T00:55:12.753121+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T00:55:12.752926+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T00:55:12.752926+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.752926+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.244855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'406","reported_seq":1803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.789222+0000","last_change":"2024-09-12T00:54:45.789222+0000","last_active":"2024-09-12T00:54:45.789222+0000","last_peered":"2024-09-12T00:54:45.789222+0000","last_clean":"2024-09-12T00:54:45.789222+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:54:45.789222+0000","last_undegraded":"2024-09-12T00:54:45.789222+0000","last_fullsized":"2024-09-12T00:54:45.789222+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.789043+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.351155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'186","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.238029+0000","last_change":"2024-09-12T00:54:45.238029+0000","last_active":"2024-09-12T00:54:45.238029+0000","last_peered":"2024-09-12T00:54:45.238029+0000","last_clean":"2024-09-12T00:54:45.238029+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:54:45.238029+0000","last_undegraded":"2024-09-12T00:54:45.238029+0000","last_fullsized":"2024-09-12T00:54:45.238029+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.237784+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.782035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33239,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":101459,"num_write":845,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.524132+0000","last_change":"2024-09-12T00:54:54.524132+0000","last_active":"2024-09-12T00:54:54.524132+0000","last_peered":"2024-09-12T00:54:54.524132+0000","last_clean":"2024-09-12T00:54:54.524132+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:54:54.524132+0000","last_undegraded":"2024-09-12T00:54:54.524132+0000","last_fullsized":"2024-09-12T00:54:54.524132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.523944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.210297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'148","reported_seq":735,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.599336+0000","last_change":"2024-09-12T00:54:59.599336+0000","last_active":"2024-09-12T00:54:59.599336+0000","last_peered":"2024-09-12T00:54:59.599336+0000","last_clean":"2024-09-12T00:54:59.599336+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:54:59.599336+0000","last_undegraded":"2024-09-12T00:54:59.599336+0000","last_fullsized":"2024-09-12T00:54:59.599336+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T00:54:59.599075+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T00:54:59.599075+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.599075+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.491961+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13149,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":189,"num_read_kb":268,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.622430+0000","last_change":"2024-09-12T00:54:57.622430+0000","last_active":"2024-09-12T00:54:57.622430+0000","last_peered":"2024-09-12T00:54:57.622430+0000","last_clean":"2024-09-12T00:54:57.622430+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:54:57.622430+0000","last_undegraded":"2024-09-12T00:54:57.622430+0000","last_fullsized":"2024-09-12T00:54:57.622430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.622225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.622225+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.622225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:41.794751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.610490+0000","last_change":"2024-09-12T00:55:03.610490+0000","last_active":"2024-09-12T00:55:03.610490+0000","last_peered":"2024-09-12T00:55:03.610490+0000","last_clean":"2024-09-12T00:55:03.610490+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:55:03.610490+0000","last_undegraded":"2024-09-12T00:55:03.610490+0000","last_fullsized":"2024-09-12T00:55:03.610490+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T00:55:03.610311+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T00:55:03.610311+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.610311+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:45.463442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'349","reported_seq":1872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.754171+0000","last_change":"2024-09-12T00:54:46.754171+0000","last_active":"2024-09-12T00:54:46.754171+0000","last_peered":"2024-09-12T00:54:46.754171+0000","last_clean":"2024-09-12T00:54:46.754171+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:54:46.754171+0000","last_undegraded":"2024-09-12T00:54:46.754171+0000","last_fullsized":"2024-09-12T00:54:46.754171+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.753992+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.515601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'340","reported_seq":1021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.976417+0000","last_change":"2024-09-12T00:54:37.976334+0000","last_active":"2024-09-12T00:54:37.976417+0000","last_peered":"2024-09-12T00:54:37.976417+0000","last_clean":"2024-09-12T00:54:37.976417+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:54:37.976417+0000","last_undegraded":"2024-09-12T00:54:37.976417+0000","last_fullsized":"2024-09-12T00:54:37.976417+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'340","last_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_deep_scrub":"266'340","last_deep_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.976207+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.328642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":797,"num_read_kb":9288,"num_write":1291,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.735034+0000","last_change":"2024-09-12T00:54:55.735034+0000","last_active":"2024-09-12T00:54:55.735034+0000","last_peered":"2024-09-12T00:54:55.735034+0000","last_clean":"2024-09-12T00:54:55.735034+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:54:55.735034+0000","last_undegraded":"2024-09-12T00:54:55.735034+0000","last_fullsized":"2024-09-12T00:54:55.735034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.734861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:10.701469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'57","reported_seq":569,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.743197+0000","last_change":"2024-09-12T00:55:02.743197+0000","last_active":"2024-09-12T00:55:02.743197+0000","last_peered":"2024-09-12T00:55:02.743197+0000","last_clean":"2024-09-12T00:55:02.743197+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:55:02.743197+0000","last_undegraded":"2024-09-12T00:55:02.743197+0000","last_fullsized":"2024-09-12T00:55:02.743197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'57","last_scrub_stamp":"2024-09-12T00:55:02.743015+0000","last_deep_scrub":"266'57","last_deep_scrub_stamp":"2024-09-12T00:55:02.743015+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.743015+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:46.675016+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.701161+0000","last_change":"2024-09-12T00:54:57.701161+0000","last_active":"2024-09-12T00:54:57.701161+0000","last_peered":"2024-09-12T00:54:57.701161+0000","last_clean":"2024-09-12T00:54:57.701161+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:54:57.701161+0000","last_undegraded":"2024-09-12T00:54:57.701161+0000","last_fullsized":"2024-09-12T00:54:57.701161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.700977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.700977+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.700977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:41.098461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'196","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.724177+0000","last_change":"2024-09-12T00:55:06.724177+0000","last_active":"2024-09-12T00:55:06.724177+0000","last_peered":"2024-09-12T00:55:06.724177+0000","last_clean":"2024-09-12T00:55:06.724177+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:55:06.724177+0000","last_undegraded":"2024-09-12T00:55:06.724177+0000","last_fullsized":"2024-09-12T00:55:06.724177+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T00:55:06.723928+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T00:55:06.723928+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.723928+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.442636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'774","reported_seq":2195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.737013+0000","last_change":"2024-09-12T00:54:45.737013+0000","last_active":"2024-09-12T00:54:45.737013+0000","last_peered":"2024-09-12T00:54:45.737013+0000","last_clean":"2024-09-12T00:54:45.737013+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:54:45.737013+0000","last_undegraded":"2024-09-12T00:54:45.737013+0000","last_fullsized":"2024-09-12T00:54:45.737013+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.736834+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.215351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'193","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.705741+0000","last_change":"2024-09-12T00:54:36.705674+0000","last_active":"2024-09-12T00:54:36.705741+0000","last_peered":"2024-09-12T00:54:36.705741+0000","last_clean":"2024-09-12T00:54:36.705741+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:36.705741+0000","last_undegraded":"2024-09-12T00:54:36.705741+0000","last_fullsized":"2024-09-12T00:54:36.705741+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.705560+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:37.794357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":25665,"num_write":923,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.705205+0000","last_change":"2024-09-12T00:54:49.705205+0000","last_active":"2024-09-12T00:54:49.705205+0000","last_peered":"2024-09-12T00:54:49.705205+0000","last_clean":"2024-09-12T00:54:49.705205+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:54:49.705205+0000","last_undegraded":"2024-09-12T00:54:49.705205+0000","last_fullsized":"2024-09-12T00:54:49.705205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.704924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:10.256859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'181","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.589082+0000","last_change":"2024-09-12T00:54:56.589082+0000","last_active":"2024-09-12T00:54:56.589082+0000","last_peered":"2024-09-12T00:54:56.589082+0000","last_clean":"2024-09-12T00:54:56.589082+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:54:56.589082+0000","last_undegraded":"2024-09-12T00:54:56.589082+0000","last_fullsized":"2024-09-12T00:54:56.589082+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'181","last_scrub_stamp":"2024-09-12T00:54:56.588880+0000","last_deep_scrub":"266'181","last_deep_scrub_stamp":"2024-09-12T00:54:56.588880+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.588880+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:45.522846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":233,"num_read_kb":302,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.661285+0000","last_change":"2024-09-12T00:54:59.661285+0000","last_active":"2024-09-12T00:54:59.661285+0000","last_peered":"2024-09-12T00:54:59.661285+0000","last_clean":"2024-09-12T00:54:59.661285+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:54:59.661285+0000","last_undegraded":"2024-09-12T00:54:59.661285+0000","last_fullsized":"2024-09-12T00:54:59.661285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.661085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.661085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.661085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.480747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'104","reported_seq":610,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:29.550126+0000","last_change":"2024-09-12T00:11:55.959282+0000","last_active":"2024-09-12T00:52:29.550126+0000","last_peered":"2024-09-12T00:52:29.550126+0000","last_clean":"2024-09-12T00:52:29.550126+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:52:29.550126+0000","last_undegraded":"2024-09-12T00:52:29.550126+0000","last_fullsized":"2024-09-12T00:52:29.550126+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:11:03.301311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'809","reported_seq":2303,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.643771+0000","last_change":"2024-09-12T00:54:44.643771+0000","last_active":"2024-09-12T00:54:44.643771+0000","last_peered":"2024-09-12T00:54:44.643771+0000","last_clean":"2024-09-12T00:54:44.643771+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:54:44.643771+0000","last_undegraded":"2024-09-12T00:54:44.643771+0000","last_fullsized":"2024-09-12T00:54:44.643771+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'809","last_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_deep_scrub":"266'809","last_deep_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.643588+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.445327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'197","reported_seq":842,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.551664+0000","last_change":"2024-09-12T00:54:39.551664+0000","last_active":"2024-09-12T00:54:39.551664+0000","last_peered":"2024-09-12T00:54:39.551664+0000","last_clean":"2024-09-12T00:54:39.551664+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:54:39.551664+0000","last_undegraded":"2024-09-12T00:54:39.551664+0000","last_fullsized":"2024-09-12T00:54:39.551664+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'197","last_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_deep_scrub":"266'197","last_deep_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.551438+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.232360+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":36400,"num_write":906,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.287499+0000","last_change":"2024-09-12T00:55:04.287499+0000","last_active":"2024-09-12T00:55:04.287499+0000","last_peered":"2024-09-12T00:55:04.287499+0000","last_clean":"2024-09-12T00:55:04.287499+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:55:04.287499+0000","last_undegraded":"2024-09-12T00:55:04.287499+0000","last_fullsized":"2024-09-12T00:55:04.287499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:04.287222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:04.287222+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.287222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.892615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'134","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.006533+0000","last_change":"2024-09-12T00:54:55.006533+0000","last_active":"2024-09-12T00:54:55.006533+0000","last_peered":"2024-09-12T00:54:55.006533+0000","last_clean":"2024-09-12T00:54:55.006533+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:54:55.006533+0000","last_undegraded":"2024-09-12T00:54:55.006533+0000","last_fullsized":"2024-09-12T00:54:55.006533+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.006347+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:12.305618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6499,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":240,"num_write":94,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.593010+0000","last_change":"2024-09-12T00:54:59.593010+0000","last_active":"2024-09-12T00:54:59.593010+0000","last_peered":"2024-09-12T00:54:59.593010+0000","last_clean":"2024-09-12T00:54:59.593010+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:54:59.593010+0000","last_undegraded":"2024-09-12T00:54:59.593010+0000","last_fullsized":"2024-09-12T00:54:59.593010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.592584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.592584+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.592584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:37.408039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'725","reported_seq":2114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.172604+0000","last_change":"2024-09-12T00:54:56.172604+0000","last_active":"2024-09-12T00:54:56.172604+0000","last_peered":"2024-09-12T00:54:56.172604+0000","last_clean":"2024-09-12T00:54:56.172604+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:54:56.172604+0000","last_undegraded":"2024-09-12T00:54:56.172604+0000","last_fullsized":"2024-09-12T00:54:56.172604+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'725","last_scrub_stamp":"2024-09-12T00:54:56.172411+0000","last_deep_scrub":"266'725","last_deep_scrub_stamp":"2024-09-12T00:54:56.172411+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.172411+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:04.190295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'194","reported_seq":820,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.582437+0000","last_change":"2024-09-12T00:54:40.582437+0000","last_active":"2024-09-12T00:54:40.582437+0000","last_peered":"2024-09-12T00:54:40.582437+0000","last_clean":"2024-09-12T00:54:40.582437+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:54:40.582437+0000","last_undegraded":"2024-09-12T00:54:40.582437+0000","last_fullsized":"2024-09-12T00:54:40.582437+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.582154+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.450282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755647,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":8092,"num_write":868,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.539786+0000","last_change":"2024-09-12T00:54:55.539786+0000","last_active":"2024-09-12T00:54:55.539786+0000","last_peered":"2024-09-12T00:54:55.539786+0000","last_clean":"2024-09-12T00:54:55.539786+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:54:55.539786+0000","last_undegraded":"2024-09-12T00:54:55.539786+0000","last_fullsized":"2024-09-12T00:54:55.539786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.539573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:02.177277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'205","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.614176+0000","last_change":"2024-09-12T00:55:01.614176+0000","last_active":"2024-09-12T00:55:01.614176+0000","last_peered":"2024-09-12T00:55:01.614176+0000","last_clean":"2024-09-12T00:55:01.614176+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:55:01.614176+0000","last_undegraded":"2024-09-12T00:55:01.614176+0000","last_fullsized":"2024-09-12T00:55:01.614176+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:55:01.613970+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:55:01.613970+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.613970+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:11.791579+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19799,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":407,"num_write":194,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.659749+0000","last_change":"2024-09-12T00:54:58.659749+0000","last_active":"2024-09-12T00:54:58.659749+0000","last_peered":"2024-09-12T00:54:58.659749+0000","last_clean":"2024-09-12T00:54:58.659749+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:54:58.659749+0000","last_undegraded":"2024-09-12T00:54:58.659749+0000","last_fullsized":"2024-09-12T00:54:58.659749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:58.659661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:58.659661+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.659661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.061740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'156","reported_seq":663,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.308323+0000","last_change":"2024-09-12T00:55:13.308323+0000","last_active":"2024-09-12T00:55:13.308323+0000","last_peered":"2024-09-12T00:55:13.308323+0000","last_clean":"2024-09-12T00:55:13.308323+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:55:13.308323+0000","last_undegraded":"2024-09-12T00:55:13.308323+0000","last_fullsized":"2024-09-12T00:55:13.308323+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T00:55:13.308134+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T00:55:13.308134+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.308134+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:49.799531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'503","reported_seq":2231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.793156+0000","last_change":"2024-09-12T00:54:49.793156+0000","last_active":"2024-09-12T00:54:49.793156+0000","last_peered":"2024-09-12T00:54:49.793156+0000","last_clean":"2024-09-12T00:54:49.793156+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:54:49.793156+0000","last_undegraded":"2024-09-12T00:54:49.793156+0000","last_fullsized":"2024-09-12T00:54:49.793156+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'503","last_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_deep_scrub":"266'503","last_deep_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.792973+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.396328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3754,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'205","reported_seq":880,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.723164+0000","last_change":"2024-09-12T00:54:37.723164+0000","last_active":"2024-09-12T00:54:37.723164+0000","last_peered":"2024-09-12T00:54:37.723164+0000","last_clean":"2024-09-12T00:54:37.723164+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:54:37.723164+0000","last_undegraded":"2024-09-12T00:54:37.723164+0000","last_fullsized":"2024-09-12T00:54:37.723164+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.722978+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.296272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":547,"num_read_kb":23120,"num_write":969,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.723086+0000","last_change":"2024-09-12T00:54:53.723086+0000","last_active":"2024-09-12T00:54:53.723086+0000","last_peered":"2024-09-12T00:54:53.723086+0000","last_clean":"2024-09-12T00:54:53.723086+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:54:53.723086+0000","last_undegraded":"2024-09-12T00:54:53.723086+0000","last_fullsized":"2024-09-12T00:54:53.723086+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.722892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.871247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'173","reported_seq":762,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.218477+0000","last_change":"2024-09-12T00:55:09.218477+0000","last_active":"2024-09-12T00:55:09.218477+0000","last_peered":"2024-09-12T00:55:09.218477+0000","last_clean":"2024-09-12T00:55:09.218477+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:55:09.218477+0000","last_undegraded":"2024-09-12T00:55:09.218477+0000","last_fullsized":"2024-09-12T00:55:09.218477+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'173","last_scrub_stamp":"2024-09-12T00:55:09.218279+0000","last_deep_scrub":"266'173","last_deep_scrub_stamp":"2024-09-12T00:55:09.218279+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.218279+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.404309+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7301,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":226,"num_read_kb":291,"num_write":146,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.330367+0000","last_change":"2024-09-12T00:55:07.330367+0000","last_active":"2024-09-12T00:55:07.330367+0000","last_peered":"2024-09-12T00:55:07.330367+0000","last_clean":"2024-09-12T00:55:07.330367+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:55:07.330367+0000","last_undegraded":"2024-09-12T00:55:07.330367+0000","last_fullsized":"2024-09-12T00:55:07.330367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.330163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.330163+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.330163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.603458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'192","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:17.122045+0000","last_change":"2024-09-12T00:11:55.970975+0000","last_active":"2024-09-12T00:54:17.122045+0000","last_peered":"2024-09-12T00:54:17.122045+0000","last_clean":"2024-09-12T00:54:17.122045+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:54:17.122045+0000","last_undegraded":"2024-09-12T00:54:17.122045+0000","last_fullsized":"2024-09-12T00:54:17.122045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:19.872508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'811","reported_seq":2321,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.633649+0000","last_change":"2024-09-12T00:54:45.633649+0000","last_active":"2024-09-12T00:54:45.633649+0000","last_peered":"2024-09-12T00:54:45.633649+0000","last_clean":"2024-09-12T00:54:45.633649+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:54:45.633649+0000","last_undegraded":"2024-09-12T00:54:45.633649+0000","last_fullsized":"2024-09-12T00:54:45.633649+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'811","last_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_deep_scrub":"266'811","last_deep_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.633450+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:59.575094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'210","reported_seq":822,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.236261+0000","last_change":"2024-09-12T00:54:38.236261+0000","last_active":"2024-09-12T00:54:38.236261+0000","last_peered":"2024-09-12T00:54:38.236261+0000","last_clean":"2024-09-12T00:54:38.236261+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:38.236261+0000","last_undegraded":"2024-09-12T00:54:38.236261+0000","last_fullsized":"2024-09-12T00:54:38.236261+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.236030+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:45.112722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":380,"num_read_kb":5549,"num_write":1015,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.754225+0000","last_change":"2024-09-12T00:54:51.754225+0000","last_active":"2024-09-12T00:54:51.754225+0000","last_peered":"2024-09-12T00:54:51.754225+0000","last_clean":"2024-09-12T00:54:51.754225+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:54:51.754225+0000","last_undegraded":"2024-09-12T00:54:51.754225+0000","last_fullsized":"2024-09-12T00:54:51.754225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.753927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:23.486364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'155","reported_seq":744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.612740+0000","last_change":"2024-09-12T00:55:00.612740+0000","last_active":"2024-09-12T00:55:00.612740+0000","last_peered":"2024-09-12T00:55:00.612740+0000","last_clean":"2024-09-12T00:55:00.612740+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:55:00.612740+0000","last_undegraded":"2024-09-12T00:55:00.612740+0000","last_fullsized":"2024-09-12T00:55:00.612740+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'155","last_scrub_stamp":"2024-09-12T00:55:00.612507+0000","last_deep_scrub":"266'155","last_deep_scrub_stamp":"2024-09-12T00:55:00.612507+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.612507+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.877171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":186,"num_read_kb":226,"num_write":104,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.598646+0000","last_change":"2024-09-12T00:54:58.598646+0000","last_active":"2024-09-12T00:54:58.598646+0000","last_peered":"2024-09-12T00:54:58.598646+0000","last_clean":"2024-09-12T00:54:58.598646+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:54:58.598646+0000","last_undegraded":"2024-09-12T00:54:58.598646+0000","last_fullsized":"2024-09-12T00:54:58.598646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:58.598472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:58.598472+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.598472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:24.699387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'153","reported_seq":642,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:18.341421+0000","last_change":"2024-09-12T00:11:55.984385+0000","last_active":"2024-09-12T00:54:18.341421+0000","last_peered":"2024-09-12T00:54:18.341421+0000","last_clean":"2024-09-12T00:54:18.341421+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:54:18.341421+0000","last_undegraded":"2024-09-12T00:54:18.341421+0000","last_fullsized":"2024-09-12T00:54:18.341421+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:18.613083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'791","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.743302+0000","last_change":"2024-09-12T00:54:47.743302+0000","last_active":"2024-09-12T00:54:47.743302+0000","last_peered":"2024-09-12T00:54:47.743302+0000","last_clean":"2024-09-12T00:54:47.743302+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:54:47.743302+0000","last_undegraded":"2024-09-12T00:54:47.743302+0000","last_fullsized":"2024-09-12T00:54:47.743302+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.743080+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.272707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'210","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.734334+0000","last_change":"2024-09-12T00:54:41.734334+0000","last_active":"2024-09-12T00:54:41.734334+0000","last_peered":"2024-09-12T00:54:41.734334+0000","last_clean":"2024-09-12T00:54:41.734334+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:54:41.734334+0000","last_undegraded":"2024-09-12T00:54:41.734334+0000","last_fullsized":"2024-09-12T00:54:41.734334+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.734103+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.931010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1993302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":30758,"num_write":1020,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.755305+0000","last_change":"2024-09-12T00:54:59.755305+0000","last_active":"2024-09-12T00:54:59.755305+0000","last_peered":"2024-09-12T00:54:59.755305+0000","last_clean":"2024-09-12T00:54:59.755305+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:54:59.755305+0000","last_undegraded":"2024-09-12T00:54:59.755305+0000","last_fullsized":"2024-09-12T00:54:59.755305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.755091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.755091+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.755091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:30.296128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'103","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.263209+0000","last_change":"2024-09-12T00:55:11.263209+0000","last_active":"2024-09-12T00:55:11.263209+0000","last_peered":"2024-09-12T00:55:11.263209+0000","last_clean":"2024-09-12T00:55:11.263209+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:55:11.263209+0000","last_undegraded":"2024-09-12T00:55:11.263209+0000","last_fullsized":"2024-09-12T00:55:11.263209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'103","last_scrub_stamp":"2024-09-12T00:55:11.262951+0000","last_deep_scrub":"266'103","last_deep_scrub_stamp":"2024-09-12T00:55:11.262951+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.262951+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:45.225247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'756","reported_seq":2397,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.048059+0000","last_change":"2024-09-12T00:54:59.048059+0000","last_active":"2024-09-12T00:54:59.048059+0000","last_peered":"2024-09-12T00:54:59.048059+0000","last_clean":"2024-09-12T00:54:59.048059+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:59.048059+0000","last_undegraded":"2024-09-12T00:54:59.048059+0000","last_fullsized":"2024-09-12T00:54:59.048059+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'756","last_scrub_stamp":"2024-09-12T00:54:59.047863+0000","last_deep_scrub":"266'756","last_deep_scrub_stamp":"2024-09-12T00:54:59.047863+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.047863+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:11.693776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":640,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:14.361616+0000","last_change":"2024-09-12T00:11:55.961931+0000","last_active":"2024-09-12T00:53:14.361616+0000","last_peered":"2024-09-12T00:53:14.361616+0000","last_clean":"2024-09-12T00:53:14.361616+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:53:14.361616+0000","last_undegraded":"2024-09-12T00:53:14.361616+0000","last_fullsized":"2024-09-12T00:53:14.361616+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:02:45.615113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'465","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.746619+0000","last_change":"2024-09-12T00:54:46.746619+0000","last_active":"2024-09-12T00:54:46.746619+0000","last_peered":"2024-09-12T00:54:46.746619+0000","last_clean":"2024-09-12T00:54:46.746619+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:54:46.746619+0000","last_undegraded":"2024-09-12T00:54:46.746619+0000","last_fullsized":"2024-09-12T00:54:46.746619+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'465","last_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_deep_scrub":"266'465","last_deep_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.746430+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:31.460666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'218","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.261923+0000","last_change":"2024-09-12T00:54:39.261923+0000","last_active":"2024-09-12T00:54:39.261923+0000","last_peered":"2024-09-12T00:54:39.261923+0000","last_clean":"2024-09-12T00:54:39.261923+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:39.261923+0000","last_undegraded":"2024-09-12T00:54:39.261923+0000","last_fullsized":"2024-09-12T00:54:39.261923+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.261665+0000","objects_scrubbed":10,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:35.988750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457849,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":55718,"num_write":1000,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.492143+0000","last_change":"2024-09-12T00:54:53.492143+0000","last_active":"2024-09-12T00:54:53.492143+0000","last_peered":"2024-09-12T00:54:53.492143+0000","last_clean":"2024-09-12T00:54:53.492143+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:54:53.492143+0000","last_undegraded":"2024-09-12T00:54:53.492143+0000","last_fullsized":"2024-09-12T00:54:53.492143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.491956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:33.502230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'199","reported_seq":807,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.067933+0000","last_change":"2024-09-12T00:54:58.067933+0000","last_active":"2024-09-12T00:54:58.067933+0000","last_peered":"2024-09-12T00:54:58.067933+0000","last_clean":"2024-09-12T00:54:58.067933+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:54:58.067933+0000","last_undegraded":"2024-09-12T00:54:58.067933+0000","last_fullsized":"2024-09-12T00:54:58.067933+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T00:54:58.067708+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T00:54:58.067708+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.067708+0000","objects_scrubbed":11,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.132974+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":245,"num_read_kb":305,"num_write":140,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.650138+0000","last_change":"2024-09-12T00:55:09.650138+0000","last_active":"2024-09-12T00:55:09.650138+0000","last_peered":"2024-09-12T00:55:09.650138+0000","last_clean":"2024-09-12T00:55:09.650138+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:55:09.650138+0000","last_undegraded":"2024-09-12T00:55:09.650138+0000","last_fullsized":"2024-09-12T00:55:09.650138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.649922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.649922+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.649922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:45.268590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'127","reported_seq":634,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.659536+0000","last_change":"2024-09-12T00:55:04.659536+0000","last_active":"2024-09-12T00:55:04.659536+0000","last_peered":"2024-09-12T00:55:04.659536+0000","last_clean":"2024-09-12T00:55:04.659536+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:55:04.659536+0000","last_undegraded":"2024-09-12T00:55:04.659536+0000","last_fullsized":"2024-09-12T00:55:04.659536+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'127","last_scrub_stamp":"2024-09-12T00:55:04.659361+0000","last_deep_scrub":"266'127","last_deep_scrub_stamp":"2024-09-12T00:55:04.659361+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.659361+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:16.848398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'929","reported_seq":2641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.729243+0000","last_change":"2024-09-12T00:54:50.729243+0000","last_active":"2024-09-12T00:54:50.729243+0000","last_peered":"2024-09-12T00:54:50.729243+0000","last_clean":"2024-09-12T00:54:50.729243+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:54:50.729243+0000","last_undegraded":"2024-09-12T00:54:50.729243+0000","last_fullsized":"2024-09-12T00:54:50.729243+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.729071+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:45.264752+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":930,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'221","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.188603+0000","last_change":"2024-09-12T00:54:47.188603+0000","last_active":"2024-09-12T00:54:47.188603+0000","last_peered":"2024-09-12T00:54:47.188603+0000","last_clean":"2024-09-12T00:54:47.188603+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:54:47.188603+0000","last_undegraded":"2024-09-12T00:54:47.188603+0000","last_fullsized":"2024-09-12T00:54:47.188603+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.188407+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:18.153988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":417,"num_read_kb":8883,"num_write":990,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.762197+0000","last_change":"2024-09-12T00:54:52.762197+0000","last_active":"2024-09-12T00:54:52.762197+0000","last_peered":"2024-09-12T00:54:52.762197+0000","last_clean":"2024-09-12T00:54:52.762197+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:54:52.762197+0000","last_undegraded":"2024-09-12T00:54:52.762197+0000","last_fullsized":"2024-09-12T00:54:52.762197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.761997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:26.003820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'137","reported_seq":719,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.623154+0000","last_change":"2024-09-12T00:55:05.623154+0000","last_active":"2024-09-12T00:55:05.623154+0000","last_peered":"2024-09-12T00:55:05.623154+0000","last_clean":"2024-09-12T00:55:05.623154+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:55:05.623154+0000","last_undegraded":"2024-09-12T00:55:05.623154+0000","last_fullsized":"2024-09-12T00:55:05.623154+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'137","last_scrub_stamp":"2024-09-12T00:55:05.622864+0000","last_deep_scrub":"266'137","last_deep_scrub_stamp":"2024-09-12T00:55:05.622864+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.622864+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:28.404950+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":258,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:50:45.934303+0000","last_change":"2024-09-12T00:11:53.964372+0000","last_active":"2024-09-12T00:50:45.934303+0000","last_peered":"2024-09-12T00:50:45.934303+0000","last_clean":"2024-09-12T00:50:45.934303+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:50:45.934303+0000","last_undegraded":"2024-09-12T00:50:45.934303+0000","last_fullsized":"2024-09-12T00:50:45.934303+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:46.181767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'122","reported_seq":641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:00.250013+0000","last_change":"2024-09-12T00:11:55.983399+0000","last_active":"2024-09-12T00:53:00.250013+0000","last_peered":"2024-09-12T00:53:00.250013+0000","last_clean":"2024-09-12T00:53:00.250013+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:53:00.250013+0000","last_undegraded":"2024-09-12T00:53:00.250013+0000","last_fullsized":"2024-09-12T00:53:00.250013+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":100,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:06.340677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'511","reported_seq":2139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.644781+0000","last_change":"2024-09-12T00:54:42.644781+0000","last_active":"2024-09-12T00:54:42.644781+0000","last_peered":"2024-09-12T00:54:42.644781+0000","last_clean":"2024-09-12T00:54:42.644781+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:54:42.644781+0000","last_undegraded":"2024-09-12T00:54:42.644781+0000","last_fullsized":"2024-09-12T00:54:42.644781+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.644589+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":400,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:44.947353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'213","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.537375+0000","last_change":"2024-09-12T00:54:41.537375+0000","last_active":"2024-09-12T00:54:41.537375+0000","last_peered":"2024-09-12T00:54:41.537375+0000","last_clean":"2024-09-12T00:54:41.537375+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:54:41.537375+0000","last_undegraded":"2024-09-12T00:54:41.537375+0000","last_fullsized":"2024-09-12T00:54:41.537375+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.537037+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:47.685748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":6403,"num_write":967,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.497088+0000","last_change":"2024-09-12T00:54:51.497088+0000","last_active":"2024-09-12T00:54:51.497088+0000","last_peered":"2024-09-12T00:54:51.497088+0000","last_clean":"2024-09-12T00:54:51.497088+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:54:51.497088+0000","last_undegraded":"2024-09-12T00:54:51.497088+0000","last_fullsized":"2024-09-12T00:54:51.497088+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.496915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.499895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'104","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.550906+0000","last_change":"2024-09-12T00:54:58.550906+0000","last_active":"2024-09-12T00:54:58.550906+0000","last_peered":"2024-09-12T00:54:58.550906+0000","last_clean":"2024-09-12T00:54:58.550906+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:58.550906+0000","last_undegraded":"2024-09-12T00:54:58.550906+0000","last_fullsized":"2024-09-12T00:54:58.550906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'104","last_scrub_stamp":"2024-09-12T00:54:58.550730+0000","last_deep_scrub":"266'104","last_deep_scrub_stamp":"2024-09-12T00:54:58.550730+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.550730+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:46.144209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":203,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":487,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:55.951806+0000","last_change":"2024-09-12T00:11:53.953440+0000","last_active":"2024-09-12T00:51:55.951806+0000","last_peered":"2024-09-12T00:51:55.951806+0000","last_clean":"2024-09-12T00:51:55.951806+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:51:55.951806+0000","last_undegraded":"2024-09-12T00:51:55.951806+0000","last_fullsized":"2024-09-12T00:51:55.951806+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:52.907172+0000","last_clean_scrub_stamp":"2024-09-12T00:11:52.907172+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:27.100590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'166","reported_seq":1291,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:53:12.040679+0000","last_change":"2024-09-12T00:11:55.977584+0000","last_active":"2024-09-12T00:53:12.040679+0000","last_peered":"2024-09-12T00:53:12.040679+0000","last_clean":"2024-09-12T00:53:12.040679+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:53:12.040679+0000","last_undegraded":"2024-09-12T00:53:12.040679+0000","last_fullsized":"2024-09-12T00:53:12.040679+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:11:54.913701+0000","last_clean_scrub_stamp":"2024-09-12T00:11:54.913701+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":100,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:20:56.244680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'393","reported_seq":1794,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.733121+0000","last_change":"2024-09-12T00:54:47.733121+0000","last_active":"2024-09-12T00:54:47.733121+0000","last_peered":"2024-09-12T00:54:47.733121+0000","last_clean":"2024-09-12T00:54:47.733121+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:54:47.733121+0000","last_undegraded":"2024-09-12T00:54:47.733121+0000","last_fullsized":"2024-09-12T00:54:47.733121+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.732939+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.184825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'225","reported_seq":862,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.578362+0000","last_change":"2024-09-12T00:54:44.578362+0000","last_active":"2024-09-12T00:54:44.578362+0000","last_peered":"2024-09-12T00:54:44.578362+0000","last_clean":"2024-09-12T00:54:44.578362+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:54:44.578362+0000","last_undegraded":"2024-09-12T00:54:44.578362+0000","last_fullsized":"2024-09-12T00:54:44.578362+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'225","last_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_deep_scrub":"266'225","last_deep_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.577941+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:23.931116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":20983,"num_write":1046,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.760497+0000","last_change":"2024-09-12T00:54:58.760497+0000","last_active":"2024-09-12T00:54:58.760497+0000","last_peered":"2024-09-12T00:54:58.760497+0000","last_clean":"2024-09-12T00:54:58.760497+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:54:58.760497+0000","last_undegraded":"2024-09-12T00:54:58.760497+0000","last_fullsized":"2024-09-12T00:54:58.760497+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:58.760309+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:58.760309+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.760309+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:46.076140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'183","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.285066+0000","last_change":"2024-09-12T00:55:12.285066+0000","last_active":"2024-09-12T00:55:12.285066+0000","last_peered":"2024-09-12T00:55:12.285066+0000","last_clean":"2024-09-12T00:55:12.285066+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:55:12.285066+0000","last_undegraded":"2024-09-12T00:55:12.285066+0000","last_fullsized":"2024-09-12T00:55:12.285066+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T00:55:12.284872+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T00:55:12.284872+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.284872+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:35.221329+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9188,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":326,"num_write":136,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.672605+0000","last_change":"2024-09-12T00:55:10.672605+0000","last_active":"2024-09-12T00:55:10.672605+0000","last_peered":"2024-09-12T00:55:10.672605+0000","last_clean":"2024-09-12T00:55:10.672605+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:55:10.672605+0000","last_undegraded":"2024-09-12T00:55:10.672605+0000","last_fullsized":"2024-09-12T00:55:10.672605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:10.672416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:10.672416+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.672416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.038683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'124","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.100910+0000","last_change":"2024-09-12T00:55:01.100910+0000","last_active":"2024-09-12T00:55:01.100910+0000","last_peered":"2024-09-12T00:55:01.100910+0000","last_clean":"2024-09-12T00:55:01.100910+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:55:01.100910+0000","last_undegraded":"2024-09-12T00:55:01.100910+0000","last_fullsized":"2024-09-12T00:55:01.100910+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'124","last_scrub_stamp":"2024-09-12T00:55:01.100722+0000","last_deep_scrub":"266'124","last_deep_scrub_stamp":"2024-09-12T00:55:01.100722+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.100722+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:17.235489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'499","reported_seq":2033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.741827+0000","last_change":"2024-09-12T00:54:48.741666+0000","last_active":"2024-09-12T00:54:48.741827+0000","last_peered":"2024-09-12T00:54:48.741827+0000","last_clean":"2024-09-12T00:54:48.741827+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:54:48.741827+0000","last_undegraded":"2024-09-12T00:54:48.741827+0000","last_fullsized":"2024-09-12T00:54:48.741827+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.741497+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:24.293528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'193","reported_seq":853,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.747873+0000","last_change":"2024-09-12T00:54:40.747873+0000","last_active":"2024-09-12T00:54:40.747873+0000","last_peered":"2024-09-12T00:54:40.747873+0000","last_clean":"2024-09-12T00:54:40.747873+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:54:40.747873+0000","last_undegraded":"2024-09-12T00:54:40.747873+0000","last_fullsized":"2024-09-12T00:54:40.747873+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.747645+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:07.125444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069312,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":61937,"num_write":920,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'819","reported_seq":2328,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.636401+0000","last_change":"2024-09-12T00:54:46.636159+0000","last_active":"2024-09-12T00:54:46.636401+0000","last_peered":"2024-09-12T00:54:46.636401+0000","last_clean":"2024-09-12T00:54:46.636401+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:54:46.636401+0000","last_undegraded":"2024-09-12T00:54:46.636401+0000","last_fullsized":"2024-09-12T00:54:46.636401+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'819","last_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_deep_scrub":"266'819","last_deep_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.635949+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:39.192196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1184,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'189","reported_seq":831,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.614805+0000","last_change":"2024-09-12T00:54:40.614805+0000","last_active":"2024-09-12T00:54:40.614805+0000","last_peered":"2024-09-12T00:54:40.614805+0000","last_clean":"2024-09-12T00:54:40.614805+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:54:40.614805+0000","last_undegraded":"2024-09-12T00:54:40.614805+0000","last_fullsized":"2024-09-12T00:54:40.614805+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'189","last_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_deep_scrub":"266'189","last_deep_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.614609+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:12.172432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":418,"num_read_kb":18747,"num_write":861,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1207","reported_seq":2895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.174934+0000","last_change":"2024-09-12T00:54:57.174792+0000","last_active":"2024-09-12T00:54:57.174934+0000","last_peered":"2024-09-12T00:54:57.174934+0000","last_clean":"2024-09-12T00:54:57.174934+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:54:57.174934+0000","last_undegraded":"2024-09-12T00:54:57.174934+0000","last_fullsized":"2024-09-12T00:54:57.174934+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1207","last_scrub_stamp":"2024-09-12T00:54:57.174594+0000","last_deep_scrub":"266'1207","last_deep_scrub_stamp":"2024-09-12T00:54:57.174594+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.174594+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":1100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:27.434860+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4666,"num_omap_keys":19,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'209","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.227154+0000","last_change":"2024-09-12T00:54:46.227154+0000","last_active":"2024-09-12T00:54:46.227154+0000","last_peered":"2024-09-12T00:54:46.227154+0000","last_clean":"2024-09-12T00:54:46.227154+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:54:46.227154+0000","last_undegraded":"2024-09-12T00:54:46.227154+0000","last_fullsized":"2024-09-12T00:54:46.227154+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'209","last_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_deep_scrub":"266'209","last_deep_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.226930+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:33.782653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753496,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":35398,"num_write":969,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'475","reported_seq":2066,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.529028+0000","last_change":"2024-09-12T00:54:54.528895+0000","last_active":"2024-09-12T00:54:54.529028+0000","last_peered":"2024-09-12T00:54:54.529028+0000","last_clean":"2024-09-12T00:54:54.529028+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:54:54.529028+0000","last_undegraded":"2024-09-12T00:54:54.529028+0000","last_fullsized":"2024-09-12T00:54:54.529028+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'475","last_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_deep_scrub":"266'475","last_deep_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.528706+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:14.173614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2762,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'203","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.586198+0000","last_change":"2024-09-12T00:54:42.586198+0000","last_active":"2024-09-12T00:54:42.586198+0000","last_peered":"2024-09-12T00:54:42.586198+0000","last_clean":"2024-09-12T00:54:42.586198+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:54:42.586198+0000","last_undegraded":"2024-09-12T00:54:42.586198+0000","last_fullsized":"2024-09-12T00:54:42.586198+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.585972+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.593597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":18770,"num_write":983,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'806","reported_seq":2343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.489353+0000","last_change":"2024-09-12T00:54:53.489353+0000","last_active":"2024-09-12T00:54:53.489353+0000","last_peered":"2024-09-12T00:54:53.489353+0000","last_clean":"2024-09-12T00:54:53.489353+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:54:53.489353+0000","last_undegraded":"2024-09-12T00:54:53.489353+0000","last_fullsized":"2024-09-12T00:54:53.489353+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'806","last_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_deep_scrub":"266'806","last_deep_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.489176+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.643319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'248","reported_seq":928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.497646+0000","last_change":"2024-09-12T00:54:40.497352+0000","last_active":"2024-09-12T00:54:40.497646+0000","last_peered":"2024-09-12T00:54:40.497646+0000","last_clean":"2024-09-12T00:54:40.497646+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:54:40.497646+0000","last_undegraded":"2024-09-12T00:54:40.497646+0000","last_fullsized":"2024-09-12T00:54:40.497646+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.497103+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:25.148164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":28384,"num_write":1056,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'478","reported_seq":1947,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.025475+0000","last_change":"2024-09-12T00:54:49.025475+0000","last_active":"2024-09-12T00:54:49.025475+0000","last_peered":"2024-09-12T00:54:49.025475+0000","last_clean":"2024-09-12T00:54:49.025475+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:54:49.025475+0000","last_undegraded":"2024-09-12T00:54:49.025475+0000","last_fullsized":"2024-09-12T00:54:49.025475+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.025287+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.458555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'293","reported_seq":1114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.541081+0000","last_change":"2024-09-12T00:54:41.540937+0000","last_active":"2024-09-12T00:54:41.541081+0000","last_peered":"2024-09-12T00:54:41.541081+0000","last_clean":"2024-09-12T00:54:41.541081+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:54:41.541081+0000","last_undegraded":"2024-09-12T00:54:41.541081+0000","last_fullsized":"2024-09-12T00:54:41.541081+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'293","last_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_deep_scrub":"266'293","last_deep_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.540710+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:24.383696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1398,"num_read_kb":1619,"num_write":1277,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'613","reported_seq":2351,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.590571+0000","last_change":"2024-09-12T00:54:50.590571+0000","last_active":"2024-09-12T00:54:50.590571+0000","last_peered":"2024-09-12T00:54:50.590571+0000","last_clean":"2024-09-12T00:54:50.590571+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:54:50.590571+0000","last_undegraded":"2024-09-12T00:54:50.590571+0000","last_fullsized":"2024-09-12T00:54:50.590571+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'613","last_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_deep_scrub":"266'613","last_deep_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.590357+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:41.152978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'228","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.694402+0000","last_change":"2024-09-12T00:54:38.694245+0000","last_active":"2024-09-12T00:54:38.694402+0000","last_peered":"2024-09-12T00:54:38.694402+0000","last_clean":"2024-09-12T00:54:38.694402+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:38.694402+0000","last_undegraded":"2024-09-12T00:54:38.694402+0000","last_fullsized":"2024-09-12T00:54:38.694402+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.693931+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:45.558338+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7916704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":17177,"num_write":1053,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1256","reported_seq":3024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.314574+0000","last_change":"2024-09-12T00:54:41.314574+0000","last_active":"2024-09-12T00:54:41.314574+0000","last_peered":"2024-09-12T00:54:41.314574+0000","last_clean":"2024-09-12T00:54:41.314574+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:54:41.314574+0000","last_undegraded":"2024-09-12T00:54:41.314574+0000","last_fullsized":"2024-09-12T00:54:41.314574+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1256","last_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_deep_scrub":"266'1256","last_deep_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.314407+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":1200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:58.492484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'277","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.614515+0000","last_change":"2024-09-12T00:54:43.614374+0000","last_active":"2024-09-12T00:54:43.614515+0000","last_peered":"2024-09-12T00:54:43.614515+0000","last_clean":"2024-09-12T00:54:43.614515+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:54:43.614515+0000","last_undegraded":"2024-09-12T00:54:43.614515+0000","last_fullsized":"2024-09-12T00:54:43.614515+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'277","last_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_deep_scrub":"266'277","last_deep_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.614131+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:24.435399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525343,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":15585,"num_write":1267,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'829","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.567505+0000","last_change":"2024-09-12T00:54:48.567505+0000","last_active":"2024-09-12T00:54:48.567505+0000","last_peered":"2024-09-12T00:54:48.567505+0000","last_clean":"2024-09-12T00:54:48.567505+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:54:48.567505+0000","last_undegraded":"2024-09-12T00:54:48.567505+0000","last_fullsized":"2024-09-12T00:54:48.567505+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.567318+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:51.422110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'251","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.243891+0000","last_change":"2024-09-12T00:54:48.243735+0000","last_active":"2024-09-12T00:54:48.243891+0000","last_peered":"2024-09-12T00:54:48.243891+0000","last_clean":"2024-09-12T00:54:48.243891+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:54:48.243891+0000","last_undegraded":"2024-09-12T00:54:48.243891+0000","last_fullsized":"2024-09-12T00:54:48.243891+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'251","last_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_deep_scrub":"266'251","last_deep_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.243504+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:31.911455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10118774,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":58641,"num_write":1118,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1328","reported_seq":2859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.982053+0000","last_change":"2024-09-12T00:54:49.982053+0000","last_active":"2024-09-12T00:54:49.982053+0000","last_peered":"2024-09-12T00:54:49.982053+0000","last_clean":"2024-09-12T00:54:49.982053+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:54:49.982053+0000","last_undegraded":"2024-09-12T00:54:49.982053+0000","last_fullsized":"2024-09-12T00:54:49.982053+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1328","last_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_deep_scrub":"266'1328","last_deep_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.981823+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":1300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:42.896076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'196","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.530369+0000","last_change":"2024-09-12T00:54:45.530369+0000","last_active":"2024-09-12T00:54:45.530369+0000","last_peered":"2024-09-12T00:54:45.530369+0000","last_clean":"2024-09-12T00:54:45.530369+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:54:45.530369+0000","last_undegraded":"2024-09-12T00:54:45.530369+0000","last_fullsized":"2024-09-12T00:54:45.530369+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.530104+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:31.515428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262331,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":34280,"num_write":929,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'556","reported_seq":2112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.490261+0000","last_change":"2024-09-12T00:54:56.490261+0000","last_active":"2024-09-12T00:54:56.490261+0000","last_peered":"2024-09-12T00:54:56.490261+0000","last_clean":"2024-09-12T00:54:56.490261+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:54:56.490261+0000","last_undegraded":"2024-09-12T00:54:56.490261+0000","last_fullsized":"2024-09-12T00:54:56.490261+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'556","last_scrub_stamp":"2024-09-12T00:54:56.490065+0000","last_deep_scrub":"266'556","last_deep_scrub_stamp":"2024-09-12T00:54:56.490065+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.490065+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:18.778279+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1195,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'229","reported_seq":972,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.285793+0000","last_change":"2024-09-12T00:54:37.285793+0000","last_active":"2024-09-12T00:54:37.285793+0000","last_peered":"2024-09-12T00:54:37.285793+0000","last_clean":"2024-09-12T00:54:37.285793+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:54:37.285793+0000","last_undegraded":"2024-09-12T00:54:37.285793+0000","last_fullsized":"2024-09-12T00:54:37.285793+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.285624+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.468189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460242,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":746,"num_read_kb":61726,"num_write":1110,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'703","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.427718+0000","last_change":"2024-09-12T00:54:47.427718+0000","last_active":"2024-09-12T00:54:47.427718+0000","last_peered":"2024-09-12T00:54:47.427718+0000","last_clean":"2024-09-12T00:54:47.427718+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:54:47.427718+0000","last_undegraded":"2024-09-12T00:54:47.427718+0000","last_fullsized":"2024-09-12T00:54:47.427718+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'703","last_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_deep_scrub":"266'703","last_deep_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.427536+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:27.740664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'210","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.759263+0000","last_change":"2024-09-12T00:54:43.759263+0000","last_active":"2024-09-12T00:54:43.759263+0000","last_peered":"2024-09-12T00:54:43.759263+0000","last_clean":"2024-09-12T00:54:43.759263+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:54:43.759263+0000","last_undegraded":"2024-09-12T00:54:43.759263+0000","last_fullsized":"2024-09-12T00:54:43.759263+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.758895+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:11.039233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457515,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":13749,"num_write":936,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'966","reported_seq":2529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.413623+0000","last_change":"2024-09-12T00:54:44.413623+0000","last_active":"2024-09-12T00:54:44.413623+0000","last_peered":"2024-09-12T00:54:44.413623+0000","last_clean":"2024-09-12T00:54:44.413623+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:54:44.413623+0000","last_undegraded":"2024-09-12T00:54:44.413623+0000","last_fullsized":"2024-09-12T00:54:44.413623+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'966","last_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_deep_scrub":"266'966","last_deep_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.413459+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.872760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'210","reported_seq":897,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.004309+0000","last_change":"2024-09-12T00:54:39.004309+0000","last_active":"2024-09-12T00:54:39.004309+0000","last_peered":"2024-09-12T00:54:39.004309+0000","last_clean":"2024-09-12T00:54:39.004309+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:54:39.004309+0000","last_undegraded":"2024-09-12T00:54:39.004309+0000","last_fullsized":"2024-09-12T00:54:39.004309+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.004060+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:37.718332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":23861,"num_write":1050,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'754","reported_seq":2238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.590559+0000","last_change":"2024-09-12T00:54:47.590559+0000","last_active":"2024-09-12T00:54:47.590559+0000","last_peered":"2024-09-12T00:54:47.590559+0000","last_clean":"2024-09-12T00:54:47.590559+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:54:47.590559+0000","last_undegraded":"2024-09-12T00:54:47.590559+0000","last_fullsized":"2024-09-12T00:54:47.590559+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'754","last_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_deep_scrub":"266'754","last_deep_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.590381+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:16.432151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'164","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.259884+0000","last_change":"2024-09-12T00:54:49.259884+0000","last_active":"2024-09-12T00:54:49.259884+0000","last_peered":"2024-09-12T00:54:49.259884+0000","last_clean":"2024-09-12T00:54:49.259884+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:54:49.259884+0000","last_undegraded":"2024-09-12T00:54:49.259884+0000","last_fullsized":"2024-09-12T00:54:49.259884+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'164","last_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_deep_scrub":"266'164","last_deep_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.259672+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:01.483020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399130,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":3653,"num_write":817,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'837","reported_seq":2669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.793185+0000","last_change":"2024-09-12T00:54:50.793185+0000","last_active":"2024-09-12T00:54:50.793185+0000","last_peered":"2024-09-12T00:54:50.793185+0000","last_clean":"2024-09-12T00:54:50.793185+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:54:50.793185+0000","last_undegraded":"2024-09-12T00:54:50.793185+0000","last_fullsized":"2024-09-12T00:54:50.793185+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'837","last_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_deep_scrub":"266'837","last_deep_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.792947+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:52.531844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2733,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'220","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.603322+0000","last_change":"2024-09-12T00:54:41.603322+0000","last_active":"2024-09-12T00:54:41.603322+0000","last_peered":"2024-09-12T00:54:41.603322+0000","last_clean":"2024-09-12T00:54:41.603322+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:54:41.603322+0000","last_undegraded":"2024-09-12T00:54:41.603322+0000","last_fullsized":"2024-09-12T00:54:41.603322+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'220","last_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_deep_scrub":"266'220","last_deep_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.603085+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:05.399778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430198,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":27002,"num_write":976,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'448","reported_seq":2076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.356262+0000","last_change":"2024-09-12T00:54:42.356125+0000","last_active":"2024-09-12T00:54:42.356262+0000","last_peered":"2024-09-12T00:54:42.356262+0000","last_clean":"2024-09-12T00:54:42.356262+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:54:42.356262+0000","last_undegraded":"2024-09-12T00:54:42.356262+0000","last_fullsized":"2024-09-12T00:54:42.356262+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.355937+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:01.881468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'186","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.293468+0000","last_change":"2024-09-12T00:54:50.293468+0000","last_active":"2024-09-12T00:54:50.293468+0000","last_peered":"2024-09-12T00:54:50.293468+0000","last_clean":"2024-09-12T00:54:50.293468+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:54:50.293468+0000","last_undegraded":"2024-09-12T00:54:50.293468+0000","last_fullsized":"2024-09-12T00:54:50.293468+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.293253+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:08.784599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":12744,"num_write":922,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.268108+0000","last_change":"2024-09-12T00:54:51.268108+0000","last_active":"2024-09-12T00:54:51.268108+0000","last_peered":"2024-09-12T00:54:51.268108+0000","last_clean":"2024-09-12T00:54:51.268108+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:54:51.268108+0000","last_undegraded":"2024-09-12T00:54:51.268108+0000","last_fullsized":"2024-09-12T00:54:51.268108+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.267890+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:47.302659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":71383,"num_write":1072,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'456","reported_seq":2147,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.803256+0000","last_change":"2024-09-12T00:54:51.803256+0000","last_active":"2024-09-12T00:54:51.803256+0000","last_peered":"2024-09-12T00:54:51.803256+0000","last_clean":"2024-09-12T00:54:51.803256+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:54:51.803256+0000","last_undegraded":"2024-09-12T00:54:51.803256+0000","last_fullsized":"2024-09-12T00:54:51.803256+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.803069+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:01.594700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'208","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.549008+0000","last_change":"2024-09-12T00:54:46.549008+0000","last_active":"2024-09-12T00:54:46.549008+0000","last_peered":"2024-09-12T00:54:46.549008+0000","last_clean":"2024-09-12T00:54:46.549008+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:54:46.549008+0000","last_undegraded":"2024-09-12T00:54:46.549008+0000","last_fullsized":"2024-09-12T00:54:46.549008+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.548801+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.676960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194359,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":710,"num_read_kb":180313,"num_write":963,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'929","reported_seq":2699,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.418811+0000","last_change":"2024-09-12T00:54:48.418811+0000","last_active":"2024-09-12T00:54:48.418811+0000","last_peered":"2024-09-12T00:54:48.418811+0000","last_clean":"2024-09-12T00:54:48.418811+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:48.418811+0000","last_undegraded":"2024-09-12T00:54:48.418811+0000","last_fullsized":"2024-09-12T00:54:48.418811+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.418615+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:00.299961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":959,"ondisk_log_size":959,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1818,"ondisk_log_size":1818,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662,"ondisk_log_size":662,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":338265,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8580,"num_read_kb":10748,"num_write":5747,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671866,"num_omap_keys":1552,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1987,"ondisk_log_size":1987,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43256,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3988,"ondisk_log_size":3988,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7,"ondisk_log_size":7,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":104917588,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":33248,"num_read_kb":1979779,"num_write":63422,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159301632,"data_stored":159301632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4504,"ondisk_log_size":4504,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":190493,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":189755,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509968,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220400,"kb_used_data":18528,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94151440,"statfs":{"total":96636764160,"available":96411074560,"internally_reserved":0,"allocated":18972672,"data_stored":16979463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509969,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92208,"kb_used_data":20768,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94279632,"statfs":{"total":96636764160,"available":96542343168,"internally_reserved":0,"allocated":21266432,"data_stored":19245709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509970,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190576,"kb_used_data":28960,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94181264,"statfs":{"total":96636764160,"available":96441614336,"internally_reserved":0,"allocated":29655040,"data_stored":27647840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509970,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":225952,"kb_used_data":32336,"kb_used_omap":1,"kb_used_meta":193598,"kb_avail":94145888,"statfs":{"total":96636764160,"available":96405389312,"internally_reserved":0,"allocated":33112064,"data_stored":31105721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":198244807},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509971,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123728,"kb_used_data":24512,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94248112,"statfs":{"total":96636764160,"available":96510066688,"internally_reserved":0,"allocated":25100288,"data_stored":23091639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509970,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293624,"kb_used_data":19496,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94078216,"statfs":{"total":96636764160,"available":96336093184,"internally_reserved":0,"allocated":19963904,"data_stored":17949977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509969,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127816,"kb_used_data":24440,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94244024,"statfs":{"total":96636764160,"available":96505880576,"internally_reserved":0,"allocated":25026560,"data_stored":23006958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542677,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246392,"kb_used_data":20840,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125448,"statfs":{"total":96636764160,"available":96384458752,"internally_reserved":0,"allocated":21340160,"data_stored":19331103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20770816,"data_stored":20770816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":15126528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20856832,"data_stored":20856832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28872704,"data_stored":28872704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25411584,"data_stored":25411584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16506880,"data_stored":16506880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17010688,"data_stored":17010688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14745600,"data_stored":14745600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:55:19.215 INFO:tasks.ceph:pgid 65.1f last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.215 INFO:tasks.ceph:pgid 68.1b last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.215 INFO:tasks.ceph:pgid 67.1c last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 66.1d last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 67.1f last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 66.1e last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 67.1e last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 68.1e last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 66.18 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.216 INFO:tasks.ceph:pgid 68.1f last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 66.19 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 68.1c last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 67.1a last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 68.12 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 67.15 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 66.14 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.217 INFO:tasks.ceph:pgid 65.17 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 68.13 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 67.14 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 68.10 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 67.17 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 66.17 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 65.14 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 68.16 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.218 INFO:tasks.ceph:pgid 67.11 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 65.13 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 68.17 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 67.10 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 66.11 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 68.14 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 67.13 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 68.15 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.219 INFO:tasks.ceph:pgid 68.a last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 67.d last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 67.c last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 65.e last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 67.f last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 67.e last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 68.e last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.220 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.221 INFO:tasks.ceph:pgid 68.f last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.221 INFO:tasks.ceph:pgid 66.9 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.221 INFO:tasks.ceph:pgid 67.b last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.221 INFO:tasks.ceph:pgid 68.d last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.221 INFO:tasks.ceph:pgid 66.b last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.221 INFO:tasks.ceph:pgid 67.5 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.221 INFO:tasks.ceph:pgid 66.4 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 67.4 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 66.5 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 65.6 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 68.0 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 66.7 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 68.6 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.222 INFO:tasks.ceph:pgid 67.1 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.223 INFO:tasks.ceph:pgid 68.7 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.223 INFO:tasks.ceph:pgid 67.0 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.223 INFO:tasks.ceph:pgid 66.1 last_scrub_stamp 2024-09-12T00:28:12.974322+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=12, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.223 INFO:tasks.ceph:pgid 65.2 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.223 INFO:tasks.ceph:pgid 68.4 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.223 INFO:tasks.ceph:pgid 65.1 last_scrub_stamp 2024-09-12T00:26:47.513620+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=26, tm_sec=47, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.223 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.225 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.226 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.226 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.226 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.226 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.226 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.226 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-12T00:11:52.907172+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=52, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.226 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-12T00:11:54.913701+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=11, tm_sec=54, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:19.227 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:55:39.232 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:55:39.581 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:55:39.592 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:55:39.599 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1586,"stamp":"2024-09-12T00:55:39.399961+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105863228,"num_objects":726,"num_object_clones":0,"num_object_copies":1691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":278142,"num_read_kb":2586611,"num_write":143606,"num_write_kb":2344249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":726068,"num_omap_keys":1771,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14299,"ondisk_log_size":14299,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1524856,"kb_used_data":189880,"kb_used_omap":12,"kb_used_meta":1334835,"kb_avail":753449864,"statfs":{"total":773094113280,"available":771532660736,"internally_reserved":0,"allocated":194437120,"data_stored":178358410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1366871602},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7199,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009435"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.229682+0000","last_change":"2024-09-12T00:55:14.229682+0000","last_active":"2024-09-12T00:55:14.229682+0000","last_peered":"2024-09-12T00:55:14.229682+0000","last_clean":"2024-09-12T00:55:14.229682+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:55:14.229682+0000","last_undegraded":"2024-09-12T00:55:14.229682+0000","last_fullsized":"2024-09-12T00:55:14.229682+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.229499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.229499+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.229499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:15.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.793177+0000","last_change":"2024-09-12T00:55:12.793177+0000","last_active":"2024-09-12T00:55:12.793177+0000","last_peered":"2024-09-12T00:55:12.793177+0000","last_clean":"2024-09-12T00:55:12.793177+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:55:12.793177+0000","last_undegraded":"2024-09-12T00:55:12.793177+0000","last_fullsized":"2024-09-12T00:55:12.793177+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T00:55:12.792992+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T00:55:12.792992+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.792992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:14.486725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.766882+0000","last_change":"2024-09-12T00:55:14.766882+0000","last_active":"2024-09-12T00:55:14.766882+0000","last_peered":"2024-09-12T00:55:14.766882+0000","last_clean":"2024-09-12T00:55:14.766882+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:55:14.766882+0000","last_undegraded":"2024-09-12T00:55:14.766882+0000","last_fullsized":"2024-09-12T00:55:14.766882+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.766689+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.766689+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.766689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:34.013158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.728413+0000","last_change":"2024-09-12T00:55:17.728413+0000","last_active":"2024-09-12T00:55:17.728413+0000","last_peered":"2024-09-12T00:55:17.728413+0000","last_clean":"2024-09-12T00:55:17.728413+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:55:17.728413+0000","last_undegraded":"2024-09-12T00:55:17.728413+0000","last_fullsized":"2024-09-12T00:55:17.728413+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-12T00:55:17.728230+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-12T00:55:17.728230+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.728230+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:17.299708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.631439+0000","last_change":"2024-09-12T00:55:19.631439+0000","last_active":"2024-09-12T00:55:19.631439+0000","last_peered":"2024-09-12T00:55:19.631439+0000","last_clean":"2024-09-12T00:55:19.631439+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:55:19.631439+0000","last_undegraded":"2024-09-12T00:55:19.631439+0000","last_fullsized":"2024-09-12T00:55:19.631439+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:19.631259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:19.631259+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.631259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:53.532256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.805565+0000","last_change":"2024-09-12T00:55:18.805565+0000","last_active":"2024-09-12T00:55:18.805565+0000","last_peered":"2024-09-12T00:55:18.805565+0000","last_clean":"2024-09-12T00:55:18.805565+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:55:18.805565+0000","last_undegraded":"2024-09-12T00:55:18.805565+0000","last_fullsized":"2024-09-12T00:55:18.805565+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.805352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.805352+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.805352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:07.582317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.317354+0000","last_change":"2024-09-12T00:55:20.317354+0000","last_active":"2024-09-12T00:55:20.317354+0000","last_peered":"2024-09-12T00:55:20.317354+0000","last_clean":"2024-09-12T00:55:20.317354+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:55:20.317354+0000","last_undegraded":"2024-09-12T00:55:20.317354+0000","last_fullsized":"2024-09-12T00:55:20.317354+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T00:55:20.317157+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T00:55:20.317157+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.317157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:39.988452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.800503+0000","last_change":"2024-09-12T00:55:15.800503+0000","last_active":"2024-09-12T00:55:15.800503+0000","last_peered":"2024-09-12T00:55:15.800503+0000","last_clean":"2024-09-12T00:55:15.800503+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:55:15.800503+0000","last_undegraded":"2024-09-12T00:55:15.800503+0000","last_fullsized":"2024-09-12T00:55:15.800503+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'43","last_scrub_stamp":"2024-09-12T00:55:15.800318+0000","last_deep_scrub":"266'43","last_deep_scrub_stamp":"2024-09-12T00:55:15.800318+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.800318+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.404637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.816681+0000","last_change":"2024-09-12T00:55:15.816681+0000","last_active":"2024-09-12T00:55:15.816681+0000","last_peered":"2024-09-12T00:55:15.816681+0000","last_clean":"2024-09-12T00:55:15.816681+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:55:15.816681+0000","last_undegraded":"2024-09-12T00:55:15.816681+0000","last_fullsized":"2024-09-12T00:55:15.816681+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:15.816508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:15.816508+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.816508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:11.337625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:29.267100+0000","last_change":"2024-09-12T00:55:29.267100+0000","last_active":"2024-09-12T00:55:29.267100+0000","last_peered":"2024-09-12T00:55:29.267100+0000","last_clean":"2024-09-12T00:55:29.267100+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:55:29.267100+0000","last_undegraded":"2024-09-12T00:55:29.267100+0000","last_fullsized":"2024-09-12T00:55:29.267100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T00:55:29.266861+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T00:55:29.266861+0000","last_clean_scrub_stamp":"2024-09-12T00:55:29.266861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:33.088330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'3","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.720553+0000","last_change":"2024-09-12T00:55:17.720553+0000","last_active":"2024-09-12T00:55:17.720553+0000","last_peered":"2024-09-12T00:55:17.720553+0000","last_clean":"2024-09-12T00:55:17.720553+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:55:17.720553+0000","last_undegraded":"2024-09-12T00:55:17.720553+0000","last_fullsized":"2024-09-12T00:55:17.720553+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T00:55:17.720377+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T00:55:17.720377+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.720377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:47.009181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.577866+0000","last_change":"2024-09-12T00:55:11.577866+0000","last_active":"2024-09-12T00:55:11.577866+0000","last_peered":"2024-09-12T00:55:11.577866+0000","last_clean":"2024-09-12T00:55:11.577866+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:55:11.577866+0000","last_undegraded":"2024-09-12T00:55:11.577866+0000","last_fullsized":"2024-09-12T00:55:11.577866+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T00:55:11.577697+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T00:55:11.577697+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.577697+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:39.149200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":19,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:39.934194+0000","last_change":"2024-09-12T00:39:28.125516+0000","last_active":"2024-09-12T00:51:39.934194+0000","last_peered":"2024-09-12T00:51:39.934194+0000","last_clean":"2024-09-12T00:51:39.934194+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:51:39.934194+0000","last_undegraded":"2024-09-12T00:51:39.934194+0000","last_fullsized":"2024-09-12T00:51:39.934194+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:50.627744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:27.276653+0000","last_change":"2024-09-12T00:55:27.276653+0000","last_active":"2024-09-12T00:55:27.276653+0000","last_peered":"2024-09-12T00:55:27.276653+0000","last_clean":"2024-09-12T00:55:27.276653+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:55:27.276653+0000","last_undegraded":"2024-09-12T00:55:27.276653+0000","last_fullsized":"2024-09-12T00:55:27.276653+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:27.276475+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:27.276475+0000","last_clean_scrub_stamp":"2024-09-12T00:55:27.276475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:07.462069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.724685+0000","last_change":"2024-09-12T00:55:10.724516+0000","last_active":"2024-09-12T00:55:10.724685+0000","last_peered":"2024-09-12T00:55:10.724685+0000","last_clean":"2024-09-12T00:55:10.724685+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:55:10.724685+0000","last_undegraded":"2024-09-12T00:55:10.724685+0000","last_fullsized":"2024-09-12T00:55:10.724685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T00:55:10.724330+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T00:55:10.724330+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.724330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:21.498427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.605078+0000","last_change":"2024-09-12T00:55:13.605078+0000","last_active":"2024-09-12T00:55:13.605078+0000","last_peered":"2024-09-12T00:55:13.605078+0000","last_clean":"2024-09-12T00:55:13.605078+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:55:13.605078+0000","last_undegraded":"2024-09-12T00:55:13.605078+0000","last_fullsized":"2024-09-12T00:55:13.605078+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'56","last_scrub_stamp":"2024-09-12T00:55:13.604900+0000","last_deep_scrub":"266'56","last_deep_scrub_stamp":"2024-09-12T00:55:13.604900+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.604900+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:03.425227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:26.760778+0000","last_change":"2024-09-12T00:55:26.760648+0000","last_active":"2024-09-12T00:55:26.760778+0000","last_peered":"2024-09-12T00:55:26.760778+0000","last_clean":"2024-09-12T00:55:26.760778+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:55:26.760778+0000","last_undegraded":"2024-09-12T00:55:26.760778+0000","last_fullsized":"2024-09-12T00:55:26.760778+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:26.760469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:26.760469+0000","last_clean_scrub_stamp":"2024-09-12T00:55:26.760469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:37.726403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.158610+0000","last_change":"2024-09-12T00:55:08.158610+0000","last_active":"2024-09-12T00:55:08.158610+0000","last_peered":"2024-09-12T00:55:08.158610+0000","last_clean":"2024-09-12T00:55:08.158610+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:55:08.158610+0000","last_undegraded":"2024-09-12T00:55:08.158610+0000","last_fullsized":"2024-09-12T00:55:08.158610+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:08.158395+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.158395+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.158395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.464176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'9","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.277466+0000","last_change":"2024-09-12T00:55:19.277466+0000","last_active":"2024-09-12T00:55:19.277466+0000","last_peered":"2024-09-12T00:55:19.277466+0000","last_clean":"2024-09-12T00:55:19.277466+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:55:19.277466+0000","last_undegraded":"2024-09-12T00:55:19.277466+0000","last_fullsized":"2024-09-12T00:55:19.277466+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T00:55:19.277280+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T00:55:19.277280+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.277280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:40.313906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":189,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.623494+0000","last_change":"2024-09-12T00:55:10.623494+0000","last_active":"2024-09-12T00:55:10.623494+0000","last_peered":"2024-09-12T00:55:10.623494+0000","last_clean":"2024-09-12T00:55:10.623494+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:55:10.623494+0000","last_undegraded":"2024-09-12T00:55:10.623494+0000","last_fullsized":"2024-09-12T00:55:10.623494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'48","last_scrub_stamp":"2024-09-12T00:55:10.623317+0000","last_deep_scrub":"266'48","last_deep_scrub_stamp":"2024-09-12T00:55:10.623317+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.623317+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:54.480935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.693721+0000","last_change":"2024-09-12T00:55:21.693721+0000","last_active":"2024-09-12T00:55:21.693721+0000","last_peered":"2024-09-12T00:55:21.693721+0000","last_clean":"2024-09-12T00:55:21.693721+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:55:21.693721+0000","last_undegraded":"2024-09-12T00:55:21.693721+0000","last_fullsized":"2024-09-12T00:55:21.693721+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:21.693539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:21.693539+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.693539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:53.141001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'7","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:31.570891+0000","last_change":"2024-09-12T00:28:17.080528+0000","last_active":"2024-09-12T00:54:31.570891+0000","last_peered":"2024-09-12T00:54:31.570891+0000","last_clean":"2024-09-12T00:54:31.570891+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:54:31.570891+0000","last_undegraded":"2024-09-12T00:54:31.570891+0000","last_fullsized":"2024-09-12T00:54:31.570891+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":651,"num_write":12,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:33.425371+0000","last_change":"2024-09-12T00:55:33.425371+0000","last_active":"2024-09-12T00:55:33.425371+0000","last_peered":"2024-09-12T00:55:33.425371+0000","last_clean":"2024-09-12T00:55:33.425371+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:55:33.425371+0000","last_undegraded":"2024-09-12T00:55:33.425371+0000","last_fullsized":"2024-09-12T00:55:33.425371+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:33.425147+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:33.425147+0000","last_clean_scrub_stamp":"2024-09-12T00:55:33.425147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:24.665112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.742145+0000","last_change":"2024-09-12T00:55:10.742145+0000","last_active":"2024-09-12T00:55:10.742145+0000","last_peered":"2024-09-12T00:55:10.742145+0000","last_clean":"2024-09-12T00:55:10.742145+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:55:10.742145+0000","last_undegraded":"2024-09-12T00:55:10.742145+0000","last_fullsized":"2024-09-12T00:55:10.742145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'71","last_scrub_stamp":"2024-09-12T00:55:10.741944+0000","last_deep_scrub":"266'71","last_deep_scrub_stamp":"2024-09-12T00:55:10.741944+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.741944+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:45.667086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'2","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.850531+0000","last_change":"2024-09-12T00:55:19.850531+0000","last_active":"2024-09-12T00:55:19.850531+0000","last_peered":"2024-09-12T00:55:19.850531+0000","last_clean":"2024-09-12T00:55:19.850531+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:55:19.850531+0000","last_undegraded":"2024-09-12T00:55:19.850531+0000","last_fullsized":"2024-09-12T00:55:19.850531+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:19.850341+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:19.850341+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.850341+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:47.578774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":41,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.816234+0000","last_change":"2024-09-12T00:55:13.816234+0000","last_active":"2024-09-12T00:55:13.816234+0000","last_peered":"2024-09-12T00:55:13.816234+0000","last_clean":"2024-09-12T00:55:13.816234+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:55:13.816234+0000","last_undegraded":"2024-09-12T00:55:13.816234+0000","last_fullsized":"2024-09-12T00:55:13.816234+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:13.816054+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:13.816054+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.816054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:51.920762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.133568+0000","last_change":"2024-09-12T00:55:02.133568+0000","last_active":"2024-09-12T00:55:02.133568+0000","last_peered":"2024-09-12T00:55:02.133568+0000","last_clean":"2024-09-12T00:55:02.133568+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:55:02.133568+0000","last_undegraded":"2024-09-12T00:55:02.133568+0000","last_fullsized":"2024-09-12T00:55:02.133568+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.133361+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:41.589597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":198,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.705902+0000","last_change":"2024-09-12T00:55:10.705902+0000","last_active":"2024-09-12T00:55:10.705902+0000","last_peered":"2024-09-12T00:55:10.705902+0000","last_clean":"2024-09-12T00:55:10.705902+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:55:10.705902+0000","last_undegraded":"2024-09-12T00:55:10.705902+0000","last_fullsized":"2024-09-12T00:55:10.705902+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'54","last_scrub_stamp":"2024-09-12T00:55:10.705720+0000","last_deep_scrub":"266'54","last_deep_scrub_stamp":"2024-09-12T00:55:10.705720+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.705720+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:30.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.226312+0000","last_change":"2024-09-12T00:55:15.226312+0000","last_active":"2024-09-12T00:55:15.226312+0000","last_peered":"2024-09-12T00:55:15.226312+0000","last_clean":"2024-09-12T00:55:15.226312+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:55:15.226312+0000","last_undegraded":"2024-09-12T00:55:15.226312+0000","last_fullsized":"2024-09-12T00:55:15.226312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:15.225979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:15.225979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.225979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:36.693603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":37,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.692763+0000","last_change":"2024-09-12T00:55:22.692763+0000","last_active":"2024-09-12T00:55:22.692763+0000","last_peered":"2024-09-12T00:55:22.692763+0000","last_clean":"2024-09-12T00:55:22.692763+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:55:22.692763+0000","last_undegraded":"2024-09-12T00:55:22.692763+0000","last_fullsized":"2024-09-12T00:55:22.692763+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:22.692564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:22.692564+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.692564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:57.295345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.579199+0000","last_change":"2024-09-12T00:55:14.579199+0000","last_active":"2024-09-12T00:55:14.579199+0000","last_peered":"2024-09-12T00:55:14.579199+0000","last_clean":"2024-09-12T00:55:14.579199+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:55:14.579199+0000","last_undegraded":"2024-09-12T00:55:14.579199+0000","last_fullsized":"2024-09-12T00:55:14.579199+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.579021+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.579021+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.579021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.763959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.645511+0000","last_change":"2024-09-12T00:55:09.645511+0000","last_active":"2024-09-12T00:55:09.645511+0000","last_peered":"2024-09-12T00:55:09.645511+0000","last_clean":"2024-09-12T00:55:09.645511+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:55:09.645511+0000","last_undegraded":"2024-09-12T00:55:09.645511+0000","last_fullsized":"2024-09-12T00:55:09.645511+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T00:55:09.645339+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T00:55:09.645339+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.645339+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:52.501367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:33.242347+0000","last_change":"2024-09-12T00:55:33.242347+0000","last_active":"2024-09-12T00:55:33.242347+0000","last_peered":"2024-09-12T00:55:33.242347+0000","last_clean":"2024-09-12T00:55:33.242347+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:55:33.242347+0000","last_undegraded":"2024-09-12T00:55:33.242347+0000","last_fullsized":"2024-09-12T00:55:33.242347+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:33.242114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:33.242114+0000","last_clean_scrub_stamp":"2024-09-12T00:55:33.242114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:15.528064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'10","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.676875+0000","last_change":"2024-09-12T00:55:21.676875+0000","last_active":"2024-09-12T00:55:21.676875+0000","last_peered":"2024-09-12T00:55:21.676875+0000","last_clean":"2024-09-12T00:55:21.676875+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:55:21.676875+0000","last_undegraded":"2024-09-12T00:55:21.676875+0000","last_fullsized":"2024-09-12T00:55:21.676875+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:21.676696+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:21.676696+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.676696+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:29.943874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12306,"num_write":10,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:35.386495+0000","last_change":"2024-09-12T00:55:35.386495+0000","last_active":"2024-09-12T00:55:35.386495+0000","last_peered":"2024-09-12T00:55:35.386495+0000","last_clean":"2024-09-12T00:55:35.386495+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:55:35.386495+0000","last_undegraded":"2024-09-12T00:55:35.386495+0000","last_fullsized":"2024-09-12T00:55:35.386495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:35.386303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:35.386303+0000","last_clean_scrub_stamp":"2024-09-12T00:55:35.386303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:02.401096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":209,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.775716+0000","last_change":"2024-09-12T00:55:16.775716+0000","last_active":"2024-09-12T00:55:16.775716+0000","last_peered":"2024-09-12T00:55:16.775716+0000","last_clean":"2024-09-12T00:55:16.775716+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:55:16.775716+0000","last_undegraded":"2024-09-12T00:55:16.775716+0000","last_fullsized":"2024-09-12T00:55:16.775716+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'59","last_scrub_stamp":"2024-09-12T00:55:16.775531+0000","last_deep_scrub":"266'59","last_deep_scrub_stamp":"2024-09-12T00:55:16.775531+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.775531+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:09.537903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'2","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.602638+0000","last_change":"2024-09-12T00:55:17.602638+0000","last_active":"2024-09-12T00:55:17.602638+0000","last_peered":"2024-09-12T00:55:17.602638+0000","last_clean":"2024-09-12T00:55:17.602638+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:55:17.602638+0000","last_undegraded":"2024-09-12T00:55:17.602638+0000","last_fullsized":"2024-09-12T00:55:17.602638+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:17.602452+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:17.602452+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.602452+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:26.508065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'4","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:26.271964+0000","last_change":"2024-09-12T00:55:26.271964+0000","last_active":"2024-09-12T00:55:26.271964+0000","last_peered":"2024-09-12T00:55:26.271964+0000","last_clean":"2024-09-12T00:55:26.271964+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:55:26.271964+0000","last_undegraded":"2024-09-12T00:55:26.271964+0000","last_fullsized":"2024-09-12T00:55:26.271964+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:26.271767+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:26.271767+0000","last_clean_scrub_stamp":"2024-09-12T00:55:26.271767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.685826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.119784+0000","last_change":"2024-09-12T00:55:04.119784+0000","last_active":"2024-09-12T00:55:04.119784+0000","last_peered":"2024-09-12T00:55:04.119784+0000","last_clean":"2024-09-12T00:55:04.119784+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:55:04.119784+0000","last_undegraded":"2024-09-12T00:55:04.119784+0000","last_fullsized":"2024-09-12T00:55:04.119784+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:04.119583+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:04.119583+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.119583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:17.216020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":134,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.784196+0000","last_change":"2024-09-12T00:55:14.784196+0000","last_active":"2024-09-12T00:55:14.784196+0000","last_peered":"2024-09-12T00:55:14.784196+0000","last_clean":"2024-09-12T00:55:14.784196+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:55:14.784196+0000","last_undegraded":"2024-09-12T00:55:14.784196+0000","last_fullsized":"2024-09-12T00:55:14.784196+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T00:55:14.783979+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T00:55:14.783979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.783979+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.709781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.808356+0000","last_change":"2024-09-12T00:55:16.808356+0000","last_active":"2024-09-12T00:55:16.808356+0000","last_peered":"2024-09-12T00:55:16.808356+0000","last_clean":"2024-09-12T00:55:16.808356+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:55:16.808356+0000","last_undegraded":"2024-09-12T00:55:16.808356+0000","last_fullsized":"2024-09-12T00:55:16.808356+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:16.808175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:16.808175+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.808175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:39.697740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:25.714058+0000","last_change":"2024-09-12T00:55:25.714058+0000","last_active":"2024-09-12T00:55:25.714058+0000","last_peered":"2024-09-12T00:55:25.714058+0000","last_clean":"2024-09-12T00:55:25.714058+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:55:25.714058+0000","last_undegraded":"2024-09-12T00:55:25.714058+0000","last_fullsized":"2024-09-12T00:55:25.714058+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T00:55:25.713866+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T00:55:25.713866+0000","last_clean_scrub_stamp":"2024-09-12T00:55:25.713866+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.579216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'4","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.761776+0000","last_change":"2024-09-12T00:55:15.761776+0000","last_active":"2024-09-12T00:55:15.761776+0000","last_peered":"2024-09-12T00:55:15.761776+0000","last_clean":"2024-09-12T00:55:15.761776+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:55:15.761776+0000","last_undegraded":"2024-09-12T00:55:15.761776+0000","last_fullsized":"2024-09-12T00:55:15.761776+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:15.761591+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:15.761591+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.761591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:00.967840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":78,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.651822+0000","last_change":"2024-09-12T00:55:08.651822+0000","last_active":"2024-09-12T00:55:08.651822+0000","last_peered":"2024-09-12T00:55:08.651822+0000","last_clean":"2024-09-12T00:55:08.651822+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:55:08.651822+0000","last_undegraded":"2024-09-12T00:55:08.651822+0000","last_fullsized":"2024-09-12T00:55:08.651822+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:08.651514+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:08.651514+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.651514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:09.199043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.195342+0000","last_change":"2024-09-12T00:55:11.195342+0000","last_active":"2024-09-12T00:55:11.195342+0000","last_peered":"2024-09-12T00:55:11.195342+0000","last_clean":"2024-09-12T00:55:11.195342+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:55:11.195342+0000","last_undegraded":"2024-09-12T00:55:11.195342+0000","last_fullsized":"2024-09-12T00:55:11.195342+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:11.195162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:11.195162+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.195162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:41.794941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.168868+0000","last_change":"2024-09-12T00:55:12.168868+0000","last_active":"2024-09-12T00:55:12.168868+0000","last_peered":"2024-09-12T00:55:12.168868+0000","last_clean":"2024-09-12T00:55:12.168868+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:55:12.168868+0000","last_undegraded":"2024-09-12T00:55:12.168868+0000","last_fullsized":"2024-09-12T00:55:12.168868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:12.168690+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:12.168690+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.168690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:45.567507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.268298+0000","last_change":"2024-09-12T00:55:18.268298+0000","last_active":"2024-09-12T00:55:18.268298+0000","last_peered":"2024-09-12T00:55:18.268298+0000","last_clean":"2024-09-12T00:55:18.268298+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:55:18.268298+0000","last_undegraded":"2024-09-12T00:55:18.268298+0000","last_fullsized":"2024-09-12T00:55:18.268298+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.268111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.268111+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.268111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.224505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'114","reported_seq":409,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:28.427308+0000","last_change":"2024-09-12T00:55:28.427308+0000","last_active":"2024-09-12T00:55:28.427308+0000","last_peered":"2024-09-12T00:55:28.427308+0000","last_clean":"2024-09-12T00:55:28.427308+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:55:28.427308+0000","last_undegraded":"2024-09-12T00:55:28.427308+0000","last_fullsized":"2024-09-12T00:55:28.427308+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'114","last_scrub_stamp":"2024-09-12T00:55:28.427119+0000","last_deep_scrub":"266'114","last_deep_scrub_stamp":"2024-09-12T00:55:28.427119+0000","last_clean_scrub_stamp":"2024-09-12T00:55:28.427119+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:49.946807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3479,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:34.223952+0000","last_change":"2024-09-12T00:55:34.223952+0000","last_active":"2024-09-12T00:55:34.223952+0000","last_peered":"2024-09-12T00:55:34.223952+0000","last_clean":"2024-09-12T00:55:34.223952+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:55:34.223952+0000","last_undegraded":"2024-09-12T00:55:34.223952+0000","last_fullsized":"2024-09-12T00:55:34.223952+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:34.223758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:34.223758+0000","last_clean_scrub_stamp":"2024-09-12T00:55:34.223758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:08.038991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'4","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:25.320531+0000","last_change":"2024-09-12T00:55:25.320531+0000","last_active":"2024-09-12T00:55:25.320531+0000","last_peered":"2024-09-12T00:55:25.320531+0000","last_clean":"2024-09-12T00:55:25.320531+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:55:25.320531+0000","last_undegraded":"2024-09-12T00:55:25.320531+0000","last_fullsized":"2024-09-12T00:55:25.320531+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:25.320338+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:25.320338+0000","last_clean_scrub_stamp":"2024-09-12T00:55:25.320338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:46.594170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4468,"num_write":4,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.715773+0000","last_change":"2024-09-12T00:55:08.715773+0000","last_active":"2024-09-12T00:55:08.715773+0000","last_peered":"2024-09-12T00:55:08.715773+0000","last_clean":"2024-09-12T00:55:08.715773+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:55:08.715773+0000","last_undegraded":"2024-09-12T00:55:08.715773+0000","last_fullsized":"2024-09-12T00:55:08.715773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:08.715567+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.715567+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.715567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:39.116238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'134","reported_seq":459,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:27.391183+0000","last_change":"2024-09-12T00:55:27.391183+0000","last_active":"2024-09-12T00:55:27.391183+0000","last_peered":"2024-09-12T00:55:27.391183+0000","last_clean":"2024-09-12T00:55:27.391183+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:55:27.391183+0000","last_undegraded":"2024-09-12T00:55:27.391183+0000","last_fullsized":"2024-09-12T00:55:27.391183+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:55:27.390995+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:55:27.390995+0000","last_clean_scrub_stamp":"2024-09-12T00:55:27.390995+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:13.619961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3720,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.634936+0000","last_change":"2024-09-12T00:55:20.634936+0000","last_active":"2024-09-12T00:55:20.634936+0000","last_peered":"2024-09-12T00:55:20.634936+0000","last_clean":"2024-09-12T00:55:20.634936+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:55:20.634936+0000","last_undegraded":"2024-09-12T00:55:20.634936+0000","last_fullsized":"2024-09-12T00:55:20.634936+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:20.634725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:20.634725+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.634725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:30.101814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:24.312901+0000","last_change":"2024-09-12T00:55:24.312901+0000","last_active":"2024-09-12T00:55:24.312901+0000","last_peered":"2024-09-12T00:55:24.312901+0000","last_clean":"2024-09-12T00:55:24.312901+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:55:24.312901+0000","last_undegraded":"2024-09-12T00:55:24.312901+0000","last_fullsized":"2024-09-12T00:55:24.312901+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:24.312700+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:24.312700+0000","last_clean_scrub_stamp":"2024-09-12T00:55:24.312700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:04.900716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.259497+0000","last_change":"2024-09-12T00:55:17.259497+0000","last_active":"2024-09-12T00:55:17.259497+0000","last_peered":"2024-09-12T00:55:17.259497+0000","last_clean":"2024-09-12T00:55:17.259497+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:55:17.259497+0000","last_undegraded":"2024-09-12T00:55:17.259497+0000","last_fullsized":"2024-09-12T00:55:17.259497+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:17.259317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:17.259317+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.259317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:44.554408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.647408+0000","last_change":"2024-09-12T00:55:07.647408+0000","last_active":"2024-09-12T00:55:07.647408+0000","last_peered":"2024-09-12T00:55:07.647408+0000","last_clean":"2024-09-12T00:55:07.647408+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:55:07.647408+0000","last_undegraded":"2024-09-12T00:55:07.647408+0000","last_fullsized":"2024-09-12T00:55:07.647408+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.647104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.647104+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.647104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:53.415759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'2","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.697987+0000","last_change":"2024-09-12T00:55:22.697987+0000","last_active":"2024-09-12T00:55:22.697987+0000","last_peered":"2024-09-12T00:55:22.697987+0000","last_clean":"2024-09-12T00:55:22.697987+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:55:22.697987+0000","last_undegraded":"2024-09-12T00:55:22.697987+0000","last_fullsized":"2024-09-12T00:55:22.697987+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:22.697793+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:22.697793+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.697793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:34.209372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.715075+0000","last_change":"2024-09-12T00:55:19.715075+0000","last_active":"2024-09-12T00:55:19.715075+0000","last_peered":"2024-09-12T00:55:19.715075+0000","last_clean":"2024-09-12T00:55:19.715075+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:55:19.715075+0000","last_undegraded":"2024-09-12T00:55:19.715075+0000","last_fullsized":"2024-09-12T00:55:19.715075+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:19.714883+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:19.714883+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.714883+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:45.667668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'4","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.772562+0000","last_change":"2024-09-12T00:55:11.772562+0000","last_active":"2024-09-12T00:55:11.772562+0000","last_peered":"2024-09-12T00:55:11.772562+0000","last_clean":"2024-09-12T00:55:11.772562+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:55:11.772562+0000","last_undegraded":"2024-09-12T00:55:11.772562+0000","last_fullsized":"2024-09-12T00:55:11.772562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:11.772354+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:11.772354+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.772354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:25.452055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.684806+0000","last_change":"2024-09-12T00:55:06.684806+0000","last_active":"2024-09-12T00:55:06.684806+0000","last_peered":"2024-09-12T00:55:06.684806+0000","last_clean":"2024-09-12T00:55:06.684806+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:55:06.684806+0000","last_undegraded":"2024-09-12T00:55:06.684806+0000","last_fullsized":"2024-09-12T00:55:06.684806+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T00:55:06.684571+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T00:55:06.684571+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.684571+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:12.401931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'2","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.620884+0000","last_change":"2024-09-12T00:55:18.620884+0000","last_active":"2024-09-12T00:55:18.620884+0000","last_peered":"2024-09-12T00:55:18.620884+0000","last_clean":"2024-09-12T00:55:18.620884+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:55:18.620884+0000","last_undegraded":"2024-09-12T00:55:18.620884+0000","last_fullsized":"2024-09-12T00:55:18.620884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:18.620698+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:18.620698+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.620698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:52.549997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:51:40.947791+0000","last_change":"2024-09-12T00:28:17.071725+0000","last_active":"2024-09-12T00:51:40.947791+0000","last_peered":"2024-09-12T00:51:40.947791+0000","last_clean":"2024-09-12T00:51:40.947791+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:51:40.947791+0000","last_undegraded":"2024-09-12T00:51:40.947791+0000","last_fullsized":"2024-09-12T00:51:40.947791+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:28.212664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'9","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.756608+0000","last_change":"2024-09-12T00:55:09.756608+0000","last_active":"2024-09-12T00:55:09.756608+0000","last_peered":"2024-09-12T00:55:09.756608+0000","last_clean":"2024-09-12T00:55:09.756608+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:55:09.756608+0000","last_undegraded":"2024-09-12T00:55:09.756608+0000","last_fullsized":"2024-09-12T00:55:09.756608+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T00:55:09.756432+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T00:55:09.756432+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.756432+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:40.453032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21053,"num_write":14,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":121,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.651000+0000","last_change":"2024-09-12T00:55:05.651000+0000","last_active":"2024-09-12T00:55:05.651000+0000","last_peered":"2024-09-12T00:55:05.651000+0000","last_clean":"2024-09-12T00:55:05.651000+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:55:05.651000+0000","last_undegraded":"2024-09-12T00:55:05.651000+0000","last_fullsized":"2024-09-12T00:55:05.651000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T00:55:05.650820+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T00:55:05.650820+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.650820+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:21.508950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:31.299370+0000","last_change":"2024-09-12T00:55:31.299370+0000","last_active":"2024-09-12T00:55:31.299370+0000","last_peered":"2024-09-12T00:55:31.299370+0000","last_clean":"2024-09-12T00:55:31.299370+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:55:31.299370+0000","last_undegraded":"2024-09-12T00:55:31.299370+0000","last_fullsized":"2024-09-12T00:55:31.299370+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:31.299176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:31.299176+0000","last_clean_scrub_stamp":"2024-09-12T00:55:31.299176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:46.292436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.676281+0000","last_change":"2024-09-12T00:55:18.676022+0000","last_active":"2024-09-12T00:55:18.676281+0000","last_peered":"2024-09-12T00:55:18.676281+0000","last_clean":"2024-09-12T00:55:18.676281+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:55:18.676281+0000","last_undegraded":"2024-09-12T00:55:18.676281+0000","last_fullsized":"2024-09-12T00:55:18.676281+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.675818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.675818+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.675818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:37.227054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.780153+0000","last_change":"2024-09-12T00:55:14.779965+0000","last_active":"2024-09-12T00:55:14.780153+0000","last_peered":"2024-09-12T00:55:14.780153+0000","last_clean":"2024-09-12T00:55:14.780153+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:55:14.780153+0000","last_undegraded":"2024-09-12T00:55:14.780153+0000","last_fullsized":"2024-09-12T00:55:14.780153+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.779773+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.779773+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.779773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:06.125955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.661387+0000","last_change":"2024-09-12T00:55:06.661387+0000","last_active":"2024-09-12T00:55:06.661387+0000","last_peered":"2024-09-12T00:55:06.661387+0000","last_clean":"2024-09-12T00:55:06.661387+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:55:06.661387+0000","last_undegraded":"2024-09-12T00:55:06.661387+0000","last_fullsized":"2024-09-12T00:55:06.661387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:06.661170+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:06.661170+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.661170+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:34.081658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.844282+0000","last_change":"2024-09-12T00:55:14.844152+0000","last_active":"2024-09-12T00:55:14.844282+0000","last_peered":"2024-09-12T00:55:14.844282+0000","last_clean":"2024-09-12T00:55:14.844282+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:55:14.844282+0000","last_undegraded":"2024-09-12T00:55:14.844282+0000","last_fullsized":"2024-09-12T00:55:14.844282+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.843969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.843969+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.843969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:01.964336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.743124+0000","last_change":"2024-09-12T00:55:16.742863+0000","last_active":"2024-09-12T00:55:16.743124+0000","last_peered":"2024-09-12T00:55:16.743124+0000","last_clean":"2024-09-12T00:55:16.743124+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:55:16.743124+0000","last_undegraded":"2024-09-12T00:55:16.743124+0000","last_fullsized":"2024-09-12T00:55:16.743124+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:16.742631+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:16.742631+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.742631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:28.694379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'13","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.553718+0000","last_change":"2024-09-12T00:55:15.553524+0000","last_active":"2024-09-12T00:55:15.553718+0000","last_peered":"2024-09-12T00:55:15.553718+0000","last_clean":"2024-09-12T00:55:15.553718+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:55:15.553718+0000","last_undegraded":"2024-09-12T00:55:15.553718+0000","last_fullsized":"2024-09-12T00:55:15.553718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T00:55:15.553347+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T00:55:15.553347+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.553347+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:57.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":18,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:25.423304+0000","last_change":"2024-09-12T00:55:25.423304+0000","last_active":"2024-09-12T00:55:25.423304+0000","last_peered":"2024-09-12T00:55:25.423304+0000","last_clean":"2024-09-12T00:55:25.423304+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:55:25.423304+0000","last_undegraded":"2024-09-12T00:55:25.423304+0000","last_fullsized":"2024-09-12T00:55:25.423304+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'37","last_scrub_stamp":"2024-09-12T00:55:25.423129+0000","last_deep_scrub":"266'37","last_deep_scrub_stamp":"2024-09-12T00:55:25.423129+0000","last_clean_scrub_stamp":"2024-09-12T00:55:25.423129+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:51.651023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:30.960990+0000","last_change":"2024-09-12T00:39:28.136382+0000","last_active":"2024-09-12T00:52:30.960990+0000","last_peered":"2024-09-12T00:52:30.960990+0000","last_clean":"2024-09-12T00:52:30.960990+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:52:30.960990+0000","last_undegraded":"2024-09-12T00:52:30.960990+0000","last_fullsized":"2024-09-12T00:52:30.960990+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.708411+0000","last_change":"2024-09-12T00:55:20.708240+0000","last_active":"2024-09-12T00:55:20.708411+0000","last_peered":"2024-09-12T00:55:20.708411+0000","last_clean":"2024-09-12T00:55:20.708411+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:55:20.708411+0000","last_undegraded":"2024-09-12T00:55:20.708411+0000","last_fullsized":"2024-09-12T00:55:20.708411+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T00:55:20.708045+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T00:55:20.708045+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.708045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:32.275206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.705450+0000","last_change":"2024-09-12T00:55:11.705316+0000","last_active":"2024-09-12T00:55:11.705450+0000","last_peered":"2024-09-12T00:55:11.705450+0000","last_clean":"2024-09-12T00:55:11.705450+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:55:11.705450+0000","last_undegraded":"2024-09-12T00:55:11.705450+0000","last_fullsized":"2024-09-12T00:55:11.705450+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:11.705125+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:11.705125+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.705125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:16.644347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":160,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.679487+0000","last_change":"2024-09-12T00:55:06.679487+0000","last_active":"2024-09-12T00:55:06.679487+0000","last_peered":"2024-09-12T00:55:06.679487+0000","last_clean":"2024-09-12T00:55:06.679487+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:55:06.679487+0000","last_undegraded":"2024-09-12T00:55:06.679487+0000","last_fullsized":"2024-09-12T00:55:06.679487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'41","last_scrub_stamp":"2024-09-12T00:55:06.679274+0000","last_deep_scrub":"266'41","last_deep_scrub_stamp":"2024-09-12T00:55:06.679274+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.679274+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:30.604913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.795156+0000","last_change":"2024-09-12T00:55:13.795156+0000","last_active":"2024-09-12T00:55:13.795156+0000","last_peered":"2024-09-12T00:55:13.795156+0000","last_clean":"2024-09-12T00:55:13.795156+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:55:13.795156+0000","last_undegraded":"2024-09-12T00:55:13.795156+0000","last_fullsized":"2024-09-12T00:55:13.795156+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:13.794974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:13.794974+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.794974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:01.424754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:23.299101+0000","last_change":"2024-09-12T00:55:23.299101+0000","last_active":"2024-09-12T00:55:23.299101+0000","last_peered":"2024-09-12T00:55:23.299101+0000","last_clean":"2024-09-12T00:55:23.299101+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:55:23.299101+0000","last_undegraded":"2024-09-12T00:55:23.299101+0000","last_fullsized":"2024-09-12T00:55:23.299101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:23.298897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:23.298897+0000","last_clean_scrub_stamp":"2024-09-12T00:55:23.298897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:31.059131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'7","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.742406+0000","last_change":"2024-09-12T00:55:13.742221+0000","last_active":"2024-09-12T00:55:13.742406+0000","last_peered":"2024-09-12T00:55:13.742406+0000","last_clean":"2024-09-12T00:55:13.742406+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:55:13.742406+0000","last_undegraded":"2024-09-12T00:55:13.742406+0000","last_fullsized":"2024-09-12T00:55:13.742406+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:13.742049+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:13.742049+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.742049+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:19.515727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.692338+0000","last_change":"2024-09-12T00:55:08.692338+0000","last_active":"2024-09-12T00:55:08.692338+0000","last_peered":"2024-09-12T00:55:08.692338+0000","last_clean":"2024-09-12T00:55:08.692338+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:55:08.692338+0000","last_undegraded":"2024-09-12T00:55:08.692338+0000","last_fullsized":"2024-09-12T00:55:08.692338+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'27","last_scrub_stamp":"2024-09-12T00:55:08.692158+0000","last_deep_scrub":"266'27","last_deep_scrub_stamp":"2024-09-12T00:55:08.692158+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.692158+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:48.050746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:32.251592+0000","last_change":"2024-09-12T00:55:32.251592+0000","last_active":"2024-09-12T00:55:32.251592+0000","last_peered":"2024-09-12T00:55:32.251592+0000","last_clean":"2024-09-12T00:55:32.251592+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:55:32.251592+0000","last_undegraded":"2024-09-12T00:55:32.251592+0000","last_fullsized":"2024-09-12T00:55:32.251592+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:32.251407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:32.251407+0000","last_clean_scrub_stamp":"2024-09-12T00:55:32.251407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.966730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'2","reported_seq":35,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:20.982962+0000","last_change":"2024-09-12T00:28:17.078262+0000","last_active":"2024-09-12T00:54:20.982962+0000","last_peered":"2024-09-12T00:54:20.982962+0000","last_clean":"2024-09-12T00:54:20.982962+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:54:20.982962+0000","last_undegraded":"2024-09-12T00:54:20.982962+0000","last_fullsized":"2024-09-12T00:54:20.982962+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:56.107029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.692162+0000","last_change":"2024-09-12T00:55:09.692162+0000","last_active":"2024-09-12T00:55:09.692162+0000","last_peered":"2024-09-12T00:55:09.692162+0000","last_clean":"2024-09-12T00:55:09.692162+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:55:09.692162+0000","last_undegraded":"2024-09-12T00:55:09.692162+0000","last_fullsized":"2024-09-12T00:55:09.692162+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.691980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.691980+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.691980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:20.998646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":94,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.729908+0000","last_change":"2024-09-12T00:55:07.729908+0000","last_active":"2024-09-12T00:55:07.729908+0000","last_peered":"2024-09-12T00:55:07.729908+0000","last_clean":"2024-09-12T00:55:07.729908+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:55:07.729908+0000","last_undegraded":"2024-09-12T00:55:07.729908+0000","last_fullsized":"2024-09-12T00:55:07.729908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'18","last_scrub_stamp":"2024-09-12T00:55:07.729701+0000","last_deep_scrub":"266'18","last_deep_scrub_stamp":"2024-09-12T00:55:07.729701+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.729701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:38.152765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.815513+0000","last_change":"2024-09-12T00:55:17.815231+0000","last_active":"2024-09-12T00:55:17.815513+0000","last_peered":"2024-09-12T00:55:17.815513+0000","last_clean":"2024-09-12T00:55:17.815513+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:55:17.815513+0000","last_undegraded":"2024-09-12T00:55:17.815513+0000","last_fullsized":"2024-09-12T00:55:17.815513+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:17.814962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:17.814962+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.814962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:07.028085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'8","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.801386+0000","last_change":"2024-09-12T00:55:12.801386+0000","last_active":"2024-09-12T00:55:12.801386+0000","last_peered":"2024-09-12T00:55:12.801386+0000","last_clean":"2024-09-12T00:55:12.801386+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:55:12.801386+0000","last_undegraded":"2024-09-12T00:55:12.801386+0000","last_fullsized":"2024-09-12T00:55:12.801386+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T00:55:12.801203+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T00:55:12.801203+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.801203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.463086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.263682+0000","last_change":"2024-09-12T00:55:16.263682+0000","last_active":"2024-09-12T00:55:16.263682+0000","last_peered":"2024-09-12T00:55:16.263682+0000","last_clean":"2024-09-12T00:55:16.263682+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:55:16.263682+0000","last_undegraded":"2024-09-12T00:55:16.263682+0000","last_fullsized":"2024-09-12T00:55:16.263682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:16.263506+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:16.263506+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.263506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:04.116688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.655760+0000","last_change":"2024-09-12T00:55:07.655760+0000","last_active":"2024-09-12T00:55:07.655760+0000","last_peered":"2024-09-12T00:55:07.655760+0000","last_clean":"2024-09-12T00:55:07.655760+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:55:07.655760+0000","last_undegraded":"2024-09-12T00:55:07.655760+0000","last_fullsized":"2024-09-12T00:55:07.655760+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'22","last_scrub_stamp":"2024-09-12T00:55:07.655523+0000","last_deep_scrub":"266'22","last_deep_scrub_stamp":"2024-09-12T00:55:07.655523+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.655523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:11.716375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.187270+0000","last_change":"2024-09-12T00:55:13.187143+0000","last_active":"2024-09-12T00:55:13.187270+0000","last_peered":"2024-09-12T00:55:13.187270+0000","last_clean":"2024-09-12T00:55:13.187270+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:55:13.187270+0000","last_undegraded":"2024-09-12T00:55:13.187270+0000","last_fullsized":"2024-09-12T00:55:13.187270+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:13.186952+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:13.186952+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.186952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:19.346141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.588636+0000","last_change":"2024-09-12T00:55:16.588375+0000","last_active":"2024-09-12T00:55:16.588636+0000","last_peered":"2024-09-12T00:55:16.588636+0000","last_clean":"2024-09-12T00:55:16.588636+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:55:16.588636+0000","last_undegraded":"2024-09-12T00:55:16.588636+0000","last_fullsized":"2024-09-12T00:55:16.588636+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T00:55:16.588100+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T00:55:16.588100+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.588100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:52.874672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.716361+0000","last_change":"2024-09-12T00:55:12.716361+0000","last_active":"2024-09-12T00:55:12.716361+0000","last_peered":"2024-09-12T00:55:12.716361+0000","last_clean":"2024-09-12T00:55:12.716361+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:55:12.716361+0000","last_undegraded":"2024-09-12T00:55:12.716361+0000","last_fullsized":"2024-09-12T00:55:12.716361+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:12.716166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:12.716166+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.716166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:00.539699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.321305+0000","last_change":"2024-09-12T00:55:14.321305+0000","last_active":"2024-09-12T00:55:14.321305+0000","last_peered":"2024-09-12T00:55:14.321305+0000","last_clean":"2024-09-12T00:55:14.321305+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:55:14.321305+0000","last_undegraded":"2024-09-12T00:55:14.321305+0000","last_fullsized":"2024-09-12T00:55:14.321305+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'29","last_scrub_stamp":"2024-09-12T00:55:14.321114+0000","last_deep_scrub":"266'29","last_deep_scrub_stamp":"2024-09-12T00:55:14.321114+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.321114+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:04.333451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:24.723897+0000","last_change":"2024-09-12T00:55:24.723897+0000","last_active":"2024-09-12T00:55:24.723897+0000","last_peered":"2024-09-12T00:55:24.723897+0000","last_clean":"2024-09-12T00:55:24.723897+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:55:24.723897+0000","last_undegraded":"2024-09-12T00:55:24.723897+0000","last_fullsized":"2024-09-12T00:55:24.723897+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:24.723723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:24.723723+0000","last_clean_scrub_stamp":"2024-09-12T00:55:24.723723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:46.566830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'4","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.136408+0000","last_change":"2024-09-12T00:55:05.136408+0000","last_active":"2024-09-12T00:55:05.136408+0000","last_peered":"2024-09-12T00:55:05.136408+0000","last_clean":"2024-09-12T00:55:05.136408+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:55:05.136408+0000","last_undegraded":"2024-09-12T00:55:05.136408+0000","last_fullsized":"2024-09-12T00:55:05.136408+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:05.136223+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:05.136223+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.136223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:30.134780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:32.405404+0000","last_change":"2024-09-12T00:55:32.405404+0000","last_active":"2024-09-12T00:55:32.405404+0000","last_peered":"2024-09-12T00:55:32.405404+0000","last_clean":"2024-09-12T00:55:32.405404+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:55:32.405404+0000","last_undegraded":"2024-09-12T00:55:32.405404+0000","last_fullsized":"2024-09-12T00:55:32.405404+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:32.405207+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:32.405207+0000","last_clean_scrub_stamp":"2024-09-12T00:55:32.405207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:45.255600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.121114+0000","last_change":"2024-09-12T00:55:07.121114+0000","last_active":"2024-09-12T00:55:07.121114+0000","last_peered":"2024-09-12T00:55:07.121114+0000","last_clean":"2024-09-12T00:55:07.121114+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:55:07.121114+0000","last_undegraded":"2024-09-12T00:55:07.121114+0000","last_fullsized":"2024-09-12T00:55:07.121114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'11","last_scrub_stamp":"2024-09-12T00:55:07.120938+0000","last_deep_scrub":"266'11","last_deep_scrub_stamp":"2024-09-12T00:55:07.120938+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.120938+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:34.007816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.180044+0000","last_change":"2024-09-12T00:55:09.180044+0000","last_active":"2024-09-12T00:55:09.180044+0000","last_peered":"2024-09-12T00:55:09.180044+0000","last_clean":"2024-09-12T00:55:09.180044+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:55:09.180044+0000","last_undegraded":"2024-09-12T00:55:09.180044+0000","last_fullsized":"2024-09-12T00:55:09.180044+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.179784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.179784+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.179784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:38.105314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.282833+0000","last_change":"2024-09-12T00:55:22.282598+0000","last_active":"2024-09-12T00:55:22.282833+0000","last_peered":"2024-09-12T00:55:22.282833+0000","last_clean":"2024-09-12T00:55:22.282833+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:55:22.282833+0000","last_undegraded":"2024-09-12T00:55:22.282833+0000","last_fullsized":"2024-09-12T00:55:22.282833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T00:55:22.282331+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T00:55:22.282331+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.282331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:02.864341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'7","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:29.397697+0000","last_change":"2024-09-12T00:55:29.397697+0000","last_active":"2024-09-12T00:55:29.397697+0000","last_peered":"2024-09-12T00:55:29.397697+0000","last_clean":"2024-09-12T00:55:29.397697+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:55:29.397697+0000","last_undegraded":"2024-09-12T00:55:29.397697+0000","last_fullsized":"2024-09-12T00:55:29.397697+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:29.397512+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:29.397512+0000","last_clean_scrub_stamp":"2024-09-12T00:55:29.397512+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:40.800371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.736727+0000","last_change":"2024-09-12T00:55:13.736727+0000","last_active":"2024-09-12T00:55:13.736727+0000","last_peered":"2024-09-12T00:55:13.736727+0000","last_clean":"2024-09-12T00:55:13.736727+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:55:13.736727+0000","last_undegraded":"2024-09-12T00:55:13.736727+0000","last_fullsized":"2024-09-12T00:55:13.736727+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T00:55:13.736493+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T00:55:13.736493+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.736493+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:57.884773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.157652+0000","last_change":"2024-09-12T00:55:06.157652+0000","last_active":"2024-09-12T00:55:06.157652+0000","last_peered":"2024-09-12T00:55:06.157652+0000","last_clean":"2024-09-12T00:55:06.157652+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:55:06.157652+0000","last_undegraded":"2024-09-12T00:55:06.157652+0000","last_fullsized":"2024-09-12T00:55:06.157652+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.157463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.157463+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.157463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:30.183129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.320147+0000","last_change":"2024-09-12T00:55:21.320006+0000","last_active":"2024-09-12T00:55:21.320147+0000","last_peered":"2024-09-12T00:55:21.320147+0000","last_clean":"2024-09-12T00:55:21.320147+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:55:21.320147+0000","last_undegraded":"2024-09-12T00:55:21.320147+0000","last_fullsized":"2024-09-12T00:55:21.320147+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:21.319822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:21.319822+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.319822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:35.538066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.699828+0000","last_change":"2024-09-12T00:55:18.699674+0000","last_active":"2024-09-12T00:55:18.699828+0000","last_peered":"2024-09-12T00:55:18.699828+0000","last_clean":"2024-09-12T00:55:18.699828+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:55:18.699828+0000","last_undegraded":"2024-09-12T00:55:18.699828+0000","last_fullsized":"2024-09-12T00:55:18.699828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:18.699491+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:18.699491+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.699491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:31.907186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":178,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:24.400527+0000","last_change":"2024-09-12T00:55:24.400527+0000","last_active":"2024-09-12T00:55:24.400527+0000","last_peered":"2024-09-12T00:55:24.400527+0000","last_clean":"2024-09-12T00:55:24.400527+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:55:24.400527+0000","last_undegraded":"2024-09-12T00:55:24.400527+0000","last_fullsized":"2024-09-12T00:55:24.400527+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-12T00:55:24.400334+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-12T00:55:24.400334+0000","last_clean_scrub_stamp":"2024-09-12T00:55:24.400334+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:23.578240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:28.299042+0000","last_change":"2024-09-12T00:55:28.298895+0000","last_active":"2024-09-12T00:55:28.299042+0000","last_peered":"2024-09-12T00:55:28.299042+0000","last_clean":"2024-09-12T00:55:28.299042+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:55:28.299042+0000","last_undegraded":"2024-09-12T00:55:28.299042+0000","last_fullsized":"2024-09-12T00:55:28.299042+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:28.298714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:28.298714+0000","last_clean_scrub_stamp":"2024-09-12T00:55:28.298714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:18.708548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'12","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.224919+0000","last_change":"2024-09-12T00:55:10.224919+0000","last_active":"2024-09-12T00:55:10.224919+0000","last_peered":"2024-09-12T00:55:10.224919+0000","last_clean":"2024-09-12T00:55:10.224919+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:55:10.224919+0000","last_undegraded":"2024-09-12T00:55:10.224919+0000","last_fullsized":"2024-09-12T00:55:10.224919+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'12","last_scrub_stamp":"2024-09-12T00:55:10.224731+0000","last_deep_scrub":"266'12","last_deep_scrub_stamp":"2024-09-12T00:55:10.224731+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.224731+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:41.204090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":22,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.720155+0000","last_change":"2024-09-12T00:55:09.720155+0000","last_active":"2024-09-12T00:55:09.720155+0000","last_peered":"2024-09-12T00:55:09.720155+0000","last_clean":"2024-09-12T00:55:09.720155+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:55:09.720155+0000","last_undegraded":"2024-09-12T00:55:09.720155+0000","last_fullsized":"2024-09-12T00:55:09.720155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:09.719977+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:09.719977+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.719977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:00.827899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.626270+0000","last_change":"2024-09-12T00:55:04.626270+0000","last_active":"2024-09-12T00:55:04.626270+0000","last_peered":"2024-09-12T00:55:04.626270+0000","last_clean":"2024-09-12T00:55:04.626270+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:55:04.626270+0000","last_undegraded":"2024-09-12T00:55:04.626270+0000","last_fullsized":"2024-09-12T00:55:04.626270+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T00:55:04.625979+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T00:55:04.625979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.625979+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:29.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:00.952894+0000","last_change":"2024-09-12T00:39:28.134519+0000","last_active":"2024-09-12T00:52:00.952894+0000","last_peered":"2024-09-12T00:52:00.952894+0000","last_clean":"2024-09-12T00:52:00.952894+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:52:00.952894+0000","last_undegraded":"2024-09-12T00:52:00.952894+0000","last_fullsized":"2024-09-12T00:52:00.952894+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:46.950649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":31,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:10.955943+0000","last_change":"2024-09-12T00:28:17.073665+0000","last_active":"2024-09-12T00:52:10.955943+0000","last_peered":"2024-09-12T00:52:10.955943+0000","last_clean":"2024-09-12T00:52:10.955943+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:52:10.955943+0000","last_undegraded":"2024-09-12T00:52:10.955943+0000","last_fullsized":"2024-09-12T00:52:10.955943+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:28:16.009642+0000","last_clean_scrub_stamp":"2024-09-12T00:28:16.009642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:18:46.110456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'6","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:31.357622+0000","last_change":"2024-09-12T00:55:31.357622+0000","last_active":"2024-09-12T00:55:31.357622+0000","last_peered":"2024-09-12T00:55:31.357622+0000","last_clean":"2024-09-12T00:55:31.357622+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:55:31.357622+0000","last_undegraded":"2024-09-12T00:55:31.357622+0000","last_fullsized":"2024-09-12T00:55:31.357622+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T00:55:31.357397+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T00:55:31.357397+0000","last_clean_scrub_stamp":"2024-09-12T00:55:31.357397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.617279+0000","last_change":"2024-09-12T00:55:04.617279+0000","last_active":"2024-09-12T00:55:04.617279+0000","last_peered":"2024-09-12T00:55:04.617279+0000","last_clean":"2024-09-12T00:55:04.617279+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:55:04.617279+0000","last_undegraded":"2024-09-12T00:55:04.617279+0000","last_fullsized":"2024-09-12T00:55:04.617279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'42","last_scrub_stamp":"2024-09-12T00:55:04.617031+0000","last_deep_scrub":"266'42","last_deep_scrub_stamp":"2024-09-12T00:55:04.617031+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.617031+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:14.514351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'2","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:23.696762+0000","last_change":"2024-09-12T00:55:23.696762+0000","last_active":"2024-09-12T00:55:23.696762+0000","last_peered":"2024-09-12T00:55:23.696762+0000","last_clean":"2024-09-12T00:55:23.696762+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:55:23.696762+0000","last_undegraded":"2024-09-12T00:55:23.696762+0000","last_fullsized":"2024-09-12T00:55:23.696762+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:23.696570+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:23.696570+0000","last_clean_scrub_stamp":"2024-09-12T00:55:23.696570+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:46.516114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.659556+0000","last_change":"2024-09-12T00:55:19.659306+0000","last_active":"2024-09-12T00:55:19.659556+0000","last_peered":"2024-09-12T00:55:19.659556+0000","last_clean":"2024-09-12T00:55:19.659556+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:55:19.659556+0000","last_undegraded":"2024-09-12T00:55:19.659556+0000","last_fullsized":"2024-09-12T00:55:19.659556+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T00:55:19.659092+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T00:55:19.659092+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.659092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.534009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.672398+0000","last_change":"2024-09-12T00:55:08.672398+0000","last_active":"2024-09-12T00:55:08.672398+0000","last_peered":"2024-09-12T00:55:08.672398+0000","last_clean":"2024-09-12T00:55:08.672398+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:55:08.672398+0000","last_undegraded":"2024-09-12T00:55:08.672398+0000","last_fullsized":"2024-09-12T00:55:08.672398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:08.672210+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.672210+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.672210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:14.072302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.668573+0000","last_change":"2024-09-12T00:55:05.668573+0000","last_active":"2024-09-12T00:55:05.668573+0000","last_peered":"2024-09-12T00:55:05.668573+0000","last_clean":"2024-09-12T00:55:05.668573+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:55:05.668573+0000","last_undegraded":"2024-09-12T00:55:05.668573+0000","last_fullsized":"2024-09-12T00:55:05.668573+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'23","last_scrub_stamp":"2024-09-12T00:55:05.668399+0000","last_deep_scrub":"266'23","last_deep_scrub_stamp":"2024-09-12T00:55:05.668399+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.668399+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:21.157528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.697133+0000","last_change":"2024-09-12T00:55:20.697133+0000","last_active":"2024-09-12T00:55:20.697133+0000","last_peered":"2024-09-12T00:55:20.697133+0000","last_clean":"2024-09-12T00:55:20.697133+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:55:20.697133+0000","last_undegraded":"2024-09-12T00:55:20.697133+0000","last_fullsized":"2024-09-12T00:55:20.697133+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:20.696952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:20.696952+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.696952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:01.096983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'7","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:34.414977+0000","last_change":"2024-09-12T00:55:34.414977+0000","last_active":"2024-09-12T00:55:34.414977+0000","last_peered":"2024-09-12T00:55:34.414977+0000","last_clean":"2024-09-12T00:55:34.414977+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:55:34.414977+0000","last_undegraded":"2024-09-12T00:55:34.414977+0000","last_fullsized":"2024-09-12T00:55:34.414977+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:34.414743+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:34.414743+0000","last_clean_scrub_stamp":"2024-09-12T00:55:34.414743+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:39.888195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:30.396582+0000","last_change":"2024-09-12T00:55:30.396582+0000","last_active":"2024-09-12T00:55:30.396582+0000","last_peered":"2024-09-12T00:55:30.396582+0000","last_clean":"2024-09-12T00:55:30.396582+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:55:30.396582+0000","last_undegraded":"2024-09-12T00:55:30.396582+0000","last_fullsized":"2024-09-12T00:55:30.396582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:30.396403+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:30.396403+0000","last_clean_scrub_stamp":"2024-09-12T00:55:30.396403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:45.270251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:26.401278+0000","last_change":"2024-09-12T00:55:26.401278+0000","last_active":"2024-09-12T00:55:26.401278+0000","last_peered":"2024-09-12T00:55:26.401278+0000","last_clean":"2024-09-12T00:55:26.401278+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:55:26.401278+0000","last_undegraded":"2024-09-12T00:55:26.401278+0000","last_fullsized":"2024-09-12T00:55:26.401278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'43","last_scrub_stamp":"2024-09-12T00:55:26.401059+0000","last_deep_scrub":"266'43","last_deep_scrub_stamp":"2024-09-12T00:55:26.401059+0000","last_clean_scrub_stamp":"2024-09-12T00:55:26.401059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:07.313616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:30.300553+0000","last_change":"2024-09-12T00:55:30.300553+0000","last_active":"2024-09-12T00:55:30.300553+0000","last_peered":"2024-09-12T00:55:30.300553+0000","last_clean":"2024-09-12T00:55:30.300553+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:55:30.300553+0000","last_undegraded":"2024-09-12T00:55:30.300553+0000","last_fullsized":"2024-09-12T00:55:30.300553+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:30.300324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:30.300324+0000","last_clean_scrub_stamp":"2024-09-12T00:55:30.300324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:57.413437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'2","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.782501+0000","last_change":"2024-09-12T00:55:11.782238+0000","last_active":"2024-09-12T00:55:11.782501+0000","last_peered":"2024-09-12T00:55:11.782501+0000","last_clean":"2024-09-12T00:55:11.782501+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:55:11.782501+0000","last_undegraded":"2024-09-12T00:55:11.782501+0000","last_fullsized":"2024-09-12T00:55:11.782501+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:11.781949+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:11.781949+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.781949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:38.253665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'19","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.575253+0000","last_change":"2024-09-12T00:55:12.575080+0000","last_active":"2024-09-12T00:55:12.575253+0000","last_peered":"2024-09-12T00:55:12.575253+0000","last_clean":"2024-09-12T00:55:12.575253+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:55:12.575253+0000","last_undegraded":"2024-09-12T00:55:12.575253+0000","last_fullsized":"2024-09-12T00:55:12.575253+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T00:55:12.574902+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T00:55:12.574902+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.574902+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.400789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":30726,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:23.432746+0000","last_change":"2024-09-12T00:55:23.432746+0000","last_active":"2024-09-12T00:55:23.432746+0000","last_peered":"2024-09-12T00:55:23.432746+0000","last_clean":"2024-09-12T00:55:23.432746+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:55:23.432746+0000","last_undegraded":"2024-09-12T00:55:23.432746+0000","last_fullsized":"2024-09-12T00:55:23.432746+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'17","last_scrub_stamp":"2024-09-12T00:55:23.432550+0000","last_deep_scrub":"266'17","last_deep_scrub_stamp":"2024-09-12T00:55:23.432550+0000","last_clean_scrub_stamp":"2024-09-12T00:55:23.432550+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:54.976850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":20,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:52:05.954372+0000","last_change":"2024-09-12T00:39:28.135750+0000","last_active":"2024-09-12T00:52:05.954372+0000","last_peered":"2024-09-12T00:52:05.954372+0000","last_clean":"2024-09-12T00:52:05.954372+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:52:05.954372+0000","last_undegraded":"2024-09-12T00:52:05.954372+0000","last_fullsized":"2024-09-12T00:52:05.954372+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:39:27.069853+0000","last_clean_scrub_stamp":"2024-09-12T00:39:27.069853+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:33.659110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.761112+0000","last_change":"2024-09-12T00:55:15.760957+0000","last_active":"2024-09-12T00:55:15.761112+0000","last_peered":"2024-09-12T00:55:15.761112+0000","last_clean":"2024-09-12T00:55:15.761112+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:55:15.761112+0000","last_undegraded":"2024-09-12T00:55:15.761112+0000","last_fullsized":"2024-09-12T00:55:15.761112+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:15.760771+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:15.760771+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.760771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.038208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'5","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.706012+0000","last_change":"2024-09-12T00:55:07.705878+0000","last_active":"2024-09-12T00:55:07.706012+0000","last_peered":"2024-09-12T00:55:07.706012+0000","last_clean":"2024-09-12T00:55:07.706012+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:55:07.706012+0000","last_undegraded":"2024-09-12T00:55:07.706012+0000","last_fullsized":"2024-09-12T00:55:07.706012+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:07.705704+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:07.705704+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.705704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.429168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.617600+0000","last_change":"2024-09-12T00:55:03.617600+0000","last_active":"2024-09-12T00:55:03.617600+0000","last_peered":"2024-09-12T00:55:03.617600+0000","last_clean":"2024-09-12T00:55:03.617600+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:55:03.617600+0000","last_undegraded":"2024-09-12T00:55:03.617600+0000","last_fullsized":"2024-09-12T00:55:03.617600+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T00:55:03.617423+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T00:55:03.617423+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.617423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:18.987923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'262","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.990962+0000","last_change":"2024-09-12T00:54:44.990766+0000","last_active":"2024-09-12T00:54:44.990962+0000","last_peered":"2024-09-12T00:54:44.990962+0000","last_clean":"2024-09-12T00:54:44.990962+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:54:44.990962+0000","last_undegraded":"2024-09-12T00:54:44.990962+0000","last_fullsized":"2024-09-12T00:54:44.990962+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.990558+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:14.960131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":2922,"num_write":1055,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1208","reported_seq":2907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.457851+0000","last_change":"2024-09-12T00:54:49.457851+0000","last_active":"2024-09-12T00:54:49.457851+0000","last_peered":"2024-09-12T00:54:49.457851+0000","last_clean":"2024-09-12T00:54:49.457851+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:49.457851+0000","last_undegraded":"2024-09-12T00:54:49.457851+0000","last_fullsized":"2024-09-12T00:54:49.457851+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1208","last_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_deep_scrub":"266'1208","last_deep_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.457644+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:17.683296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'226","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.565552+0000","last_change":"2024-09-12T00:54:49.565409+0000","last_active":"2024-09-12T00:54:49.565552+0000","last_peered":"2024-09-12T00:54:49.565552+0000","last_clean":"2024-09-12T00:54:49.565552+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:54:49.565552+0000","last_undegraded":"2024-09-12T00:54:49.565552+0000","last_fullsized":"2024-09-12T00:54:49.565552+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.565191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:46.709139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":8607,"num_write":1041,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'457","reported_seq":2047,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.210682+0000","last_change":"2024-09-12T00:54:59.210682+0000","last_active":"2024-09-12T00:54:59.210682+0000","last_peered":"2024-09-12T00:54:59.210682+0000","last_clean":"2024-09-12T00:54:59.210682+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:54:59.210682+0000","last_undegraded":"2024-09-12T00:54:59.210682+0000","last_fullsized":"2024-09-12T00:54:59.210682+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T00:54:59.210500+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T00:54:59.210500+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.210500+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:15.276452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3035,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'205","reported_seq":825,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.572985+0000","last_change":"2024-09-12T00:54:47.572828+0000","last_active":"2024-09-12T00:54:47.572985+0000","last_peered":"2024-09-12T00:54:47.572985+0000","last_clean":"2024-09-12T00:54:47.572985+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:54:47.572985+0000","last_undegraded":"2024-09-12T00:54:47.572985+0000","last_fullsized":"2024-09-12T00:54:47.572985+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.572612+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:38.077210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":9703,"num_write":942,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'472","reported_seq":2029,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.252532+0000","last_change":"2024-09-12T00:55:00.252532+0000","last_active":"2024-09-12T00:55:00.252532+0000","last_peered":"2024-09-12T00:55:00.252532+0000","last_clean":"2024-09-12T00:55:00.252532+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:55:00.252532+0000","last_undegraded":"2024-09-12T00:55:00.252532+0000","last_fullsized":"2024-09-12T00:55:00.252532+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'472","last_scrub_stamp":"2024-09-12T00:55:00.252348+0000","last_deep_scrub":"266'472","last_deep_scrub_stamp":"2024-09-12T00:55:00.252348+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.252348+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:31.620465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'172","reported_seq":802,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.805793+0000","last_change":"2024-09-12T00:54:42.805793+0000","last_active":"2024-09-12T00:54:42.805793+0000","last_peered":"2024-09-12T00:54:42.805793+0000","last_clean":"2024-09-12T00:54:42.805793+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:54:42.805793+0000","last_undegraded":"2024-09-12T00:54:42.805793+0000","last_fullsized":"2024-09-12T00:54:42.805793+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'172","last_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_deep_scrub":"266'172","last_deep_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.805574+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:52.082618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3723389,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":16186,"num_write":899,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'824","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.771399+0000","last_change":"2024-09-12T00:54:52.771399+0000","last_active":"2024-09-12T00:54:52.771399+0000","last_peered":"2024-09-12T00:54:52.771399+0000","last_clean":"2024-09-12T00:54:52.771399+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:54:52.771399+0000","last_undegraded":"2024-09-12T00:54:52.771399+0000","last_fullsized":"2024-09-12T00:54:52.771399+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'824","last_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_deep_scrub":"266'824","last_deep_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.771212+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:46.148911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'190","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.992323+0000","last_change":"2024-09-12T00:54:43.992323+0000","last_active":"2024-09-12T00:54:43.992323+0000","last_peered":"2024-09-12T00:54:43.992323+0000","last_clean":"2024-09-12T00:54:43.992323+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:54:43.992323+0000","last_undegraded":"2024-09-12T00:54:43.992323+0000","last_fullsized":"2024-09-12T00:54:43.992323+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.991947+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:36.462643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569693,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":16314,"num_write":910,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'801","reported_seq":2293,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.039117+0000","last_change":"2024-09-12T00:54:48.039117+0000","last_active":"2024-09-12T00:54:48.039117+0000","last_peered":"2024-09-12T00:54:48.039117+0000","last_clean":"2024-09-12T00:54:48.039117+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:54:48.039117+0000","last_undegraded":"2024-09-12T00:54:48.039117+0000","last_fullsized":"2024-09-12T00:54:48.039117+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.038929+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:45.582305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'177","reported_seq":787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.699958+0000","last_change":"2024-09-12T00:54:39.699958+0000","last_active":"2024-09-12T00:54:39.699958+0000","last_peered":"2024-09-12T00:54:39.699958+0000","last_clean":"2024-09-12T00:54:39.699958+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:39.699958+0000","last_undegraded":"2024-09-12T00:54:39.699958+0000","last_fullsized":"2024-09-12T00:54:39.699958+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.699741+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.796747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":30215,"num_write":846,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'392","reported_seq":1916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.963106+0000","last_change":"2024-09-12T00:54:55.962955+0000","last_active":"2024-09-12T00:54:55.963106+0000","last_peered":"2024-09-12T00:54:55.963106+0000","last_clean":"2024-09-12T00:54:55.963106+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:54:55.963106+0000","last_undegraded":"2024-09-12T00:54:55.963106+0000","last_fullsized":"2024-09-12T00:54:55.963106+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.962710+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:54.934059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'229","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.012358+0000","last_change":"2024-09-12T00:54:40.012358+0000","last_active":"2024-09-12T00:54:40.012358+0000","last_peered":"2024-09-12T00:54:40.012358+0000","last_clean":"2024-09-12T00:54:40.012358+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:54:40.012358+0000","last_undegraded":"2024-09-12T00:54:40.012358+0000","last_fullsized":"2024-09-12T00:54:40.012358+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.012124+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:25.409967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924437,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":17813,"num_write":1032,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'991","reported_seq":2518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.695219+0000","last_change":"2024-09-12T00:54:48.695069+0000","last_active":"2024-09-12T00:54:48.695219+0000","last_peered":"2024-09-12T00:54:48.695219+0000","last_clean":"2024-09-12T00:54:48.695219+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:54:48.695219+0000","last_undegraded":"2024-09-12T00:54:48.695219+0000","last_fullsized":"2024-09-12T00:54:48.695219+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'991","last_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_deep_scrub":"266'991","last_deep_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.694882+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":900,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:30.875835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'182","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.568654+0000","last_change":"2024-09-12T00:54:48.568654+0000","last_active":"2024-09-12T00:54:48.568654+0000","last_peered":"2024-09-12T00:54:48.568654+0000","last_clean":"2024-09-12T00:54:48.568654+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:54:48.568654+0000","last_undegraded":"2024-09-12T00:54:48.568654+0000","last_fullsized":"2024-09-12T00:54:48.568654+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.568387+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:29.536238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":351,"num_read_kb":20841,"num_write":801,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2410,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.505498+0000","last_change":"2024-09-12T00:54:58.505321+0000","last_active":"2024-09-12T00:54:58.505498+0000","last_peered":"2024-09-12T00:54:58.505498+0000","last_clean":"2024-09-12T00:54:58.505498+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:54:58.505498+0000","last_undegraded":"2024-09-12T00:54:58.505498+0000","last_fullsized":"2024-09-12T00:54:58.505498+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'826","last_scrub_stamp":"2024-09-12T00:54:58.505112+0000","last_deep_scrub":"266'826","last_deep_scrub_stamp":"2024-09-12T00:54:58.505112+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.505112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:50.859376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'813","reported_seq":2367,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.177379+0000","last_change":"2024-09-12T00:54:58.177379+0000","last_active":"2024-09-12T00:54:58.177379+0000","last_peered":"2024-09-12T00:54:58.177379+0000","last_clean":"2024-09-12T00:54:58.177379+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:58.177379+0000","last_undegraded":"2024-09-12T00:54:58.177379+0000","last_fullsized":"2024-09-12T00:54:58.177379+0000","mapping_epoch":27,"log_start":"266'801","ondisk_log_start":"266'801","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'813","last_scrub_stamp":"2024-09-12T00:54:58.177199+0000","last_deep_scrub":"266'813","last_deep_scrub_stamp":"2024-09-12T00:54:58.177199+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.177199+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":801,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:36.178190+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'281","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.283023+0000","last_change":"2024-09-12T00:54:40.282873+0000","last_active":"2024-09-12T00:54:40.283023+0000","last_peered":"2024-09-12T00:54:40.283023+0000","last_clean":"2024-09-12T00:54:40.283023+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:54:40.283023+0000","last_undegraded":"2024-09-12T00:54:40.283023+0000","last_fullsized":"2024-09-12T00:54:40.283023+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'281","last_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_deep_scrub":"266'281","last_deep_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.282649+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:52.630575+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351099,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":931,"num_read_kb":25081,"num_write":1230,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2594,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.064930+0000","last_change":"2024-09-12T00:54:47.064930+0000","last_active":"2024-09-12T00:54:47.064930+0000","last_peered":"2024-09-12T00:54:47.064930+0000","last_clean":"2024-09-12T00:54:47.064930+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:47.064930+0000","last_undegraded":"2024-09-12T00:54:47.064930+0000","last_fullsized":"2024-09-12T00:54:47.064930+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1096","last_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_deep_scrub":"266'1096","last_deep_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.064751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:16.284275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'183","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.027292+0000","last_change":"2024-09-12T00:54:41.027152+0000","last_active":"2024-09-12T00:54:41.027292+0000","last_peered":"2024-09-12T00:54:41.027292+0000","last_clean":"2024-09-12T00:54:41.027292+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:41.027292+0000","last_undegraded":"2024-09-12T00:54:41.027292+0000","last_fullsized":"2024-09-12T00:54:41.027292+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.026921+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:42.983840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":23009,"num_write":868,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'442","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.423768+0000","last_change":"2024-09-12T00:54:45.423768+0000","last_active":"2024-09-12T00:54:45.423768+0000","last_peered":"2024-09-12T00:54:45.423768+0000","last_clean":"2024-09-12T00:54:45.423768+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:45.423768+0000","last_undegraded":"2024-09-12T00:54:45.423768+0000","last_fullsized":"2024-09-12T00:54:45.423768+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'442","last_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_deep_scrub":"266'442","last_deep_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.423598+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:38.014555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'192","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.994296+0000","last_change":"2024-09-12T00:54:41.994046+0000","last_active":"2024-09-12T00:54:41.994296+0000","last_peered":"2024-09-12T00:54:41.994296+0000","last_clean":"2024-09-12T00:54:41.994296+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:54:41.994296+0000","last_undegraded":"2024-09-12T00:54:41.994296+0000","last_fullsized":"2024-09-12T00:54:41.994296+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'192","last_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_deep_scrub":"266'192","last_deep_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.993748+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:48.875430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129095,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":15824,"num_write":919,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'555","reported_seq":2164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.584874+0000","last_change":"2024-09-12T00:54:51.584583+0000","last_active":"2024-09-12T00:54:51.584874+0000","last_peered":"2024-09-12T00:54:51.584874+0000","last_clean":"2024-09-12T00:54:51.584874+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:54:51.584874+0000","last_undegraded":"2024-09-12T00:54:51.584874+0000","last_fullsized":"2024-09-12T00:54:51.584874+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'555","last_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_deep_scrub":"266'555","last_deep_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.584300+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:27.384007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":877,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'211","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.978919+0000","last_change":"2024-09-12T00:54:42.978773+0000","last_active":"2024-09-12T00:54:42.978919+0000","last_peered":"2024-09-12T00:54:42.978919+0000","last_clean":"2024-09-12T00:54:42.978919+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:54:42.978919+0000","last_undegraded":"2024-09-12T00:54:42.978919+0000","last_fullsized":"2024-09-12T00:54:42.978919+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.978525+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:06.511163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924468,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":26404,"num_write":991,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'629","reported_seq":2260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.506916+0000","last_change":"2024-09-12T00:54:57.506768+0000","last_active":"2024-09-12T00:54:57.506916+0000","last_peered":"2024-09-12T00:54:57.506916+0000","last_clean":"2024-09-12T00:54:57.506916+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:54:57.506916+0000","last_undegraded":"2024-09-12T00:54:57.506916+0000","last_fullsized":"2024-09-12T00:54:57.506916+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'629","last_scrub_stamp":"2024-09-12T00:54:57.506590+0000","last_deep_scrub":"266'629","last_deep_scrub_stamp":"2024-09-12T00:54:57.506590+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.506590+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.590029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'186","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.583910+0000","last_change":"2024-09-12T00:54:44.583757+0000","last_active":"2024-09-12T00:54:44.583910+0000","last_peered":"2024-09-12T00:54:44.583910+0000","last_clean":"2024-09-12T00:54:44.583910+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:54:44.583910+0000","last_undegraded":"2024-09-12T00:54:44.583910+0000","last_fullsized":"2024-09-12T00:54:44.583910+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.583505+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:41.416586+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":395,"num_read_kb":19556,"num_write":891,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1216","reported_seq":2921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.382229+0000","last_change":"2024-09-12T00:54:46.381975+0000","last_active":"2024-09-12T00:54:46.382229+0000","last_peered":"2024-09-12T00:54:46.382229+0000","last_clean":"2024-09-12T00:54:46.382229+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:46.382229+0000","last_undegraded":"2024-09-12T00:54:46.382229+0000","last_fullsized":"2024-09-12T00:54:46.382229+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1216","last_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_deep_scrub":"266'1216","last_deep_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.381745+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:02.347559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2038,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'206","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.526531+0000","last_change":"2024-09-12T00:54:43.526531+0000","last_active":"2024-09-12T00:54:43.526531+0000","last_peered":"2024-09-12T00:54:43.526531+0000","last_clean":"2024-09-12T00:54:43.526531+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:43.526531+0000","last_undegraded":"2024-09-12T00:54:43.526531+0000","last_fullsized":"2024-09-12T00:54:43.526531+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.526312+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:10.785471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":13603,"num_write":999,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'159","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.155970+0000","last_change":"2024-09-12T00:55:03.155812+0000","last_active":"2024-09-12T00:55:03.155970+0000","last_peered":"2024-09-12T00:55:03.155970+0000","last_clean":"2024-09-12T00:55:03.155970+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:55:03.155970+0000","last_undegraded":"2024-09-12T00:55:03.155970+0000","last_fullsized":"2024-09-12T00:55:03.155970+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'159","last_scrub_stamp":"2024-09-12T00:55:03.155627+0000","last_deep_scrub":"266'159","last_deep_scrub_stamp":"2024-09-12T00:55:03.155627+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.155627+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:21.467016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'432","reported_seq":1957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.583276+0000","last_change":"2024-09-12T00:54:49.583276+0000","last_active":"2024-09-12T00:54:49.583276+0000","last_peered":"2024-09-12T00:54:49.583276+0000","last_clean":"2024-09-12T00:54:49.583276+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:54:49.583276+0000","last_undegraded":"2024-09-12T00:54:49.583276+0000","last_fullsized":"2024-09-12T00:54:49.583276+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'432","last_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_deep_scrub":"266'432","last_deep_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.583097+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:25.325862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'200","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.527392+0000","last_change":"2024-09-12T00:54:39.527392+0000","last_active":"2024-09-12T00:54:39.527392+0000","last_peered":"2024-09-12T00:54:39.527392+0000","last_clean":"2024-09-12T00:54:39.527392+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:54:39.527392+0000","last_undegraded":"2024-09-12T00:54:39.527392+0000","last_fullsized":"2024-09-12T00:54:39.527392+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.527188+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.380120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1954,"num_write":1014,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.240769+0000","last_change":"2024-09-12T00:55:05.240645+0000","last_active":"2024-09-12T00:55:05.240769+0000","last_peered":"2024-09-12T00:55:05.240769+0000","last_clean":"2024-09-12T00:55:05.240769+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:55:05.240769+0000","last_undegraded":"2024-09-12T00:55:05.240769+0000","last_fullsized":"2024-09-12T00:55:05.240769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:05.240468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:05.240468+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.240468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:34.522701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'206","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.674577+0000","last_change":"2024-09-12T00:55:04.674338+0000","last_active":"2024-09-12T00:55:04.674577+0000","last_peered":"2024-09-12T00:55:04.674577+0000","last_clean":"2024-09-12T00:55:04.674577+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:55:04.674577+0000","last_undegraded":"2024-09-12T00:55:04.674577+0000","last_fullsized":"2024-09-12T00:55:04.674577+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:55:04.674010+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:55:04.674010+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.674010+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:58.102887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":272,"num_read_kb":332,"num_write":160,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.613108+0000","last_change":"2024-09-12T00:55:00.612871+0000","last_active":"2024-09-12T00:55:00.613108+0000","last_peered":"2024-09-12T00:55:00.613108+0000","last_clean":"2024-09-12T00:55:00.613108+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:55:00.613108+0000","last_undegraded":"2024-09-12T00:55:00.613108+0000","last_fullsized":"2024-09-12T00:55:00.613108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:00.612535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:00.612535+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.612535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.509961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2476","reported_seq":4377,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.652400+0000","last_change":"2024-09-12T00:55:05.652238+0000","last_active":"2024-09-12T00:55:05.652400+0000","last_peered":"2024-09-12T00:55:05.652400+0000","last_clean":"2024-09-12T00:55:05.652400+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:55:05.652400+0000","last_undegraded":"2024-09-12T00:55:05.652400+0000","last_fullsized":"2024-09-12T00:55:05.652400+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2476","last_scrub_stamp":"2024-09-12T00:55:05.652034+0000","last_deep_scrub":"266'2476","last_deep_scrub_stamp":"2024-09-12T00:55:05.652034+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.652034+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:50.117470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'466","reported_seq":1923,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.189748+0000","last_change":"2024-09-12T00:54:55.189586+0000","last_active":"2024-09-12T00:54:55.189748+0000","last_peered":"2024-09-12T00:54:55.189748+0000","last_clean":"2024-09-12T00:54:55.189748+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:55.189748+0000","last_undegraded":"2024-09-12T00:54:55.189748+0000","last_fullsized":"2024-09-12T00:54:55.189748+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'466","last_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_deep_scrub":"266'466","last_deep_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.189400+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.744860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'244","reported_seq":940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.557769+0000","last_change":"2024-09-12T00:54:37.557769+0000","last_active":"2024-09-12T00:54:37.557769+0000","last_peered":"2024-09-12T00:54:37.557769+0000","last_clean":"2024-09-12T00:54:37.557769+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:54:37.557769+0000","last_undegraded":"2024-09-12T00:54:37.557769+0000","last_fullsized":"2024-09-12T00:54:37.557769+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'244","last_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_deep_scrub":"266'244","last_deep_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.557554+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:58.369323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49242,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":71900,"num_write":1168,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.780257+0000","last_change":"2024-09-12T00:54:56.780257+0000","last_active":"2024-09-12T00:54:56.780257+0000","last_peered":"2024-09-12T00:54:56.780257+0000","last_clean":"2024-09-12T00:54:56.780257+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:54:56.780257+0000","last_undegraded":"2024-09-12T00:54:56.780257+0000","last_fullsized":"2024-09-12T00:54:56.780257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:56.780049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:56.780049+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.780049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:46.069418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'95","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.582012+0000","last_change":"2024-09-12T00:54:55.581870+0000","last_active":"2024-09-12T00:54:55.582012+0000","last_peered":"2024-09-12T00:54:55.582012+0000","last_clean":"2024-09-12T00:54:55.582012+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:54:55.582012+0000","last_undegraded":"2024-09-12T00:54:55.582012+0000","last_fullsized":"2024-09-12T00:54:55.582012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'95","last_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_deep_scrub":"266'95","last_deep_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.581679+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:01.848720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.574342+0000","last_change":"2024-09-12T00:55:01.574205+0000","last_active":"2024-09-12T00:55:01.574342+0000","last_peered":"2024-09-12T00:55:01.574342+0000","last_clean":"2024-09-12T00:55:01.574342+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:55:01.574342+0000","last_undegraded":"2024-09-12T00:55:01.574342+0000","last_fullsized":"2024-09-12T00:55:01.574342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:01.574021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:01.574021+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.574021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.759800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'161","reported_seq":679,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.681813+0000","last_change":"2024-09-12T00:55:05.681813+0000","last_active":"2024-09-12T00:55:05.681813+0000","last_peered":"2024-09-12T00:55:05.681813+0000","last_clean":"2024-09-12T00:55:05.681813+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:55:05.681813+0000","last_undegraded":"2024-09-12T00:55:05.681813+0000","last_fullsized":"2024-09-12T00:55:05.681813+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'161","last_scrub_stamp":"2024-09-12T00:55:05.681606+0000","last_deep_scrub":"266'161","last_deep_scrub_stamp":"2024-09-12T00:55:05.681606+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.681606+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:52.851058+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'568","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.496229+0000","last_change":"2024-09-12T00:54:55.496091+0000","last_active":"2024-09-12T00:54:55.496229+0000","last_peered":"2024-09-12T00:54:55.496229+0000","last_clean":"2024-09-12T00:54:55.496229+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:54:55.496229+0000","last_undegraded":"2024-09-12T00:54:55.496229+0000","last_fullsized":"2024-09-12T00:54:55.496229+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'568","last_scrub_stamp":"2024-09-12T00:54:55.495889+0000","last_deep_scrub":"266'568","last_deep_scrub_stamp":"2024-09-12T00:54:55.495889+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.495889+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:02.338433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'235","reported_seq":875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.252201+0000","last_change":"2024-09-12T00:54:44.252201+0000","last_active":"2024-09-12T00:54:44.252201+0000","last_peered":"2024-09-12T00:54:44.252201+0000","last_clean":"2024-09-12T00:54:44.252201+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:54:44.252201+0000","last_undegraded":"2024-09-12T00:54:44.252201+0000","last_fullsized":"2024-09-12T00:54:44.252201+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.251990+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:21.780768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":11769,"num_write":1011,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.788483+0000","last_change":"2024-09-12T00:54:57.788234+0000","last_active":"2024-09-12T00:54:57.788483+0000","last_peered":"2024-09-12T00:54:57.788483+0000","last_clean":"2024-09-12T00:54:57.788483+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:54:57.788483+0000","last_undegraded":"2024-09-12T00:54:57.788483+0000","last_fullsized":"2024-09-12T00:54:57.788483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.788032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.788032+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.788032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:57.817885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'135","reported_seq":690,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.716139+0000","last_change":"2024-09-12T00:55:03.716139+0000","last_active":"2024-09-12T00:55:03.716139+0000","last_peered":"2024-09-12T00:55:03.716139+0000","last_clean":"2024-09-12T00:55:03.716139+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:55:03.716139+0000","last_undegraded":"2024-09-12T00:55:03.716139+0000","last_fullsized":"2024-09-12T00:55:03.716139+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'135","last_scrub_stamp":"2024-09-12T00:55:03.715942+0000","last_deep_scrub":"266'135","last_deep_scrub_stamp":"2024-09-12T00:55:03.715942+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.715942+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:21.099760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'780","reported_seq":2226,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.256781+0000","last_change":"2024-09-12T00:55:15.256620+0000","last_active":"2024-09-12T00:55:15.256781+0000","last_peered":"2024-09-12T00:55:15.256781+0000","last_clean":"2024-09-12T00:55:15.256781+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:55:15.256781+0000","last_undegraded":"2024-09-12T00:55:15.256781+0000","last_fullsized":"2024-09-12T00:55:15.256781+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'780","last_scrub_stamp":"2024-09-12T00:55:15.256431+0000","last_deep_scrub":"266'780","last_deep_scrub_stamp":"2024-09-12T00:55:15.256431+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.256431+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:50.511293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'220","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.633267+0000","last_change":"2024-09-12T00:55:02.633267+0000","last_active":"2024-09-12T00:55:02.633267+0000","last_peered":"2024-09-12T00:55:02.633267+0000","last_clean":"2024-09-12T00:55:02.633267+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:55:02.633267+0000","last_undegraded":"2024-09-12T00:55:02.633267+0000","last_fullsized":"2024-09-12T00:55:02.633267+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'220","last_scrub_stamp":"2024-09-12T00:55:02.633094+0000","last_deep_scrub":"266'220","last_deep_scrub_stamp":"2024-09-12T00:55:02.633094+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.633094+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:18.981830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'341","reported_seq":1788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.481597+0000","last_change":"2024-09-12T00:54:52.481419+0000","last_active":"2024-09-12T00:54:52.481597+0000","last_peered":"2024-09-12T00:54:52.481597+0000","last_clean":"2024-09-12T00:54:52.481597+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:54:52.481597+0000","last_undegraded":"2024-09-12T00:54:52.481597+0000","last_fullsized":"2024-09-12T00:54:52.481597+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'341","last_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_deep_scrub":"266'341","last_deep_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.481235+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.223578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'204","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.252728+0000","last_change":"2024-09-12T00:54:36.252728+0000","last_active":"2024-09-12T00:54:36.252728+0000","last_peered":"2024-09-12T00:54:36.252728+0000","last_clean":"2024-09-12T00:54:36.252728+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:54:36.252728+0000","last_undegraded":"2024-09-12T00:54:36.252728+0000","last_fullsized":"2024-09-12T00:54:36.252728+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.252593+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:55.096253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5525,"num_write":929,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.214764+0000","last_change":"2024-09-12T00:55:06.214591+0000","last_active":"2024-09-12T00:55:06.214764+0000","last_peered":"2024-09-12T00:55:06.214764+0000","last_clean":"2024-09-12T00:55:06.214764+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:55:06.214764+0000","last_undegraded":"2024-09-12T00:55:06.214764+0000","last_fullsized":"2024-09-12T00:55:06.214764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.214415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.214415+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.214415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:10.611172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'125","reported_seq":704,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.736922+0000","last_change":"2024-09-12T00:54:54.736749+0000","last_active":"2024-09-12T00:54:54.736922+0000","last_peered":"2024-09-12T00:54:54.736922+0000","last_clean":"2024-09-12T00:54:54.736922+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:54.736922+0000","last_undegraded":"2024-09-12T00:54:54.736922+0000","last_fullsized":"2024-09-12T00:54:54.736922+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'125","last_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_deep_scrub":"266'125","last_deep_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.736531+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:19.668088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":150,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'791","reported_seq":2268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.269631+0000","last_change":"2024-09-12T00:55:11.269631+0000","last_active":"2024-09-12T00:55:11.269631+0000","last_peered":"2024-09-12T00:55:11.269631+0000","last_clean":"2024-09-12T00:55:11.269631+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:55:11.269631+0000","last_undegraded":"2024-09-12T00:55:11.269631+0000","last_fullsized":"2024-09-12T00:55:11.269631+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T00:55:11.269441+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T00:55:11.269441+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.269441+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:34.272360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'541","reported_seq":2425,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.233737+0000","last_change":"2024-09-12T00:54:53.233588+0000","last_active":"2024-09-12T00:54:53.233737+0000","last_peered":"2024-09-12T00:54:53.233737+0000","last_clean":"2024-09-12T00:54:53.233737+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:54:53.233737+0000","last_undegraded":"2024-09-12T00:54:53.233737+0000","last_fullsized":"2024-09-12T00:54:53.233737+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'541","last_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_deep_scrub":"266'541","last_deep_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.233406+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:22.797998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'243","reported_seq":908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.022640+0000","last_change":"2024-09-12T00:54:37.022589+0000","last_active":"2024-09-12T00:54:37.022640+0000","last_peered":"2024-09-12T00:54:37.022640+0000","last_clean":"2024-09-12T00:54:37.022640+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:54:37.022640+0000","last_undegraded":"2024-09-12T00:54:37.022640+0000","last_fullsized":"2024-09-12T00:54:37.022640+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.022508+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:27.678475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639369,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":593,"num_read_kb":40518,"num_write":1099,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.463094+0000","last_change":"2024-09-12T00:54:52.462947+0000","last_active":"2024-09-12T00:54:52.463094+0000","last_peered":"2024-09-12T00:54:52.463094+0000","last_clean":"2024-09-12T00:54:52.463094+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:54:52.463094+0000","last_undegraded":"2024-09-12T00:54:52.463094+0000","last_fullsized":"2024-09-12T00:54:52.463094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.462775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.499387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'229","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.012234+0000","last_change":"2024-09-12T00:54:53.012090+0000","last_active":"2024-09-12T00:54:53.012234+0000","last_peered":"2024-09-12T00:54:53.012234+0000","last_clean":"2024-09-12T00:54:53.012234+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:54:53.012234+0000","last_undegraded":"2024-09-12T00:54:53.012234+0000","last_fullsized":"2024-09-12T00:54:53.012234+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.011878+0000","objects_scrubbed":10,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:32.987361+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":300,"num_read_kb":365,"num_write":178,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.649950+0000","last_change":"2024-09-12T00:55:02.649950+0000","last_active":"2024-09-12T00:55:02.649950+0000","last_peered":"2024-09-12T00:55:02.649950+0000","last_clean":"2024-09-12T00:55:02.649950+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:55:02.649950+0000","last_undegraded":"2024-09-12T00:55:02.649950+0000","last_fullsized":"2024-09-12T00:55:02.649950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.649779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.649779+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.649779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:36.061666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'547","reported_seq":1381,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.636228+0000","last_change":"2024-09-12T00:55:00.636228+0000","last_active":"2024-09-12T00:55:00.636228+0000","last_peered":"2024-09-12T00:55:00.636228+0000","last_clean":"2024-09-12T00:55:00.636228+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:55:00.636228+0000","last_undegraded":"2024-09-12T00:55:00.636228+0000","last_fullsized":"2024-09-12T00:55:00.636228+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'547","last_scrub_stamp":"2024-09-12T00:55:00.636015+0000","last_deep_scrub":"266'547","last_deep_scrub_stamp":"2024-09-12T00:55:00.636015+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.636015+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:11.319690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'848","reported_seq":2500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.378138+0000","last_change":"2024-09-12T00:54:43.377977+0000","last_active":"2024-09-12T00:54:43.378138+0000","last_peered":"2024-09-12T00:54:43.378138+0000","last_clean":"2024-09-12T00:54:43.378138+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:54:43.378138+0000","last_undegraded":"2024-09-12T00:54:43.378138+0000","last_fullsized":"2024-09-12T00:54:43.378138+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'848","last_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_deep_scrub":"266'848","last_deep_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.377796+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:14.837239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":722,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'191","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.713942+0000","last_change":"2024-09-12T00:54:37.713942+0000","last_active":"2024-09-12T00:54:37.713942+0000","last_peered":"2024-09-12T00:54:37.713942+0000","last_clean":"2024-09-12T00:54:37.713942+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:37.713942+0000","last_undegraded":"2024-09-12T00:54:37.713942+0000","last_fullsized":"2024-09-12T00:54:37.713942+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.713849+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.923192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399155,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":818,"num_read_kb":32535,"num_write":884,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.551937+0000","last_change":"2024-09-12T00:54:52.551709+0000","last_active":"2024-09-12T00:54:52.551937+0000","last_peered":"2024-09-12T00:54:52.551937+0000","last_clean":"2024-09-12T00:54:52.551937+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:54:52.551937+0000","last_undegraded":"2024-09-12T00:54:52.551937+0000","last_fullsized":"2024-09-12T00:54:52.551937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.551408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.893833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'134","reported_seq":718,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.735836+0000","last_change":"2024-09-12T00:55:01.735836+0000","last_active":"2024-09-12T00:55:01.735836+0000","last_peered":"2024-09-12T00:55:01.735836+0000","last_clean":"2024-09-12T00:55:01.735836+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:55:01.735836+0000","last_undegraded":"2024-09-12T00:55:01.735836+0000","last_fullsized":"2024-09-12T00:55:01.735836+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:55:01.735648+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:55:01.735648+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.735648+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:25.065258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":236,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.620724+0000","last_change":"2024-09-12T00:55:08.620579+0000","last_active":"2024-09-12T00:55:08.620724+0000","last_peered":"2024-09-12T00:55:08.620724+0000","last_clean":"2024-09-12T00:55:08.620724+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:55:08.620724+0000","last_undegraded":"2024-09-12T00:55:08.620724+0000","last_fullsized":"2024-09-12T00:55:08.620724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:08.620388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:08.620388+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.620388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:01.875295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'145","reported_seq":706,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.626619+0000","last_change":"2024-09-12T00:55:02.626619+0000","last_active":"2024-09-12T00:55:02.626619+0000","last_peered":"2024-09-12T00:55:02.626619+0000","last_clean":"2024-09-12T00:55:02.626619+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:55:02.626619+0000","last_undegraded":"2024-09-12T00:55:02.626619+0000","last_fullsized":"2024-09-12T00:55:02.626619+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'145","last_scrub_stamp":"2024-09-12T00:55:02.626426+0000","last_deep_scrub":"266'145","last_deep_scrub_stamp":"2024-09-12T00:55:02.626426+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.626426+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:50.334371+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'473","reported_seq":1974,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.801043+0000","last_change":"2024-09-12T00:54:43.800905+0000","last_active":"2024-09-12T00:54:43.801043+0000","last_peered":"2024-09-12T00:54:43.801043+0000","last_clean":"2024-09-12T00:54:43.801043+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:54:43.801043+0000","last_undegraded":"2024-09-12T00:54:43.801043+0000","last_fullsized":"2024-09-12T00:54:43.801043+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.800712+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:56.152735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'169","reported_seq":791,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.292864+0000","last_change":"2024-09-12T00:54:43.292864+0000","last_active":"2024-09-12T00:54:43.292864+0000","last_peered":"2024-09-12T00:54:43.292864+0000","last_clean":"2024-09-12T00:54:43.292864+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:54:43.292864+0000","last_undegraded":"2024-09-12T00:54:43.292864+0000","last_fullsized":"2024-09-12T00:54:43.292864+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'169","last_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_deep_scrub":"266'169","last_deep_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.292636+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:50.241174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263229,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":53604,"num_write":798,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.466853+0000","last_change":"2024-09-12T00:54:59.466853+0000","last_active":"2024-09-12T00:54:59.466853+0000","last_peered":"2024-09-12T00:54:59.466853+0000","last_clean":"2024-09-12T00:54:59.466853+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:54:59.466853+0000","last_undegraded":"2024-09-12T00:54:59.466853+0000","last_fullsized":"2024-09-12T00:54:59.466853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.466666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.466666+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.466666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.960894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'174","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.204352+0000","last_change":"2024-09-12T00:55:08.204100+0000","last_active":"2024-09-12T00:55:08.204352+0000","last_peered":"2024-09-12T00:55:08.204352+0000","last_clean":"2024-09-12T00:55:08.204352+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:55:08.204352+0000","last_undegraded":"2024-09-12T00:55:08.204352+0000","last_fullsized":"2024-09-12T00:55:08.204352+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'174","last_scrub_stamp":"2024-09-12T00:55:08.203826+0000","last_deep_scrub":"266'174","last_deep_scrub_stamp":"2024-09-12T00:55:08.203826+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.203826+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:09.697458+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":225,"num_read_kb":295,"num_write":126,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'790","reported_seq":4507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.375288+0000","last_change":"2024-09-12T00:55:06.375133+0000","last_active":"2024-09-12T00:55:06.375288+0000","last_peered":"2024-09-12T00:55:06.375288+0000","last_clean":"2024-09-12T00:55:06.375288+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:55:06.375288+0000","last_undegraded":"2024-09-12T00:55:06.375288+0000","last_fullsized":"2024-09-12T00:55:06.375288+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'790","last_scrub_stamp":"2024-09-12T00:55:06.374948+0000","last_deep_scrub":"266'790","last_deep_scrub_stamp":"2024-09-12T00:55:06.374948+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.374948+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:20.260953+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.674167+0000","last_change":"2024-09-12T00:55:04.674028+0000","last_active":"2024-09-12T00:55:04.674167+0000","last_peered":"2024-09-12T00:55:04.674167+0000","last_clean":"2024-09-12T00:55:04.674167+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:55:04.674167+0000","last_undegraded":"2024-09-12T00:55:04.674167+0000","last_fullsized":"2024-09-12T00:55:04.674167+0000","mapping_epoch":35,"log_start":"266'101","ondisk_log_start":"266'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'112","last_scrub_stamp":"2024-09-12T00:55:04.673811+0000","last_deep_scrub":"266'112","last_deep_scrub_stamp":"2024-09-12T00:55:04.673811+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.673811+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:11.571983+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.521426+0000","last_change":"2024-09-12T00:54:50.521426+0000","last_active":"2024-09-12T00:54:50.521426+0000","last_peered":"2024-09-12T00:54:50.521426+0000","last_clean":"2024-09-12T00:54:50.521426+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:54:50.521426+0000","last_undegraded":"2024-09-12T00:54:50.521426+0000","last_fullsized":"2024-09-12T00:54:50.521426+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.521244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:58.029014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'206","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.986855+0000","last_change":"2024-09-12T00:54:35.986855+0000","last_active":"2024-09-12T00:54:35.986855+0000","last_peered":"2024-09-12T00:54:35.986855+0000","last_clean":"2024-09-12T00:54:35.986855+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:54:35.986855+0000","last_undegraded":"2024-09-12T00:54:35.986855+0000","last_fullsized":"2024-09-12T00:54:35.986855+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.986557+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:47.032800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263232,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":7228,"num_write":905,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.541213+0000","last_change":"2024-09-12T00:54:53.541065+0000","last_active":"2024-09-12T00:54:53.541213+0000","last_peered":"2024-09-12T00:54:53.541213+0000","last_clean":"2024-09-12T00:54:53.541213+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:54:53.541213+0000","last_undegraded":"2024-09-12T00:54:53.541213+0000","last_fullsized":"2024-09-12T00:54:53.541213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.540887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:37.677352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'226","reported_seq":877,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.727373+0000","last_change":"2024-09-12T00:55:00.727231+0000","last_active":"2024-09-12T00:55:00.727373+0000","last_peered":"2024-09-12T00:55:00.727373+0000","last_clean":"2024-09-12T00:55:00.727373+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:55:00.727373+0000","last_undegraded":"2024-09-12T00:55:00.727373+0000","last_fullsized":"2024-09-12T00:55:00.727373+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:55:00.727049+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:55:00.727049+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.727049+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:25.809988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17671,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":453,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.421594+0000","last_change":"2024-09-12T00:55:05.421439+0000","last_active":"2024-09-12T00:55:05.421594+0000","last_peered":"2024-09-12T00:55:05.421594+0000","last_clean":"2024-09-12T00:55:05.421594+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:55:05.421594+0000","last_undegraded":"2024-09-12T00:55:05.421594+0000","last_fullsized":"2024-09-12T00:55:05.421594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:05.421260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:05.421260+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.421260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:18.381893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'168","reported_seq":705,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.585645+0000","last_change":"2024-09-12T00:55:01.585367+0000","last_active":"2024-09-12T00:55:01.585645+0000","last_peered":"2024-09-12T00:55:01.585645+0000","last_clean":"2024-09-12T00:55:01.585645+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:55:01.585645+0000","last_undegraded":"2024-09-12T00:55:01.585645+0000","last_fullsized":"2024-09-12T00:55:01.585645+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'168","last_scrub_stamp":"2024-09-12T00:55:01.585026+0000","last_deep_scrub":"266'168","last_deep_scrub_stamp":"2024-09-12T00:55:01.585026+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.585026+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:53.787732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'473","reported_seq":1914,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.024560+0000","last_change":"2024-09-12T00:54:46.024560+0000","last_active":"2024-09-12T00:54:46.024560+0000","last_peered":"2024-09-12T00:54:46.024560+0000","last_clean":"2024-09-12T00:54:46.024560+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:54:46.024560+0000","last_undegraded":"2024-09-12T00:54:46.024560+0000","last_fullsized":"2024-09-12T00:54:46.024560+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.024305+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:36.127769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'213","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.570214+0000","last_change":"2024-09-12T00:54:39.570214+0000","last_active":"2024-09-12T00:54:39.570214+0000","last_peered":"2024-09-12T00:54:39.570214+0000","last_clean":"2024-09-12T00:54:39.570214+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:54:39.570214+0000","last_undegraded":"2024-09-12T00:54:39.570214+0000","last_fullsized":"2024-09-12T00:54:39.570214+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.570000+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:44.813413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1957,"num_write":1001,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"266'4","reported_seq":982,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.606327+0000","last_change":"2024-09-12T00:54:51.606327+0000","last_active":"2024-09-12T00:54:51.606327+0000","last_peered":"2024-09-12T00:54:51.606327+0000","last_clean":"2024-09-12T00:54:51.606327+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:51.606327+0000","last_undegraded":"2024-09-12T00:54:51.606327+0000","last_fullsized":"2024-09-12T00:54:51.606327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.606222+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:53.762430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'170","reported_seq":762,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.619760+0000","last_change":"2024-09-12T00:54:57.619760+0000","last_active":"2024-09-12T00:54:57.619760+0000","last_peered":"2024-09-12T00:54:57.619760+0000","last_clean":"2024-09-12T00:54:57.619760+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:57.619760+0000","last_undegraded":"2024-09-12T00:54:57.619760+0000","last_fullsized":"2024-09-12T00:54:57.619760+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T00:54:57.619550+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T00:54:57.619550+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.619550+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:58.330414+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8234,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":271,"num_write":174,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.536437+0000","last_change":"2024-09-12T00:54:55.536437+0000","last_active":"2024-09-12T00:54:55.536437+0000","last_peered":"2024-09-12T00:54:55.536437+0000","last_clean":"2024-09-12T00:54:55.536437+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:54:55.536437+0000","last_undegraded":"2024-09-12T00:54:55.536437+0000","last_fullsized":"2024-09-12T00:54:55.536437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.536271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:31.775278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'115","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.302070+0000","last_change":"2024-09-12T00:55:08.302070+0000","last_active":"2024-09-12T00:55:08.302070+0000","last_peered":"2024-09-12T00:55:08.302070+0000","last_clean":"2024-09-12T00:55:08.302070+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:55:08.302070+0000","last_undegraded":"2024-09-12T00:55:08.302070+0000","last_fullsized":"2024-09-12T00:55:08.302070+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:08.301877+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:08.301877+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.301877+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:27.663319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'361","reported_seq":1774,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.211004+0000","last_change":"2024-09-12T00:54:54.211004+0000","last_active":"2024-09-12T00:54:54.211004+0000","last_peered":"2024-09-12T00:54:54.211004+0000","last_clean":"2024-09-12T00:54:54.211004+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:54:54.211004+0000","last_undegraded":"2024-09-12T00:54:54.211004+0000","last_fullsized":"2024-09-12T00:54:54.211004+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'361","last_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_deep_scrub":"266'361","last_deep_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.210799+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:50.984927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'180","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.277922+0000","last_change":"2024-09-12T00:54:42.277780+0000","last_active":"2024-09-12T00:54:42.277922+0000","last_peered":"2024-09-12T00:54:42.277922+0000","last_clean":"2024-09-12T00:54:42.277922+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:54:42.277922+0000","last_undegraded":"2024-09-12T00:54:42.277922+0000","last_fullsized":"2024-09-12T00:54:42.277922+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.277535+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:04.627342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029147,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":98751,"num_write":852,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.466092+0000","last_change":"2024-09-12T00:55:00.466092+0000","last_active":"2024-09-12T00:55:00.466092+0000","last_peered":"2024-09-12T00:55:00.466092+0000","last_clean":"2024-09-12T00:55:00.466092+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:55:00.466092+0000","last_undegraded":"2024-09-12T00:55:00.466092+0000","last_fullsized":"2024-09-12T00:55:00.466092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:00.465889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:00.465889+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.465889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:55.760477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'153","reported_seq":744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.481188+0000","last_change":"2024-09-12T00:55:02.481188+0000","last_active":"2024-09-12T00:55:02.481188+0000","last_peered":"2024-09-12T00:55:02.481188+0000","last_clean":"2024-09-12T00:55:02.481188+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:55:02.481188+0000","last_undegraded":"2024-09-12T00:55:02.481188+0000","last_fullsized":"2024-09-12T00:55:02.481188+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T00:55:02.480984+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T00:55:02.480984+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.480984+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.612551+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4675,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":249,"num_write":108,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'760","reported_seq":4280,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.563296+0000","last_change":"2024-09-12T00:54:54.563296+0000","last_active":"2024-09-12T00:54:54.563296+0000","last_peered":"2024-09-12T00:54:54.563296+0000","last_clean":"2024-09-12T00:54:54.563296+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:54.563296+0000","last_undegraded":"2024-09-12T00:54:54.563296+0000","last_fullsized":"2024-09-12T00:54:54.563296+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'760","last_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_deep_scrub":"266'760","last_deep_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.563105+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.533407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'136","reported_seq":635,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.671646+0000","last_change":"2024-09-12T00:55:03.671646+0000","last_active":"2024-09-12T00:55:03.671646+0000","last_peered":"2024-09-12T00:55:03.671646+0000","last_clean":"2024-09-12T00:55:03.671646+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:55:03.671646+0000","last_undegraded":"2024-09-12T00:55:03.671646+0000","last_fullsized":"2024-09-12T00:55:03.671646+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'136","last_scrub_stamp":"2024-09-12T00:55:03.671538+0000","last_deep_scrub":"266'136","last_deep_scrub_stamp":"2024-09-12T00:55:03.671538+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.671538+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:14.251070+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.827777+0000","last_change":"2024-09-12T00:54:44.827777+0000","last_active":"2024-09-12T00:54:44.827777+0000","last_peered":"2024-09-12T00:54:44.827777+0000","last_clean":"2024-09-12T00:54:44.827777+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:54:44.827777+0000","last_undegraded":"2024-09-12T00:54:44.827777+0000","last_fullsized":"2024-09-12T00:54:44.827777+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.827583+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:48.105846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'205","reported_seq":969,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.317059+0000","last_change":"2024-09-12T00:54:41.316896+0000","last_active":"2024-09-12T00:54:41.317059+0000","last_peered":"2024-09-12T00:54:41.317059+0000","last_clean":"2024-09-12T00:54:41.317059+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:54:41.317059+0000","last_undegraded":"2024-09-12T00:54:41.317059+0000","last_fullsized":"2024-09-12T00:54:41.317059+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.316614+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.862723+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3292722,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":199371,"num_write":991,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1457,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.467529+0000","last_change":"2024-09-12T00:54:50.467529+0000","last_active":"2024-09-12T00:54:50.467529+0000","last_peered":"2024-09-12T00:54:50.467529+0000","last_clean":"2024-09-12T00:54:50.467529+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:50.467529+0000","last_undegraded":"2024-09-12T00:54:50.467529+0000","last_fullsized":"2024-09-12T00:54:50.467529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.467357+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:26.686465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'77","reported_seq":604,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.575276+0000","last_change":"2024-09-12T00:54:57.575276+0000","last_active":"2024-09-12T00:54:57.575276+0000","last_peered":"2024-09-12T00:54:57.575276+0000","last_clean":"2024-09-12T00:54:57.575276+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:54:57.575276+0000","last_undegraded":"2024-09-12T00:54:57.575276+0000","last_fullsized":"2024-09-12T00:54:57.575276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T00:54:57.575036+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T00:54:57.575036+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.575036+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:26.524340+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'798","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.634055+0000","last_change":"2024-09-12T00:54:58.634055+0000","last_active":"2024-09-12T00:54:58.634055+0000","last_peered":"2024-09-12T00:54:58.634055+0000","last_clean":"2024-09-12T00:54:58.634055+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:58.634055+0000","last_undegraded":"2024-09-12T00:54:58.634055+0000","last_fullsized":"2024-09-12T00:54:58.634055+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T00:54:58.633950+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T00:54:58.633950+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.633950+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":701,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:30.165647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":650,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.675774+0000","last_change":"2024-09-12T00:54:59.675774+0000","last_active":"2024-09-12T00:54:59.675774+0000","last_peered":"2024-09-12T00:54:59.675774+0000","last_clean":"2024-09-12T00:54:59.675774+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:54:59.675774+0000","last_undegraded":"2024-09-12T00:54:59.675774+0000","last_fullsized":"2024-09-12T00:54:59.675774+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'151","last_scrub_stamp":"2024-09-12T00:54:59.675592+0000","last_deep_scrub":"266'151","last_deep_scrub_stamp":"2024-09-12T00:54:59.675592+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.675592+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:49.816081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'761","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.666891+0000","last_change":"2024-09-12T00:54:43.666617+0000","last_active":"2024-09-12T00:54:43.666891+0000","last_peered":"2024-09-12T00:54:43.666891+0000","last_clean":"2024-09-12T00:54:43.666891+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:54:43.666891+0000","last_undegraded":"2024-09-12T00:54:43.666891+0000","last_fullsized":"2024-09-12T00:54:43.666891+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'761","last_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_deep_scrub":"266'761","last_deep_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.666383+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.971115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'218","reported_seq":873,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.748716+0000","last_change":"2024-09-12T00:54:39.748564+0000","last_active":"2024-09-12T00:54:39.748716+0000","last_peered":"2024-09-12T00:54:39.748716+0000","last_clean":"2024-09-12T00:54:39.748716+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:54:39.748716+0000","last_undegraded":"2024-09-12T00:54:39.748716+0000","last_fullsized":"2024-09-12T00:54:39.748716+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.748286+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:20.574571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263224,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":31245,"num_write":954,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.283527+0000","last_change":"2024-09-12T00:55:02.283527+0000","last_active":"2024-09-12T00:55:02.283527+0000","last_peered":"2024-09-12T00:55:02.283527+0000","last_clean":"2024-09-12T00:55:02.283527+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:55:02.283527+0000","last_undegraded":"2024-09-12T00:55:02.283527+0000","last_fullsized":"2024-09-12T00:55:02.283527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.283345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.283345+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.283345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:27.352193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'230","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.555251+0000","last_change":"2024-09-12T00:54:54.555251+0000","last_active":"2024-09-12T00:54:54.555251+0000","last_peered":"2024-09-12T00:54:54.555251+0000","last_clean":"2024-09-12T00:54:54.555251+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:54.555251+0000","last_undegraded":"2024-09-12T00:54:54.555251+0000","last_fullsized":"2024-09-12T00:54:54.555251+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.555026+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:19.736607+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":871,"num_read_kb":936,"num_write":1362,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.686865+0000","last_change":"2024-09-12T00:54:56.686865+0000","last_active":"2024-09-12T00:54:56.686865+0000","last_peered":"2024-09-12T00:54:56.686865+0000","last_clean":"2024-09-12T00:54:56.686865+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:54:56.686865+0000","last_undegraded":"2024-09-12T00:54:56.686865+0000","last_fullsized":"2024-09-12T00:54:56.686865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:56.686680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:56.686680+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.686680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:52.673507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'108","reported_seq":608,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.567791+0000","last_change":"2024-09-12T00:55:00.567791+0000","last_active":"2024-09-12T00:55:00.567791+0000","last_peered":"2024-09-12T00:55:00.567791+0000","last_clean":"2024-09-12T00:55:00.567791+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:55:00.567791+0000","last_undegraded":"2024-09-12T00:55:00.567791+0000","last_fullsized":"2024-09-12T00:55:00.567791+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T00:55:00.567594+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T00:55:00.567594+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.567594+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:14.526248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'793","reported_seq":2443,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.287495+0000","last_change":"2024-09-12T00:54:52.287495+0000","last_active":"2024-09-12T00:54:52.287495+0000","last_peered":"2024-09-12T00:54:52.287495+0000","last_clean":"2024-09-12T00:54:52.287495+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:54:52.287495+0000","last_undegraded":"2024-09-12T00:54:52.287495+0000","last_fullsized":"2024-09-12T00:54:52.287495+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.287309+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:21.498590+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.224931+0000","last_change":"2024-09-12T00:54:35.224884+0000","last_active":"2024-09-12T00:54:35.224931+0000","last_peered":"2024-09-12T00:54:35.224931+0000","last_clean":"2024-09-12T00:54:35.224931+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:54:35.224931+0000","last_undegraded":"2024-09-12T00:54:35.224931+0000","last_fullsized":"2024-09-12T00:54:35.224931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.224815+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:03.397008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.274653+0000","last_change":"2024-09-12T00:54:38.274584+0000","last_active":"2024-09-12T00:54:38.274653+0000","last_peered":"2024-09-12T00:54:38.274653+0000","last_clean":"2024-09-12T00:54:38.274653+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:54:38.274653+0000","last_undegraded":"2024-09-12T00:54:38.274653+0000","last_fullsized":"2024-09-12T00:54:38.274653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.274494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.201817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'188","reported_seq":815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.789372+0000","last_change":"2024-09-12T00:54:42.789217+0000","last_active":"2024-09-12T00:54:42.789372+0000","last_peered":"2024-09-12T00:54:42.789372+0000","last_clean":"2024-09-12T00:54:42.789372+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:54:42.789372+0000","last_undegraded":"2024-09-12T00:54:42.789372+0000","last_fullsized":"2024-09-12T00:54:42.789372+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.788986+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:41.647136+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829240,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":15296,"num_write":922,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"266'5","reported_seq":976,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.966646+0000","last_change":"2024-09-12T00:54:51.966425+0000","last_active":"2024-09-12T00:54:51.966646+0000","last_peered":"2024-09-12T00:54:51.966646+0000","last_clean":"2024-09-12T00:54:51.966646+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:51.966646+0000","last_undegraded":"2024-09-12T00:54:51.966646+0000","last_fullsized":"2024-09-12T00:54:51.966646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.966203+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:02.641365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'310","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.211022+0000","last_change":"2024-09-12T00:55:07.210862+0000","last_active":"2024-09-12T00:55:07.211022+0000","last_peered":"2024-09-12T00:55:07.211022+0000","last_clean":"2024-09-12T00:55:07.211022+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:55:07.211022+0000","last_undegraded":"2024-09-12T00:55:07.211022+0000","last_fullsized":"2024-09-12T00:55:07.211022+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'310","last_scrub_stamp":"2024-09-12T00:55:07.210646+0000","last_deep_scrub":"266'310","last_deep_scrub_stamp":"2024-09-12T00:55:07.210646+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.210646+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:27.265745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38032,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":812,"num_write":452,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89064,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.421374+0000","last_change":"2024-09-12T00:55:04.421246+0000","last_active":"2024-09-12T00:55:04.421374+0000","last_peered":"2024-09-12T00:55:04.421374+0000","last_clean":"2024-09-12T00:55:04.421374+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:55:04.421374+0000","last_undegraded":"2024-09-12T00:55:04.421374+0000","last_fullsized":"2024-09-12T00:55:04.421374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:04.421057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:04.421057+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.421057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:46.700027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'191","reported_seq":899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.081768+0000","last_change":"2024-09-12T00:55:00.081610+0000","last_active":"2024-09-12T00:55:00.081768+0000","last_peered":"2024-09-12T00:55:00.081768+0000","last_clean":"2024-09-12T00:55:00.081768+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:55:00.081768+0000","last_undegraded":"2024-09-12T00:55:00.081768+0000","last_fullsized":"2024-09-12T00:55:00.081768+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:55:00.081425+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:55:00.081425+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.081425+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:07.440493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'456","reported_seq":1928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.519445+0000","last_change":"2024-09-12T00:54:51.519310+0000","last_active":"2024-09-12T00:54:51.519445+0000","last_peered":"2024-09-12T00:54:51.519445+0000","last_clean":"2024-09-12T00:54:51.519445+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:54:51.519445+0000","last_undegraded":"2024-09-12T00:54:51.519445+0000","last_fullsized":"2024-09-12T00:54:51.519445+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.519121+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:49.830324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.242615+0000","last_change":"2024-09-12T00:54:37.242615+0000","last_active":"2024-09-12T00:54:37.242615+0000","last_peered":"2024-09-12T00:54:37.242615+0000","last_clean":"2024-09-12T00:54:37.242615+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:54:37.242615+0000","last_undegraded":"2024-09-12T00:54:37.242615+0000","last_fullsized":"2024-09-12T00:54:37.242615+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.242525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:38.015711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'204","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.526784+0000","last_change":"2024-09-12T00:54:42.526486+0000","last_active":"2024-09-12T00:54:42.526784+0000","last_peered":"2024-09-12T00:54:42.526784+0000","last_clean":"2024-09-12T00:54:42.526784+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:54:42.526784+0000","last_undegraded":"2024-09-12T00:54:42.526784+0000","last_fullsized":"2024-09-12T00:54:42.526784+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.526184+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:15.774324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306325,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":403,"num_read_kb":6581,"num_write":989,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.310008+0000","last_change":"2024-09-12T00:55:03.309849+0000","last_active":"2024-09-12T00:55:03.310008+0000","last_peered":"2024-09-12T00:55:03.310008+0000","last_clean":"2024-09-12T00:55:03.310008+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:55:03.310008+0000","last_undegraded":"2024-09-12T00:55:03.310008+0000","last_fullsized":"2024-09-12T00:55:03.310008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:03.309659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:03.309659+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.309659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:36.319439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'853","reported_seq":2314,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.624156+0000","last_change":"2024-09-12T00:54:53.624156+0000","last_active":"2024-09-12T00:54:53.624156+0000","last_peered":"2024-09-12T00:54:53.624156+0000","last_clean":"2024-09-12T00:54:53.624156+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:53.624156+0000","last_undegraded":"2024-09-12T00:54:53.624156+0000","last_fullsized":"2024-09-12T00:54:53.624156+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'853","last_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_deep_scrub":"266'853","last_deep_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.623958+0000","objects_scrubbed":12,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:03.095882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66079,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1175,"num_read_kb":1468,"num_write":286,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.270242+0000","last_change":"2024-09-12T00:55:13.270242+0000","last_active":"2024-09-12T00:55:13.270242+0000","last_peered":"2024-09-12T00:55:13.270242+0000","last_clean":"2024-09-12T00:55:13.270242+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:55:13.270242+0000","last_undegraded":"2024-09-12T00:55:13.270242+0000","last_fullsized":"2024-09-12T00:55:13.270242+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:13.269978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:13.269978+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.269978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:52.961298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'209","reported_seq":734,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.291639+0000","last_change":"2024-09-12T00:55:09.291393+0000","last_active":"2024-09-12T00:55:09.291639+0000","last_peered":"2024-09-12T00:55:09.291639+0000","last_clean":"2024-09-12T00:55:09.291639+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:55:09.291639+0000","last_undegraded":"2024-09-12T00:55:09.291639+0000","last_fullsized":"2024-09-12T00:55:09.291639+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'209","last_scrub_stamp":"2024-09-12T00:55:09.291169+0000","last_deep_scrub":"266'209","last_deep_scrub_stamp":"2024-09-12T00:55:09.291169+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.291169+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:41.354281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'995","reported_seq":2854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.580114+0000","last_change":"2024-09-12T00:54:48.579986+0000","last_active":"2024-09-12T00:54:48.580114+0000","last_peered":"2024-09-12T00:54:48.580114+0000","last_clean":"2024-09-12T00:54:48.580114+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:54:48.580114+0000","last_undegraded":"2024-09-12T00:54:48.580114+0000","last_fullsized":"2024-09-12T00:54:48.580114+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'995","last_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_deep_scrub":"266'995","last_deep_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.579784+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:38.249646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.545793+0000","last_change":"2024-09-12T00:54:38.545567+0000","last_active":"2024-09-12T00:54:38.545793+0000","last_peered":"2024-09-12T00:54:38.545793+0000","last_clean":"2024-09-12T00:54:38.545793+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:54:38.545793+0000","last_undegraded":"2024-09-12T00:54:38.545793+0000","last_fullsized":"2024-09-12T00:54:38.545793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.545294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:50.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'191","reported_seq":813,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.551347+0000","last_change":"2024-09-12T00:54:38.551347+0000","last_active":"2024-09-12T00:54:38.551347+0000","last_peered":"2024-09-12T00:54:38.551347+0000","last_clean":"2024-09-12T00:54:38.551347+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:54:38.551347+0000","last_undegraded":"2024-09-12T00:54:38.551347+0000","last_fullsized":"2024-09-12T00:54:38.551347+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.551135+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:39.228607+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399318,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":402,"num_read_kb":16624,"num_write":912,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.576791+0000","last_change":"2024-09-12T00:54:50.576517+0000","last_active":"2024-09-12T00:54:50.576791+0000","last_peered":"2024-09-12T00:54:50.576791+0000","last_clean":"2024-09-12T00:54:50.576791+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:54:50.576791+0000","last_undegraded":"2024-09-12T00:54:50.576791+0000","last_fullsized":"2024-09-12T00:54:50.576791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.576297+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.163460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'240","reported_seq":1300,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.014557+0000","last_change":"2024-09-12T00:54:57.014557+0000","last_active":"2024-09-12T00:54:57.014557+0000","last_peered":"2024-09-12T00:54:57.014557+0000","last_clean":"2024-09-12T00:54:57.014557+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:57.014557+0000","last_undegraded":"2024-09-12T00:54:57.014557+0000","last_fullsized":"2024-09-12T00:54:57.014557+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'240","last_scrub_stamp":"2024-09-12T00:54:57.014349+0000","last_deep_scrub":"266'240","last_deep_scrub_stamp":"2024-09-12T00:54:57.014349+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.014349+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:47.882649+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.624108+0000","last_change":"2024-09-12T00:55:06.624108+0000","last_active":"2024-09-12T00:55:06.624108+0000","last_peered":"2024-09-12T00:55:06.624108+0000","last_clean":"2024-09-12T00:55:06.624108+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:55:06.624108+0000","last_undegraded":"2024-09-12T00:55:06.624108+0000","last_fullsized":"2024-09-12T00:55:06.624108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.623930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.623930+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.623930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:33.032507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'315","reported_seq":946,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.714992+0000","last_change":"2024-09-12T00:55:11.714992+0000","last_active":"2024-09-12T00:55:11.714992+0000","last_peered":"2024-09-12T00:55:11.714992+0000","last_clean":"2024-09-12T00:55:11.714992+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:55:11.714992+0000","last_undegraded":"2024-09-12T00:55:11.714992+0000","last_fullsized":"2024-09-12T00:55:11.714992+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'315","last_scrub_stamp":"2024-09-12T00:55:11.714813+0000","last_deep_scrub":"266'315","last_deep_scrub_stamp":"2024-09-12T00:55:11.714813+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.714813+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:49.232900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'380","reported_seq":1794,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.548331+0000","last_change":"2024-09-12T00:54:47.548188+0000","last_active":"2024-09-12T00:54:47.548331+0000","last_peered":"2024-09-12T00:54:47.548331+0000","last_clean":"2024-09-12T00:54:47.548331+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:54:47.548331+0000","last_undegraded":"2024-09-12T00:54:47.548331+0000","last_fullsized":"2024-09-12T00:54:47.548331+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.548014+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:48.760777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.197523+0000","last_change":"2024-09-12T00:54:36.197440+0000","last_active":"2024-09-12T00:54:36.197523+0000","last_peered":"2024-09-12T00:54:36.197523+0000","last_clean":"2024-09-12T00:54:36.197523+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:54:36.197523+0000","last_undegraded":"2024-09-12T00:54:36.197523+0000","last_fullsized":"2024-09-12T00:54:36.197523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.197360+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.561316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'279","reported_seq":961,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:34.999799+0000","last_change":"2024-09-12T00:54:34.999658+0000","last_active":"2024-09-12T00:54:34.999799+0000","last_peered":"2024-09-12T00:54:34.999799+0000","last_clean":"2024-09-12T00:54:34.999799+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:54:34.999799+0000","last_undegraded":"2024-09-12T00:54:34.999799+0000","last_fullsized":"2024-09-12T00:54:34.999799+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'279","last_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_deep_scrub":"266'279","last_deep_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_clean_scrub_stamp":"2024-09-12T00:54:34.999451+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:22.247017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":17781,"num_write":1208,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.529558+0000","last_change":"2024-09-12T00:54:49.529558+0000","last_active":"2024-09-12T00:54:49.529558+0000","last_peered":"2024-09-12T00:54:49.529558+0000","last_clean":"2024-09-12T00:54:49.529558+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:54:49.529558+0000","last_undegraded":"2024-09-12T00:54:49.529558+0000","last_fullsized":"2024-09-12T00:54:49.529558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.529356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:46.730267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'116","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.514099+0000","last_change":"2024-09-12T00:55:01.513954+0000","last_active":"2024-09-12T00:55:01.514099+0000","last_peered":"2024-09-12T00:55:01.514099+0000","last_clean":"2024-09-12T00:55:01.514099+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:55:01.514099+0000","last_undegraded":"2024-09-12T00:55:01.514099+0000","last_fullsized":"2024-09-12T00:55:01.514099+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'116","last_scrub_stamp":"2024-09-12T00:55:01.513747+0000","last_deep_scrub":"266'116","last_deep_scrub_stamp":"2024-09-12T00:55:01.513747+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.513747+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:25.060624+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.276690+0000","last_change":"2024-09-12T00:55:14.276537+0000","last_active":"2024-09-12T00:55:14.276690+0000","last_peered":"2024-09-12T00:55:14.276690+0000","last_clean":"2024-09-12T00:55:14.276690+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:55:14.276690+0000","last_undegraded":"2024-09-12T00:55:14.276690+0000","last_fullsized":"2024-09-12T00:55:14.276690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.276365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.276365+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.276365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:47.649896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.609090+0000","last_change":"2024-09-12T00:55:03.608951+0000","last_active":"2024-09-12T00:55:03.609090+0000","last_peered":"2024-09-12T00:55:03.609090+0000","last_clean":"2024-09-12T00:55:03.609090+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:55:03.609090+0000","last_undegraded":"2024-09-12T00:55:03.609090+0000","last_fullsized":"2024-09-12T00:55:03.609090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'107","last_scrub_stamp":"2024-09-12T00:55:03.608770+0000","last_deep_scrub":"266'107","last_deep_scrub_stamp":"2024-09-12T00:55:03.608770+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.608770+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.097958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'427","reported_seq":1937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.584216+0000","last_change":"2024-09-12T00:54:46.584085+0000","last_active":"2024-09-12T00:54:46.584216+0000","last_peered":"2024-09-12T00:54:46.584216+0000","last_clean":"2024-09-12T00:54:46.584216+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:46.584216+0000","last_undegraded":"2024-09-12T00:54:46.584216+0000","last_fullsized":"2024-09-12T00:54:46.584216+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'427","last_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_deep_scrub":"266'427","last_deep_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.583899+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:29.567951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'194","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.728770+0000","last_change":"2024-09-12T00:54:35.728711+0000","last_active":"2024-09-12T00:54:35.728770+0000","last_peered":"2024-09-12T00:54:35.728770+0000","last_clean":"2024-09-12T00:54:35.728770+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:35.728770+0000","last_undegraded":"2024-09-12T00:54:35.728770+0000","last_fullsized":"2024-09-12T00:54:35.728770+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.728619+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:56.800395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":917,"num_read_kb":23524,"num_write":944,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.583032+0000","last_change":"2024-09-12T00:54:37.582880+0000","last_active":"2024-09-12T00:54:37.583032+0000","last_peered":"2024-09-12T00:54:37.583032+0000","last_clean":"2024-09-12T00:54:37.583032+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:54:37.583032+0000","last_undegraded":"2024-09-12T00:54:37.583032+0000","last_fullsized":"2024-09-12T00:54:37.583032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.582700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:21.296604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.770800+0000","last_change":"2024-09-12T00:54:54.770670+0000","last_active":"2024-09-12T00:54:54.770800+0000","last_peered":"2024-09-12T00:54:54.770800+0000","last_clean":"2024-09-12T00:54:54.770800+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:54:54.770800+0000","last_undegraded":"2024-09-12T00:54:54.770800+0000","last_fullsized":"2024-09-12T00:54:54.770800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.770488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:04.172382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'283","reported_seq":965,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.642804+0000","last_change":"2024-09-12T00:54:52.642804+0000","last_active":"2024-09-12T00:54:52.642804+0000","last_peered":"2024-09-12T00:54:52.642804+0000","last_clean":"2024-09-12T00:54:52.642804+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:52.642804+0000","last_undegraded":"2024-09-12T00:54:52.642804+0000","last_fullsized":"2024-09-12T00:54:52.642804+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'283","last_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_deep_scrub":"266'283","last_deep_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.642577+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.027888+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26101,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":392,"num_read_kb":552,"num_write":218,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.721716+0000","last_change":"2024-09-12T00:54:55.721716+0000","last_active":"2024-09-12T00:54:55.721716+0000","last_peered":"2024-09-12T00:54:55.721716+0000","last_clean":"2024-09-12T00:54:55.721716+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:54:55.721716+0000","last_undegraded":"2024-09-12T00:54:55.721716+0000","last_fullsized":"2024-09-12T00:54:55.721716+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.721527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'152","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.296106+0000","last_change":"2024-09-12T00:55:12.296106+0000","last_active":"2024-09-12T00:55:12.296106+0000","last_peered":"2024-09-12T00:55:12.296106+0000","last_clean":"2024-09-12T00:55:12.296106+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:55:12.296106+0000","last_undegraded":"2024-09-12T00:55:12.296106+0000","last_fullsized":"2024-09-12T00:55:12.296106+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T00:55:12.295901+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T00:55:12.295901+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.295901+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:00.516313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'459","reported_seq":2087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.594979+0000","last_change":"2024-09-12T00:54:45.594823+0000","last_active":"2024-09-12T00:54:45.594979+0000","last_peered":"2024-09-12T00:54:45.594979+0000","last_clean":"2024-09-12T00:54:45.594979+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:45.594979+0000","last_undegraded":"2024-09-12T00:54:45.594979+0000","last_fullsized":"2024-09-12T00:54:45.594979+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.594645+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:35.357485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'218","reported_seq":849,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.561793+0000","last_change":"2024-09-12T00:54:38.561566+0000","last_active":"2024-09-12T00:54:38.561793+0000","last_peered":"2024-09-12T00:54:38.561793+0000","last_clean":"2024-09-12T00:54:38.561793+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:54:38.561793+0000","last_undegraded":"2024-09-12T00:54:38.561793+0000","last_fullsized":"2024-09-12T00:54:38.561793+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.561353+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.740390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":428,"num_read_kb":4575,"num_write":1019,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.323676+0000","last_change":"2024-09-12T00:54:39.323452+0000","last_active":"2024-09-12T00:54:39.323676+0000","last_peered":"2024-09-12T00:54:39.323676+0000","last_clean":"2024-09-12T00:54:39.323676+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:54:39.323676+0000","last_undegraded":"2024-09-12T00:54:39.323676+0000","last_fullsized":"2024-09-12T00:54:39.323676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.323253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.936694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.968342+0000","last_change":"2024-09-12T00:54:53.968184+0000","last_active":"2024-09-12T00:54:53.968342+0000","last_peered":"2024-09-12T00:54:53.968342+0000","last_clean":"2024-09-12T00:54:53.968342+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:54:53.968342+0000","last_undegraded":"2024-09-12T00:54:53.968342+0000","last_fullsized":"2024-09-12T00:54:53.968342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.967996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:51.436997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'188","reported_seq":764,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.580854+0000","last_change":"2024-09-12T00:54:56.580854+0000","last_active":"2024-09-12T00:54:56.580854+0000","last_peered":"2024-09-12T00:54:56.580854+0000","last_clean":"2024-09-12T00:54:56.580854+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:54:56.580854+0000","last_undegraded":"2024-09-12T00:54:56.580854+0000","last_fullsized":"2024-09-12T00:54:56.580854+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T00:54:56.580514+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T00:54:56.580514+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.580514+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.929018+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'800","reported_seq":2675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.597567+0000","last_change":"2024-09-12T00:54:56.597567+0000","last_active":"2024-09-12T00:54:56.597567+0000","last_peered":"2024-09-12T00:54:56.597567+0000","last_clean":"2024-09-12T00:54:56.597567+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:56.597567+0000","last_undegraded":"2024-09-12T00:54:56.597567+0000","last_fullsized":"2024-09-12T00:54:56.597567+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'800","last_scrub_stamp":"2024-09-12T00:54:56.597386+0000","last_deep_scrub":"266'800","last_deep_scrub_stamp":"2024-09-12T00:54:56.597386+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.597386+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":701,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.113206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'115","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.635235+0000","last_change":"2024-09-12T00:55:02.635235+0000","last_active":"2024-09-12T00:55:02.635235+0000","last_peered":"2024-09-12T00:55:02.635235+0000","last_clean":"2024-09-12T00:55:02.635235+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:55:02.635235+0000","last_undegraded":"2024-09-12T00:55:02.635235+0000","last_fullsized":"2024-09-12T00:55:02.635235+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:02.635060+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:02.635060+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.635060+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:00.741162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'451","reported_seq":1864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.779886+0000","last_change":"2024-09-12T00:54:44.779886+0000","last_active":"2024-09-12T00:54:44.779886+0000","last_peered":"2024-09-12T00:54:44.779886+0000","last_clean":"2024-09-12T00:54:44.779886+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:54:44.779886+0000","last_undegraded":"2024-09-12T00:54:44.779886+0000","last_fullsized":"2024-09-12T00:54:44.779886+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.779697+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.485479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'250","reported_seq":920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.721106+0000","last_change":"2024-09-12T00:54:38.720957+0000","last_active":"2024-09-12T00:54:38.721106+0000","last_peered":"2024-09-12T00:54:38.721106+0000","last_clean":"2024-09-12T00:54:38.721106+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:54:38.721106+0000","last_undegraded":"2024-09-12T00:54:38.721106+0000","last_fullsized":"2024-09-12T00:54:38.721106+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'250","last_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_deep_scrub":"266'250","last_deep_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.720733+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.451856+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337134,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":14953,"num_write":1330,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.712764+0000","last_change":"2024-09-12T00:54:36.712634+0000","last_active":"2024-09-12T00:54:36.712764+0000","last_peered":"2024-09-12T00:54:36.712764+0000","last_clean":"2024-09-12T00:54:36.712764+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:54:36.712764+0000","last_undegraded":"2024-09-12T00:54:36.712764+0000","last_fullsized":"2024-09-12T00:54:36.712764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.712454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:05.577210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.294465+0000","last_change":"2024-09-12T00:55:01.294322+0000","last_active":"2024-09-12T00:55:01.294465+0000","last_peered":"2024-09-12T00:55:01.294465+0000","last_clean":"2024-09-12T00:55:01.294465+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:55:01.294465+0000","last_undegraded":"2024-09-12T00:55:01.294465+0000","last_fullsized":"2024-09-12T00:55:01.294465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:01.294142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:01.294142+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.294142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:59.069922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'115","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.263231+0000","last_change":"2024-09-12T00:55:10.263231+0000","last_active":"2024-09-12T00:55:10.263231+0000","last_peered":"2024-09-12T00:55:10.263231+0000","last_clean":"2024-09-12T00:55:10.263231+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:55:10.263231+0000","last_undegraded":"2024-09-12T00:55:10.263231+0000","last_fullsized":"2024-09-12T00:55:10.263231+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:10.263055+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:10.263055+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.263055+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:20.196677+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'790","reported_seq":2352,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.453945+0000","last_change":"2024-09-12T00:55:03.453945+0000","last_active":"2024-09-12T00:55:03.453945+0000","last_peered":"2024-09-12T00:55:03.453945+0000","last_clean":"2024-09-12T00:55:03.453945+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:55:03.453945+0000","last_undegraded":"2024-09-12T00:55:03.453945+0000","last_fullsized":"2024-09-12T00:55:03.453945+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'790","last_scrub_stamp":"2024-09-12T00:55:03.453762+0000","last_deep_scrub":"266'790","last_deep_scrub_stamp":"2024-09-12T00:55:03.453762+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.453762+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":701,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:30.381039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'190","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.254611+0000","last_change":"2024-09-12T00:55:10.254611+0000","last_active":"2024-09-12T00:55:10.254611+0000","last_peered":"2024-09-12T00:55:10.254611+0000","last_clean":"2024-09-12T00:55:10.254611+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:55:10.254611+0000","last_undegraded":"2024-09-12T00:55:10.254611+0000","last_fullsized":"2024-09-12T00:55:10.254611+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T00:55:10.254291+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T00:55:10.254291+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.254291+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:19.599040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'483","reported_seq":2178,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.777527+0000","last_change":"2024-09-12T00:54:41.777384+0000","last_active":"2024-09-12T00:54:41.777527+0000","last_peered":"2024-09-12T00:54:41.777527+0000","last_clean":"2024-09-12T00:54:41.777527+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:41.777527+0000","last_undegraded":"2024-09-12T00:54:41.777527+0000","last_fullsized":"2024-09-12T00:54:41.777527+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.777199+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:25.825062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'218","reported_seq":879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.709035+0000","last_change":"2024-09-12T00:54:40.708851+0000","last_active":"2024-09-12T00:54:40.709035+0000","last_peered":"2024-09-12T00:54:40.709035+0000","last_clean":"2024-09-12T00:54:40.709035+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:54:40.709035+0000","last_undegraded":"2024-09-12T00:54:40.709035+0000","last_fullsized":"2024-09-12T00:54:40.709035+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.708626+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.336367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5989411,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":60723,"num_write":949,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.310540+0000","last_change":"2024-09-12T00:54:40.310420+0000","last_active":"2024-09-12T00:54:40.310540+0000","last_peered":"2024-09-12T00:54:40.310540+0000","last_clean":"2024-09-12T00:54:40.310540+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:54:40.310540+0000","last_undegraded":"2024-09-12T00:54:40.310540+0000","last_fullsized":"2024-09-12T00:54:40.310540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.310255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:59.694076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.797268+0000","last_change":"2024-09-12T00:54:53.797268+0000","last_active":"2024-09-12T00:54:53.797268+0000","last_peered":"2024-09-12T00:54:53.797268+0000","last_clean":"2024-09-12T00:54:53.797268+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:54:53.797268+0000","last_undegraded":"2024-09-12T00:54:53.797268+0000","last_fullsized":"2024-09-12T00:54:53.797268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.797085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:00.567896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'349","reported_seq":1072,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.942474+0000","last_change":"2024-09-12T00:54:50.942474+0000","last_active":"2024-09-12T00:54:50.942474+0000","last_peered":"2024-09-12T00:54:50.942474+0000","last_clean":"2024-09-12T00:54:50.942474+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:50.942474+0000","last_undegraded":"2024-09-12T00:54:50.942474+0000","last_fullsized":"2024-09-12T00:54:50.942474+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.942260+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:21.958753+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32232,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":703,"num_write":258,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.650462+0000","last_change":"2024-09-12T00:55:07.650462+0000","last_active":"2024-09-12T00:55:07.650462+0000","last_peered":"2024-09-12T00:55:07.650462+0000","last_clean":"2024-09-12T00:55:07.650462+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:55:07.650462+0000","last_undegraded":"2024-09-12T00:55:07.650462+0000","last_fullsized":"2024-09-12T00:55:07.650462+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.650237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.650237+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.650237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:51.752192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'94","reported_seq":593,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.591231+0000","last_change":"2024-09-12T00:55:01.591231+0000","last_active":"2024-09-12T00:55:01.591231+0000","last_peered":"2024-09-12T00:55:01.591231+0000","last_clean":"2024-09-12T00:55:01.591231+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:55:01.591231+0000","last_undegraded":"2024-09-12T00:55:01.591231+0000","last_fullsized":"2024-09-12T00:55:01.591231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'94","last_scrub_stamp":"2024-09-12T00:55:01.591042+0000","last_deep_scrub":"266'94","last_deep_scrub_stamp":"2024-09-12T00:55:01.591042+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.591042+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:48.103864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'152","reported_seq":729,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.753121+0000","last_change":"2024-09-12T00:55:12.753121+0000","last_active":"2024-09-12T00:55:12.753121+0000","last_peered":"2024-09-12T00:55:12.753121+0000","last_clean":"2024-09-12T00:55:12.753121+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:55:12.753121+0000","last_undegraded":"2024-09-12T00:55:12.753121+0000","last_fullsized":"2024-09-12T00:55:12.753121+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T00:55:12.752926+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T00:55:12.752926+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.752926+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.244855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'406","reported_seq":1803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.789222+0000","last_change":"2024-09-12T00:54:45.789222+0000","last_active":"2024-09-12T00:54:45.789222+0000","last_peered":"2024-09-12T00:54:45.789222+0000","last_clean":"2024-09-12T00:54:45.789222+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:54:45.789222+0000","last_undegraded":"2024-09-12T00:54:45.789222+0000","last_fullsized":"2024-09-12T00:54:45.789222+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.789043+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.351155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'186","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.238029+0000","last_change":"2024-09-12T00:54:45.238029+0000","last_active":"2024-09-12T00:54:45.238029+0000","last_peered":"2024-09-12T00:54:45.238029+0000","last_clean":"2024-09-12T00:54:45.238029+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:54:45.238029+0000","last_undegraded":"2024-09-12T00:54:45.238029+0000","last_fullsized":"2024-09-12T00:54:45.238029+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.237784+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.782035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33239,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":101459,"num_write":845,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.524132+0000","last_change":"2024-09-12T00:54:54.524132+0000","last_active":"2024-09-12T00:54:54.524132+0000","last_peered":"2024-09-12T00:54:54.524132+0000","last_clean":"2024-09-12T00:54:54.524132+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:54:54.524132+0000","last_undegraded":"2024-09-12T00:54:54.524132+0000","last_fullsized":"2024-09-12T00:54:54.524132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.523944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.210297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'148","reported_seq":735,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.599336+0000","last_change":"2024-09-12T00:54:59.599336+0000","last_active":"2024-09-12T00:54:59.599336+0000","last_peered":"2024-09-12T00:54:59.599336+0000","last_clean":"2024-09-12T00:54:59.599336+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:54:59.599336+0000","last_undegraded":"2024-09-12T00:54:59.599336+0000","last_fullsized":"2024-09-12T00:54:59.599336+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T00:54:59.599075+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T00:54:59.599075+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.599075+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.491961+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13149,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":189,"num_read_kb":268,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.622430+0000","last_change":"2024-09-12T00:54:57.622430+0000","last_active":"2024-09-12T00:54:57.622430+0000","last_peered":"2024-09-12T00:54:57.622430+0000","last_clean":"2024-09-12T00:54:57.622430+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:54:57.622430+0000","last_undegraded":"2024-09-12T00:54:57.622430+0000","last_fullsized":"2024-09-12T00:54:57.622430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.622225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.622225+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.622225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:41.794751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.610490+0000","last_change":"2024-09-12T00:55:03.610490+0000","last_active":"2024-09-12T00:55:03.610490+0000","last_peered":"2024-09-12T00:55:03.610490+0000","last_clean":"2024-09-12T00:55:03.610490+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:55:03.610490+0000","last_undegraded":"2024-09-12T00:55:03.610490+0000","last_fullsized":"2024-09-12T00:55:03.610490+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T00:55:03.610311+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T00:55:03.610311+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.610311+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:45.463442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'349","reported_seq":1872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.754171+0000","last_change":"2024-09-12T00:54:46.754171+0000","last_active":"2024-09-12T00:54:46.754171+0000","last_peered":"2024-09-12T00:54:46.754171+0000","last_clean":"2024-09-12T00:54:46.754171+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:54:46.754171+0000","last_undegraded":"2024-09-12T00:54:46.754171+0000","last_fullsized":"2024-09-12T00:54:46.754171+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.753992+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.515601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'340","reported_seq":1021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.976417+0000","last_change":"2024-09-12T00:54:37.976334+0000","last_active":"2024-09-12T00:54:37.976417+0000","last_peered":"2024-09-12T00:54:37.976417+0000","last_clean":"2024-09-12T00:54:37.976417+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:54:37.976417+0000","last_undegraded":"2024-09-12T00:54:37.976417+0000","last_fullsized":"2024-09-12T00:54:37.976417+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'340","last_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_deep_scrub":"266'340","last_deep_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.976207+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.328642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":797,"num_read_kb":9288,"num_write":1291,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.735034+0000","last_change":"2024-09-12T00:54:55.735034+0000","last_active":"2024-09-12T00:54:55.735034+0000","last_peered":"2024-09-12T00:54:55.735034+0000","last_clean":"2024-09-12T00:54:55.735034+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:54:55.735034+0000","last_undegraded":"2024-09-12T00:54:55.735034+0000","last_fullsized":"2024-09-12T00:54:55.735034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.734861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:10.701469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'57","reported_seq":569,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.743197+0000","last_change":"2024-09-12T00:55:02.743197+0000","last_active":"2024-09-12T00:55:02.743197+0000","last_peered":"2024-09-12T00:55:02.743197+0000","last_clean":"2024-09-12T00:55:02.743197+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:55:02.743197+0000","last_undegraded":"2024-09-12T00:55:02.743197+0000","last_fullsized":"2024-09-12T00:55:02.743197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'57","last_scrub_stamp":"2024-09-12T00:55:02.743015+0000","last_deep_scrub":"266'57","last_deep_scrub_stamp":"2024-09-12T00:55:02.743015+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.743015+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:46.675016+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.701161+0000","last_change":"2024-09-12T00:54:57.701161+0000","last_active":"2024-09-12T00:54:57.701161+0000","last_peered":"2024-09-12T00:54:57.701161+0000","last_clean":"2024-09-12T00:54:57.701161+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:54:57.701161+0000","last_undegraded":"2024-09-12T00:54:57.701161+0000","last_fullsized":"2024-09-12T00:54:57.701161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.700977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.700977+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.700977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:41.098461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'196","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.724177+0000","last_change":"2024-09-12T00:55:06.724177+0000","last_active":"2024-09-12T00:55:06.724177+0000","last_peered":"2024-09-12T00:55:06.724177+0000","last_clean":"2024-09-12T00:55:06.724177+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:55:06.724177+0000","last_undegraded":"2024-09-12T00:55:06.724177+0000","last_fullsized":"2024-09-12T00:55:06.724177+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T00:55:06.723928+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T00:55:06.723928+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.723928+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.442636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'774","reported_seq":2195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.737013+0000","last_change":"2024-09-12T00:54:45.737013+0000","last_active":"2024-09-12T00:54:45.737013+0000","last_peered":"2024-09-12T00:54:45.737013+0000","last_clean":"2024-09-12T00:54:45.737013+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:54:45.737013+0000","last_undegraded":"2024-09-12T00:54:45.737013+0000","last_fullsized":"2024-09-12T00:54:45.737013+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.736834+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.215351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'193","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.705741+0000","last_change":"2024-09-12T00:54:36.705674+0000","last_active":"2024-09-12T00:54:36.705741+0000","last_peered":"2024-09-12T00:54:36.705741+0000","last_clean":"2024-09-12T00:54:36.705741+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:36.705741+0000","last_undegraded":"2024-09-12T00:54:36.705741+0000","last_fullsized":"2024-09-12T00:54:36.705741+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.705560+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:37.794357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":25665,"num_write":923,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.705205+0000","last_change":"2024-09-12T00:54:49.705205+0000","last_active":"2024-09-12T00:54:49.705205+0000","last_peered":"2024-09-12T00:54:49.705205+0000","last_clean":"2024-09-12T00:54:49.705205+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:54:49.705205+0000","last_undegraded":"2024-09-12T00:54:49.705205+0000","last_fullsized":"2024-09-12T00:54:49.705205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.704924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:10.256859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'181","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.589082+0000","last_change":"2024-09-12T00:54:56.589082+0000","last_active":"2024-09-12T00:54:56.589082+0000","last_peered":"2024-09-12T00:54:56.589082+0000","last_clean":"2024-09-12T00:54:56.589082+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:54:56.589082+0000","last_undegraded":"2024-09-12T00:54:56.589082+0000","last_fullsized":"2024-09-12T00:54:56.589082+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'181","last_scrub_stamp":"2024-09-12T00:54:56.588880+0000","last_deep_scrub":"266'181","last_deep_scrub_stamp":"2024-09-12T00:54:56.588880+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.588880+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:45.522846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":233,"num_read_kb":302,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.661285+0000","last_change":"2024-09-12T00:54:59.661285+0000","last_active":"2024-09-12T00:54:59.661285+0000","last_peered":"2024-09-12T00:54:59.661285+0000","last_clean":"2024-09-12T00:54:59.661285+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:54:59.661285+0000","last_undegraded":"2024-09-12T00:54:59.661285+0000","last_fullsized":"2024-09-12T00:54:59.661285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.661085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.661085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.661085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.480747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'105","reported_seq":619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.376047+0000","last_change":"2024-09-12T00:55:21.376047+0000","last_active":"2024-09-12T00:55:21.376047+0000","last_peered":"2024-09-12T00:55:21.376047+0000","last_clean":"2024-09-12T00:55:21.376047+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:55:21.376047+0000","last_undegraded":"2024-09-12T00:55:21.376047+0000","last_fullsized":"2024-09-12T00:55:21.376047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'105","last_scrub_stamp":"2024-09-12T00:55:21.375847+0000","last_deep_scrub":"266'105","last_deep_scrub_stamp":"2024-09-12T00:55:21.375847+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.375847+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:21.223181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'809","reported_seq":2303,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.643771+0000","last_change":"2024-09-12T00:54:44.643771+0000","last_active":"2024-09-12T00:54:44.643771+0000","last_peered":"2024-09-12T00:54:44.643771+0000","last_clean":"2024-09-12T00:54:44.643771+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:54:44.643771+0000","last_undegraded":"2024-09-12T00:54:44.643771+0000","last_fullsized":"2024-09-12T00:54:44.643771+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'809","last_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_deep_scrub":"266'809","last_deep_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.643588+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.445327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'197","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.551808+0000","last_change":"2024-09-12T00:54:39.551664+0000","last_active":"2024-09-12T00:54:39.551808+0000","last_peered":"2024-09-12T00:54:39.551808+0000","last_clean":"2024-09-12T00:54:39.551808+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:54:39.551808+0000","last_undegraded":"2024-09-12T00:54:39.551808+0000","last_fullsized":"2024-09-12T00:54:39.551808+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'197","last_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_deep_scrub":"266'197","last_deep_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.551438+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.232360+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":36400,"num_write":906,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.287499+0000","last_change":"2024-09-12T00:55:04.287499+0000","last_active":"2024-09-12T00:55:04.287499+0000","last_peered":"2024-09-12T00:55:04.287499+0000","last_clean":"2024-09-12T00:55:04.287499+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:55:04.287499+0000","last_undegraded":"2024-09-12T00:55:04.287499+0000","last_fullsized":"2024-09-12T00:55:04.287499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:04.287222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:04.287222+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.287222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.892615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'134","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.006533+0000","last_change":"2024-09-12T00:54:55.006533+0000","last_active":"2024-09-12T00:54:55.006533+0000","last_peered":"2024-09-12T00:54:55.006533+0000","last_clean":"2024-09-12T00:54:55.006533+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:54:55.006533+0000","last_undegraded":"2024-09-12T00:54:55.006533+0000","last_fullsized":"2024-09-12T00:54:55.006533+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.006347+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:12.305618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6499,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":240,"num_write":94,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.593010+0000","last_change":"2024-09-12T00:54:59.593010+0000","last_active":"2024-09-12T00:54:59.593010+0000","last_peered":"2024-09-12T00:54:59.593010+0000","last_clean":"2024-09-12T00:54:59.593010+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:54:59.593010+0000","last_undegraded":"2024-09-12T00:54:59.593010+0000","last_fullsized":"2024-09-12T00:54:59.593010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.592584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.592584+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.592584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:37.408039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'725","reported_seq":2115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.172748+0000","last_change":"2024-09-12T00:54:56.172604+0000","last_active":"2024-09-12T00:54:56.172748+0000","last_peered":"2024-09-12T00:54:56.172748+0000","last_clean":"2024-09-12T00:54:56.172748+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:54:56.172748+0000","last_undegraded":"2024-09-12T00:54:56.172748+0000","last_fullsized":"2024-09-12T00:54:56.172748+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'725","last_scrub_stamp":"2024-09-12T00:54:56.172411+0000","last_deep_scrub":"266'725","last_deep_scrub_stamp":"2024-09-12T00:54:56.172411+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.172411+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:04.190295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'194","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.582575+0000","last_change":"2024-09-12T00:54:40.582437+0000","last_active":"2024-09-12T00:54:40.582575+0000","last_peered":"2024-09-12T00:54:40.582575+0000","last_clean":"2024-09-12T00:54:40.582575+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:54:40.582575+0000","last_undegraded":"2024-09-12T00:54:40.582575+0000","last_fullsized":"2024-09-12T00:54:40.582575+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.582154+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.450282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755647,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":8092,"num_write":868,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.539786+0000","last_change":"2024-09-12T00:54:55.539786+0000","last_active":"2024-09-12T00:54:55.539786+0000","last_peered":"2024-09-12T00:54:55.539786+0000","last_clean":"2024-09-12T00:54:55.539786+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:54:55.539786+0000","last_undegraded":"2024-09-12T00:54:55.539786+0000","last_fullsized":"2024-09-12T00:54:55.539786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.539573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:02.177277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'205","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.614176+0000","last_change":"2024-09-12T00:55:01.614176+0000","last_active":"2024-09-12T00:55:01.614176+0000","last_peered":"2024-09-12T00:55:01.614176+0000","last_clean":"2024-09-12T00:55:01.614176+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:55:01.614176+0000","last_undegraded":"2024-09-12T00:55:01.614176+0000","last_fullsized":"2024-09-12T00:55:01.614176+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:55:01.613970+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:55:01.613970+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.613970+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:11.791579+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19799,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":407,"num_write":194,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.659749+0000","last_change":"2024-09-12T00:54:58.659749+0000","last_active":"2024-09-12T00:54:58.659749+0000","last_peered":"2024-09-12T00:54:58.659749+0000","last_clean":"2024-09-12T00:54:58.659749+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:54:58.659749+0000","last_undegraded":"2024-09-12T00:54:58.659749+0000","last_fullsized":"2024-09-12T00:54:58.659749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:58.659661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:58.659661+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.659661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.061740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'156","reported_seq":663,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.308323+0000","last_change":"2024-09-12T00:55:13.308323+0000","last_active":"2024-09-12T00:55:13.308323+0000","last_peered":"2024-09-12T00:55:13.308323+0000","last_clean":"2024-09-12T00:55:13.308323+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:55:13.308323+0000","last_undegraded":"2024-09-12T00:55:13.308323+0000","last_fullsized":"2024-09-12T00:55:13.308323+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T00:55:13.308134+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T00:55:13.308134+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.308134+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:49.799531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'503","reported_seq":2231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.793156+0000","last_change":"2024-09-12T00:54:49.793156+0000","last_active":"2024-09-12T00:54:49.793156+0000","last_peered":"2024-09-12T00:54:49.793156+0000","last_clean":"2024-09-12T00:54:49.793156+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:54:49.793156+0000","last_undegraded":"2024-09-12T00:54:49.793156+0000","last_fullsized":"2024-09-12T00:54:49.793156+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'503","last_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_deep_scrub":"266'503","last_deep_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.792973+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.396328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3754,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'205","reported_seq":881,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.723302+0000","last_change":"2024-09-12T00:54:37.723164+0000","last_active":"2024-09-12T00:54:37.723302+0000","last_peered":"2024-09-12T00:54:37.723302+0000","last_clean":"2024-09-12T00:54:37.723302+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:54:37.723302+0000","last_undegraded":"2024-09-12T00:54:37.723302+0000","last_fullsized":"2024-09-12T00:54:37.723302+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.722978+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.296272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":547,"num_read_kb":23120,"num_write":969,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.723243+0000","last_change":"2024-09-12T00:54:53.723086+0000","last_active":"2024-09-12T00:54:53.723243+0000","last_peered":"2024-09-12T00:54:53.723243+0000","last_clean":"2024-09-12T00:54:53.723243+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:54:53.723243+0000","last_undegraded":"2024-09-12T00:54:53.723243+0000","last_fullsized":"2024-09-12T00:54:53.723243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.722892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.871247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'173","reported_seq":762,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.218477+0000","last_change":"2024-09-12T00:55:09.218477+0000","last_active":"2024-09-12T00:55:09.218477+0000","last_peered":"2024-09-12T00:55:09.218477+0000","last_clean":"2024-09-12T00:55:09.218477+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:55:09.218477+0000","last_undegraded":"2024-09-12T00:55:09.218477+0000","last_fullsized":"2024-09-12T00:55:09.218477+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'173","last_scrub_stamp":"2024-09-12T00:55:09.218279+0000","last_deep_scrub":"266'173","last_deep_scrub_stamp":"2024-09-12T00:55:09.218279+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.218279+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.404309+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7301,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":226,"num_read_kb":291,"num_write":146,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.330367+0000","last_change":"2024-09-12T00:55:07.330367+0000","last_active":"2024-09-12T00:55:07.330367+0000","last_peered":"2024-09-12T00:55:07.330367+0000","last_clean":"2024-09-12T00:55:07.330367+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:55:07.330367+0000","last_undegraded":"2024-09-12T00:55:07.330367+0000","last_fullsized":"2024-09-12T00:55:07.330367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.330163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.330163+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.330163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.603458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'197","reported_seq":1071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.403183+0000","last_change":"2024-09-12T00:55:22.403183+0000","last_active":"2024-09-12T00:55:22.403183+0000","last_peered":"2024-09-12T00:55:22.403183+0000","last_clean":"2024-09-12T00:55:22.403183+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:55:22.403183+0000","last_undegraded":"2024-09-12T00:55:22.403183+0000","last_fullsized":"2024-09-12T00:55:22.403183+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'197","last_scrub_stamp":"2024-09-12T00:55:22.402946+0000","last_deep_scrub":"266'197","last_deep_scrub_stamp":"2024-09-12T00:55:22.402946+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.402946+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.492226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'811","reported_seq":2321,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.633649+0000","last_change":"2024-09-12T00:54:45.633649+0000","last_active":"2024-09-12T00:54:45.633649+0000","last_peered":"2024-09-12T00:54:45.633649+0000","last_clean":"2024-09-12T00:54:45.633649+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:54:45.633649+0000","last_undegraded":"2024-09-12T00:54:45.633649+0000","last_fullsized":"2024-09-12T00:54:45.633649+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'811","last_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_deep_scrub":"266'811","last_deep_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.633450+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:59.575094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'210","reported_seq":822,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.236261+0000","last_change":"2024-09-12T00:54:38.236261+0000","last_active":"2024-09-12T00:54:38.236261+0000","last_peered":"2024-09-12T00:54:38.236261+0000","last_clean":"2024-09-12T00:54:38.236261+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:38.236261+0000","last_undegraded":"2024-09-12T00:54:38.236261+0000","last_fullsized":"2024-09-12T00:54:38.236261+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.236030+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:45.112722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":380,"num_read_kb":5549,"num_write":1015,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.754225+0000","last_change":"2024-09-12T00:54:51.754225+0000","last_active":"2024-09-12T00:54:51.754225+0000","last_peered":"2024-09-12T00:54:51.754225+0000","last_clean":"2024-09-12T00:54:51.754225+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:54:51.754225+0000","last_undegraded":"2024-09-12T00:54:51.754225+0000","last_fullsized":"2024-09-12T00:54:51.754225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.753927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:23.486364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'155","reported_seq":744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.612740+0000","last_change":"2024-09-12T00:55:00.612740+0000","last_active":"2024-09-12T00:55:00.612740+0000","last_peered":"2024-09-12T00:55:00.612740+0000","last_clean":"2024-09-12T00:55:00.612740+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:55:00.612740+0000","last_undegraded":"2024-09-12T00:55:00.612740+0000","last_fullsized":"2024-09-12T00:55:00.612740+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'155","last_scrub_stamp":"2024-09-12T00:55:00.612507+0000","last_deep_scrub":"266'155","last_deep_scrub_stamp":"2024-09-12T00:55:00.612507+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.612507+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.877171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":186,"num_read_kb":226,"num_write":104,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.598646+0000","last_change":"2024-09-12T00:54:58.598646+0000","last_active":"2024-09-12T00:54:58.598646+0000","last_peered":"2024-09-12T00:54:58.598646+0000","last_clean":"2024-09-12T00:54:58.598646+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:54:58.598646+0000","last_undegraded":"2024-09-12T00:54:58.598646+0000","last_fullsized":"2024-09-12T00:54:58.598646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:58.598472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:58.598472+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.598472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:24.699387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'156","reported_seq":653,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.355045+0000","last_change":"2024-09-12T00:55:19.355045+0000","last_active":"2024-09-12T00:55:19.355045+0000","last_peered":"2024-09-12T00:55:19.355045+0000","last_clean":"2024-09-12T00:55:19.355045+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:55:19.355045+0000","last_undegraded":"2024-09-12T00:55:19.355045+0000","last_fullsized":"2024-09-12T00:55:19.355045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T00:55:19.354855+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T00:55:19.354855+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.354855+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:44.141717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'791","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.743302+0000","last_change":"2024-09-12T00:54:47.743302+0000","last_active":"2024-09-12T00:54:47.743302+0000","last_peered":"2024-09-12T00:54:47.743302+0000","last_clean":"2024-09-12T00:54:47.743302+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:54:47.743302+0000","last_undegraded":"2024-09-12T00:54:47.743302+0000","last_fullsized":"2024-09-12T00:54:47.743302+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.743080+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.272707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'210","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.734334+0000","last_change":"2024-09-12T00:54:41.734334+0000","last_active":"2024-09-12T00:54:41.734334+0000","last_peered":"2024-09-12T00:54:41.734334+0000","last_clean":"2024-09-12T00:54:41.734334+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:54:41.734334+0000","last_undegraded":"2024-09-12T00:54:41.734334+0000","last_fullsized":"2024-09-12T00:54:41.734334+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.734103+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.931010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1993302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":30758,"num_write":1020,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.755305+0000","last_change":"2024-09-12T00:54:59.755305+0000","last_active":"2024-09-12T00:54:59.755305+0000","last_peered":"2024-09-12T00:54:59.755305+0000","last_clean":"2024-09-12T00:54:59.755305+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:54:59.755305+0000","last_undegraded":"2024-09-12T00:54:59.755305+0000","last_fullsized":"2024-09-12T00:54:59.755305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.755091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.755091+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.755091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:30.296128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'103","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.263209+0000","last_change":"2024-09-12T00:55:11.263209+0000","last_active":"2024-09-12T00:55:11.263209+0000","last_peered":"2024-09-12T00:55:11.263209+0000","last_clean":"2024-09-12T00:55:11.263209+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:55:11.263209+0000","last_undegraded":"2024-09-12T00:55:11.263209+0000","last_fullsized":"2024-09-12T00:55:11.263209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'103","last_scrub_stamp":"2024-09-12T00:55:11.262951+0000","last_deep_scrub":"266'103","last_deep_scrub_stamp":"2024-09-12T00:55:11.262951+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.262951+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:45.225247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'756","reported_seq":2397,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.048059+0000","last_change":"2024-09-12T00:54:59.048059+0000","last_active":"2024-09-12T00:54:59.048059+0000","last_peered":"2024-09-12T00:54:59.048059+0000","last_clean":"2024-09-12T00:54:59.048059+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:59.048059+0000","last_undegraded":"2024-09-12T00:54:59.048059+0000","last_fullsized":"2024-09-12T00:54:59.048059+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'756","last_scrub_stamp":"2024-09-12T00:54:59.047863+0000","last_deep_scrub":"266'756","last_deep_scrub_stamp":"2024-09-12T00:54:59.047863+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.047863+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:11.693776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.285920+0000","last_change":"2024-09-12T00:55:17.285920+0000","last_active":"2024-09-12T00:55:17.285920+0000","last_peered":"2024-09-12T00:55:17.285920+0000","last_clean":"2024-09-12T00:55:17.285920+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:55:17.285920+0000","last_undegraded":"2024-09-12T00:55:17.285920+0000","last_fullsized":"2024-09-12T00:55:17.285920+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'130","last_scrub_stamp":"2024-09-12T00:55:17.285747+0000","last_deep_scrub":"266'130","last_deep_scrub_stamp":"2024-09-12T00:55:17.285747+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.285747+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:44.686218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'465","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.746619+0000","last_change":"2024-09-12T00:54:46.746619+0000","last_active":"2024-09-12T00:54:46.746619+0000","last_peered":"2024-09-12T00:54:46.746619+0000","last_clean":"2024-09-12T00:54:46.746619+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:54:46.746619+0000","last_undegraded":"2024-09-12T00:54:46.746619+0000","last_fullsized":"2024-09-12T00:54:46.746619+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'465","last_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_deep_scrub":"266'465","last_deep_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.746430+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:31.460666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'218","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.261923+0000","last_change":"2024-09-12T00:54:39.261923+0000","last_active":"2024-09-12T00:54:39.261923+0000","last_peered":"2024-09-12T00:54:39.261923+0000","last_clean":"2024-09-12T00:54:39.261923+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:39.261923+0000","last_undegraded":"2024-09-12T00:54:39.261923+0000","last_fullsized":"2024-09-12T00:54:39.261923+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.261665+0000","objects_scrubbed":10,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:35.988750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457849,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":55718,"num_write":1000,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.492143+0000","last_change":"2024-09-12T00:54:53.492143+0000","last_active":"2024-09-12T00:54:53.492143+0000","last_peered":"2024-09-12T00:54:53.492143+0000","last_clean":"2024-09-12T00:54:53.492143+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:54:53.492143+0000","last_undegraded":"2024-09-12T00:54:53.492143+0000","last_fullsized":"2024-09-12T00:54:53.492143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.491956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:33.502230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'199","reported_seq":808,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.068069+0000","last_change":"2024-09-12T00:54:58.067933+0000","last_active":"2024-09-12T00:54:58.068069+0000","last_peered":"2024-09-12T00:54:58.068069+0000","last_clean":"2024-09-12T00:54:58.068069+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:54:58.068069+0000","last_undegraded":"2024-09-12T00:54:58.068069+0000","last_fullsized":"2024-09-12T00:54:58.068069+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T00:54:58.067708+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T00:54:58.067708+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.067708+0000","objects_scrubbed":11,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.132974+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":245,"num_read_kb":305,"num_write":140,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.650304+0000","last_change":"2024-09-12T00:55:09.650138+0000","last_active":"2024-09-12T00:55:09.650304+0000","last_peered":"2024-09-12T00:55:09.650304+0000","last_clean":"2024-09-12T00:55:09.650304+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:55:09.650304+0000","last_undegraded":"2024-09-12T00:55:09.650304+0000","last_fullsized":"2024-09-12T00:55:09.650304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.649922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.649922+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.649922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:45.268590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'127","reported_seq":635,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.659676+0000","last_change":"2024-09-12T00:55:04.659536+0000","last_active":"2024-09-12T00:55:04.659676+0000","last_peered":"2024-09-12T00:55:04.659676+0000","last_clean":"2024-09-12T00:55:04.659676+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:55:04.659676+0000","last_undegraded":"2024-09-12T00:55:04.659676+0000","last_fullsized":"2024-09-12T00:55:04.659676+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'127","last_scrub_stamp":"2024-09-12T00:55:04.659361+0000","last_deep_scrub":"266'127","last_deep_scrub_stamp":"2024-09-12T00:55:04.659361+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.659361+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:16.848398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'929","reported_seq":2641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.729243+0000","last_change":"2024-09-12T00:54:50.729243+0000","last_active":"2024-09-12T00:54:50.729243+0000","last_peered":"2024-09-12T00:54:50.729243+0000","last_clean":"2024-09-12T00:54:50.729243+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:54:50.729243+0000","last_undegraded":"2024-09-12T00:54:50.729243+0000","last_fullsized":"2024-09-12T00:54:50.729243+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.729071+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:45.264752+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":930,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'221","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.188603+0000","last_change":"2024-09-12T00:54:47.188603+0000","last_active":"2024-09-12T00:54:47.188603+0000","last_peered":"2024-09-12T00:54:47.188603+0000","last_clean":"2024-09-12T00:54:47.188603+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:54:47.188603+0000","last_undegraded":"2024-09-12T00:54:47.188603+0000","last_fullsized":"2024-09-12T00:54:47.188603+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.188407+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:18.153988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":417,"num_read_kb":8883,"num_write":990,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.762197+0000","last_change":"2024-09-12T00:54:52.762197+0000","last_active":"2024-09-12T00:54:52.762197+0000","last_peered":"2024-09-12T00:54:52.762197+0000","last_clean":"2024-09-12T00:54:52.762197+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:54:52.762197+0000","last_undegraded":"2024-09-12T00:54:52.762197+0000","last_fullsized":"2024-09-12T00:54:52.762197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.761997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:26.003820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'137","reported_seq":720,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.623381+0000","last_change":"2024-09-12T00:55:05.623154+0000","last_active":"2024-09-12T00:55:05.623381+0000","last_peered":"2024-09-12T00:55:05.623381+0000","last_clean":"2024-09-12T00:55:05.623381+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:55:05.623381+0000","last_undegraded":"2024-09-12T00:55:05.623381+0000","last_fullsized":"2024-09-12T00:55:05.623381+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'137","last_scrub_stamp":"2024-09-12T00:55:05.622864+0000","last_deep_scrub":"266'137","last_deep_scrub_stamp":"2024-09-12T00:55:05.622864+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.622864+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:28.404950+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":258,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.292959+0000","last_change":"2024-09-12T00:55:16.292827+0000","last_active":"2024-09-12T00:55:16.292959+0000","last_peered":"2024-09-12T00:55:16.292959+0000","last_clean":"2024-09-12T00:55:16.292959+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:55:16.292959+0000","last_undegraded":"2024-09-12T00:55:16.292959+0000","last_fullsized":"2024-09-12T00:55:16.292959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:16.292642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:16.292642+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.292642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:02.147093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'124","reported_seq":652,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.282681+0000","last_change":"2024-09-12T00:55:15.282529+0000","last_active":"2024-09-12T00:55:15.282681+0000","last_peered":"2024-09-12T00:55:15.282681+0000","last_clean":"2024-09-12T00:55:15.282681+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:55:15.282681+0000","last_undegraded":"2024-09-12T00:55:15.282681+0000","last_fullsized":"2024-09-12T00:55:15.282681+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'124","last_scrub_stamp":"2024-09-12T00:55:15.282342+0000","last_deep_scrub":"266'124","last_deep_scrub_stamp":"2024-09-12T00:55:15.282342+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.282342+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:46.675309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'511","reported_seq":2140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.644913+0000","last_change":"2024-09-12T00:54:42.644781+0000","last_active":"2024-09-12T00:54:42.644913+0000","last_peered":"2024-09-12T00:54:42.644913+0000","last_clean":"2024-09-12T00:54:42.644913+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:54:42.644913+0000","last_undegraded":"2024-09-12T00:54:42.644913+0000","last_fullsized":"2024-09-12T00:54:42.644913+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.644589+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":400,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:44.947353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'213","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.537375+0000","last_change":"2024-09-12T00:54:41.537375+0000","last_active":"2024-09-12T00:54:41.537375+0000","last_peered":"2024-09-12T00:54:41.537375+0000","last_clean":"2024-09-12T00:54:41.537375+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:54:41.537375+0000","last_undegraded":"2024-09-12T00:54:41.537375+0000","last_fullsized":"2024-09-12T00:54:41.537375+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.537037+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:47.685748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":6403,"num_write":967,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.497212+0000","last_change":"2024-09-12T00:54:51.497088+0000","last_active":"2024-09-12T00:54:51.497212+0000","last_peered":"2024-09-12T00:54:51.497212+0000","last_clean":"2024-09-12T00:54:51.497212+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:54:51.497212+0000","last_undegraded":"2024-09-12T00:54:51.497212+0000","last_fullsized":"2024-09-12T00:54:51.497212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.496915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.499895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'104","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.550906+0000","last_change":"2024-09-12T00:54:58.550906+0000","last_active":"2024-09-12T00:54:58.550906+0000","last_peered":"2024-09-12T00:54:58.550906+0000","last_clean":"2024-09-12T00:54:58.550906+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:58.550906+0000","last_undegraded":"2024-09-12T00:54:58.550906+0000","last_fullsized":"2024-09-12T00:54:58.550906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'104","last_scrub_stamp":"2024-09-12T00:54:58.550730+0000","last_deep_scrub":"266'104","last_deep_scrub_stamp":"2024-09-12T00:54:58.550730+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.550730+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:46.144209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":203,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.318007+0000","last_change":"2024-09-12T00:55:18.318007+0000","last_active":"2024-09-12T00:55:18.318007+0000","last_peered":"2024-09-12T00:55:18.318007+0000","last_clean":"2024-09-12T00:55:18.318007+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:55:18.318007+0000","last_undegraded":"2024-09-12T00:55:18.318007+0000","last_fullsized":"2024-09-12T00:55:18.318007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.317784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.317784+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.317784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:55.970944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'170","reported_seq":1304,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.393568+0000","last_change":"2024-09-12T00:55:20.393332+0000","last_active":"2024-09-12T00:55:20.393568+0000","last_peered":"2024-09-12T00:55:20.393568+0000","last_clean":"2024-09-12T00:55:20.393568+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:55:20.393568+0000","last_undegraded":"2024-09-12T00:55:20.393568+0000","last_fullsized":"2024-09-12T00:55:20.393568+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T00:55:20.393104+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T00:55:20.393104+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.393104+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:48.265773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'393","reported_seq":1795,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.733300+0000","last_change":"2024-09-12T00:54:47.733121+0000","last_active":"2024-09-12T00:54:47.733300+0000","last_peered":"2024-09-12T00:54:47.733300+0000","last_clean":"2024-09-12T00:54:47.733300+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:54:47.733300+0000","last_undegraded":"2024-09-12T00:54:47.733300+0000","last_fullsized":"2024-09-12T00:54:47.733300+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.732939+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.184825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'225","reported_seq":863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.578613+0000","last_change":"2024-09-12T00:54:44.578362+0000","last_active":"2024-09-12T00:54:44.578613+0000","last_peered":"2024-09-12T00:54:44.578613+0000","last_clean":"2024-09-12T00:54:44.578613+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:54:44.578613+0000","last_undegraded":"2024-09-12T00:54:44.578613+0000","last_fullsized":"2024-09-12T00:54:44.578613+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'225","last_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_deep_scrub":"266'225","last_deep_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.577941+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:23.931116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":20983,"num_write":1046,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.760660+0000","last_change":"2024-09-12T00:54:58.760497+0000","last_active":"2024-09-12T00:54:58.760660+0000","last_peered":"2024-09-12T00:54:58.760660+0000","last_clean":"2024-09-12T00:54:58.760660+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:54:58.760660+0000","last_undegraded":"2024-09-12T00:54:58.760660+0000","last_fullsized":"2024-09-12T00:54:58.760660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:58.760309+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:58.760309+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.760309+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:46.076140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'183","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.285066+0000","last_change":"2024-09-12T00:55:12.285066+0000","last_active":"2024-09-12T00:55:12.285066+0000","last_peered":"2024-09-12T00:55:12.285066+0000","last_clean":"2024-09-12T00:55:12.285066+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:55:12.285066+0000","last_undegraded":"2024-09-12T00:55:12.285066+0000","last_fullsized":"2024-09-12T00:55:12.285066+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T00:55:12.284872+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T00:55:12.284872+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.284872+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:35.221329+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9188,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":326,"num_write":136,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.672605+0000","last_change":"2024-09-12T00:55:10.672605+0000","last_active":"2024-09-12T00:55:10.672605+0000","last_peered":"2024-09-12T00:55:10.672605+0000","last_clean":"2024-09-12T00:55:10.672605+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:55:10.672605+0000","last_undegraded":"2024-09-12T00:55:10.672605+0000","last_fullsized":"2024-09-12T00:55:10.672605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:10.672416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:10.672416+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.672416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.038683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'124","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.100910+0000","last_change":"2024-09-12T00:55:01.100910+0000","last_active":"2024-09-12T00:55:01.100910+0000","last_peered":"2024-09-12T00:55:01.100910+0000","last_clean":"2024-09-12T00:55:01.100910+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:55:01.100910+0000","last_undegraded":"2024-09-12T00:55:01.100910+0000","last_fullsized":"2024-09-12T00:55:01.100910+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'124","last_scrub_stamp":"2024-09-12T00:55:01.100722+0000","last_deep_scrub":"266'124","last_deep_scrub_stamp":"2024-09-12T00:55:01.100722+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.100722+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:17.235489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'499","reported_seq":2033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.741827+0000","last_change":"2024-09-12T00:54:48.741666+0000","last_active":"2024-09-12T00:54:48.741827+0000","last_peered":"2024-09-12T00:54:48.741827+0000","last_clean":"2024-09-12T00:54:48.741827+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:54:48.741827+0000","last_undegraded":"2024-09-12T00:54:48.741827+0000","last_fullsized":"2024-09-12T00:54:48.741827+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.741497+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:24.293528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'193","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.748016+0000","last_change":"2024-09-12T00:54:40.747873+0000","last_active":"2024-09-12T00:54:40.748016+0000","last_peered":"2024-09-12T00:54:40.748016+0000","last_clean":"2024-09-12T00:54:40.748016+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:54:40.748016+0000","last_undegraded":"2024-09-12T00:54:40.748016+0000","last_fullsized":"2024-09-12T00:54:40.748016+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.747645+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:07.125444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069312,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":61937,"num_write":920,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'819","reported_seq":2328,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.636401+0000","last_change":"2024-09-12T00:54:46.636159+0000","last_active":"2024-09-12T00:54:46.636401+0000","last_peered":"2024-09-12T00:54:46.636401+0000","last_clean":"2024-09-12T00:54:46.636401+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:54:46.636401+0000","last_undegraded":"2024-09-12T00:54:46.636401+0000","last_fullsized":"2024-09-12T00:54:46.636401+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'819","last_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_deep_scrub":"266'819","last_deep_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.635949+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:39.192196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1184,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'189","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.614966+0000","last_change":"2024-09-12T00:54:40.614805+0000","last_active":"2024-09-12T00:54:40.614966+0000","last_peered":"2024-09-12T00:54:40.614966+0000","last_clean":"2024-09-12T00:54:40.614966+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:54:40.614966+0000","last_undegraded":"2024-09-12T00:54:40.614966+0000","last_fullsized":"2024-09-12T00:54:40.614966+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'189","last_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_deep_scrub":"266'189","last_deep_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.614609+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:12.172432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":418,"num_read_kb":18747,"num_write":861,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1207","reported_seq":2895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.174934+0000","last_change":"2024-09-12T00:54:57.174792+0000","last_active":"2024-09-12T00:54:57.174934+0000","last_peered":"2024-09-12T00:54:57.174934+0000","last_clean":"2024-09-12T00:54:57.174934+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:54:57.174934+0000","last_undegraded":"2024-09-12T00:54:57.174934+0000","last_fullsized":"2024-09-12T00:54:57.174934+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1207","last_scrub_stamp":"2024-09-12T00:54:57.174594+0000","last_deep_scrub":"266'1207","last_deep_scrub_stamp":"2024-09-12T00:54:57.174594+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.174594+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":1100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:27.434860+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4666,"num_omap_keys":19,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'209","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.227394+0000","last_change":"2024-09-12T00:54:46.227154+0000","last_active":"2024-09-12T00:54:46.227394+0000","last_peered":"2024-09-12T00:54:46.227394+0000","last_clean":"2024-09-12T00:54:46.227394+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:54:46.227394+0000","last_undegraded":"2024-09-12T00:54:46.227394+0000","last_fullsized":"2024-09-12T00:54:46.227394+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'209","last_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_deep_scrub":"266'209","last_deep_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.226930+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:33.782653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753496,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":35398,"num_write":969,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'475","reported_seq":2066,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.529028+0000","last_change":"2024-09-12T00:54:54.528895+0000","last_active":"2024-09-12T00:54:54.529028+0000","last_peered":"2024-09-12T00:54:54.529028+0000","last_clean":"2024-09-12T00:54:54.529028+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:54:54.529028+0000","last_undegraded":"2024-09-12T00:54:54.529028+0000","last_fullsized":"2024-09-12T00:54:54.529028+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'475","last_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_deep_scrub":"266'475","last_deep_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.528706+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:14.173614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2762,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'203","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.586198+0000","last_change":"2024-09-12T00:54:42.586198+0000","last_active":"2024-09-12T00:54:42.586198+0000","last_peered":"2024-09-12T00:54:42.586198+0000","last_clean":"2024-09-12T00:54:42.586198+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:54:42.586198+0000","last_undegraded":"2024-09-12T00:54:42.586198+0000","last_fullsized":"2024-09-12T00:54:42.586198+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.585972+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.593597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":18770,"num_write":983,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'806","reported_seq":2343,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.489353+0000","last_change":"2024-09-12T00:54:53.489353+0000","last_active":"2024-09-12T00:54:53.489353+0000","last_peered":"2024-09-12T00:54:53.489353+0000","last_clean":"2024-09-12T00:54:53.489353+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:54:53.489353+0000","last_undegraded":"2024-09-12T00:54:53.489353+0000","last_fullsized":"2024-09-12T00:54:53.489353+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'806","last_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_deep_scrub":"266'806","last_deep_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.489176+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.643319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'248","reported_seq":928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.497646+0000","last_change":"2024-09-12T00:54:40.497352+0000","last_active":"2024-09-12T00:54:40.497646+0000","last_peered":"2024-09-12T00:54:40.497646+0000","last_clean":"2024-09-12T00:54:40.497646+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:54:40.497646+0000","last_undegraded":"2024-09-12T00:54:40.497646+0000","last_fullsized":"2024-09-12T00:54:40.497646+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.497103+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:25.148164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":28384,"num_write":1056,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'478","reported_seq":1948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.025614+0000","last_change":"2024-09-12T00:54:49.025475+0000","last_active":"2024-09-12T00:54:49.025614+0000","last_peered":"2024-09-12T00:54:49.025614+0000","last_clean":"2024-09-12T00:54:49.025614+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:54:49.025614+0000","last_undegraded":"2024-09-12T00:54:49.025614+0000","last_fullsized":"2024-09-12T00:54:49.025614+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.025287+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.458555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'293","reported_seq":1114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.541081+0000","last_change":"2024-09-12T00:54:41.540937+0000","last_active":"2024-09-12T00:54:41.541081+0000","last_peered":"2024-09-12T00:54:41.541081+0000","last_clean":"2024-09-12T00:54:41.541081+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:54:41.541081+0000","last_undegraded":"2024-09-12T00:54:41.541081+0000","last_fullsized":"2024-09-12T00:54:41.541081+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'293","last_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_deep_scrub":"266'293","last_deep_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.540710+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:24.383696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1398,"num_read_kb":1619,"num_write":1277,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'613","reported_seq":2352,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.590795+0000","last_change":"2024-09-12T00:54:50.590571+0000","last_active":"2024-09-12T00:54:50.590795+0000","last_peered":"2024-09-12T00:54:50.590795+0000","last_clean":"2024-09-12T00:54:50.590795+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:54:50.590795+0000","last_undegraded":"2024-09-12T00:54:50.590795+0000","last_fullsized":"2024-09-12T00:54:50.590795+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'613","last_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_deep_scrub":"266'613","last_deep_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.590357+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:41.152978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'228","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.694402+0000","last_change":"2024-09-12T00:54:38.694245+0000","last_active":"2024-09-12T00:54:38.694402+0000","last_peered":"2024-09-12T00:54:38.694402+0000","last_clean":"2024-09-12T00:54:38.694402+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:38.694402+0000","last_undegraded":"2024-09-12T00:54:38.694402+0000","last_fullsized":"2024-09-12T00:54:38.694402+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.693931+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:45.558338+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7916704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":17177,"num_write":1053,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1256","reported_seq":3025,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.314701+0000","last_change":"2024-09-12T00:54:41.314574+0000","last_active":"2024-09-12T00:54:41.314701+0000","last_peered":"2024-09-12T00:54:41.314701+0000","last_clean":"2024-09-12T00:54:41.314701+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:54:41.314701+0000","last_undegraded":"2024-09-12T00:54:41.314701+0000","last_fullsized":"2024-09-12T00:54:41.314701+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1256","last_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_deep_scrub":"266'1256","last_deep_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.314407+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":1200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:58.492484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'277","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.614515+0000","last_change":"2024-09-12T00:54:43.614374+0000","last_active":"2024-09-12T00:54:43.614515+0000","last_peered":"2024-09-12T00:54:43.614515+0000","last_clean":"2024-09-12T00:54:43.614515+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:54:43.614515+0000","last_undegraded":"2024-09-12T00:54:43.614515+0000","last_fullsized":"2024-09-12T00:54:43.614515+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'277","last_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_deep_scrub":"266'277","last_deep_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.614131+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:24.435399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525343,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":15585,"num_write":1267,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'829","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.567505+0000","last_change":"2024-09-12T00:54:48.567505+0000","last_active":"2024-09-12T00:54:48.567505+0000","last_peered":"2024-09-12T00:54:48.567505+0000","last_clean":"2024-09-12T00:54:48.567505+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:54:48.567505+0000","last_undegraded":"2024-09-12T00:54:48.567505+0000","last_fullsized":"2024-09-12T00:54:48.567505+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.567318+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:51.422110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'251","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.243891+0000","last_change":"2024-09-12T00:54:48.243735+0000","last_active":"2024-09-12T00:54:48.243891+0000","last_peered":"2024-09-12T00:54:48.243891+0000","last_clean":"2024-09-12T00:54:48.243891+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:54:48.243891+0000","last_undegraded":"2024-09-12T00:54:48.243891+0000","last_fullsized":"2024-09-12T00:54:48.243891+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'251","last_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_deep_scrub":"266'251","last_deep_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.243504+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:31.911455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10118774,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":58641,"num_write":1118,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1328","reported_seq":2859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.982053+0000","last_change":"2024-09-12T00:54:49.982053+0000","last_active":"2024-09-12T00:54:49.982053+0000","last_peered":"2024-09-12T00:54:49.982053+0000","last_clean":"2024-09-12T00:54:49.982053+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:54:49.982053+0000","last_undegraded":"2024-09-12T00:54:49.982053+0000","last_fullsized":"2024-09-12T00:54:49.982053+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1328","last_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_deep_scrub":"266'1328","last_deep_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.981823+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":1300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:42.896076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'196","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.530369+0000","last_change":"2024-09-12T00:54:45.530369+0000","last_active":"2024-09-12T00:54:45.530369+0000","last_peered":"2024-09-12T00:54:45.530369+0000","last_clean":"2024-09-12T00:54:45.530369+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:54:45.530369+0000","last_undegraded":"2024-09-12T00:54:45.530369+0000","last_fullsized":"2024-09-12T00:54:45.530369+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.530104+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:31.515428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262331,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":34280,"num_write":929,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'556","reported_seq":2112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.490261+0000","last_change":"2024-09-12T00:54:56.490261+0000","last_active":"2024-09-12T00:54:56.490261+0000","last_peered":"2024-09-12T00:54:56.490261+0000","last_clean":"2024-09-12T00:54:56.490261+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:54:56.490261+0000","last_undegraded":"2024-09-12T00:54:56.490261+0000","last_fullsized":"2024-09-12T00:54:56.490261+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'556","last_scrub_stamp":"2024-09-12T00:54:56.490065+0000","last_deep_scrub":"266'556","last_deep_scrub_stamp":"2024-09-12T00:54:56.490065+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.490065+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:18.778279+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1195,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'229","reported_seq":972,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.285793+0000","last_change":"2024-09-12T00:54:37.285793+0000","last_active":"2024-09-12T00:54:37.285793+0000","last_peered":"2024-09-12T00:54:37.285793+0000","last_clean":"2024-09-12T00:54:37.285793+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:54:37.285793+0000","last_undegraded":"2024-09-12T00:54:37.285793+0000","last_fullsized":"2024-09-12T00:54:37.285793+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.285624+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.468189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460242,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":746,"num_read_kb":61726,"num_write":1110,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'703","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.427718+0000","last_change":"2024-09-12T00:54:47.427718+0000","last_active":"2024-09-12T00:54:47.427718+0000","last_peered":"2024-09-12T00:54:47.427718+0000","last_clean":"2024-09-12T00:54:47.427718+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:54:47.427718+0000","last_undegraded":"2024-09-12T00:54:47.427718+0000","last_fullsized":"2024-09-12T00:54:47.427718+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'703","last_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_deep_scrub":"266'703","last_deep_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.427536+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:27.740664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'210","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.759263+0000","last_change":"2024-09-12T00:54:43.759263+0000","last_active":"2024-09-12T00:54:43.759263+0000","last_peered":"2024-09-12T00:54:43.759263+0000","last_clean":"2024-09-12T00:54:43.759263+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:54:43.759263+0000","last_undegraded":"2024-09-12T00:54:43.759263+0000","last_fullsized":"2024-09-12T00:54:43.759263+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.758895+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:11.039233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457515,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":13749,"num_write":936,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'966","reported_seq":2529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.413623+0000","last_change":"2024-09-12T00:54:44.413623+0000","last_active":"2024-09-12T00:54:44.413623+0000","last_peered":"2024-09-12T00:54:44.413623+0000","last_clean":"2024-09-12T00:54:44.413623+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:54:44.413623+0000","last_undegraded":"2024-09-12T00:54:44.413623+0000","last_fullsized":"2024-09-12T00:54:44.413623+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'966","last_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_deep_scrub":"266'966","last_deep_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.413459+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.872760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'210","reported_seq":897,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.004309+0000","last_change":"2024-09-12T00:54:39.004309+0000","last_active":"2024-09-12T00:54:39.004309+0000","last_peered":"2024-09-12T00:54:39.004309+0000","last_clean":"2024-09-12T00:54:39.004309+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:54:39.004309+0000","last_undegraded":"2024-09-12T00:54:39.004309+0000","last_fullsized":"2024-09-12T00:54:39.004309+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.004060+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:37.718332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":23861,"num_write":1050,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'754","reported_seq":2238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.590559+0000","last_change":"2024-09-12T00:54:47.590559+0000","last_active":"2024-09-12T00:54:47.590559+0000","last_peered":"2024-09-12T00:54:47.590559+0000","last_clean":"2024-09-12T00:54:47.590559+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:54:47.590559+0000","last_undegraded":"2024-09-12T00:54:47.590559+0000","last_fullsized":"2024-09-12T00:54:47.590559+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'754","last_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_deep_scrub":"266'754","last_deep_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.590381+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:16.432151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'164","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.259884+0000","last_change":"2024-09-12T00:54:49.259884+0000","last_active":"2024-09-12T00:54:49.259884+0000","last_peered":"2024-09-12T00:54:49.259884+0000","last_clean":"2024-09-12T00:54:49.259884+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:54:49.259884+0000","last_undegraded":"2024-09-12T00:54:49.259884+0000","last_fullsized":"2024-09-12T00:54:49.259884+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'164","last_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_deep_scrub":"266'164","last_deep_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.259672+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:01.483020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399130,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":3653,"num_write":817,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'837","reported_seq":2669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.793185+0000","last_change":"2024-09-12T00:54:50.793185+0000","last_active":"2024-09-12T00:54:50.793185+0000","last_peered":"2024-09-12T00:54:50.793185+0000","last_clean":"2024-09-12T00:54:50.793185+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:54:50.793185+0000","last_undegraded":"2024-09-12T00:54:50.793185+0000","last_fullsized":"2024-09-12T00:54:50.793185+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'837","last_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_deep_scrub":"266'837","last_deep_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.792947+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:52.531844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2733,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'220","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.603322+0000","last_change":"2024-09-12T00:54:41.603322+0000","last_active":"2024-09-12T00:54:41.603322+0000","last_peered":"2024-09-12T00:54:41.603322+0000","last_clean":"2024-09-12T00:54:41.603322+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:54:41.603322+0000","last_undegraded":"2024-09-12T00:54:41.603322+0000","last_fullsized":"2024-09-12T00:54:41.603322+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'220","last_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_deep_scrub":"266'220","last_deep_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.603085+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:05.399778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430198,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":27002,"num_write":976,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'448","reported_seq":2076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.356262+0000","last_change":"2024-09-12T00:54:42.356125+0000","last_active":"2024-09-12T00:54:42.356262+0000","last_peered":"2024-09-12T00:54:42.356262+0000","last_clean":"2024-09-12T00:54:42.356262+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:54:42.356262+0000","last_undegraded":"2024-09-12T00:54:42.356262+0000","last_fullsized":"2024-09-12T00:54:42.356262+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.355937+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:01.881468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'186","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.293468+0000","last_change":"2024-09-12T00:54:50.293468+0000","last_active":"2024-09-12T00:54:50.293468+0000","last_peered":"2024-09-12T00:54:50.293468+0000","last_clean":"2024-09-12T00:54:50.293468+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:54:50.293468+0000","last_undegraded":"2024-09-12T00:54:50.293468+0000","last_fullsized":"2024-09-12T00:54:50.293468+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.293253+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:08.784599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":12744,"num_write":922,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.268108+0000","last_change":"2024-09-12T00:54:51.268108+0000","last_active":"2024-09-12T00:54:51.268108+0000","last_peered":"2024-09-12T00:54:51.268108+0000","last_clean":"2024-09-12T00:54:51.268108+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:54:51.268108+0000","last_undegraded":"2024-09-12T00:54:51.268108+0000","last_fullsized":"2024-09-12T00:54:51.268108+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.267890+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:47.302659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":71383,"num_write":1072,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'456","reported_seq":2148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.803400+0000","last_change":"2024-09-12T00:54:51.803256+0000","last_active":"2024-09-12T00:54:51.803400+0000","last_peered":"2024-09-12T00:54:51.803400+0000","last_clean":"2024-09-12T00:54:51.803400+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:54:51.803400+0000","last_undegraded":"2024-09-12T00:54:51.803400+0000","last_fullsized":"2024-09-12T00:54:51.803400+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.803069+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:01.594700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'208","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.549008+0000","last_change":"2024-09-12T00:54:46.549008+0000","last_active":"2024-09-12T00:54:46.549008+0000","last_peered":"2024-09-12T00:54:46.549008+0000","last_clean":"2024-09-12T00:54:46.549008+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:54:46.549008+0000","last_undegraded":"2024-09-12T00:54:46.549008+0000","last_fullsized":"2024-09-12T00:54:46.549008+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.548801+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.676960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194359,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":710,"num_read_kb":180313,"num_write":963,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'929","reported_seq":2700,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.418940+0000","last_change":"2024-09-12T00:54:48.418811+0000","last_active":"2024-09-12T00:54:48.418940+0000","last_peered":"2024-09-12T00:54:48.418940+0000","last_clean":"2024-09-12T00:54:48.418940+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:48.418940+0000","last_undegraded":"2024-09-12T00:54:48.418940+0000","last_fullsized":"2024-09-12T00:54:48.418940+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.418615+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:00.299961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7199,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":961,"ondisk_log_size":961,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1833,"ondisk_log_size":1833,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662,"ondisk_log_size":662,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":338265,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8580,"num_read_kb":10748,"num_write":5747,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671866,"num_omap_keys":1552,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1987,"ondisk_log_size":1987,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43256,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3988,"ondisk_log_size":3988,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":104917588,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":33248,"num_read_kb":1979779,"num_write":63422,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159301632,"data_stored":159301632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4504,"ondisk_log_size":4504,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":190493,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":189755,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509972,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220400,"kb_used_data":18528,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94151440,"statfs":{"total":96636764160,"available":96411074560,"internally_reserved":0,"allocated":18972672,"data_stored":16979463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509973,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92208,"kb_used_data":20768,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94279632,"statfs":{"total":96636764160,"available":96542343168,"internally_reserved":0,"allocated":21266432,"data_stored":19245709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509974,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190576,"kb_used_data":28960,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94181264,"statfs":{"total":96636764160,"available":96441614336,"internally_reserved":0,"allocated":29655040,"data_stored":27647840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509974,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230112,"kb_used_data":32336,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":94141728,"statfs":{"total":96636764160,"available":96401129472,"internally_reserved":0,"allocated":33112064,"data_stored":31105721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202504647},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509975,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123728,"kb_used_data":24512,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94248112,"statfs":{"total":96636764160,"available":96510066688,"internally_reserved":0,"allocated":25100288,"data_stored":23091639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509974,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293624,"kb_used_data":19496,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94078216,"statfs":{"total":96636764160,"available":96336093184,"internally_reserved":0,"allocated":19963904,"data_stored":17949977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509973,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127816,"kb_used_data":24440,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94244024,"statfs":{"total":96636764160,"available":96505880576,"internally_reserved":0,"allocated":25026560,"data_stored":23006958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542681,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246392,"kb_used_data":20840,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125448,"statfs":{"total":96636764160,"available":96384458752,"internally_reserved":0,"allocated":21340160,"data_stored":19331103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20770816,"data_stored":20770816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":15126528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20856832,"data_stored":20856832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28872704,"data_stored":28872704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25411584,"data_stored":25411584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16506880,"data_stored":16506880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17010688,"data_stored":17010688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14745600,"data_stored":14745600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:55:39.617 INFO:tasks.ceph:pgid 68.19 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.618 INFO:tasks.ceph:pgid 67.18 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.618 INFO:tasks.ceph:pgid 67.12 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.618 INFO:tasks.ceph:pgid 68.8 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.619 INFO:tasks.ceph:pgid 67.9 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.619 INFO:tasks.ceph:pgid 68.1 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.619 INFO:tasks.ceph:pgid 67.6 last_scrub_stamp 2024-09-12T00:28:16.009642+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.619 INFO:tasks.ceph:pgid 68.5 last_scrub_stamp 2024-09-12T00:39:27.069853+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=39, tm_sec=27, tm_wday=3, tm_yday=256, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=12, tm_hour=0, tm_min=54, tm_sec=33, tm_wday=3, tm_yday=256, tm_isdst=0) 2024-09-12T00:55:39.623 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-12T00:55:59.624 DEBUG:teuthology.orchestra.run.smithi078:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-12T00:55:59.987 INFO:teuthology.orchestra.run.smithi078.stdout: 2024-09-12T00:55:59.998 INFO:teuthology.orchestra.run.smithi078.stderr:dumped all 2024-09-12T00:56:00.004 INFO:teuthology.orchestra.run.smithi078.stdout:{"pg_ready":true,"pg_map":{"version":1596,"stamp":"2024-09-12T00:55:59.413996+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":105863228,"num_objects":726,"num_object_clones":0,"num_object_copies":1691,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":726,"num_whiteouts":0,"num_read":278142,"num_read_kb":2586611,"num_write":143606,"num_write_kb":2344249,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":202,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":726068,"num_omap_keys":1771,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14299,"ondisk_log_size":14299,"up":850,"acting":850,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":850,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1524856,"kb_used_data":189880,"kb_used_omap":12,"kb_used_meta":1334835,"kb_avail":753449864,"statfs":{"total":773094113280,"available":771532660736,"internally_reserved":0,"allocated":194437120,"data_stored":178358410,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":1366871602},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009308"},"pg_stats":[{"pgid":"68.1a","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.229682+0000","last_change":"2024-09-12T00:55:14.229682+0000","last_active":"2024-09-12T00:55:14.229682+0000","last_peered":"2024-09-12T00:55:14.229682+0000","last_clean":"2024-09-12T00:55:14.229682+0000","last_became_active":"2024-09-12T00:39:28.137678+0000","last_became_peered":"2024-09-12T00:39:28.137678+0000","last_unstale":"2024-09-12T00:55:14.229682+0000","last_undegraded":"2024-09-12T00:55:14.229682+0000","last_fullsized":"2024-09-12T00:55:14.229682+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.229499+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.229499+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.229499+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:15.538945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1d","version":"263'4","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.793322+0000","last_change":"2024-09-12T00:55:12.793177+0000","last_active":"2024-09-12T00:55:12.793322+0000","last_peered":"2024-09-12T00:55:12.793322+0000","last_clean":"2024-09-12T00:55:12.793322+0000","last_became_active":"2024-09-12T00:28:17.046599+0000","last_became_peered":"2024-09-12T00:28:17.046599+0000","last_unstale":"2024-09-12T00:55:12.793322+0000","last_undegraded":"2024-09-12T00:55:12.793322+0000","last_fullsized":"2024-09-12T00:55:12.793322+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'4","last_scrub_stamp":"2024-09-12T00:55:12.792992+0000","last_deep_scrub":"263'4","last_deep_scrub_stamp":"2024-09-12T00:55:12.792992+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.792992+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:04:14.486725+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":4,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"66.1c","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.767025+0000","last_change":"2024-09-12T00:55:14.766882+0000","last_active":"2024-09-12T00:55:14.767025+0000","last_peered":"2024-09-12T00:55:14.767025+0000","last_clean":"2024-09-12T00:55:14.767025+0000","last_became_active":"2024-09-12T00:28:14.032685+0000","last_became_peered":"2024-09-12T00:28:14.032685+0000","last_unstale":"2024-09-12T00:55:14.767025+0000","last_undegraded":"2024-09-12T00:55:14.767025+0000","last_fullsized":"2024-09-12T00:55:14.767025+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.766689+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.766689+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.766689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:33:34.013158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1f","version":"263'12","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.728413+0000","last_change":"2024-09-12T00:55:17.728413+0000","last_active":"2024-09-12T00:55:17.728413+0000","last_peered":"2024-09-12T00:55:17.728413+0000","last_clean":"2024-09-12T00:55:17.728413+0000","last_became_active":"2024-09-12T00:26:48.569314+0000","last_became_peered":"2024-09-12T00:26:48.569314+0000","last_unstale":"2024-09-12T00:55:17.728413+0000","last_undegraded":"2024-09-12T00:55:17.728413+0000","last_fullsized":"2024-09-12T00:55:17.728413+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'12","last_scrub_stamp":"2024-09-12T00:55:17.728230+0000","last_deep_scrub":"263'12","last_deep_scrub_stamp":"2024-09-12T00:55:17.728230+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.728230+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:04:17.299708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":38,"num_write":24,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.1b","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.631439+0000","last_change":"2024-09-12T00:55:19.631439+0000","last_active":"2024-09-12T00:55:19.631439+0000","last_peered":"2024-09-12T00:55:19.631439+0000","last_clean":"2024-09-12T00:55:19.631439+0000","last_became_active":"2024-09-12T00:39:28.125789+0000","last_became_peered":"2024-09-12T00:39:28.125789+0000","last_unstale":"2024-09-12T00:55:19.631439+0000","last_undegraded":"2024-09-12T00:55:19.631439+0000","last_fullsized":"2024-09-12T00:55:19.631439+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:19.631259+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:19.631259+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.631259+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:53.532256+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.1c","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.805813+0000","last_change":"2024-09-12T00:55:18.805565+0000","last_active":"2024-09-12T00:55:18.805813+0000","last_peered":"2024-09-12T00:55:18.805813+0000","last_clean":"2024-09-12T00:55:18.805813+0000","last_became_active":"2024-09-12T00:28:17.068745+0000","last_became_peered":"2024-09-12T00:28:17.068745+0000","last_unstale":"2024-09-12T00:55:18.805813+0000","last_undegraded":"2024-09-12T00:55:18.805813+0000","last_fullsized":"2024-09-12T00:55:18.805813+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.805352+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.805352+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.805352+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:47:07.582317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1d","version":"263'3","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.317515+0000","last_change":"2024-09-12T00:55:20.317354+0000","last_active":"2024-09-12T00:55:20.317515+0000","last_peered":"2024-09-12T00:55:20.317515+0000","last_clean":"2024-09-12T00:55:20.317515+0000","last_became_active":"2024-09-12T00:28:14.052625+0000","last_became_peered":"2024-09-12T00:28:14.052625+0000","last_unstale":"2024-09-12T00:55:20.317515+0000","last_undegraded":"2024-09-12T00:55:20.317515+0000","last_fullsized":"2024-09-12T00:55:20.317515+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T00:55:20.317157+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T00:55:20.317157+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.317157+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:39.988452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1e","version":"266'43","reported_seq":171,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.800503+0000","last_change":"2024-09-12T00:55:15.800503+0000","last_active":"2024-09-12T00:55:15.800503+0000","last_peered":"2024-09-12T00:55:15.800503+0000","last_clean":"2024-09-12T00:55:15.800503+0000","last_became_active":"2024-09-12T00:26:48.578470+0000","last_became_peered":"2024-09-12T00:26:48.578470+0000","last_unstale":"2024-09-12T00:55:15.800503+0000","last_undegraded":"2024-09-12T00:55:15.800503+0000","last_fullsized":"2024-09-12T00:55:15.800503+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'43","last_scrub_stamp":"2024-09-12T00:55:15.800318+0000","last_deep_scrub":"266'43","last_deep_scrub_stamp":"2024-09-12T00:55:15.800318+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.800318+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:46:02.404637+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":223,"num_read_kb":158,"num_write":78,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.18","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.816681+0000","last_change":"2024-09-12T00:55:15.816681+0000","last_active":"2024-09-12T00:55:15.816681+0000","last_peered":"2024-09-12T00:55:15.816681+0000","last_clean":"2024-09-12T00:55:15.816681+0000","last_became_active":"2024-09-12T00:39:28.121377+0000","last_became_peered":"2024-09-12T00:39:28.121377+0000","last_unstale":"2024-09-12T00:55:15.816681+0000","last_undegraded":"2024-09-12T00:55:15.816681+0000","last_fullsized":"2024-09-12T00:55:15.816681+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:15.816508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:15.816508+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.816508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:49:11.337625+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.1f","version":"263'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:29.267100+0000","last_change":"2024-09-12T00:55:29.267100+0000","last_active":"2024-09-12T00:55:29.267100+0000","last_peered":"2024-09-12T00:55:29.267100+0000","last_clean":"2024-09-12T00:55:29.267100+0000","last_became_active":"2024-09-12T00:28:17.053834+0000","last_became_peered":"2024-09-12T00:28:17.053834+0000","last_unstale":"2024-09-12T00:55:29.267100+0000","last_undegraded":"2024-09-12T00:55:29.267100+0000","last_fullsized":"2024-09-12T00:55:29.267100+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T00:55:29.266861+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T00:55:29.266861+0000","last_clean_scrub_stamp":"2024-09-12T00:55:29.266861+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:09:33.088330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3072,"num_write":10,"num_write_kb":3072,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1e","version":"266'3","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.720553+0000","last_change":"2024-09-12T00:55:17.720553+0000","last_active":"2024-09-12T00:55:17.720553+0000","last_peered":"2024-09-12T00:55:17.720553+0000","last_clean":"2024-09-12T00:55:17.720553+0000","last_became_active":"2024-09-12T00:28:14.047094+0000","last_became_peered":"2024-09-12T00:28:14.047094+0000","last_unstale":"2024-09-12T00:55:17.720553+0000","last_undegraded":"2024-09-12T00:55:17.720553+0000","last_fullsized":"2024-09-12T00:55:17.720553+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T00:55:17.720377+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T00:55:17.720377+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.720377+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:57:47.009181+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.1d","version":"266'19","reported_seq":97,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.577866+0000","last_change":"2024-09-12T00:55:11.577866+0000","last_active":"2024-09-12T00:55:11.577866+0000","last_peered":"2024-09-12T00:55:11.577866+0000","last_clean":"2024-09-12T00:55:11.577866+0000","last_became_active":"2024-09-12T00:26:48.579848+0000","last_became_peered":"2024-09-12T00:26:48.579848+0000","last_unstale":"2024-09-12T00:55:11.577866+0000","last_undegraded":"2024-09-12T00:55:11.577866+0000","last_fullsized":"2024-09-12T00:55:11.577866+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T00:55:11.577697+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T00:55:11.577697+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.577697+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:46:39.149200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":56,"num_write":45,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.19","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:35.212797+0000","last_change":"2024-09-12T00:55:35.212797+0000","last_active":"2024-09-12T00:55:35.212797+0000","last_peered":"2024-09-12T00:55:35.212797+0000","last_clean":"2024-09-12T00:55:35.212797+0000","last_became_active":"2024-09-12T00:39:28.124524+0000","last_became_peered":"2024-09-12T00:39:28.124524+0000","last_unstale":"2024-09-12T00:55:35.212797+0000","last_undegraded":"2024-09-12T00:55:35.212797+0000","last_fullsized":"2024-09-12T00:55:35.212797+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:35.212609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:35.212609+0000","last_clean_scrub_stamp":"2024-09-12T00:55:35.212609+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:38.295387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.1e","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:27.276653+0000","last_change":"2024-09-12T00:55:27.276653+0000","last_active":"2024-09-12T00:55:27.276653+0000","last_peered":"2024-09-12T00:55:27.276653+0000","last_clean":"2024-09-12T00:55:27.276653+0000","last_became_active":"2024-09-12T00:28:17.052096+0000","last_became_peered":"2024-09-12T00:28:17.052096+0000","last_unstale":"2024-09-12T00:55:27.276653+0000","last_undegraded":"2024-09-12T00:55:27.276653+0000","last_fullsized":"2024-09-12T00:55:27.276653+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:27.276475+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:27.276475+0000","last_clean_scrub_stamp":"2024-09-12T00:55:27.276475+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:07.462069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":9216,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.1f","version":"263'5","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.724685+0000","last_change":"2024-09-12T00:55:10.724516+0000","last_active":"2024-09-12T00:55:10.724685+0000","last_peered":"2024-09-12T00:55:10.724685+0000","last_clean":"2024-09-12T00:55:10.724685+0000","last_became_active":"2024-09-12T00:28:14.041092+0000","last_became_peered":"2024-09-12T00:28:14.041092+0000","last_unstale":"2024-09-12T00:55:10.724685+0000","last_undegraded":"2024-09-12T00:55:10.724685+0000","last_fullsized":"2024-09-12T00:55:10.724685+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'5","last_scrub_stamp":"2024-09-12T00:55:10.724330+0000","last_deep_scrub":"263'5","last_deep_scrub_stamp":"2024-09-12T00:55:10.724330+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.724330+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:36:21.498427+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":16386,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.1c","version":"266'56","reported_seq":206,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.605078+0000","last_change":"2024-09-12T00:55:13.605078+0000","last_active":"2024-09-12T00:55:13.605078+0000","last_peered":"2024-09-12T00:55:13.605078+0000","last_clean":"2024-09-12T00:55:13.605078+0000","last_became_active":"2024-09-12T00:26:48.581677+0000","last_became_peered":"2024-09-12T00:26:48.581677+0000","last_unstale":"2024-09-12T00:55:13.605078+0000","last_undegraded":"2024-09-12T00:55:13.605078+0000","last_fullsized":"2024-09-12T00:55:13.605078+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'56","last_scrub_stamp":"2024-09-12T00:55:13.604900+0000","last_deep_scrub":"266'56","last_deep_scrub_stamp":"2024-09-12T00:55:13.604900+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.604900+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:35:03.425227+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":298,"num_read_kb":209,"num_write":94,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1e","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:26.760778+0000","last_change":"2024-09-12T00:55:26.760648+0000","last_active":"2024-09-12T00:55:26.760778+0000","last_peered":"2024-09-12T00:55:26.760778+0000","last_clean":"2024-09-12T00:55:26.760778+0000","last_became_active":"2024-09-12T00:39:28.139518+0000","last_became_peered":"2024-09-12T00:39:28.139518+0000","last_unstale":"2024-09-12T00:55:26.760778+0000","last_undegraded":"2024-09-12T00:55:26.760778+0000","last_fullsized":"2024-09-12T00:55:26.760778+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:26.760469+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:26.760469+0000","last_clean_scrub_stamp":"2024-09-12T00:55:26.760469+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:37.726403+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.19","version":"266'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.158610+0000","last_change":"2024-09-12T00:55:08.158610+0000","last_active":"2024-09-12T00:55:08.158610+0000","last_peered":"2024-09-12T00:55:08.158610+0000","last_clean":"2024-09-12T00:55:08.158610+0000","last_became_active":"2024-09-12T00:28:17.058410+0000","last_became_peered":"2024-09-12T00:28:17.058410+0000","last_unstale":"2024-09-12T00:55:08.158610+0000","last_undegraded":"2024-09-12T00:55:08.158610+0000","last_fullsized":"2024-09-12T00:55:08.158610+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:08.158395+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.158395+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.158395+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:45.464176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":8192,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.18","version":"266'9","reported_seq":59,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.277466+0000","last_change":"2024-09-12T00:55:19.277466+0000","last_active":"2024-09-12T00:55:19.277466+0000","last_peered":"2024-09-12T00:55:19.277466+0000","last_clean":"2024-09-12T00:55:19.277466+0000","last_became_active":"2024-09-12T00:28:14.042231+0000","last_became_peered":"2024-09-12T00:28:14.042231+0000","last_unstale":"2024-09-12T00:55:19.277466+0000","last_undegraded":"2024-09-12T00:55:19.277466+0000","last_fullsized":"2024-09-12T00:55:19.277466+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T00:55:19.277280+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T00:55:19.277280+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.277280+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:12:40.313906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":14336,"num_write":14,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.1b","version":"266'48","reported_seq":189,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.623494+0000","last_change":"2024-09-12T00:55:10.623494+0000","last_active":"2024-09-12T00:55:10.623494+0000","last_peered":"2024-09-12T00:55:10.623494+0000","last_clean":"2024-09-12T00:55:10.623494+0000","last_became_active":"2024-09-12T00:26:48.585700+0000","last_became_peered":"2024-09-12T00:26:48.585700+0000","last_unstale":"2024-09-12T00:55:10.623494+0000","last_undegraded":"2024-09-12T00:55:10.623494+0000","last_fullsized":"2024-09-12T00:55:10.623494+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'48","last_scrub_stamp":"2024-09-12T00:55:10.623317+0000","last_deep_scrub":"266'48","last_deep_scrub_stamp":"2024-09-12T00:55:10.623317+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.623317+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:04:54.480935+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":269,"num_read_kb":196,"num_write":72,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.1f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.693721+0000","last_change":"2024-09-12T00:55:21.693721+0000","last_active":"2024-09-12T00:55:21.693721+0000","last_peered":"2024-09-12T00:55:21.693721+0000","last_clean":"2024-09-12T00:55:21.693721+0000","last_became_active":"2024-09-12T00:39:28.106780+0000","last_became_peered":"2024-09-12T00:39:28.106780+0000","last_unstale":"2024-09-12T00:55:21.693721+0000","last_undegraded":"2024-09-12T00:55:21.693721+0000","last_fullsized":"2024-09-12T00:55:21.693721+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:21.693539+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:21.693539+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.693539+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:56:53.141001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.18","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:38.363290+0000","last_change":"2024-09-12T00:55:38.363290+0000","last_active":"2024-09-12T00:55:38.363290+0000","last_peered":"2024-09-12T00:55:38.363290+0000","last_clean":"2024-09-12T00:55:38.363290+0000","last_became_active":"2024-09-12T00:28:17.077220+0000","last_became_peered":"2024-09-12T00:28:17.077220+0000","last_unstale":"2024-09-12T00:55:38.363290+0000","last_undegraded":"2024-09-12T00:55:38.363290+0000","last_fullsized":"2024-09-12T00:55:38.363290+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:38.363104+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:38.363104+0000","last_clean_scrub_stamp":"2024-09-12T00:55:38.363104+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:03.359541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":651,"num_write":12,"num_write_kb":4707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.19","version":"266'2","reported_seq":47,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:33.425371+0000","last_change":"2024-09-12T00:55:33.425371+0000","last_active":"2024-09-12T00:55:33.425371+0000","last_peered":"2024-09-12T00:55:33.425371+0000","last_clean":"2024-09-12T00:55:33.425371+0000","last_became_active":"2024-09-12T00:28:14.044516+0000","last_became_peered":"2024-09-12T00:28:14.044516+0000","last_unstale":"2024-09-12T00:55:33.425371+0000","last_undegraded":"2024-09-12T00:55:33.425371+0000","last_fullsized":"2024-09-12T00:55:33.425371+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:33.425147+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:33.425147+0000","last_clean_scrub_stamp":"2024-09-12T00:55:33.425147+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:24.665112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":698,"num_write":2,"num_write_kb":698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.1a","version":"266'71","reported_seq":247,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.742145+0000","last_change":"2024-09-12T00:55:10.742145+0000","last_active":"2024-09-12T00:55:10.742145+0000","last_peered":"2024-09-12T00:55:10.742145+0000","last_clean":"2024-09-12T00:55:10.742145+0000","last_became_active":"2024-09-12T00:26:48.573021+0000","last_became_peered":"2024-09-12T00:26:48.573021+0000","last_unstale":"2024-09-12T00:55:10.742145+0000","last_undegraded":"2024-09-12T00:55:10.742145+0000","last_fullsized":"2024-09-12T00:55:10.742145+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'71","last_scrub_stamp":"2024-09-12T00:55:10.741944+0000","last_deep_scrub":"266'71","last_deep_scrub_stamp":"2024-09-12T00:55:10.741944+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.741944+0000","objects_scrubbed":0,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:06:45.667086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":376,"num_read_kb":284,"num_write":120,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1c","version":"266'2","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.850531+0000","last_change":"2024-09-12T00:55:19.850531+0000","last_active":"2024-09-12T00:55:19.850531+0000","last_peered":"2024-09-12T00:55:19.850531+0000","last_clean":"2024-09-12T00:55:19.850531+0000","last_became_active":"2024-09-12T00:39:28.126928+0000","last_became_peered":"2024-09-12T00:39:28.126928+0000","last_unstale":"2024-09-12T00:55:19.850531+0000","last_undegraded":"2024-09-12T00:55:19.850531+0000","last_fullsized":"2024-09-12T00:55:19.850531+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:19.850341+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:19.850341+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.850341+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:47.578774+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.1b","version":"263'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.816405+0000","last_change":"2024-09-12T00:55:13.816234+0000","last_active":"2024-09-12T00:55:13.816405+0000","last_peered":"2024-09-12T00:55:13.816405+0000","last_clean":"2024-09-12T00:55:13.816405+0000","last_became_active":"2024-09-12T00:28:17.068842+0000","last_became_peered":"2024-09-12T00:28:17.068842+0000","last_unstale":"2024-09-12T00:55:13.816405+0000","last_undegraded":"2024-09-12T00:55:13.816405+0000","last_fullsized":"2024-09-12T00:55:13.816405+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:13.816054+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:13.816054+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.816054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:43:51.920762+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.1a","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.133797+0000","last_change":"2024-09-12T00:55:02.133568+0000","last_active":"2024-09-12T00:55:02.133797+0000","last_peered":"2024-09-12T00:55:02.133797+0000","last_clean":"2024-09-12T00:55:02.133797+0000","last_became_active":"2024-09-12T00:28:14.035660+0000","last_became_peered":"2024-09-12T00:28:14.035660+0000","last_unstale":"2024-09-12T00:55:02.133797+0000","last_undegraded":"2024-09-12T00:55:02.133797+0000","last_fullsized":"2024-09-12T00:55:02.133797+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.133361+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.133361+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.133361+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:17:41.589597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.19","version":"266'54","reported_seq":199,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.706107+0000","last_change":"2024-09-12T00:55:10.705902+0000","last_active":"2024-09-12T00:55:10.706107+0000","last_peered":"2024-09-12T00:55:10.706107+0000","last_clean":"2024-09-12T00:55:10.706107+0000","last_became_active":"2024-09-12T00:26:48.566862+0000","last_became_peered":"2024-09-12T00:26:48.566862+0000","last_unstale":"2024-09-12T00:55:10.706107+0000","last_undegraded":"2024-09-12T00:55:10.706107+0000","last_fullsized":"2024-09-12T00:55:10.706107+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'54","last_scrub_stamp":"2024-09-12T00:55:10.705720+0000","last_deep_scrub":"266'54","last_deep_scrub_stamp":"2024-09-12T00:55:10.705720+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.705720+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:28:30.802724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":281,"num_read_kb":201,"num_write":93,"num_write_kb":41,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.1d","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.226312+0000","last_change":"2024-09-12T00:55:15.226312+0000","last_active":"2024-09-12T00:55:15.226312+0000","last_peered":"2024-09-12T00:55:15.226312+0000","last_clean":"2024-09-12T00:55:15.226312+0000","last_became_active":"2024-09-12T00:39:28.124636+0000","last_became_peered":"2024-09-12T00:39:28.124636+0000","last_unstale":"2024-09-12T00:55:15.226312+0000","last_undegraded":"2024-09-12T00:55:15.226312+0000","last_fullsized":"2024-09-12T00:55:15.226312+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:15.225979+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:15.225979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.225979+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:55:36.693603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.1a","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.692892+0000","last_change":"2024-09-12T00:55:22.692763+0000","last_active":"2024-09-12T00:55:22.692892+0000","last_peered":"2024-09-12T00:55:22.692892+0000","last_clean":"2024-09-12T00:55:22.692892+0000","last_became_active":"2024-09-12T00:28:17.072221+0000","last_became_peered":"2024-09-12T00:28:17.072221+0000","last_unstale":"2024-09-12T00:55:22.692892+0000","last_undegraded":"2024-09-12T00:55:22.692892+0000","last_fullsized":"2024-09-12T00:55:22.692892+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:22.692564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:22.692564+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.692564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:42:57.295345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.1b","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.579342+0000","last_change":"2024-09-12T00:55:14.579199+0000","last_active":"2024-09-12T00:55:14.579342+0000","last_peered":"2024-09-12T00:55:14.579342+0000","last_clean":"2024-09-12T00:55:14.579342+0000","last_became_active":"2024-09-12T00:28:14.050039+0000","last_became_peered":"2024-09-12T00:28:14.050039+0000","last_unstale":"2024-09-12T00:55:14.579342+0000","last_undegraded":"2024-09-12T00:55:14.579342+0000","last_fullsized":"2024-09-12T00:55:14.579342+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.579021+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.579021+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.579021+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:22:20.763959+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.18","version":"266'26","reported_seq":120,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.645691+0000","last_change":"2024-09-12T00:55:09.645511+0000","last_active":"2024-09-12T00:55:09.645691+0000","last_peered":"2024-09-12T00:55:09.645691+0000","last_clean":"2024-09-12T00:55:09.645691+0000","last_became_active":"2024-09-12T00:26:48.575675+0000","last_became_peered":"2024-09-12T00:26:48.575675+0000","last_unstale":"2024-09-12T00:55:09.645691+0000","last_undegraded":"2024-09-12T00:55:09.645691+0000","last_fullsized":"2024-09-12T00:55:09.645691+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T00:55:09.645339+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T00:55:09.645339+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.645339+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:52.501367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":132,"num_read_kb":93,"num_write":43,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.12","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:33.242622+0000","last_change":"2024-09-12T00:55:33.242347+0000","last_active":"2024-09-12T00:55:33.242622+0000","last_peered":"2024-09-12T00:55:33.242622+0000","last_clean":"2024-09-12T00:55:33.242622+0000","last_became_active":"2024-09-12T00:39:28.131057+0000","last_became_peered":"2024-09-12T00:39:28.131057+0000","last_unstale":"2024-09-12T00:55:33.242622+0000","last_undegraded":"2024-09-12T00:55:33.242622+0000","last_fullsized":"2024-09-12T00:55:33.242622+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:33.242114+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:33.242114+0000","last_clean_scrub_stamp":"2024-09-12T00:55:33.242114+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:18:15.528064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.15","version":"266'10","reported_seq":58,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.676875+0000","last_change":"2024-09-12T00:55:21.676875+0000","last_active":"2024-09-12T00:55:21.676875+0000","last_peered":"2024-09-12T00:55:21.676875+0000","last_clean":"2024-09-12T00:55:21.676875+0000","last_became_active":"2024-09-12T00:28:17.077540+0000","last_became_peered":"2024-09-12T00:28:17.077540+0000","last_unstale":"2024-09-12T00:55:21.676875+0000","last_undegraded":"2024-09-12T00:55:21.676875+0000","last_fullsized":"2024-09-12T00:55:21.676875+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:21.676696+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:21.676696+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.676696+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:29.943874+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":12306,"num_write":10,"num_write_kb":9232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.14","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:35.386495+0000","last_change":"2024-09-12T00:55:35.386495+0000","last_active":"2024-09-12T00:55:35.386495+0000","last_peered":"2024-09-12T00:55:35.386495+0000","last_clean":"2024-09-12T00:55:35.386495+0000","last_became_active":"2024-09-12T00:28:14.044921+0000","last_became_peered":"2024-09-12T00:28:14.044921+0000","last_unstale":"2024-09-12T00:55:35.386495+0000","last_undegraded":"2024-09-12T00:55:35.386495+0000","last_fullsized":"2024-09-12T00:55:35.386495+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:35.386303+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:35.386303+0000","last_clean_scrub_stamp":"2024-09-12T00:55:35.386303+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:21:02.401096+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.17","version":"266'59","reported_seq":210,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.775853+0000","last_change":"2024-09-12T00:55:16.775716+0000","last_active":"2024-09-12T00:55:16.775853+0000","last_peered":"2024-09-12T00:55:16.775853+0000","last_clean":"2024-09-12T00:55:16.775853+0000","last_became_active":"2024-09-12T00:26:48.571651+0000","last_became_peered":"2024-09-12T00:26:48.571651+0000","last_unstale":"2024-09-12T00:55:16.775853+0000","last_undegraded":"2024-09-12T00:55:16.775853+0000","last_fullsized":"2024-09-12T00:55:16.775853+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'59","last_scrub_stamp":"2024-09-12T00:55:16.775531+0000","last_deep_scrub":"266'59","last_deep_scrub_stamp":"2024-09-12T00:55:16.775531+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.775531+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:38:09.537903+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":302,"num_read_kb":211,"num_write":101,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.13","version":"266'2","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.602802+0000","last_change":"2024-09-12T00:55:17.602638+0000","last_active":"2024-09-12T00:55:17.602802+0000","last_peered":"2024-09-12T00:55:17.602802+0000","last_clean":"2024-09-12T00:55:17.602802+0000","last_became_active":"2024-09-12T00:39:28.114959+0000","last_became_peered":"2024-09-12T00:39:28.114959+0000","last_unstale":"2024-09-12T00:55:17.602802+0000","last_undegraded":"2024-09-12T00:55:17.602802+0000","last_fullsized":"2024-09-12T00:55:17.602802+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:17.602452+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:17.602452+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.602452+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:26.508065+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.14","version":"266'4","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:26.271964+0000","last_change":"2024-09-12T00:55:26.271964+0000","last_active":"2024-09-12T00:55:26.271964+0000","last_peered":"2024-09-12T00:55:26.271964+0000","last_clean":"2024-09-12T00:55:26.271964+0000","last_became_active":"2024-09-12T00:28:17.067881+0000","last_became_peered":"2024-09-12T00:28:17.067881+0000","last_unstale":"2024-09-12T00:55:26.271964+0000","last_undegraded":"2024-09-12T00:55:26.271964+0000","last_fullsized":"2024-09-12T00:55:26.271964+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:26.271767+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:26.271767+0000","last_clean_scrub_stamp":"2024-09-12T00:55:26.271767+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:51.685826+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":2048,"num_write":4,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.15","version":"263'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.119784+0000","last_change":"2024-09-12T00:55:04.119784+0000","last_active":"2024-09-12T00:55:04.119784+0000","last_peered":"2024-09-12T00:55:04.119784+0000","last_clean":"2024-09-12T00:55:04.119784+0000","last_became_active":"2024-09-12T00:28:14.032887+0000","last_became_peered":"2024-09-12T00:28:14.032887+0000","last_unstale":"2024-09-12T00:55:04.119784+0000","last_undegraded":"2024-09-12T00:55:04.119784+0000","last_fullsized":"2024-09-12T00:55:04.119784+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:04.119583+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:04.119583+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.119583+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:17.216020+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"65.16","version":"266'32","reported_seq":135,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.784450+0000","last_change":"2024-09-12T00:55:14.784196+0000","last_active":"2024-09-12T00:55:14.784450+0000","last_peered":"2024-09-12T00:55:14.784450+0000","last_clean":"2024-09-12T00:55:14.784450+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:55:14.784450+0000","last_undegraded":"2024-09-12T00:55:14.784450+0000","last_fullsized":"2024-09-12T00:55:14.784450+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'32","last_scrub_stamp":"2024-09-12T00:55:14.783979+0000","last_deep_scrub":"266'32","last_deep_scrub_stamp":"2024-09-12T00:55:14.783979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.783979+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:50:45.709781+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":156,"num_read_kb":108,"num_write":59,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.10","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.808481+0000","last_change":"2024-09-12T00:55:16.808356+0000","last_active":"2024-09-12T00:55:16.808481+0000","last_peered":"2024-09-12T00:55:16.808481+0000","last_clean":"2024-09-12T00:55:16.808481+0000","last_became_active":"2024-09-12T00:39:28.140565+0000","last_became_peered":"2024-09-12T00:39:28.140565+0000","last_unstale":"2024-09-12T00:55:16.808481+0000","last_undegraded":"2024-09-12T00:55:16.808481+0000","last_fullsized":"2024-09-12T00:55:16.808481+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:16.808175+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:16.808175+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.808175+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:27:39.697740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.17","version":"263'11","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:25.714058+0000","last_change":"2024-09-12T00:55:25.714058+0000","last_active":"2024-09-12T00:55:25.714058+0000","last_peered":"2024-09-12T00:55:25.714058+0000","last_clean":"2024-09-12T00:55:25.714058+0000","last_became_active":"2024-09-12T00:28:17.071491+0000","last_became_peered":"2024-09-12T00:28:17.071491+0000","last_unstale":"2024-09-12T00:55:25.714058+0000","last_undegraded":"2024-09-12T00:55:25.714058+0000","last_fullsized":"2024-09-12T00:55:25.714058+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T00:55:25.713866+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T00:55:25.713866+0000","last_clean_scrub_stamp":"2024-09-12T00:55:25.713866+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:49:27.579216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":16386,"num_write":16,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.16","version":"266'4","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.761776+0000","last_change":"2024-09-12T00:55:15.761776+0000","last_active":"2024-09-12T00:55:15.761776+0000","last_peered":"2024-09-12T00:55:15.761776+0000","last_clean":"2024-09-12T00:55:15.761776+0000","last_became_active":"2024-09-12T00:28:14.051153+0000","last_became_peered":"2024-09-12T00:28:14.051153+0000","last_unstale":"2024-09-12T00:55:15.761776+0000","last_undegraded":"2024-09-12T00:55:15.761776+0000","last_fullsized":"2024-09-12T00:55:15.761776+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:15.761591+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:15.761591+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.761591+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:13:00.967840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.15","version":"266'10","reported_seq":79,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.652075+0000","last_change":"2024-09-12T00:55:08.651822+0000","last_active":"2024-09-12T00:55:08.652075+0000","last_peered":"2024-09-12T00:55:08.652075+0000","last_clean":"2024-09-12T00:55:08.652075+0000","last_became_active":"2024-09-12T00:26:48.566009+0000","last_became_peered":"2024-09-12T00:26:48.566009+0000","last_unstale":"2024-09-12T00:55:08.652075+0000","last_undegraded":"2024-09-12T00:55:08.652075+0000","last_fullsized":"2024-09-12T00:55:08.652075+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:08.651514+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:08.651514+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.651514+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:12:09.199043+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":37,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.11","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.195466+0000","last_change":"2024-09-12T00:55:11.195342+0000","last_active":"2024-09-12T00:55:11.195466+0000","last_peered":"2024-09-12T00:55:11.195466+0000","last_clean":"2024-09-12T00:55:11.195466+0000","last_became_active":"2024-09-12T00:39:28.129477+0000","last_became_peered":"2024-09-12T00:39:28.129477+0000","last_unstale":"2024-09-12T00:55:11.195466+0000","last_undegraded":"2024-09-12T00:55:11.195466+0000","last_fullsized":"2024-09-12T00:55:11.195466+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:11.195162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:11.195162+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.195162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:50:41.794941+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.16","version":"266'5","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.168868+0000","last_change":"2024-09-12T00:55:12.168868+0000","last_active":"2024-09-12T00:55:12.168868+0000","last_peered":"2024-09-12T00:55:12.168868+0000","last_clean":"2024-09-12T00:55:12.168868+0000","last_became_active":"2024-09-12T00:28:17.073396+0000","last_became_peered":"2024-09-12T00:28:17.073396+0000","last_unstale":"2024-09-12T00:55:12.168868+0000","last_undegraded":"2024-09-12T00:55:12.168868+0000","last_fullsized":"2024-09-12T00:55:12.168868+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:12.168690+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:12.168690+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.168690+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:45.567507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3072,"num_write":10,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.17","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.268298+0000","last_change":"2024-09-12T00:55:18.268298+0000","last_active":"2024-09-12T00:55:18.268298+0000","last_peered":"2024-09-12T00:55:18.268298+0000","last_clean":"2024-09-12T00:55:18.268298+0000","last_became_active":"2024-09-12T00:28:14.044407+0000","last_became_peered":"2024-09-12T00:28:14.044407+0000","last_unstale":"2024-09-12T00:55:18.268298+0000","last_undegraded":"2024-09-12T00:55:18.268298+0000","last_fullsized":"2024-09-12T00:55:18.268298+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.268111+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.268111+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.268111+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:22.224505+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.14","version":"266'114","reported_seq":409,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:28.427308+0000","last_change":"2024-09-12T00:55:28.427308+0000","last_active":"2024-09-12T00:55:28.427308+0000","last_peered":"2024-09-12T00:55:28.427308+0000","last_clean":"2024-09-12T00:55:28.427308+0000","last_became_active":"2024-09-12T00:26:48.577681+0000","last_became_peered":"2024-09-12T00:26:48.577681+0000","last_unstale":"2024-09-12T00:55:28.427308+0000","last_undegraded":"2024-09-12T00:55:28.427308+0000","last_fullsized":"2024-09-12T00:55:28.427308+0000","mapping_epoch":255,"log_start":"266'100","ondisk_log_start":"266'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'114","last_scrub_stamp":"2024-09-12T00:55:28.427119+0000","last_deep_scrub":"266'114","last_deep_scrub_stamp":"2024-09-12T00:55:28.427119+0000","last_clean_scrub_stamp":"2024-09-12T00:55:28.427119+0000","objects_scrubbed":1,"log_size":14,"log_dups_size":100,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:07:49.946807+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":698,"num_read_kb":510,"num_write":149,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3479,"num_omap_keys":7,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.16","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:34.223952+0000","last_change":"2024-09-12T00:55:34.223952+0000","last_active":"2024-09-12T00:55:34.223952+0000","last_peered":"2024-09-12T00:55:34.223952+0000","last_clean":"2024-09-12T00:55:34.223952+0000","last_became_active":"2024-09-12T00:39:28.124664+0000","last_became_peered":"2024-09-12T00:39:28.124664+0000","last_unstale":"2024-09-12T00:55:34.223952+0000","last_undegraded":"2024-09-12T00:55:34.223952+0000","last_fullsized":"2024-09-12T00:55:34.223952+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:34.223758+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:34.223758+0000","last_clean_scrub_stamp":"2024-09-12T00:55:34.223758+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:02:08.038991+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.11","version":"266'4","reported_seq":46,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:25.320531+0000","last_change":"2024-09-12T00:55:25.320531+0000","last_active":"2024-09-12T00:55:25.320531+0000","last_peered":"2024-09-12T00:55:25.320531+0000","last_clean":"2024-09-12T00:55:25.320531+0000","last_became_active":"2024-09-12T00:28:17.045922+0000","last_became_peered":"2024-09-12T00:28:17.045922+0000","last_unstale":"2024-09-12T00:55:25.320531+0000","last_undegraded":"2024-09-12T00:55:25.320531+0000","last_fullsized":"2024-09-12T00:55:25.320531+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:25.320338+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:25.320338+0000","last_clean_scrub_stamp":"2024-09-12T00:55:25.320338+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:46.594170+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4468,"num_write":4,"num_write_kb":3770,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.10","version":"263'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.715773+0000","last_change":"2024-09-12T00:55:08.715773+0000","last_active":"2024-09-12T00:55:08.715773+0000","last_peered":"2024-09-12T00:55:08.715773+0000","last_clean":"2024-09-12T00:55:08.715773+0000","last_became_active":"2024-09-12T00:28:14.031808+0000","last_became_peered":"2024-09-12T00:28:14.031808+0000","last_unstale":"2024-09-12T00:55:08.715773+0000","last_undegraded":"2024-09-12T00:55:08.715773+0000","last_fullsized":"2024-09-12T00:55:08.715773+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:08.715567+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.715567+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.715567+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:39.116238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.13","version":"266'134","reported_seq":459,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:27.391183+0000","last_change":"2024-09-12T00:55:27.391183+0000","last_active":"2024-09-12T00:55:27.391183+0000","last_peered":"2024-09-12T00:55:27.391183+0000","last_clean":"2024-09-12T00:55:27.391183+0000","last_became_active":"2024-09-12T00:26:48.577338+0000","last_became_peered":"2024-09-12T00:26:48.577338+0000","last_unstale":"2024-09-12T00:55:27.391183+0000","last_undegraded":"2024-09-12T00:55:27.391183+0000","last_fullsized":"2024-09-12T00:55:27.391183+0000","mapping_epoch":255,"log_start":"263'100","ondisk_log_start":"263'100","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:55:27.390995+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:55:27.390995+0000","last_clean_scrub_stamp":"2024-09-12T00:55:27.390995+0000","objects_scrubbed":1,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:28:13.619961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":804,"num_read_kb":593,"num_write":171,"num_write_kb":121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3720,"num_omap_keys":8,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.17","version":"0'0","reported_seq":27,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.634936+0000","last_change":"2024-09-12T00:55:20.634936+0000","last_active":"2024-09-12T00:55:20.634936+0000","last_peered":"2024-09-12T00:55:20.634936+0000","last_clean":"2024-09-12T00:55:20.634936+0000","last_became_active":"2024-09-12T00:39:28.114901+0000","last_became_peered":"2024-09-12T00:39:28.114901+0000","last_unstale":"2024-09-12T00:55:20.634936+0000","last_undegraded":"2024-09-12T00:55:20.634936+0000","last_fullsized":"2024-09-12T00:55:20.634936+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:20.634725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:20.634725+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.634725+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:30.101814+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.10","version":"263'2","reported_seq":42,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:24.312901+0000","last_change":"2024-09-12T00:55:24.312901+0000","last_active":"2024-09-12T00:55:24.312901+0000","last_peered":"2024-09-12T00:55:24.312901+0000","last_clean":"2024-09-12T00:55:24.312901+0000","last_became_active":"2024-09-12T00:28:17.059049+0000","last_became_peered":"2024-09-12T00:28:17.059049+0000","last_unstale":"2024-09-12T00:55:24.312901+0000","last_undegraded":"2024-09-12T00:55:24.312901+0000","last_fullsized":"2024-09-12T00:55:24.312901+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:24.312700+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:24.312700+0000","last_clean_scrub_stamp":"2024-09-12T00:55:24.312700+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:05:04.900716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.11","version":"0'0","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.259497+0000","last_change":"2024-09-12T00:55:17.259497+0000","last_active":"2024-09-12T00:55:17.259497+0000","last_peered":"2024-09-12T00:55:17.259497+0000","last_clean":"2024-09-12T00:55:17.259497+0000","last_became_active":"2024-09-12T00:28:14.042926+0000","last_became_peered":"2024-09-12T00:28:14.042926+0000","last_unstale":"2024-09-12T00:55:17.259497+0000","last_undegraded":"2024-09-12T00:55:17.259497+0000","last_fullsized":"2024-09-12T00:55:17.259497+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:17.259317+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:17.259317+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.259317+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:39:44.554408+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.12","version":"0'0","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.647408+0000","last_change":"2024-09-12T00:55:07.647408+0000","last_active":"2024-09-12T00:55:07.647408+0000","last_peered":"2024-09-12T00:55:07.647408+0000","last_clean":"2024-09-12T00:55:07.647408+0000","last_became_active":"2024-09-12T00:26:48.586788+0000","last_became_peered":"2024-09-12T00:26:48.586788+0000","last_unstale":"2024-09-12T00:55:07.647408+0000","last_undegraded":"2024-09-12T00:55:07.647408+0000","last_fullsized":"2024-09-12T00:55:07.647408+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.647104+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.647104+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.647104+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:37:53.415759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.14","version":"266'2","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.698132+0000","last_change":"2024-09-12T00:55:22.697987+0000","last_active":"2024-09-12T00:55:22.698132+0000","last_peered":"2024-09-12T00:55:22.698132+0000","last_clean":"2024-09-12T00:55:22.698132+0000","last_became_active":"2024-09-12T00:39:28.115407+0000","last_became_peered":"2024-09-12T00:39:28.115407+0000","last_unstale":"2024-09-12T00:55:22.698132+0000","last_undegraded":"2024-09-12T00:55:22.698132+0000","last_fullsized":"2024-09-12T00:55:22.698132+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:22.697793+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:22.697793+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.697793+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:05:34.209372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.13","version":"266'7","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.715075+0000","last_change":"2024-09-12T00:55:19.715075+0000","last_active":"2024-09-12T00:55:19.715075+0000","last_peered":"2024-09-12T00:55:19.715075+0000","last_clean":"2024-09-12T00:55:19.715075+0000","last_became_active":"2024-09-12T00:28:17.075296+0000","last_became_peered":"2024-09-12T00:28:17.075296+0000","last_unstale":"2024-09-12T00:55:19.715075+0000","last_undegraded":"2024-09-12T00:55:19.715075+0000","last_fullsized":"2024-09-12T00:55:19.715075+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:19.714883+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:19.714883+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.714883+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:45.667668+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":2048,"num_write":12,"num_write_kb":6144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.12","version":"266'4","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.772562+0000","last_change":"2024-09-12T00:55:11.772562+0000","last_active":"2024-09-12T00:55:11.772562+0000","last_peered":"2024-09-12T00:55:11.772562+0000","last_clean":"2024-09-12T00:55:11.772562+0000","last_became_active":"2024-09-12T00:28:14.040213+0000","last_became_peered":"2024-09-12T00:28:14.040213+0000","last_unstale":"2024-09-12T00:55:11.772562+0000","last_undegraded":"2024-09-12T00:55:11.772562+0000","last_fullsized":"2024-09-12T00:55:11.772562+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:11.772354+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:11.772354+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.772354+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:00:25.452055+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":7168,"num_write":4,"num_write_kb":7168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.11","version":"263'11","reported_seq":80,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.684806+0000","last_change":"2024-09-12T00:55:06.684806+0000","last_active":"2024-09-12T00:55:06.684806+0000","last_peered":"2024-09-12T00:55:06.684806+0000","last_clean":"2024-09-12T00:55:06.684806+0000","last_became_active":"2024-09-12T00:26:48.563129+0000","last_became_peered":"2024-09-12T00:26:48.563129+0000","last_unstale":"2024-09-12T00:55:06.684806+0000","last_undegraded":"2024-09-12T00:55:06.684806+0000","last_fullsized":"2024-09-12T00:55:06.684806+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'11","last_scrub_stamp":"2024-09-12T00:55:06.684571+0000","last_deep_scrub":"263'11","last_deep_scrub_stamp":"2024-09-12T00:55:06.684571+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.684571+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:12.401931+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":53,"num_read_kb":37,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.15","version":"266'2","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.620884+0000","last_change":"2024-09-12T00:55:18.620884+0000","last_active":"2024-09-12T00:55:18.620884+0000","last_peered":"2024-09-12T00:55:18.620884+0000","last_clean":"2024-09-12T00:55:18.620884+0000","last_became_active":"2024-09-12T00:39:28.106279+0000","last_became_peered":"2024-09-12T00:39:28.106279+0000","last_unstale":"2024-09-12T00:55:18.620884+0000","last_undegraded":"2024-09-12T00:55:18.620884+0000","last_fullsized":"2024-09-12T00:55:18.620884+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:18.620698+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:18.620698+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.620698+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:52.549997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"67.12","version":"0'0","reported_seq":38,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:40.317297+0000","last_change":"2024-09-12T00:55:40.317297+0000","last_active":"2024-09-12T00:55:40.317297+0000","last_peered":"2024-09-12T00:55:40.317297+0000","last_clean":"2024-09-12T00:55:40.317297+0000","last_became_active":"2024-09-12T00:28:17.070915+0000","last_became_peered":"2024-09-12T00:28:17.070915+0000","last_unstale":"2024-09-12T00:55:40.317297+0000","last_undegraded":"2024-09-12T00:55:40.317297+0000","last_fullsized":"2024-09-12T00:55:40.317297+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:40.317090+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:40.317090+0000","last_clean_scrub_stamp":"2024-09-12T00:55:40.317090+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:34:11.242413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.13","version":"266'9","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.756608+0000","last_change":"2024-09-12T00:55:09.756608+0000","last_active":"2024-09-12T00:55:09.756608+0000","last_peered":"2024-09-12T00:55:09.756608+0000","last_clean":"2024-09-12T00:55:09.756608+0000","last_became_active":"2024-09-12T00:28:14.032646+0000","last_became_peered":"2024-09-12T00:28:14.032646+0000","last_unstale":"2024-09-12T00:55:09.756608+0000","last_undegraded":"2024-09-12T00:55:09.756608+0000","last_fullsized":"2024-09-12T00:55:09.756608+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'9","last_scrub_stamp":"2024-09-12T00:55:09.756432+0000","last_deep_scrub":"266'9","last_deep_scrub_stamp":"2024-09-12T00:55:09.756432+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.756432+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:07:40.453032+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":13,"num_read_kb":21053,"num_write":14,"num_write_kb":8763,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.10","version":"266'26","reported_seq":121,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.651000+0000","last_change":"2024-09-12T00:55:05.651000+0000","last_active":"2024-09-12T00:55:05.651000+0000","last_peered":"2024-09-12T00:55:05.651000+0000","last_clean":"2024-09-12T00:55:05.651000+0000","last_became_active":"2024-09-12T00:26:48.583143+0000","last_became_peered":"2024-09-12T00:26:48.583143+0000","last_unstale":"2024-09-12T00:55:05.651000+0000","last_undegraded":"2024-09-12T00:55:05.651000+0000","last_fullsized":"2024-09-12T00:55:05.651000+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'26","last_scrub_stamp":"2024-09-12T00:55:05.650820+0000","last_deep_scrub":"266'26","last_deep_scrub_stamp":"2024-09-12T00:55:05.650820+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.650820+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:28:21.508950+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":131,"num_read_kb":92,"num_write":50,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.a","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:31.299370+0000","last_change":"2024-09-12T00:55:31.299370+0000","last_active":"2024-09-12T00:55:31.299370+0000","last_peered":"2024-09-12T00:55:31.299370+0000","last_clean":"2024-09-12T00:55:31.299370+0000","last_became_active":"2024-09-12T00:39:28.127169+0000","last_became_peered":"2024-09-12T00:39:28.127169+0000","last_unstale":"2024-09-12T00:55:31.299370+0000","last_undegraded":"2024-09-12T00:55:31.299370+0000","last_fullsized":"2024-09-12T00:55:31.299370+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:31.299176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:31.299176+0000","last_clean_scrub_stamp":"2024-09-12T00:55:31.299176+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:46.292436+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.d","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.676281+0000","last_change":"2024-09-12T00:55:18.676022+0000","last_active":"2024-09-12T00:55:18.676281+0000","last_peered":"2024-09-12T00:55:18.676281+0000","last_clean":"2024-09-12T00:55:18.676281+0000","last_became_active":"2024-09-12T00:28:17.072293+0000","last_became_peered":"2024-09-12T00:28:17.072293+0000","last_unstale":"2024-09-12T00:55:18.676281+0000","last_undegraded":"2024-09-12T00:55:18.676281+0000","last_fullsized":"2024-09-12T00:55:18.676281+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.675818+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.675818+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.675818+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:37.227054+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.c","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.780153+0000","last_change":"2024-09-12T00:55:14.779965+0000","last_active":"2024-09-12T00:55:14.780153+0000","last_peered":"2024-09-12T00:55:14.780153+0000","last_clean":"2024-09-12T00:55:14.780153+0000","last_became_active":"2024-09-12T00:28:14.013343+0000","last_became_peered":"2024-09-12T00:28:14.013343+0000","last_unstale":"2024-09-12T00:55:14.780153+0000","last_undegraded":"2024-09-12T00:55:14.780153+0000","last_fullsized":"2024-09-12T00:55:14.780153+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:14.779773+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:14.779773+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.779773+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:06.125955+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.f","version":"266'10","reported_seq":76,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.661387+0000","last_change":"2024-09-12T00:55:06.661387+0000","last_active":"2024-09-12T00:55:06.661387+0000","last_peered":"2024-09-12T00:55:06.661387+0000","last_clean":"2024-09-12T00:55:06.661387+0000","last_became_active":"2024-09-12T00:26:48.572355+0000","last_became_peered":"2024-09-12T00:26:48.572355+0000","last_unstale":"2024-09-12T00:55:06.661387+0000","last_undegraded":"2024-09-12T00:55:06.661387+0000","last_fullsized":"2024-09-12T00:55:06.661387+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'10","last_scrub_stamp":"2024-09-12T00:55:06.661170+0000","last_deep_scrub":"266'10","last_deep_scrub_stamp":"2024-09-12T00:55:06.661170+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.661170+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:34.081658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":33,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.b","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.844282+0000","last_change":"2024-09-12T00:55:14.844152+0000","last_active":"2024-09-12T00:55:14.844282+0000","last_peered":"2024-09-12T00:55:14.844282+0000","last_clean":"2024-09-12T00:55:14.844282+0000","last_became_active":"2024-09-12T00:39:28.120909+0000","last_became_peered":"2024-09-12T00:39:28.120909+0000","last_unstale":"2024-09-12T00:55:14.844282+0000","last_undegraded":"2024-09-12T00:55:14.844282+0000","last_fullsized":"2024-09-12T00:55:14.844282+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.843969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.843969+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.843969+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:09:01.964336+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.c","version":"263'2","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.743124+0000","last_change":"2024-09-12T00:55:16.742863+0000","last_active":"2024-09-12T00:55:16.743124+0000","last_peered":"2024-09-12T00:55:16.743124+0000","last_clean":"2024-09-12T00:55:16.743124+0000","last_became_active":"2024-09-12T00:28:17.072166+0000","last_became_peered":"2024-09-12T00:28:17.072166+0000","last_unstale":"2024-09-12T00:55:16.743124+0000","last_undegraded":"2024-09-12T00:55:16.743124+0000","last_fullsized":"2024-09-12T00:55:16.743124+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:16.742631+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:16.742631+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.742631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:28.694379+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.d","version":"266'13","reported_seq":68,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.553718+0000","last_change":"2024-09-12T00:55:15.553524+0000","last_active":"2024-09-12T00:55:15.553718+0000","last_peered":"2024-09-12T00:55:15.553718+0000","last_clean":"2024-09-12T00:55:15.553718+0000","last_became_active":"2024-09-12T00:28:14.040204+0000","last_became_peered":"2024-09-12T00:28:14.040204+0000","last_unstale":"2024-09-12T00:55:15.553718+0000","last_undegraded":"2024-09-12T00:55:15.553718+0000","last_fullsized":"2024-09-12T00:55:15.553718+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'13","last_scrub_stamp":"2024-09-12T00:55:15.553347+0000","last_deep_scrub":"266'13","last_deep_scrub_stamp":"2024-09-12T00:55:15.553347+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.553347+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:56:57.280719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":10242,"num_write":18,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.e","version":"266'37","reported_seq":142,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:25.423304+0000","last_change":"2024-09-12T00:55:25.423304+0000","last_active":"2024-09-12T00:55:25.423304+0000","last_peered":"2024-09-12T00:55:25.423304+0000","last_clean":"2024-09-12T00:55:25.423304+0000","last_became_active":"2024-09-12T00:26:48.578328+0000","last_became_peered":"2024-09-12T00:26:48.578328+0000","last_unstale":"2024-09-12T00:55:25.423304+0000","last_undegraded":"2024-09-12T00:55:25.423304+0000","last_fullsized":"2024-09-12T00:55:25.423304+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'37","last_scrub_stamp":"2024-09-12T00:55:25.423129+0000","last_deep_scrub":"266'37","last_deep_scrub_stamp":"2024-09-12T00:55:25.423129+0000","last_clean_scrub_stamp":"2024-09-12T00:55:25.423129+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:51.651023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":168,"num_read_kb":114,"num_write":70,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.8","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:41.272852+0000","last_change":"2024-09-12T00:55:41.272852+0000","last_active":"2024-09-12T00:55:41.272852+0000","last_peered":"2024-09-12T00:55:41.272852+0000","last_clean":"2024-09-12T00:55:41.272852+0000","last_became_active":"2024-09-12T00:39:28.131039+0000","last_became_peered":"2024-09-12T00:39:28.131039+0000","last_unstale":"2024-09-12T00:55:41.272852+0000","last_undegraded":"2024-09-12T00:55:41.272852+0000","last_fullsized":"2024-09-12T00:55:41.272852+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:41.272668+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:41.272668+0000","last_clean_scrub_stamp":"2024-09-12T00:55:41.272668+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:31:24.811027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.f","version":"263'3","reported_seq":44,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.708411+0000","last_change":"2024-09-12T00:55:20.708240+0000","last_active":"2024-09-12T00:55:20.708411+0000","last_peered":"2024-09-12T00:55:20.708411+0000","last_clean":"2024-09-12T00:55:20.708411+0000","last_became_active":"2024-09-12T00:28:17.077287+0000","last_became_peered":"2024-09-12T00:28:17.077287+0000","last_unstale":"2024-09-12T00:55:20.708411+0000","last_undegraded":"2024-09-12T00:55:20.708411+0000","last_fullsized":"2024-09-12T00:55:20.708411+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T00:55:20.708045+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T00:55:20.708045+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.708045+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:43:32.275206+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"66.e","version":"266'5","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.705450+0000","last_change":"2024-09-12T00:55:11.705316+0000","last_active":"2024-09-12T00:55:11.705450+0000","last_peered":"2024-09-12T00:55:11.705450+0000","last_clean":"2024-09-12T00:55:11.705450+0000","last_became_active":"2024-09-12T00:28:14.053270+0000","last_became_peered":"2024-09-12T00:28:14.053270+0000","last_unstale":"2024-09-12T00:55:11.705450+0000","last_undegraded":"2024-09-12T00:55:11.705450+0000","last_fullsized":"2024-09-12T00:55:11.705450+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:11.705125+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:11.705125+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.705125+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:53:16.644347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5120,"num_write":10,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.d","version":"266'41","reported_seq":160,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.679487+0000","last_change":"2024-09-12T00:55:06.679487+0000","last_active":"2024-09-12T00:55:06.679487+0000","last_peered":"2024-09-12T00:55:06.679487+0000","last_clean":"2024-09-12T00:55:06.679487+0000","last_became_active":"2024-09-12T00:26:48.566302+0000","last_became_peered":"2024-09-12T00:26:48.566302+0000","last_unstale":"2024-09-12T00:55:06.679487+0000","last_undegraded":"2024-09-12T00:55:06.679487+0000","last_fullsized":"2024-09-12T00:55:06.679487+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'41","last_scrub_stamp":"2024-09-12T00:55:06.679274+0000","last_deep_scrub":"266'41","last_deep_scrub_stamp":"2024-09-12T00:55:06.679274+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.679274+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:33:30.604913+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":203,"num_read_kb":142,"num_write":77,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"68.9","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.795156+0000","last_change":"2024-09-12T00:55:13.795156+0000","last_active":"2024-09-12T00:55:13.795156+0000","last_peered":"2024-09-12T00:55:13.795156+0000","last_clean":"2024-09-12T00:55:13.795156+0000","last_became_active":"2024-09-12T00:39:28.115802+0000","last_became_peered":"2024-09-12T00:39:28.115802+0000","last_unstale":"2024-09-12T00:55:13.795156+0000","last_undegraded":"2024-09-12T00:55:13.795156+0000","last_fullsized":"2024-09-12T00:55:13.795156+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:13.794974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:13.794974+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.794974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:16:01.424754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"67.e","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:23.299101+0000","last_change":"2024-09-12T00:55:23.299101+0000","last_active":"2024-09-12T00:55:23.299101+0000","last_peered":"2024-09-12T00:55:23.299101+0000","last_clean":"2024-09-12T00:55:23.299101+0000","last_became_active":"2024-09-12T00:28:17.060485+0000","last_became_peered":"2024-09-12T00:28:17.060485+0000","last_unstale":"2024-09-12T00:55:23.299101+0000","last_undegraded":"2024-09-12T00:55:23.299101+0000","last_fullsized":"2024-09-12T00:55:23.299101+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:23.298897+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:23.298897+0000","last_clean_scrub_stamp":"2024-09-12T00:55:23.298897+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:58:31.059131+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.f","version":"266'7","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.742406+0000","last_change":"2024-09-12T00:55:13.742221+0000","last_active":"2024-09-12T00:55:13.742406+0000","last_peered":"2024-09-12T00:55:13.742406+0000","last_clean":"2024-09-12T00:55:13.742406+0000","last_became_active":"2024-09-12T00:28:14.052489+0000","last_became_peered":"2024-09-12T00:28:14.052489+0000","last_unstale":"2024-09-12T00:55:13.742406+0000","last_undegraded":"2024-09-12T00:55:13.742406+0000","last_fullsized":"2024-09-12T00:55:13.742406+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:13.742049+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:13.742049+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.742049+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:29:19.515727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":13312,"num_write":12,"num_write_kb":9216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.c","version":"266'27","reported_seq":119,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.692338+0000","last_change":"2024-09-12T00:55:08.692338+0000","last_active":"2024-09-12T00:55:08.692338+0000","last_peered":"2024-09-12T00:55:08.692338+0000","last_clean":"2024-09-12T00:55:08.692338+0000","last_became_active":"2024-09-12T00:26:48.589613+0000","last_became_peered":"2024-09-12T00:26:48.589613+0000","last_unstale":"2024-09-12T00:55:08.692338+0000","last_undegraded":"2024-09-12T00:55:08.692338+0000","last_fullsized":"2024-09-12T00:55:08.692338+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'27","last_scrub_stamp":"2024-09-12T00:55:08.692158+0000","last_deep_scrub":"266'27","last_deep_scrub_stamp":"2024-09-12T00:55:08.692158+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.692158+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:23:48.050746+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":122,"num_read_kb":85,"num_write":63,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.e","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:32.251592+0000","last_change":"2024-09-12T00:55:32.251592+0000","last_active":"2024-09-12T00:55:32.251592+0000","last_peered":"2024-09-12T00:55:32.251592+0000","last_clean":"2024-09-12T00:55:32.251592+0000","last_became_active":"2024-09-12T00:39:28.123481+0000","last_became_peered":"2024-09-12T00:39:28.123481+0000","last_unstale":"2024-09-12T00:55:32.251592+0000","last_undegraded":"2024-09-12T00:55:32.251592+0000","last_fullsized":"2024-09-12T00:55:32.251592+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:32.251407+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:32.251407+0000","last_clean_scrub_stamp":"2024-09-12T00:55:32.251407+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:07:16.966730+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.9","version":"266'2","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:36.346693+0000","last_change":"2024-09-12T00:55:36.346693+0000","last_active":"2024-09-12T00:55:36.346693+0000","last_peered":"2024-09-12T00:55:36.346693+0000","last_clean":"2024-09-12T00:55:36.346693+0000","last_became_active":"2024-09-12T00:28:17.075238+0000","last_became_peered":"2024-09-12T00:28:17.075238+0000","last_unstale":"2024-09-12T00:55:36.346693+0000","last_undegraded":"2024-09-12T00:55:36.346693+0000","last_fullsized":"2024-09-12T00:55:36.346693+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:36.346516+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:36.346516+0000","last_clean_scrub_stamp":"2024-09-12T00:55:36.346516+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:39.963476+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.8","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.692162+0000","last_change":"2024-09-12T00:55:09.692162+0000","last_active":"2024-09-12T00:55:09.692162+0000","last_peered":"2024-09-12T00:55:09.692162+0000","last_clean":"2024-09-12T00:55:09.692162+0000","last_became_active":"2024-09-12T00:28:14.039135+0000","last_became_peered":"2024-09-12T00:28:14.039135+0000","last_unstale":"2024-09-12T00:55:09.692162+0000","last_undegraded":"2024-09-12T00:55:09.692162+0000","last_fullsized":"2024-09-12T00:55:09.692162+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.691980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.691980+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.691980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:40:20.998646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.b","version":"266'18","reported_seq":94,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.729908+0000","last_change":"2024-09-12T00:55:07.729908+0000","last_active":"2024-09-12T00:55:07.729908+0000","last_peered":"2024-09-12T00:55:07.729908+0000","last_clean":"2024-09-12T00:55:07.729908+0000","last_became_active":"2024-09-12T00:26:48.584993+0000","last_became_peered":"2024-09-12T00:26:48.584993+0000","last_unstale":"2024-09-12T00:55:07.729908+0000","last_undegraded":"2024-09-12T00:55:07.729908+0000","last_fullsized":"2024-09-12T00:55:07.729908+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'18","last_scrub_stamp":"2024-09-12T00:55:07.729701+0000","last_deep_scrub":"266'18","last_deep_scrub_stamp":"2024-09-12T00:55:07.729701+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.729701+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:38.152765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":51,"num_write":40,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"68.f","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.815513+0000","last_change":"2024-09-12T00:55:17.815231+0000","last_active":"2024-09-12T00:55:17.815513+0000","last_peered":"2024-09-12T00:55:17.815513+0000","last_clean":"2024-09-12T00:55:17.815513+0000","last_became_active":"2024-09-12T00:39:28.126635+0000","last_became_peered":"2024-09-12T00:39:28.126635+0000","last_unstale":"2024-09-12T00:55:17.815513+0000","last_undegraded":"2024-09-12T00:55:17.815513+0000","last_fullsized":"2024-09-12T00:55:17.815513+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:17.814962+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:17.814962+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.814962+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:03:07.028085+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"67.8","version":"266'8","reported_seq":51,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.801386+0000","last_change":"2024-09-12T00:55:12.801386+0000","last_active":"2024-09-12T00:55:12.801386+0000","last_peered":"2024-09-12T00:55:12.801386+0000","last_clean":"2024-09-12T00:55:12.801386+0000","last_became_active":"2024-09-12T00:28:17.067181+0000","last_became_peered":"2024-09-12T00:28:17.067181+0000","last_unstale":"2024-09-12T00:55:12.801386+0000","last_undegraded":"2024-09-12T00:55:12.801386+0000","last_fullsized":"2024-09-12T00:55:12.801386+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'8","last_scrub_stamp":"2024-09-12T00:55:12.801203+0000","last_deep_scrub":"266'8","last_deep_scrub_stamp":"2024-09-12T00:55:12.801203+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.801203+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:29:19.463086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":10240,"num_write":8,"num_write_kb":10240,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.9","version":"266'5","reported_seq":52,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.263682+0000","last_change":"2024-09-12T00:55:16.263682+0000","last_active":"2024-09-12T00:55:16.263682+0000","last_peered":"2024-09-12T00:55:16.263682+0000","last_clean":"2024-09-12T00:55:16.263682+0000","last_became_active":"2024-09-12T00:28:14.042174+0000","last_became_peered":"2024-09-12T00:28:14.042174+0000","last_unstale":"2024-09-12T00:55:16.263682+0000","last_undegraded":"2024-09-12T00:55:16.263682+0000","last_fullsized":"2024-09-12T00:55:16.263682+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:16.263506+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:16.263506+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.263506+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:11:04.116688+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2048,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"65.a","version":"266'22","reported_seq":112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.655760+0000","last_change":"2024-09-12T00:55:07.655760+0000","last_active":"2024-09-12T00:55:07.655760+0000","last_peered":"2024-09-12T00:55:07.655760+0000","last_clean":"2024-09-12T00:55:07.655760+0000","last_became_active":"2024-09-12T00:26:48.567966+0000","last_became_peered":"2024-09-12T00:26:48.567966+0000","last_unstale":"2024-09-12T00:55:07.655760+0000","last_undegraded":"2024-09-12T00:55:07.655760+0000","last_fullsized":"2024-09-12T00:55:07.655760+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'22","last_scrub_stamp":"2024-09-12T00:55:07.655523+0000","last_deep_scrub":"266'22","last_deep_scrub_stamp":"2024-09-12T00:55:07.655523+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.655523+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:33:11.716375+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":78,"num_write":32,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.c","version":"266'2","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.187270+0000","last_change":"2024-09-12T00:55:13.187143+0000","last_active":"2024-09-12T00:55:13.187270+0000","last_peered":"2024-09-12T00:55:13.187270+0000","last_clean":"2024-09-12T00:55:13.187270+0000","last_became_active":"2024-09-12T00:39:28.129421+0000","last_became_peered":"2024-09-12T00:39:28.129421+0000","last_unstale":"2024-09-12T00:55:13.187270+0000","last_undegraded":"2024-09-12T00:55:13.187270+0000","last_fullsized":"2024-09-12T00:55:13.187270+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:13.186952+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:13.186952+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.186952+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:00:19.346141+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.b","version":"263'6","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.588636+0000","last_change":"2024-09-12T00:55:16.588375+0000","last_active":"2024-09-12T00:55:16.588636+0000","last_peered":"2024-09-12T00:55:16.588636+0000","last_clean":"2024-09-12T00:55:16.588636+0000","last_became_active":"2024-09-12T00:28:17.080068+0000","last_became_peered":"2024-09-12T00:28:17.080068+0000","last_unstale":"2024-09-12T00:55:16.588636+0000","last_undegraded":"2024-09-12T00:55:16.588636+0000","last_fullsized":"2024-09-12T00:55:16.588636+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'6","last_scrub_stamp":"2024-09-12T00:55:16.588100+0000","last_deep_scrub":"263'6","last_deep_scrub_stamp":"2024-09-12T00:55:16.588100+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.588100+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:52.874672+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":8194,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"66.a","version":"0'0","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.716361+0000","last_change":"2024-09-12T00:55:12.716361+0000","last_active":"2024-09-12T00:55:12.716361+0000","last_peered":"2024-09-12T00:55:12.716361+0000","last_clean":"2024-09-12T00:55:12.716361+0000","last_became_active":"2024-09-12T00:28:14.046567+0000","last_became_peered":"2024-09-12T00:28:14.046567+0000","last_unstale":"2024-09-12T00:55:12.716361+0000","last_undegraded":"2024-09-12T00:55:12.716361+0000","last_fullsized":"2024-09-12T00:55:12.716361+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:12.716166+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:12.716166+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.716166+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:01:00.539699+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"65.9","version":"266'29","reported_seq":133,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.321305+0000","last_change":"2024-09-12T00:55:14.321305+0000","last_active":"2024-09-12T00:55:14.321305+0000","last_peered":"2024-09-12T00:55:14.321305+0000","last_clean":"2024-09-12T00:55:14.321305+0000","last_became_active":"2024-09-12T00:26:48.569620+0000","last_became_peered":"2024-09-12T00:26:48.569620+0000","last_unstale":"2024-09-12T00:55:14.321305+0000","last_undegraded":"2024-09-12T00:55:14.321305+0000","last_fullsized":"2024-09-12T00:55:14.321305+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'29","last_scrub_stamp":"2024-09-12T00:55:14.321114+0000","last_deep_scrub":"266'29","last_deep_scrub_stamp":"2024-09-12T00:55:14.321114+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.321114+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:32:04.333451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":152,"num_read_kb":105,"num_write":52,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"68.d","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:24.723897+0000","last_change":"2024-09-12T00:55:24.723897+0000","last_active":"2024-09-12T00:55:24.723897+0000","last_peered":"2024-09-12T00:55:24.723897+0000","last_clean":"2024-09-12T00:55:24.723897+0000","last_became_active":"2024-09-12T00:39:28.138643+0000","last_became_peered":"2024-09-12T00:39:28.138643+0000","last_unstale":"2024-09-12T00:55:24.723897+0000","last_undegraded":"2024-09-12T00:55:24.723897+0000","last_fullsized":"2024-09-12T00:55:24.723897+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:24.723723+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:24.723723+0000","last_clean_scrub_stamp":"2024-09-12T00:55:24.723723+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:46.566830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.a","version":"266'4","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.136408+0000","last_change":"2024-09-12T00:55:05.136408+0000","last_active":"2024-09-12T00:55:05.136408+0000","last_peered":"2024-09-12T00:55:05.136408+0000","last_clean":"2024-09-12T00:55:05.136408+0000","last_became_active":"2024-09-12T00:28:17.063875+0000","last_became_peered":"2024-09-12T00:28:17.063875+0000","last_unstale":"2024-09-12T00:55:05.136408+0000","last_undegraded":"2024-09-12T00:55:05.136408+0000","last_fullsized":"2024-09-12T00:55:05.136408+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:05.136223+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:05.136223+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.136223+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:30:30.134780+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":5120,"num_write":4,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.b","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:32.405404+0000","last_change":"2024-09-12T00:55:32.405404+0000","last_active":"2024-09-12T00:55:32.405404+0000","last_peered":"2024-09-12T00:55:32.405404+0000","last_clean":"2024-09-12T00:55:32.405404+0000","last_became_active":"2024-09-12T00:28:14.044872+0000","last_became_peered":"2024-09-12T00:28:14.044872+0000","last_unstale":"2024-09-12T00:55:32.405404+0000","last_undegraded":"2024-09-12T00:55:32.405404+0000","last_fullsized":"2024-09-12T00:55:32.405404+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:32.405207+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:32.405207+0000","last_clean_scrub_stamp":"2024-09-12T00:55:32.405207+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:34:45.255600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":1024,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.8","version":"266'11","reported_seq":82,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.121114+0000","last_change":"2024-09-12T00:55:07.121114+0000","last_active":"2024-09-12T00:55:07.121114+0000","last_peered":"2024-09-12T00:55:07.121114+0000","last_clean":"2024-09-12T00:55:07.121114+0000","last_became_active":"2024-09-12T00:26:48.572144+0000","last_became_peered":"2024-09-12T00:26:48.572144+0000","last_unstale":"2024-09-12T00:55:07.121114+0000","last_undegraded":"2024-09-12T00:55:07.121114+0000","last_fullsized":"2024-09-12T00:55:07.121114+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'11","last_scrub_stamp":"2024-09-12T00:55:07.120938+0000","last_deep_scrub":"266'11","last_deep_scrub_stamp":"2024-09-12T00:55:07.120938+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.120938+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:57:34.007816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":40,"num_write":21,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"68.2","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.180044+0000","last_change":"2024-09-12T00:55:09.180044+0000","last_active":"2024-09-12T00:55:09.180044+0000","last_peered":"2024-09-12T00:55:09.180044+0000","last_clean":"2024-09-12T00:55:09.180044+0000","last_became_active":"2024-09-12T00:39:28.124831+0000","last_became_peered":"2024-09-12T00:39:28.124831+0000","last_unstale":"2024-09-12T00:55:09.180044+0000","last_undegraded":"2024-09-12T00:55:09.180044+0000","last_fullsized":"2024-09-12T00:55:09.180044+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.179784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.179784+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.179784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:41:38.105314+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.5","version":"263'3","reported_seq":45,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.282833+0000","last_change":"2024-09-12T00:55:22.282598+0000","last_active":"2024-09-12T00:55:22.282833+0000","last_peered":"2024-09-12T00:55:22.282833+0000","last_clean":"2024-09-12T00:55:22.282833+0000","last_became_active":"2024-09-12T00:28:17.053891+0000","last_became_peered":"2024-09-12T00:28:17.053891+0000","last_unstale":"2024-09-12T00:55:22.282833+0000","last_undegraded":"2024-09-12T00:55:22.282833+0000","last_fullsized":"2024-09-12T00:55:22.282833+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'3","last_scrub_stamp":"2024-09-12T00:55:22.282331+0000","last_deep_scrub":"263'3","last_deep_scrub_stamp":"2024-09-12T00:55:22.282331+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.282331+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:50:02.864341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":4096,"num_write":8,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.4","version":"266'7","reported_seq":61,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:29.397697+0000","last_change":"2024-09-12T00:55:29.397697+0000","last_active":"2024-09-12T00:55:29.397697+0000","last_peered":"2024-09-12T00:55:29.397697+0000","last_clean":"2024-09-12T00:55:29.397697+0000","last_became_active":"2024-09-12T00:28:14.029809+0000","last_became_peered":"2024-09-12T00:28:14.029809+0000","last_unstale":"2024-09-12T00:55:29.397697+0000","last_undegraded":"2024-09-12T00:55:29.397697+0000","last_fullsized":"2024-09-12T00:55:29.397697+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:29.397512+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:29.397512+0000","last_clean_scrub_stamp":"2024-09-12T00:55:29.397512+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:00:40.800371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":12,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.7","version":"266'39","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.736727+0000","last_change":"2024-09-12T00:55:13.736727+0000","last_active":"2024-09-12T00:55:13.736727+0000","last_peered":"2024-09-12T00:55:13.736727+0000","last_clean":"2024-09-12T00:55:13.736727+0000","last_became_active":"2024-09-12T00:26:48.585705+0000","last_became_peered":"2024-09-12T00:26:48.585705+0000","last_unstale":"2024-09-12T00:55:13.736727+0000","last_undegraded":"2024-09-12T00:55:13.736727+0000","last_fullsized":"2024-09-12T00:55:13.736727+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'39","last_scrub_stamp":"2024-09-12T00:55:13.736493+0000","last_deep_scrub":"266'39","last_deep_scrub_stamp":"2024-09-12T00:55:13.736493+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.736493+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:40:57.884773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":207,"num_read_kb":152,"num_write":75,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"68.3","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.157652+0000","last_change":"2024-09-12T00:55:06.157652+0000","last_active":"2024-09-12T00:55:06.157652+0000","last_peered":"2024-09-12T00:55:06.157652+0000","last_clean":"2024-09-12T00:55:06.157652+0000","last_became_active":"2024-09-12T00:39:28.119842+0000","last_became_peered":"2024-09-12T00:39:28.119842+0000","last_unstale":"2024-09-12T00:55:06.157652+0000","last_undegraded":"2024-09-12T00:55:06.157652+0000","last_fullsized":"2024-09-12T00:55:06.157652+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.157463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.157463+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.157463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:05:30.183129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"67.4","version":"0'0","reported_seq":40,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.320147+0000","last_change":"2024-09-12T00:55:21.320006+0000","last_active":"2024-09-12T00:55:21.320147+0000","last_peered":"2024-09-12T00:55:21.320147+0000","last_clean":"2024-09-12T00:55:21.320147+0000","last_became_active":"2024-09-12T00:28:17.067997+0000","last_became_peered":"2024-09-12T00:28:17.067997+0000","last_unstale":"2024-09-12T00:55:21.320147+0000","last_undegraded":"2024-09-12T00:55:21.320147+0000","last_fullsized":"2024-09-12T00:55:21.320147+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:21.319822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:21.319822+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.319822+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:35.538066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"66.5","version":"266'2","reported_seq":48,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.699828+0000","last_change":"2024-09-12T00:55:18.699674+0000","last_active":"2024-09-12T00:55:18.699828+0000","last_peered":"2024-09-12T00:55:18.699828+0000","last_clean":"2024-09-12T00:55:18.699828+0000","last_became_active":"2024-09-12T00:28:14.046168+0000","last_became_peered":"2024-09-12T00:28:14.046168+0000","last_unstale":"2024-09-12T00:55:18.699828+0000","last_undegraded":"2024-09-12T00:55:18.699828+0000","last_fullsized":"2024-09-12T00:55:18.699828+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:18.699491+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:18.699491+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.699491+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:51:31.907186+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"65.6","version":"263'46","reported_seq":178,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:24.400527+0000","last_change":"2024-09-12T00:55:24.400527+0000","last_active":"2024-09-12T00:55:24.400527+0000","last_peered":"2024-09-12T00:55:24.400527+0000","last_clean":"2024-09-12T00:55:24.400527+0000","last_became_active":"2024-09-12T00:26:48.575659+0000","last_became_peered":"2024-09-12T00:26:48.575659+0000","last_unstale":"2024-09-12T00:55:24.400527+0000","last_undegraded":"2024-09-12T00:55:24.400527+0000","last_fullsized":"2024-09-12T00:55:24.400527+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'46","last_scrub_stamp":"2024-09-12T00:55:24.400334+0000","last_deep_scrub":"263'46","last_deep_scrub_stamp":"2024-09-12T00:55:24.400334+0000","last_clean_scrub_stamp":"2024-09-12T00:55:24.400334+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:54:23.578240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":235,"num_read_kb":168,"num_write":82,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.0","version":"0'0","reported_seq":29,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:28.299042+0000","last_change":"2024-09-12T00:55:28.298895+0000","last_active":"2024-09-12T00:55:28.299042+0000","last_peered":"2024-09-12T00:55:28.299042+0000","last_clean":"2024-09-12T00:55:28.299042+0000","last_became_active":"2024-09-12T00:39:28.110700+0000","last_became_peered":"2024-09-12T00:39:28.110700+0000","last_unstale":"2024-09-12T00:55:28.299042+0000","last_undegraded":"2024-09-12T00:55:28.299042+0000","last_fullsized":"2024-09-12T00:55:28.299042+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:28.298714+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:28.298714+0000","last_clean_scrub_stamp":"2024-09-12T00:55:28.298714+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:04:18.708548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.7","version":"266'12","reported_seq":60,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.224919+0000","last_change":"2024-09-12T00:55:10.224919+0000","last_active":"2024-09-12T00:55:10.224919+0000","last_peered":"2024-09-12T00:55:10.224919+0000","last_clean":"2024-09-12T00:55:10.224919+0000","last_became_active":"2024-09-12T00:28:17.063662+0000","last_became_peered":"2024-09-12T00:28:17.063662+0000","last_unstale":"2024-09-12T00:55:10.224919+0000","last_undegraded":"2024-09-12T00:55:10.224919+0000","last_fullsized":"2024-09-12T00:55:10.224919+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'12","last_scrub_stamp":"2024-09-12T00:55:10.224731+0000","last_deep_scrub":"266'12","last_deep_scrub_stamp":"2024-09-12T00:55:10.224731+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.224731+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:02:41.204090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":28674,"num_write":22,"num_write_kb":13312,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"66.6","version":"263'2","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.720155+0000","last_change":"2024-09-12T00:55:09.720155+0000","last_active":"2024-09-12T00:55:09.720155+0000","last_peered":"2024-09-12T00:55:09.720155+0000","last_clean":"2024-09-12T00:55:09.720155+0000","last_became_active":"2024-09-12T00:28:14.037482+0000","last_became_peered":"2024-09-12T00:28:14.037482+0000","last_unstale":"2024-09-12T00:55:09.720155+0000","last_undegraded":"2024-09-12T00:55:09.720155+0000","last_fullsized":"2024-09-12T00:55:09.720155+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'2","last_scrub_stamp":"2024-09-12T00:55:09.719977+0000","last_deep_scrub":"263'2","last_deep_scrub_stamp":"2024-09-12T00:55:09.719977+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.719977+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:15:00.827899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":16,"num_write":2,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.5","version":"266'33","reported_seq":139,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.626270+0000","last_change":"2024-09-12T00:55:04.626270+0000","last_active":"2024-09-12T00:55:04.626270+0000","last_peered":"2024-09-12T00:55:04.626270+0000","last_clean":"2024-09-12T00:55:04.626270+0000","last_became_active":"2024-09-12T00:26:48.578267+0000","last_became_peered":"2024-09-12T00:26:48.578267+0000","last_unstale":"2024-09-12T00:55:04.626270+0000","last_undegraded":"2024-09-12T00:55:04.626270+0000","last_fullsized":"2024-09-12T00:55:04.626270+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'33","last_scrub_stamp":"2024-09-12T00:55:04.625979+0000","last_deep_scrub":"266'33","last_deep_scrub_stamp":"2024-09-12T00:55:04.625979+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.625979+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:34:29.700832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":164,"num_read_kb":114,"num_write":63,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.1","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:39.345232+0000","last_change":"2024-09-12T00:55:39.345232+0000","last_active":"2024-09-12T00:55:39.345232+0000","last_peered":"2024-09-12T00:55:39.345232+0000","last_clean":"2024-09-12T00:55:39.345232+0000","last_became_active":"2024-09-12T00:39:28.133708+0000","last_became_peered":"2024-09-12T00:39:28.133708+0000","last_unstale":"2024-09-12T00:55:39.345232+0000","last_undegraded":"2024-09-12T00:55:39.345232+0000","last_fullsized":"2024-09-12T00:55:39.345232+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:39.345052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:39.345052+0000","last_clean_scrub_stamp":"2024-09-12T00:55:39.345052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:14:05.121548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.6","version":"0'0","reported_seq":39,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:37.319194+0000","last_change":"2024-09-12T00:55:37.319194+0000","last_active":"2024-09-12T00:55:37.319194+0000","last_peered":"2024-09-12T00:55:37.319194+0000","last_clean":"2024-09-12T00:55:37.319194+0000","last_became_active":"2024-09-12T00:28:17.072449+0000","last_became_peered":"2024-09-12T00:28:17.072449+0000","last_unstale":"2024-09-12T00:55:37.319194+0000","last_undegraded":"2024-09-12T00:55:37.319194+0000","last_fullsized":"2024-09-12T00:55:37.319194+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:37.318999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:37.318999+0000","last_clean_scrub_stamp":"2024-09-12T00:55:37.318999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:33.880712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.7","version":"266'6","reported_seq":57,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:31.357622+0000","last_change":"2024-09-12T00:55:31.357622+0000","last_active":"2024-09-12T00:55:31.357622+0000","last_peered":"2024-09-12T00:55:31.357622+0000","last_clean":"2024-09-12T00:55:31.357622+0000","last_became_active":"2024-09-12T00:28:14.042931+0000","last_became_peered":"2024-09-12T00:28:14.042931+0000","last_unstale":"2024-09-12T00:55:31.357622+0000","last_undegraded":"2024-09-12T00:55:31.357622+0000","last_fullsized":"2024-09-12T00:55:31.357622+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T00:55:31.357397+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T00:55:31.357397+0000","last_clean_scrub_stamp":"2024-09-12T00:55:31.357397+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:52.290508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":15360,"num_write":6,"num_write_kb":11264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.4","version":"266'42","reported_seq":163,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.617279+0000","last_change":"2024-09-12T00:55:04.617279+0000","last_active":"2024-09-12T00:55:04.617279+0000","last_peered":"2024-09-12T00:55:04.617279+0000","last_clean":"2024-09-12T00:55:04.617279+0000","last_became_active":"2024-09-12T00:26:48.577849+0000","last_became_peered":"2024-09-12T00:26:48.577849+0000","last_unstale":"2024-09-12T00:55:04.617279+0000","last_undegraded":"2024-09-12T00:55:04.617279+0000","last_fullsized":"2024-09-12T00:55:04.617279+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'42","last_scrub_stamp":"2024-09-12T00:55:04.617031+0000","last_deep_scrub":"266'42","last_deep_scrub_stamp":"2024-09-12T00:55:04.617031+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.617031+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:42:14.514351+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":146,"num_write":76,"num_write_kb":30,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"68.6","version":"266'2","reported_seq":30,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:23.696762+0000","last_change":"2024-09-12T00:55:23.696762+0000","last_active":"2024-09-12T00:55:23.696762+0000","last_peered":"2024-09-12T00:55:23.696762+0000","last_clean":"2024-09-12T00:55:23.696762+0000","last_became_active":"2024-09-12T00:39:28.144555+0000","last_became_peered":"2024-09-12T00:39:28.144555+0000","last_unstale":"2024-09-12T00:55:23.696762+0000","last_undegraded":"2024-09-12T00:55:23.696762+0000","last_fullsized":"2024-09-12T00:55:23.696762+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:23.696570+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:23.696570+0000","last_clean_scrub_stamp":"2024-09-12T00:55:23.696570+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:42:46.516114+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":188,"num_omap_keys":2,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"67.1","version":"266'6","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.659556+0000","last_change":"2024-09-12T00:55:19.659306+0000","last_active":"2024-09-12T00:55:19.659556+0000","last_peered":"2024-09-12T00:55:19.659556+0000","last_clean":"2024-09-12T00:55:19.659556+0000","last_became_active":"2024-09-12T00:28:17.060942+0000","last_became_peered":"2024-09-12T00:28:17.060942+0000","last_unstale":"2024-09-12T00:55:19.659556+0000","last_undegraded":"2024-09-12T00:55:19.659556+0000","last_fullsized":"2024-09-12T00:55:19.659556+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'6","last_scrub_stamp":"2024-09-12T00:55:19.659092+0000","last_deep_scrub":"266'6","last_deep_scrub_stamp":"2024-09-12T00:55:19.659092+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.659092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:28:16.534009+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":12290,"num_write":6,"num_write_kb":5120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"66.0","version":"266'2","reported_seq":50,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.672398+0000","last_change":"2024-09-12T00:55:08.672398+0000","last_active":"2024-09-12T00:55:08.672398+0000","last_peered":"2024-09-12T00:55:08.672398+0000","last_clean":"2024-09-12T00:55:08.672398+0000","last_became_active":"2024-09-12T00:28:14.037456+0000","last_became_peered":"2024-09-12T00:28:14.037456+0000","last_unstale":"2024-09-12T00:55:08.672398+0000","last_undegraded":"2024-09-12T00:55:08.672398+0000","last_fullsized":"2024-09-12T00:55:08.672398+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:08.672210+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:08.672210+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.672210+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:42:14.072302+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":2048,"num_write":2,"num_write_kb":1024,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"65.3","version":"266'23","reported_seq":115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.668573+0000","last_change":"2024-09-12T00:55:05.668573+0000","last_active":"2024-09-12T00:55:05.668573+0000","last_peered":"2024-09-12T00:55:05.668573+0000","last_clean":"2024-09-12T00:55:05.668573+0000","last_became_active":"2024-09-12T00:26:48.569380+0000","last_became_peered":"2024-09-12T00:26:48.569380+0000","last_unstale":"2024-09-12T00:55:05.668573+0000","last_undegraded":"2024-09-12T00:55:05.668573+0000","last_fullsized":"2024-09-12T00:55:05.668573+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'23","last_scrub_stamp":"2024-09-12T00:55:05.668399+0000","last_deep_scrub":"266'23","last_deep_scrub_stamp":"2024-09-12T00:55:05.668399+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.668399+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:21.157528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":83,"num_write":44,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"68.7","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.697133+0000","last_change":"2024-09-12T00:55:20.697133+0000","last_active":"2024-09-12T00:55:20.697133+0000","last_peered":"2024-09-12T00:55:20.697133+0000","last_clean":"2024-09-12T00:55:20.697133+0000","last_became_active":"2024-09-12T00:39:28.133587+0000","last_became_peered":"2024-09-12T00:39:28.133587+0000","last_unstale":"2024-09-12T00:55:20.697133+0000","last_undegraded":"2024-09-12T00:55:20.697133+0000","last_fullsized":"2024-09-12T00:55:20.697133+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:20.696952+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:20.696952+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.696952+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:01.096983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"67.0","version":"266'7","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:34.414977+0000","last_change":"2024-09-12T00:55:34.414977+0000","last_active":"2024-09-12T00:55:34.414977+0000","last_peered":"2024-09-12T00:55:34.414977+0000","last_clean":"2024-09-12T00:55:34.414977+0000","last_became_active":"2024-09-12T00:28:17.074353+0000","last_became_peered":"2024-09-12T00:28:17.074353+0000","last_unstale":"2024-09-12T00:55:34.414977+0000","last_undegraded":"2024-09-12T00:55:34.414977+0000","last_fullsized":"2024-09-12T00:55:34.414977+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'7","last_scrub_stamp":"2024-09-12T00:55:34.414743+0000","last_deep_scrub":"266'7","last_deep_scrub_stamp":"2024-09-12T00:55:34.414743+0000","last_clean_scrub_stamp":"2024-09-12T00:55:34.414743+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:19:39.888195+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":20482,"num_write":12,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"66.1","version":"266'4","reported_seq":53,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:30.396582+0000","last_change":"2024-09-12T00:55:30.396582+0000","last_active":"2024-09-12T00:55:30.396582+0000","last_peered":"2024-09-12T00:55:30.396582+0000","last_clean":"2024-09-12T00:55:30.396582+0000","last_became_active":"2024-09-12T00:28:14.049828+0000","last_became_peered":"2024-09-12T00:28:14.049828+0000","last_unstale":"2024-09-12T00:55:30.396582+0000","last_undegraded":"2024-09-12T00:55:30.396582+0000","last_fullsized":"2024-09-12T00:55:30.396582+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:55:30.396403+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:55:30.396403+0000","last_clean_scrub_stamp":"2024-09-12T00:55:30.396403+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:20:45.270251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":8192,"num_write":4,"num_write_kb":8192,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"65.2","version":"266'43","reported_seq":169,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:26.401278+0000","last_change":"2024-09-12T00:55:26.401278+0000","last_active":"2024-09-12T00:55:26.401278+0000","last_peered":"2024-09-12T00:55:26.401278+0000","last_clean":"2024-09-12T00:55:26.401278+0000","last_became_active":"2024-09-12T00:26:48.571698+0000","last_became_peered":"2024-09-12T00:26:48.571698+0000","last_unstale":"2024-09-12T00:55:26.401278+0000","last_undegraded":"2024-09-12T00:55:26.401278+0000","last_fullsized":"2024-09-12T00:55:26.401278+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'43","last_scrub_stamp":"2024-09-12T00:55:26.401059+0000","last_deep_scrub":"266'43","last_deep_scrub_stamp":"2024-09-12T00:55:26.401059+0000","last_clean_scrub_stamp":"2024-09-12T00:55:26.401059+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:25:07.313616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":220,"num_read_kb":151,"num_write":81,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.4","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:30.300553+0000","last_change":"2024-09-12T00:55:30.300553+0000","last_active":"2024-09-12T00:55:30.300553+0000","last_peered":"2024-09-12T00:55:30.300553+0000","last_clean":"2024-09-12T00:55:30.300553+0000","last_became_active":"2024-09-12T00:39:28.124368+0000","last_became_peered":"2024-09-12T00:39:28.124368+0000","last_unstale":"2024-09-12T00:55:30.300553+0000","last_undegraded":"2024-09-12T00:55:30.300553+0000","last_fullsized":"2024-09-12T00:55:30.300553+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:30.300324+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:30.300324+0000","last_clean_scrub_stamp":"2024-09-12T00:55:30.300324+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:01:57.413437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"67.3","version":"266'2","reported_seq":43,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.782501+0000","last_change":"2024-09-12T00:55:11.782238+0000","last_active":"2024-09-12T00:55:11.782501+0000","last_peered":"2024-09-12T00:55:11.782501+0000","last_clean":"2024-09-12T00:55:11.782501+0000","last_became_active":"2024-09-12T00:28:17.072624+0000","last_became_peered":"2024-09-12T00:28:17.072624+0000","last_unstale":"2024-09-12T00:55:11.782501+0000","last_undegraded":"2024-09-12T00:55:11.782501+0000","last_fullsized":"2024-09-12T00:55:11.782501+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:55:11.781949+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:55:11.781949+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.781949+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:09:38.253665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":4096,"num_write":2,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.2","version":"266'19","reported_seq":88,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.575253+0000","last_change":"2024-09-12T00:55:12.575080+0000","last_active":"2024-09-12T00:55:12.575253+0000","last_peered":"2024-09-12T00:55:12.575253+0000","last_clean":"2024-09-12T00:55:12.575253+0000","last_became_active":"2024-09-12T00:28:14.034435+0000","last_became_peered":"2024-09-12T00:28:14.034435+0000","last_unstale":"2024-09-12T00:55:12.575253+0000","last_undegraded":"2024-09-12T00:55:12.575253+0000","last_fullsized":"2024-09-12T00:55:12.575253+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'19","last_scrub_stamp":"2024-09-12T00:55:12.574902+0000","last_deep_scrub":"266'19","last_deep_scrub_stamp":"2024-09-12T00:55:12.574902+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.574902+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:18.400789+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":30726,"num_write":24,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"65.1","version":"266'17","reported_seq":95,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:23.432746+0000","last_change":"2024-09-12T00:55:23.432746+0000","last_active":"2024-09-12T00:55:23.432746+0000","last_peered":"2024-09-12T00:55:23.432746+0000","last_clean":"2024-09-12T00:55:23.432746+0000","last_became_active":"2024-09-12T00:26:48.567553+0000","last_became_peered":"2024-09-12T00:26:48.567553+0000","last_unstale":"2024-09-12T00:55:23.432746+0000","last_undegraded":"2024-09-12T00:55:23.432746+0000","last_fullsized":"2024-09-12T00:55:23.432746+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'17","last_scrub_stamp":"2024-09-12T00:55:23.432550+0000","last_deep_scrub":"266'17","last_deep_scrub_stamp":"2024-09-12T00:55:23.432550+0000","last_clean_scrub_stamp":"2024-09-12T00:55:23.432550+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:04:54.976850+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":55,"num_write":40,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"68.5","version":"0'0","reported_seq":28,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:42.246445+0000","last_change":"2024-09-12T00:55:42.246445+0000","last_active":"2024-09-12T00:55:42.246445+0000","last_peered":"2024-09-12T00:55:42.246445+0000","last_clean":"2024-09-12T00:55:42.246445+0000","last_became_active":"2024-09-12T00:39:28.134620+0000","last_became_peered":"2024-09-12T00:39:28.134620+0000","last_unstale":"2024-09-12T00:55:42.246445+0000","last_undegraded":"2024-09-12T00:55:42.246445+0000","last_fullsized":"2024-09-12T00:55:42.246445+0000","mapping_epoch":264,"log_start":"0'0","ondisk_log_start":"0'0","created":264,"last_epoch_clean":265,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:42.246238+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:42.246238+0000","last_clean_scrub_stamp":"2024-09-12T00:55:42.246238+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:41.136916+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"67.2","version":"266'5","reported_seq":49,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.761112+0000","last_change":"2024-09-12T00:55:15.760957+0000","last_active":"2024-09-12T00:55:15.761112+0000","last_peered":"2024-09-12T00:55:15.761112+0000","last_clean":"2024-09-12T00:55:15.761112+0000","last_became_active":"2024-09-12T00:28:17.058800+0000","last_became_peered":"2024-09-12T00:28:17.058800+0000","last_unstale":"2024-09-12T00:55:15.761112+0000","last_undegraded":"2024-09-12T00:55:15.761112+0000","last_fullsized":"2024-09-12T00:55:15.761112+0000","mapping_epoch":261,"log_start":"0'0","ondisk_log_start":"0'0","created":261,"last_epoch_clean":262,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:15.760771+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:15.760771+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.760771+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:05:56.038208+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4096,"num_write":10,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"66.3","version":"266'5","reported_seq":54,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.706012+0000","last_change":"2024-09-12T00:55:07.705878+0000","last_active":"2024-09-12T00:55:07.706012+0000","last_peered":"2024-09-12T00:55:07.706012+0000","last_clean":"2024-09-12T00:55:07.706012+0000","last_became_active":"2024-09-12T00:28:14.046493+0000","last_became_peered":"2024-09-12T00:28:14.046493+0000","last_unstale":"2024-09-12T00:55:07.706012+0000","last_undegraded":"2024-09-12T00:55:07.706012+0000","last_fullsized":"2024-09-12T00:55:07.706012+0000","mapping_epoch":258,"log_start":"0'0","ondisk_log_start":"0'0","created":258,"last_epoch_clean":259,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:55:07.705704+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:55:07.705704+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.705704+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:00:11.429168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":4136,"num_write":10,"num_write_kb":4136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"65.0","version":"263'8","reported_seq":77,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.617600+0000","last_change":"2024-09-12T00:55:03.617600+0000","last_active":"2024-09-12T00:55:03.617600+0000","last_peered":"2024-09-12T00:55:03.617600+0000","last_clean":"2024-09-12T00:55:03.617600+0000","last_became_active":"2024-09-12T00:26:48.572274+0000","last_became_peered":"2024-09-12T00:26:48.572274+0000","last_unstale":"2024-09-12T00:55:03.617600+0000","last_undegraded":"2024-09-12T00:55:03.617600+0000","last_fullsized":"2024-09-12T00:55:03.617600+0000","mapping_epoch":255,"log_start":"0'0","ondisk_log_start":"0'0","created":255,"last_epoch_clean":256,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'8","last_scrub_stamp":"2024-09-12T00:55:03.617423+0000","last_deep_scrub":"263'8","last_deep_scrub_stamp":"2024-09-12T00:55:03.617423+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.617423+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:17:18.987923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":32,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.3f","version":"266'262","reported_seq":915,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.990962+0000","last_change":"2024-09-12T00:54:44.990766+0000","last_active":"2024-09-12T00:54:44.990962+0000","last_peered":"2024-09-12T00:54:44.990962+0000","last_clean":"2024-09-12T00:54:44.990962+0000","last_became_active":"2024-09-12T00:11:45.934365+0000","last_became_peered":"2024-09-12T00:11:45.934365+0000","last_unstale":"2024-09-12T00:54:44.990962+0000","last_undegraded":"2024-09-12T00:54:44.990962+0000","last_fullsized":"2024-09-12T00:54:44.990962+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'262","last_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_deep_scrub":"266'262","last_deep_scrub_stamp":"2024-09-12T00:54:44.990558+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.990558+0000","objects_scrubbed":2,"log_size":62,"log_dups_size":200,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:14.960131+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":21,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":619,"num_read_kb":2922,"num_write":1055,"num_write_kb":23329,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.38","version":"266'1208","reported_seq":2907,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.457851+0000","last_change":"2024-09-12T00:54:49.457851+0000","last_active":"2024-09-12T00:54:49.457851+0000","last_peered":"2024-09-12T00:54:49.457851+0000","last_clean":"2024-09-12T00:54:49.457851+0000","last_became_active":"2024-09-12T00:11:47.923545+0000","last_became_peered":"2024-09-12T00:11:47.923545+0000","last_unstale":"2024-09-12T00:54:49.457851+0000","last_undegraded":"2024-09-12T00:54:49.457851+0000","last_fullsized":"2024-09-12T00:54:49.457851+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1208","last_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_deep_scrub":"266'1208","last_deep_scrub_stamp":"2024-09-12T00:54:49.457644+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.457644+0000","objects_scrubbed":3,"log_size":108,"log_dups_size":1100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:45:17.683296+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":5458,"num_read_kb":4832,"num_write":1631,"num_write_kb":645,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":219,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"266'226","reported_seq":866,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.565552+0000","last_change":"2024-09-12T00:54:49.565409+0000","last_active":"2024-09-12T00:54:49.565552+0000","last_peered":"2024-09-12T00:54:49.565552+0000","last_clean":"2024-09-12T00:54:49.565552+0000","last_became_active":"2024-09-12T00:11:45.952336+0000","last_became_peered":"2024-09-12T00:11:45.952336+0000","last_unstale":"2024-09-12T00:54:49.565552+0000","last_undegraded":"2024-09-12T00:54:49.565552+0000","last_fullsized":"2024-09-12T00:54:49.565552+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:49.565191+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.565191+0000","objects_scrubbed":3,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:48:46.709139+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399219,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":454,"num_read_kb":8607,"num_write":1041,"num_write_kb":35892,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,0],"acting":[5,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.39","version":"266'457","reported_seq":2047,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.210682+0000","last_change":"2024-09-12T00:54:59.210682+0000","last_active":"2024-09-12T00:54:59.210682+0000","last_peered":"2024-09-12T00:54:59.210682+0000","last_clean":"2024-09-12T00:54:59.210682+0000","last_became_active":"2024-09-12T00:11:47.929987+0000","last_became_peered":"2024-09-12T00:11:47.929987+0000","last_unstale":"2024-09-12T00:54:59.210682+0000","last_undegraded":"2024-09-12T00:54:59.210682+0000","last_fullsized":"2024-09-12T00:54:59.210682+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'457","last_scrub_stamp":"2024-09-12T00:54:59.210500+0000","last_deep_scrub":"266'457","last_deep_scrub_stamp":"2024-09-12T00:54:59.210500+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.210500+0000","objects_scrubbed":2,"log_size":57,"log_dups_size":400,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:15.276452+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2518,"num_read_kb":2367,"num_write":531,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3035,"num_omap_keys":12,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"266'205","reported_seq":825,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.572985+0000","last_change":"2024-09-12T00:54:47.572828+0000","last_active":"2024-09-12T00:54:47.572985+0000","last_peered":"2024-09-12T00:54:47.572985+0000","last_clean":"2024-09-12T00:54:47.572985+0000","last_became_active":"2024-09-12T00:11:45.962070+0000","last_became_peered":"2024-09-12T00:11:45.962070+0000","last_unstale":"2024-09-12T00:54:47.572985+0000","last_undegraded":"2024-09-12T00:54:47.572985+0000","last_fullsized":"2024-09-12T00:54:47.572985+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:47.572612+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.572612+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:38.077210+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262144,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":414,"num_read_kb":9703,"num_write":942,"num_write_kb":39554,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7],"acting":[5,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3a","version":"266'472","reported_seq":2029,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.252532+0000","last_change":"2024-09-12T00:55:00.252532+0000","last_active":"2024-09-12T00:55:00.252532+0000","last_peered":"2024-09-12T00:55:00.252532+0000","last_clean":"2024-09-12T00:55:00.252532+0000","last_became_active":"2024-09-12T00:11:47.928526+0000","last_became_peered":"2024-09-12T00:11:47.928526+0000","last_unstale":"2024-09-12T00:55:00.252532+0000","last_undegraded":"2024-09-12T00:55:00.252532+0000","last_fullsized":"2024-09-12T00:55:00.252532+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'472","last_scrub_stamp":"2024-09-12T00:55:00.252348+0000","last_deep_scrub":"266'472","last_deep_scrub_stamp":"2024-09-12T00:55:00.252348+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.252348+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":400,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:17:31.620465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2347,"num_read_kb":2208,"num_write":522,"num_write_kb":104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3c","version":"266'172","reported_seq":803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.805943+0000","last_change":"2024-09-12T00:54:42.805793+0000","last_active":"2024-09-12T00:54:42.805943+0000","last_peered":"2024-09-12T00:54:42.805943+0000","last_clean":"2024-09-12T00:54:42.805943+0000","last_became_active":"2024-09-12T00:11:45.917540+0000","last_became_peered":"2024-09-12T00:11:45.917540+0000","last_unstale":"2024-09-12T00:54:42.805943+0000","last_undegraded":"2024-09-12T00:54:42.805943+0000","last_fullsized":"2024-09-12T00:54:42.805943+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'172","last_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_deep_scrub":"266'172","last_deep_scrub_stamp":"2024-09-12T00:54:42.805574+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.805574+0000","objects_scrubbed":3,"log_size":72,"log_dups_size":100,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:40:52.082618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3723389,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":422,"num_read_kb":16186,"num_write":899,"num_write_kb":19801,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,3],"acting":[2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"266'824","reported_seq":2418,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.771399+0000","last_change":"2024-09-12T00:54:52.771399+0000","last_active":"2024-09-12T00:54:52.771399+0000","last_peered":"2024-09-12T00:54:52.771399+0000","last_clean":"2024-09-12T00:54:52.771399+0000","last_became_active":"2024-09-12T00:11:47.933160+0000","last_became_peered":"2024-09-12T00:11:47.933160+0000","last_unstale":"2024-09-12T00:54:52.771399+0000","last_undegraded":"2024-09-12T00:54:52.771399+0000","last_fullsized":"2024-09-12T00:54:52.771399+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'824","last_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_deep_scrub":"266'824","last_deep_scrub_stamp":"2024-09-12T00:54:52.771212+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.771212+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":800,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:57:46.148911+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3852,"num_read_kb":3466,"num_write":1064,"num_write_kb":377,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"266'190","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.992323+0000","last_change":"2024-09-12T00:54:43.992323+0000","last_active":"2024-09-12T00:54:43.992323+0000","last_peered":"2024-09-12T00:54:43.992323+0000","last_clean":"2024-09-12T00:54:43.992323+0000","last_became_active":"2024-09-12T00:11:45.949335+0000","last_became_peered":"2024-09-12T00:11:45.949335+0000","last_unstale":"2024-09-12T00:54:43.992323+0000","last_undegraded":"2024-09-12T00:54:43.992323+0000","last_fullsized":"2024-09-12T00:54:43.992323+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T00:54:43.991947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.991947+0000","objects_scrubbed":4,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:29:36.462643+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":569693,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":465,"num_read_kb":16314,"num_write":910,"num_write_kb":23948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"266'801","reported_seq":2293,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.039117+0000","last_change":"2024-09-12T00:54:48.039117+0000","last_active":"2024-09-12T00:54:48.039117+0000","last_peered":"2024-09-12T00:54:48.039117+0000","last_clean":"2024-09-12T00:54:48.039117+0000","last_became_active":"2024-09-12T00:11:47.929602+0000","last_became_peered":"2024-09-12T00:11:47.929602+0000","last_unstale":"2024-09-12T00:54:48.039117+0000","last_undegraded":"2024-09-12T00:54:48.039117+0000","last_fullsized":"2024-09-12T00:54:48.039117+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'801","last_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_deep_scrub":"266'801","last_deep_scrub_stamp":"2024-09-12T00:54:48.038929+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.038929+0000","objects_scrubbed":2,"log_size":101,"log_dups_size":700,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:16:45.582305+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3820,"num_read_kb":3421,"num_write":1068,"num_write_kb":406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":467,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3a","version":"266'177","reported_seq":787,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.699958+0000","last_change":"2024-09-12T00:54:39.699958+0000","last_active":"2024-09-12T00:54:39.699958+0000","last_peered":"2024-09-12T00:54:39.699958+0000","last_clean":"2024-09-12T00:54:39.699958+0000","last_became_active":"2024-09-12T00:11:45.915896+0000","last_became_peered":"2024-09-12T00:11:45.915896+0000","last_unstale":"2024-09-12T00:54:39.699958+0000","last_undegraded":"2024-09-12T00:54:39.699958+0000","last_fullsized":"2024-09-12T00:54:39.699958+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'177","last_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_deep_scrub":"266'177","last_deep_scrub_stamp":"2024-09-12T00:54:39.699741+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.699741+0000","objects_scrubbed":0,"log_size":77,"log_dups_size":100,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:15.796747+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":365,"num_read_kb":30215,"num_write":846,"num_write_kb":28881,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4,7],"acting":[2,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"266'392","reported_seq":1916,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.963106+0000","last_change":"2024-09-12T00:54:55.962955+0000","last_active":"2024-09-12T00:54:55.963106+0000","last_peered":"2024-09-12T00:54:55.963106+0000","last_clean":"2024-09-12T00:54:55.963106+0000","last_became_active":"2024-09-12T00:11:47.942136+0000","last_became_peered":"2024-09-12T00:11:47.942136+0000","last_unstale":"2024-09-12T00:54:55.963106+0000","last_undegraded":"2024-09-12T00:54:55.963106+0000","last_fullsized":"2024-09-12T00:54:55.963106+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'392","last_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_deep_scrub":"266'392","last_deep_scrub_stamp":"2024-09-12T00:54:55.962710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.962710+0000","objects_scrubbed":1,"log_size":92,"log_dups_size":300,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:19:54.934059+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2186,"num_read_kb":2080,"num_write":438,"num_write_kb":81,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":243,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.39","version":"266'229","reported_seq":860,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.012358+0000","last_change":"2024-09-12T00:54:40.012358+0000","last_active":"2024-09-12T00:54:40.012358+0000","last_peered":"2024-09-12T00:54:40.012358+0000","last_clean":"2024-09-12T00:54:40.012358+0000","last_became_active":"2024-09-12T00:11:45.933440+0000","last_became_peered":"2024-09-12T00:11:45.933440+0000","last_unstale":"2024-09-12T00:54:40.012358+0000","last_undegraded":"2024-09-12T00:54:40.012358+0000","last_fullsized":"2024-09-12T00:54:40.012358+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:40.012124+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.012124+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:51:25.409967+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924437,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":415,"num_read_kb":17813,"num_write":1032,"num_write_kb":52762,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"266'991","reported_seq":2518,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.695219+0000","last_change":"2024-09-12T00:54:48.695069+0000","last_active":"2024-09-12T00:54:48.695219+0000","last_peered":"2024-09-12T00:54:48.695219+0000","last_clean":"2024-09-12T00:54:48.695219+0000","last_became_active":"2024-09-12T00:11:47.923325+0000","last_became_peered":"2024-09-12T00:11:47.923325+0000","last_unstale":"2024-09-12T00:54:48.695219+0000","last_undegraded":"2024-09-12T00:54:48.695219+0000","last_fullsized":"2024-09-12T00:54:48.695219+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'991","last_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_deep_scrub":"266'991","last_deep_scrub_stamp":"2024-09-12T00:54:48.694882+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.694882+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":900,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:18:30.875835+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":4762,"num_read_kb":4205,"num_write":1410,"num_write_kb":601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"266'182","reported_seq":788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.568654+0000","last_change":"2024-09-12T00:54:48.568654+0000","last_active":"2024-09-12T00:54:48.568654+0000","last_peered":"2024-09-12T00:54:48.568654+0000","last_clean":"2024-09-12T00:54:48.568654+0000","last_became_active":"2024-09-12T00:12:19.245833+0000","last_became_peered":"2024-09-12T00:12:19.245833+0000","last_unstale":"2024-09-12T00:54:48.568654+0000","last_undegraded":"2024-09-12T00:54:48.568654+0000","last_fullsized":"2024-09-12T00:54:48.568654+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'182","last_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_deep_scrub":"266'182","last_deep_scrub_stamp":"2024-09-12T00:54:48.568387+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.568387+0000","objects_scrubbed":1,"log_size":82,"log_dups_size":100,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:29.536238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263185,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":351,"num_read_kb":20841,"num_write":801,"num_write_kb":39880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,1],"acting":[5,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3f","version":"266'826","reported_seq":2410,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.505498+0000","last_change":"2024-09-12T00:54:58.505321+0000","last_active":"2024-09-12T00:54:58.505498+0000","last_peered":"2024-09-12T00:54:58.505498+0000","last_clean":"2024-09-12T00:54:58.505498+0000","last_became_active":"2024-09-12T00:11:47.943728+0000","last_became_peered":"2024-09-12T00:11:47.943728+0000","last_unstale":"2024-09-12T00:54:58.505498+0000","last_undegraded":"2024-09-12T00:54:58.505498+0000","last_fullsized":"2024-09-12T00:54:58.505498+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'826","last_scrub_stamp":"2024-09-12T00:54:58.505112+0000","last_deep_scrub":"266'826","last_deep_scrub_stamp":"2024-09-12T00:54:58.505112+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.505112+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":800,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:50.859376+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3902,"num_read_kb":3511,"num_write":1082,"num_write_kb":386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.30","version":"266'813","reported_seq":2367,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.177379+0000","last_change":"2024-09-12T00:54:58.177379+0000","last_active":"2024-09-12T00:54:58.177379+0000","last_peered":"2024-09-12T00:54:58.177379+0000","last_clean":"2024-09-12T00:54:58.177379+0000","last_became_active":"2024-09-12T00:11:47.932377+0000","last_became_peered":"2024-09-12T00:11:47.932377+0000","last_unstale":"2024-09-12T00:54:58.177379+0000","last_undegraded":"2024-09-12T00:54:58.177379+0000","last_fullsized":"2024-09-12T00:54:58.177379+0000","mapping_epoch":27,"log_start":"266'801","ondisk_log_start":"266'801","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'813","last_scrub_stamp":"2024-09-12T00:54:58.177199+0000","last_deep_scrub":"266'813","last_deep_scrub_stamp":"2024-09-12T00:54:58.177199+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.177199+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":801,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:27:36.178190+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3865,"num_read_kb":3475,"num_write":1062,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":894,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"266'281","reported_seq":1014,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.283023+0000","last_change":"2024-09-12T00:54:40.282873+0000","last_active":"2024-09-12T00:54:40.283023+0000","last_peered":"2024-09-12T00:54:40.283023+0000","last_clean":"2024-09-12T00:54:40.283023+0000","last_became_active":"2024-09-12T00:11:45.959536+0000","last_became_peered":"2024-09-12T00:11:45.959536+0000","last_unstale":"2024-09-12T00:54:40.283023+0000","last_undegraded":"2024-09-12T00:54:40.283023+0000","last_fullsized":"2024-09-12T00:54:40.283023+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'281","last_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_deep_scrub":"266'281","last_deep_scrub_stamp":"2024-09-12T00:54:40.282649+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.282649+0000","objects_scrubbed":4,"log_size":81,"log_dups_size":200,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:30:52.630575+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":351099,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":931,"num_read_kb":25081,"num_write":1230,"num_write_kb":26951,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,5],"acting":[1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"266'1096","reported_seq":2594,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.064930+0000","last_change":"2024-09-12T00:54:47.064930+0000","last_active":"2024-09-12T00:54:47.064930+0000","last_peered":"2024-09-12T00:54:47.064930+0000","last_clean":"2024-09-12T00:54:47.064930+0000","last_became_active":"2024-09-12T00:11:47.935021+0000","last_became_peered":"2024-09-12T00:11:47.935021+0000","last_unstale":"2024-09-12T00:54:47.064930+0000","last_undegraded":"2024-09-12T00:54:47.064930+0000","last_fullsized":"2024-09-12T00:54:47.064930+0000","mapping_epoch":27,"log_start":"266'1000","ondisk_log_start":"266'1000","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1096","last_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_deep_scrub":"266'1096","last_deep_scrub_stamp":"2024-09-12T00:54:47.064751+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.064751+0000","objects_scrubbed":0,"log_size":96,"log_dups_size":1000,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:16.284275+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5028,"num_read_kb":4448,"num_write":1509,"num_write_kb":619,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.36","version":"266'183","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.027292+0000","last_change":"2024-09-12T00:54:41.027152+0000","last_active":"2024-09-12T00:54:41.027292+0000","last_peered":"2024-09-12T00:54:41.027292+0000","last_clean":"2024-09-12T00:54:41.027292+0000","last_became_active":"2024-09-12T00:11:45.920319+0000","last_became_peered":"2024-09-12T00:11:45.920319+0000","last_unstale":"2024-09-12T00:54:41.027292+0000","last_undegraded":"2024-09-12T00:54:41.027292+0000","last_fullsized":"2024-09-12T00:54:41.027292+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T00:54:41.026921+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.026921+0000","objects_scrubbed":4,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:50:42.983840+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":441,"num_read_kb":23009,"num_write":868,"num_write_kb":16729,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.32","version":"266'442","reported_seq":2015,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.423768+0000","last_change":"2024-09-12T00:54:45.423768+0000","last_active":"2024-09-12T00:54:45.423768+0000","last_peered":"2024-09-12T00:54:45.423768+0000","last_clean":"2024-09-12T00:54:45.423768+0000","last_became_active":"2024-09-12T00:11:47.940575+0000","last_became_peered":"2024-09-12T00:11:47.940575+0000","last_unstale":"2024-09-12T00:54:45.423768+0000","last_undegraded":"2024-09-12T00:54:45.423768+0000","last_fullsized":"2024-09-12T00:54:45.423768+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'442","last_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_deep_scrub":"266'442","last_deep_scrub_stamp":"2024-09-12T00:54:45.423598+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.423598+0000","objects_scrubbed":3,"log_size":42,"log_dups_size":400,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:38.014555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2277,"num_read_kb":2173,"num_write":506,"num_write_kb":95,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"266'192","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.994296+0000","last_change":"2024-09-12T00:54:41.994046+0000","last_active":"2024-09-12T00:54:41.994296+0000","last_peered":"2024-09-12T00:54:41.994296+0000","last_clean":"2024-09-12T00:54:41.994296+0000","last_became_active":"2024-09-12T00:11:45.925350+0000","last_became_peered":"2024-09-12T00:11:45.925350+0000","last_unstale":"2024-09-12T00:54:41.994296+0000","last_undegraded":"2024-09-12T00:54:41.994296+0000","last_fullsized":"2024-09-12T00:54:41.994296+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'192","last_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_deep_scrub":"266'192","last_deep_scrub_stamp":"2024-09-12T00:54:41.993748+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.993748+0000","objects_scrubbed":4,"log_size":92,"log_dups_size":100,"ondisk_log_size":92,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:20:48.875430+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2129095,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":467,"num_read_kb":15824,"num_write":919,"num_write_kb":27404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,4],"acting":[0,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.33","version":"266'555","reported_seq":2164,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.584874+0000","last_change":"2024-09-12T00:54:51.584583+0000","last_active":"2024-09-12T00:54:51.584874+0000","last_peered":"2024-09-12T00:54:51.584874+0000","last_clean":"2024-09-12T00:54:51.584874+0000","last_became_active":"2024-09-12T00:11:47.948334+0000","last_became_peered":"2024-09-12T00:11:47.948334+0000","last_unstale":"2024-09-12T00:54:51.584874+0000","last_undegraded":"2024-09-12T00:54:51.584874+0000","last_fullsized":"2024-09-12T00:54:51.584874+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'555","last_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_deep_scrub":"266'555","last_deep_scrub_stamp":"2024-09-12T00:54:51.584300+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.584300+0000","objects_scrubbed":3,"log_size":55,"log_dups_size":500,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:27.384007+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3159,"num_read_kb":2932,"num_write":720,"num_write_kb":244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":877,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"266'211","reported_seq":839,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.978919+0000","last_change":"2024-09-12T00:54:42.978773+0000","last_active":"2024-09-12T00:54:42.978919+0000","last_peered":"2024-09-12T00:54:42.978919+0000","last_clean":"2024-09-12T00:54:42.978919+0000","last_became_active":"2024-09-12T00:11:45.936284+0000","last_became_peered":"2024-09-12T00:11:45.936284+0000","last_unstale":"2024-09-12T00:54:42.978919+0000","last_undegraded":"2024-09-12T00:54:42.978919+0000","last_fullsized":"2024-09-12T00:54:42.978919+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'211","last_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_deep_scrub":"266'211","last_deep_scrub_stamp":"2024-09-12T00:54:42.978525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.978525+0000","objects_scrubbed":5,"log_size":11,"log_dups_size":200,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:06.511163+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":924468,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":458,"num_read_kb":26404,"num_write":991,"num_write_kb":31253,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,7],"acting":[0,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.34","version":"266'629","reported_seq":2260,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.506916+0000","last_change":"2024-09-12T00:54:57.506768+0000","last_active":"2024-09-12T00:54:57.506916+0000","last_peered":"2024-09-12T00:54:57.506916+0000","last_clean":"2024-09-12T00:54:57.506916+0000","last_became_active":"2024-09-12T00:11:47.923012+0000","last_became_peered":"2024-09-12T00:11:47.923012+0000","last_unstale":"2024-09-12T00:54:57.506916+0000","last_undegraded":"2024-09-12T00:54:57.506916+0000","last_fullsized":"2024-09-12T00:54:57.506916+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'629","last_scrub_stamp":"2024-09-12T00:54:57.506590+0000","last_deep_scrub":"266'629","last_deep_scrub_stamp":"2024-09-12T00:54:57.506590+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.506590+0000","objects_scrubbed":1,"log_size":29,"log_dups_size":600,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:07:34.590029+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3244,"num_read_kb":2966,"num_write":871,"num_write_kb":363,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.33","version":"266'186","reported_seq":817,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.583910+0000","last_change":"2024-09-12T00:54:44.583757+0000","last_active":"2024-09-12T00:54:44.583910+0000","last_peered":"2024-09-12T00:54:44.583910+0000","last_clean":"2024-09-12T00:54:44.583910+0000","last_became_active":"2024-09-12T00:11:45.947379+0000","last_became_peered":"2024-09-12T00:11:45.947379+0000","last_unstale":"2024-09-12T00:54:44.583910+0000","last_undegraded":"2024-09-12T00:54:44.583910+0000","last_fullsized":"2024-09-12T00:54:44.583910+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:44.583505+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.583505+0000","objects_scrubbed":5,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:03:41.416586+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5924451,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":395,"num_read_kb":19556,"num_write":891,"num_write_kb":36616,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,4],"acting":[6,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.35","version":"266'1216","reported_seq":2921,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.382229+0000","last_change":"2024-09-12T00:54:46.381975+0000","last_active":"2024-09-12T00:54:46.382229+0000","last_peered":"2024-09-12T00:54:46.382229+0000","last_clean":"2024-09-12T00:54:46.382229+0000","last_became_active":"2024-09-12T00:11:47.924166+0000","last_became_peered":"2024-09-12T00:11:47.924166+0000","last_unstale":"2024-09-12T00:54:46.382229+0000","last_undegraded":"2024-09-12T00:54:46.382229+0000","last_fullsized":"2024-09-12T00:54:46.382229+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1216","last_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_deep_scrub":"266'1216","last_deep_scrub_stamp":"2024-09-12T00:54:46.381745+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.381745+0000","objects_scrubbed":1,"log_size":16,"log_dups_size":1200,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:02.347559+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5761,"num_read_kb":5104,"num_write":1675,"num_write_kb":695,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2038,"num_omap_keys":8,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"266'206","reported_seq":900,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.526531+0000","last_change":"2024-09-12T00:54:43.526531+0000","last_active":"2024-09-12T00:54:43.526531+0000","last_peered":"2024-09-12T00:54:43.526531+0000","last_clean":"2024-09-12T00:54:43.526531+0000","last_became_active":"2024-09-12T00:11:45.937440+0000","last_became_peered":"2024-09-12T00:11:45.937440+0000","last_unstale":"2024-09-12T00:54:43.526531+0000","last_undegraded":"2024-09-12T00:54:43.526531+0000","last_fullsized":"2024-09-12T00:54:43.526531+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:43.526312+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.526312+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:20:10.785471+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":572,"num_read_kb":13603,"num_write":999,"num_write_kb":28419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,4],"acting":[6,7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.18","version":"266'159","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.155970+0000","last_change":"2024-09-12T00:55:03.155812+0000","last_active":"2024-09-12T00:55:03.155970+0000","last_peered":"2024-09-12T00:55:03.155970+0000","last_clean":"2024-09-12T00:55:03.155970+0000","last_became_active":"2024-09-12T00:11:55.962134+0000","last_became_peered":"2024-09-12T00:11:55.962134+0000","last_unstale":"2024-09-12T00:55:03.155970+0000","last_undegraded":"2024-09-12T00:55:03.155970+0000","last_fullsized":"2024-09-12T00:55:03.155970+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'159","last_scrub_stamp":"2024-09-12T00:55:03.155627+0000","last_deep_scrub":"266'159","last_deep_scrub_stamp":"2024-09-12T00:55:03.155627+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.155627+0000","objects_scrubbed":1,"log_size":59,"log_dups_size":100,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:13:21.467016+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":177,"num_read_kb":171,"num_write":396,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.14","version":"266'432","reported_seq":1957,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.583276+0000","last_change":"2024-09-12T00:54:49.583276+0000","last_active":"2024-09-12T00:54:49.583276+0000","last_peered":"2024-09-12T00:54:49.583276+0000","last_clean":"2024-09-12T00:54:49.583276+0000","last_became_active":"2024-09-12T00:11:47.956216+0000","last_became_peered":"2024-09-12T00:11:47.956216+0000","last_unstale":"2024-09-12T00:54:49.583276+0000","last_undegraded":"2024-09-12T00:54:49.583276+0000","last_fullsized":"2024-09-12T00:54:49.583276+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'432","last_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_deep_scrub":"266'432","last_deep_scrub_stamp":"2024-09-12T00:54:49.583097+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.583097+0000","objects_scrubbed":4,"log_size":32,"log_dups_size":400,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:25.325862+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2272,"num_read_kb":2155,"num_write":509,"num_write_kb":106,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":441,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.13","version":"266'200","reported_seq":857,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.527392+0000","last_change":"2024-09-12T00:54:39.527392+0000","last_active":"2024-09-12T00:54:39.527392+0000","last_peered":"2024-09-12T00:54:39.527392+0000","last_clean":"2024-09-12T00:54:39.527392+0000","last_became_active":"2024-09-12T00:12:19.242273+0000","last_became_peered":"2024-09-12T00:12:19.242273+0000","last_unstale":"2024-09-12T00:54:39.527392+0000","last_undegraded":"2024-09-12T00:54:39.527392+0000","last_fullsized":"2024-09-12T00:54:39.527392+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'200","last_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_deep_scrub":"266'200","last_deep_scrub_stamp":"2024-09-12T00:54:39.527188+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.527188+0000","objects_scrubbed":4,"log_size":100,"log_dups_size":100,"ondisk_log_size":100,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:46:35.380120+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262201,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":562,"num_read_kb":1954,"num_write":1014,"num_write_kb":9698,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.240769+0000","last_change":"2024-09-12T00:55:05.240645+0000","last_active":"2024-09-12T00:55:05.240769+0000","last_peered":"2024-09-12T00:55:05.240769+0000","last_clean":"2024-09-12T00:55:05.240769+0000","last_became_active":"2024-09-12T00:11:49.940333+0000","last_became_peered":"2024-09-12T00:11:49.940333+0000","last_unstale":"2024-09-12T00:55:05.240769+0000","last_undegraded":"2024-09-12T00:55:05.240769+0000","last_fullsized":"2024-09-12T00:55:05.240769+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:05.240468+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:05.240468+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.240468+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:00:34.522701+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"266'206","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.674577+0000","last_change":"2024-09-12T00:55:04.674338+0000","last_active":"2024-09-12T00:55:04.674577+0000","last_peered":"2024-09-12T00:55:04.674577+0000","last_clean":"2024-09-12T00:55:04.674577+0000","last_became_active":"2024-09-12T00:11:51.946939+0000","last_became_peered":"2024-09-12T00:11:51.946939+0000","last_unstale":"2024-09-12T00:55:04.674577+0000","last_undegraded":"2024-09-12T00:55:04.674577+0000","last_fullsized":"2024-09-12T00:55:04.674577+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:55:04.674010+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:55:04.674010+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.674010+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:08:58.102887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11525,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":272,"num_read_kb":332,"num_write":160,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.613108+0000","last_change":"2024-09-12T00:55:00.612871+0000","last_active":"2024-09-12T00:55:00.613108+0000","last_peered":"2024-09-12T00:55:00.613108+0000","last_clean":"2024-09-12T00:55:00.613108+0000","last_became_active":"2024-09-12T00:11:53.947855+0000","last_became_peered":"2024-09-12T00:11:53.947855+0000","last_unstale":"2024-09-12T00:55:00.613108+0000","last_undegraded":"2024-09-12T00:55:00.613108+0000","last_fullsized":"2024-09-12T00:55:00.613108+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:00.612535+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:00.612535+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.612535+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:03:13.509961+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"266'2476","reported_seq":4377,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.652400+0000","last_change":"2024-09-12T00:55:05.652238+0000","last_active":"2024-09-12T00:55:05.652400+0000","last_peered":"2024-09-12T00:55:05.652400+0000","last_clean":"2024-09-12T00:55:05.652400+0000","last_became_active":"2024-09-12T00:11:55.973907+0000","last_became_peered":"2024-09-12T00:11:55.973907+0000","last_unstale":"2024-09-12T00:55:05.652400+0000","last_undegraded":"2024-09-12T00:55:05.652400+0000","last_fullsized":"2024-09-12T00:55:05.652400+0000","mapping_epoch":35,"log_start":"266'2400","ondisk_log_start":"266'2400","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2476","last_scrub_stamp":"2024-09-12T00:55:05.652034+0000","last_deep_scrub":"266'2476","last_deep_scrub_stamp":"2024-09-12T00:55:05.652034+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.652034+0000","objects_scrubbed":4,"log_size":76,"log_dups_size":2400,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:21:50.117470+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":615,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":6082,"num_read_kb":6081,"num_write":4910,"num_write_kb":1830,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":347,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"266'466","reported_seq":1923,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.189748+0000","last_change":"2024-09-12T00:54:55.189586+0000","last_active":"2024-09-12T00:54:55.189748+0000","last_peered":"2024-09-12T00:54:55.189748+0000","last_clean":"2024-09-12T00:54:55.189748+0000","last_became_active":"2024-09-12T00:11:47.930374+0000","last_became_peered":"2024-09-12T00:11:47.930374+0000","last_unstale":"2024-09-12T00:54:55.189748+0000","last_undegraded":"2024-09-12T00:54:55.189748+0000","last_fullsized":"2024-09-12T00:54:55.189748+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'466","last_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_deep_scrub":"266'466","last_deep_scrub_stamp":"2024-09-12T00:54:55.189400+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.189400+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":400,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:09:23.744860+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2308,"num_read_kb":2143,"num_write":557,"num_write_kb":133,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"266'244","reported_seq":940,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.557769+0000","last_change":"2024-09-12T00:54:37.557769+0000","last_active":"2024-09-12T00:54:37.557769+0000","last_peered":"2024-09-12T00:54:37.557769+0000","last_clean":"2024-09-12T00:54:37.557769+0000","last_became_active":"2024-09-12T00:11:45.929072+0000","last_became_peered":"2024-09-12T00:11:45.929072+0000","last_unstale":"2024-09-12T00:54:37.557769+0000","last_undegraded":"2024-09-12T00:54:37.557769+0000","last_fullsized":"2024-09-12T00:54:37.557769+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'244","last_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_deep_scrub":"266'244","last_deep_scrub_stamp":"2024-09-12T00:54:37.557554+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.557554+0000","objects_scrubbed":2,"log_size":44,"log_dups_size":200,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:40:58.369323+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":49242,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":594,"num_read_kb":71900,"num_write":1168,"num_write_kb":43127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.780257+0000","last_change":"2024-09-12T00:54:56.780257+0000","last_active":"2024-09-12T00:54:56.780257+0000","last_peered":"2024-09-12T00:54:56.780257+0000","last_clean":"2024-09-12T00:54:56.780257+0000","last_became_active":"2024-09-12T00:11:49.927718+0000","last_became_peered":"2024-09-12T00:11:49.927718+0000","last_unstale":"2024-09-12T00:54:56.780257+0000","last_undegraded":"2024-09-12T00:54:56.780257+0000","last_fullsized":"2024-09-12T00:54:56.780257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:56.780049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:56.780049+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.780049+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:31:46.069418+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"266'95","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.582012+0000","last_change":"2024-09-12T00:54:55.581870+0000","last_active":"2024-09-12T00:54:55.582012+0000","last_peered":"2024-09-12T00:54:55.582012+0000","last_clean":"2024-09-12T00:54:55.582012+0000","last_became_active":"2024-09-12T00:11:51.929156+0000","last_became_peered":"2024-09-12T00:11:51.929156+0000","last_unstale":"2024-09-12T00:54:55.582012+0000","last_undegraded":"2024-09-12T00:54:55.582012+0000","last_fullsized":"2024-09-12T00:54:55.582012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'95","last_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_deep_scrub":"266'95","last_deep_scrub_stamp":"2024-09-12T00:54:55.581679+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.581679+0000","objects_scrubbed":4,"log_size":95,"log_dups_size":0,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:45:01.848720+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":98,"num_read_kb":94,"num_write":64,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.574342+0000","last_change":"2024-09-12T00:55:01.574205+0000","last_active":"2024-09-12T00:55:01.574342+0000","last_peered":"2024-09-12T00:55:01.574342+0000","last_clean":"2024-09-12T00:55:01.574342+0000","last_became_active":"2024-09-12T00:11:53.946202+0000","last_became_peered":"2024-09-12T00:11:53.946202+0000","last_unstale":"2024-09-12T00:55:01.574342+0000","last_undegraded":"2024-09-12T00:55:01.574342+0000","last_fullsized":"2024-09-12T00:55:01.574342+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:01.574021+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:01.574021+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.574021+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:39:07.759800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"266'161","reported_seq":679,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.681813+0000","last_change":"2024-09-12T00:55:05.681813+0000","last_active":"2024-09-12T00:55:05.681813+0000","last_peered":"2024-09-12T00:55:05.681813+0000","last_clean":"2024-09-12T00:55:05.681813+0000","last_became_active":"2024-09-12T00:11:55.973578+0000","last_became_peered":"2024-09-12T00:11:55.973578+0000","last_unstale":"2024-09-12T00:55:05.681813+0000","last_undegraded":"2024-09-12T00:55:05.681813+0000","last_fullsized":"2024-09-12T00:55:05.681813+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'161","last_scrub_stamp":"2024-09-12T00:55:05.681606+0000","last_deep_scrub":"266'161","last_deep_scrub_stamp":"2024-09-12T00:55:05.681606+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.681606+0000","objects_scrubbed":6,"log_size":61,"log_dups_size":100,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:52.851058+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1097,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":190,"num_read_kb":177,"num_write":385,"num_write_kb":90,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.16","version":"266'568","reported_seq":2065,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.496229+0000","last_change":"2024-09-12T00:54:55.496091+0000","last_active":"2024-09-12T00:54:55.496229+0000","last_peered":"2024-09-12T00:54:55.496229+0000","last_clean":"2024-09-12T00:54:55.496229+0000","last_became_active":"2024-09-12T00:11:47.933350+0000","last_became_peered":"2024-09-12T00:11:47.933350+0000","last_unstale":"2024-09-12T00:54:55.496229+0000","last_undegraded":"2024-09-12T00:54:55.496229+0000","last_fullsized":"2024-09-12T00:54:55.496229+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'568","last_scrub_stamp":"2024-09-12T00:54:55.495889+0000","last_deep_scrub":"266'568","last_deep_scrub_stamp":"2024-09-12T00:54:55.495889+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.495889+0000","objects_scrubbed":3,"log_size":68,"log_dups_size":500,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:45:02.338433+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":2736,"num_read_kb":2489,"num_write":721,"num_write_kb":212,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"266'235","reported_seq":875,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.252201+0000","last_change":"2024-09-12T00:54:44.252201+0000","last_active":"2024-09-12T00:54:44.252201+0000","last_peered":"2024-09-12T00:54:44.252201+0000","last_clean":"2024-09-12T00:54:44.252201+0000","last_became_active":"2024-09-12T00:11:45.920298+0000","last_became_peered":"2024-09-12T00:11:45.920298+0000","last_unstale":"2024-09-12T00:54:44.252201+0000","last_undegraded":"2024-09-12T00:54:44.252201+0000","last_fullsized":"2024-09-12T00:54:44.252201+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'235","last_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_deep_scrub":"266'235","last_deep_scrub_stamp":"2024-09-12T00:54:44.251990+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.251990+0000","objects_scrubbed":2,"log_size":35,"log_dups_size":200,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:18:21.780768+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":475,"num_read_kb":11769,"num_write":1011,"num_write_kb":33421,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1],"acting":[3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.788483+0000","last_change":"2024-09-12T00:54:57.788234+0000","last_active":"2024-09-12T00:54:57.788483+0000","last_peered":"2024-09-12T00:54:57.788483+0000","last_clean":"2024-09-12T00:54:57.788483+0000","last_became_active":"2024-09-12T00:11:49.945308+0000","last_became_peered":"2024-09-12T00:11:49.945308+0000","last_unstale":"2024-09-12T00:54:57.788483+0000","last_undegraded":"2024-09-12T00:54:57.788483+0000","last_fullsized":"2024-09-12T00:54:57.788483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.788032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.788032+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.788032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:57.817885+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"266'135","reported_seq":690,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.716139+0000","last_change":"2024-09-12T00:55:03.716139+0000","last_active":"2024-09-12T00:55:03.716139+0000","last_peered":"2024-09-12T00:55:03.716139+0000","last_clean":"2024-09-12T00:55:03.716139+0000","last_became_active":"2024-09-12T00:11:51.951248+0000","last_became_peered":"2024-09-12T00:11:51.951248+0000","last_unstale":"2024-09-12T00:55:03.716139+0000","last_undegraded":"2024-09-12T00:55:03.716139+0000","last_fullsized":"2024-09-12T00:55:03.716139+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'135","last_scrub_stamp":"2024-09-12T00:55:03.715942+0000","last_deep_scrub":"266'135","last_deep_scrub_stamp":"2024-09-12T00:55:03.715942+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.715942+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":100,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:22:21.099760+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":148,"num_read_kb":140,"num_write":106,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.15","version":"266'780","reported_seq":2226,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.256781+0000","last_change":"2024-09-12T00:55:15.256620+0000","last_active":"2024-09-12T00:55:15.256781+0000","last_peered":"2024-09-12T00:55:15.256781+0000","last_clean":"2024-09-12T00:55:15.256781+0000","last_became_active":"2024-09-12T00:11:53.963157+0000","last_became_peered":"2024-09-12T00:11:53.963157+0000","last_unstale":"2024-09-12T00:55:15.256781+0000","last_undegraded":"2024-09-12T00:55:15.256781+0000","last_fullsized":"2024-09-12T00:55:15.256781+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'780","last_scrub_stamp":"2024-09-12T00:55:15.256431+0000","last_deep_scrub":"266'780","last_deep_scrub_stamp":"2024-09-12T00:55:15.256431+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.256431+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":700,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:52:50.511293+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"266'220","reported_seq":1058,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.633267+0000","last_change":"2024-09-12T00:55:02.633267+0000","last_active":"2024-09-12T00:55:02.633267+0000","last_peered":"2024-09-12T00:55:02.633267+0000","last_clean":"2024-09-12T00:55:02.633267+0000","last_became_active":"2024-09-12T00:11:55.960992+0000","last_became_peered":"2024-09-12T00:11:55.960992+0000","last_unstale":"2024-09-12T00:55:02.633267+0000","last_undegraded":"2024-09-12T00:55:02.633267+0000","last_fullsized":"2024-09-12T00:55:02.633267+0000","mapping_epoch":35,"log_start":"266'200","ondisk_log_start":"266'200","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'220","last_scrub_stamp":"2024-09-12T00:55:02.633094+0000","last_deep_scrub":"266'220","last_deep_scrub_stamp":"2024-09-12T00:55:02.633094+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.633094+0000","objects_scrubbed":2,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:28:18.981830+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":660,"num_read_kb":643,"num_write":503,"num_write_kb":128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":234,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"266'341","reported_seq":1788,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.481597+0000","last_change":"2024-09-12T00:54:52.481419+0000","last_active":"2024-09-12T00:54:52.481597+0000","last_peered":"2024-09-12T00:54:52.481597+0000","last_clean":"2024-09-12T00:54:52.481597+0000","last_became_active":"2024-09-12T00:11:47.930457+0000","last_became_peered":"2024-09-12T00:11:47.930457+0000","last_unstale":"2024-09-12T00:54:52.481597+0000","last_undegraded":"2024-09-12T00:54:52.481597+0000","last_fullsized":"2024-09-12T00:54:52.481597+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'341","last_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_deep_scrub":"266'341","last_deep_scrub_stamp":"2024-09-12T00:54:52.481235+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.481235+0000","objects_scrubbed":2,"log_size":41,"log_dups_size":300,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:21:35.223578+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1856,"num_read_kb":1798,"num_write":358,"num_write_kb":40,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.10","version":"266'204","reported_seq":814,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.252728+0000","last_change":"2024-09-12T00:54:36.252728+0000","last_active":"2024-09-12T00:54:36.252728+0000","last_peered":"2024-09-12T00:54:36.252728+0000","last_clean":"2024-09-12T00:54:36.252728+0000","last_became_active":"2024-09-12T00:11:45.959664+0000","last_became_peered":"2024-09-12T00:11:45.959664+0000","last_unstale":"2024-09-12T00:54:36.252728+0000","last_undegraded":"2024-09-12T00:54:36.252728+0000","last_fullsized":"2024-09-12T00:54:36.252728+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:36.252593+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.252593+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:55.096253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":368,"num_read_kb":5525,"num_write":929,"num_write_kb":22921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,3],"acting":[1,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.214764+0000","last_change":"2024-09-12T00:55:06.214591+0000","last_active":"2024-09-12T00:55:06.214764+0000","last_peered":"2024-09-12T00:55:06.214764+0000","last_clean":"2024-09-12T00:55:06.214764+0000","last_became_active":"2024-09-12T00:11:49.936390+0000","last_became_peered":"2024-09-12T00:11:49.936390+0000","last_unstale":"2024-09-12T00:55:06.214764+0000","last_undegraded":"2024-09-12T00:55:06.214764+0000","last_fullsized":"2024-09-12T00:55:06.214764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.214415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.214415+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.214415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:10.611172+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"266'125","reported_seq":704,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.736922+0000","last_change":"2024-09-12T00:54:54.736749+0000","last_active":"2024-09-12T00:54:54.736922+0000","last_peered":"2024-09-12T00:54:54.736922+0000","last_clean":"2024-09-12T00:54:54.736922+0000","last_became_active":"2024-09-12T00:11:51.944258+0000","last_became_peered":"2024-09-12T00:11:51.944258+0000","last_unstale":"2024-09-12T00:54:54.736922+0000","last_undegraded":"2024-09-12T00:54:54.736922+0000","last_fullsized":"2024-09-12T00:54:54.736922+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'125","last_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_deep_scrub":"266'125","last_deep_scrub_stamp":"2024-09-12T00:54:54.736531+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.736531+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":100,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:12:19.668088+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":151,"num_read_kb":150,"num_write":72,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"266'791","reported_seq":2268,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.269631+0000","last_change":"2024-09-12T00:55:11.269631+0000","last_active":"2024-09-12T00:55:11.269631+0000","last_peered":"2024-09-12T00:55:11.269631+0000","last_clean":"2024-09-12T00:55:11.269631+0000","last_became_active":"2024-09-12T00:11:53.965311+0000","last_became_peered":"2024-09-12T00:11:53.965311+0000","last_unstale":"2024-09-12T00:55:11.269631+0000","last_undegraded":"2024-09-12T00:55:11.269631+0000","last_fullsized":"2024-09-12T00:55:11.269631+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T00:55:11.269441+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T00:55:11.269441+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.269441+0000","objects_scrubbed":1,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:34.272360+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.8","version":"266'541","reported_seq":2425,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.233737+0000","last_change":"2024-09-12T00:54:53.233588+0000","last_active":"2024-09-12T00:54:53.233737+0000","last_peered":"2024-09-12T00:54:53.233737+0000","last_clean":"2024-09-12T00:54:53.233737+0000","last_became_active":"2024-09-12T00:11:47.925195+0000","last_became_peered":"2024-09-12T00:11:47.925195+0000","last_unstale":"2024-09-12T00:54:53.233737+0000","last_undegraded":"2024-09-12T00:54:53.233737+0000","last_fullsized":"2024-09-12T00:54:53.233737+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'541","last_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_deep_scrub":"266'541","last_deep_scrub_stamp":"2024-09-12T00:54:53.233406+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.233406+0000","objects_scrubbed":3,"log_size":41,"log_dups_size":500,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:32:22.797998+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3148,"num_read_kb":2973,"num_write":641,"num_write_kb":155,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2811,"num_omap_keys":11,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"266'243","reported_seq":908,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.022640+0000","last_change":"2024-09-12T00:54:37.022589+0000","last_active":"2024-09-12T00:54:37.022640+0000","last_peered":"2024-09-12T00:54:37.022640+0000","last_clean":"2024-09-12T00:54:37.022640+0000","last_became_active":"2024-09-12T00:11:45.936311+0000","last_became_peered":"2024-09-12T00:11:45.936311+0000","last_unstale":"2024-09-12T00:54:37.022640+0000","last_undegraded":"2024-09-12T00:54:37.022640+0000","last_fullsized":"2024-09-12T00:54:37.022640+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'243","last_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_deep_scrub":"266'243","last_deep_scrub_stamp":"2024-09-12T00:54:37.022508+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.022508+0000","objects_scrubbed":3,"log_size":43,"log_dups_size":200,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:37:27.678475+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":639369,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":593,"num_read_kb":40518,"num_write":1099,"num_write_kb":40851,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":511,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.463094+0000","last_change":"2024-09-12T00:54:52.462947+0000","last_active":"2024-09-12T00:54:52.463094+0000","last_peered":"2024-09-12T00:54:52.463094+0000","last_clean":"2024-09-12T00:54:52.463094+0000","last_became_active":"2024-09-12T00:11:49.915187+0000","last_became_peered":"2024-09-12T00:11:49.915187+0000","last_unstale":"2024-09-12T00:54:52.463094+0000","last_undegraded":"2024-09-12T00:54:52.463094+0000","last_fullsized":"2024-09-12T00:54:52.463094+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.462775+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.462775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:26:38.499387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"266'229","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.012234+0000","last_change":"2024-09-12T00:54:53.012090+0000","last_active":"2024-09-12T00:54:53.012234+0000","last_peered":"2024-09-12T00:54:53.012234+0000","last_clean":"2024-09-12T00:54:53.012234+0000","last_became_active":"2024-09-12T00:11:51.951077+0000","last_became_peered":"2024-09-12T00:11:51.951077+0000","last_unstale":"2024-09-12T00:54:53.012234+0000","last_undegraded":"2024-09-12T00:54:53.012234+0000","last_fullsized":"2024-09-12T00:54:53.012234+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:53.011878+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.011878+0000","objects_scrubbed":10,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:26:32.987361+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9550,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":300,"num_read_kb":365,"num_write":178,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.649950+0000","last_change":"2024-09-12T00:55:02.649950+0000","last_active":"2024-09-12T00:55:02.649950+0000","last_peered":"2024-09-12T00:55:02.649950+0000","last_clean":"2024-09-12T00:55:02.649950+0000","last_became_active":"2024-09-12T00:11:53.968218+0000","last_became_peered":"2024-09-12T00:11:53.968218+0000","last_unstale":"2024-09-12T00:55:02.649950+0000","last_undegraded":"2024-09-12T00:55:02.649950+0000","last_fullsized":"2024-09-12T00:55:02.649950+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.649779+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.649779+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.649779+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:36.061666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.4","version":"266'547","reported_seq":1382,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.636377+0000","last_change":"2024-09-12T00:55:00.636228+0000","last_active":"2024-09-12T00:55:00.636377+0000","last_peered":"2024-09-12T00:55:00.636377+0000","last_clean":"2024-09-12T00:55:00.636377+0000","last_became_active":"2024-09-12T00:11:55.960700+0000","last_became_peered":"2024-09-12T00:11:55.960700+0000","last_unstale":"2024-09-12T00:55:00.636377+0000","last_undegraded":"2024-09-12T00:55:00.636377+0000","last_fullsized":"2024-09-12T00:55:00.636377+0000","mapping_epoch":35,"log_start":"266'500","ondisk_log_start":"266'500","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'547","last_scrub_stamp":"2024-09-12T00:55:00.636015+0000","last_deep_scrub":"266'547","last_deep_scrub_stamp":"2024-09-12T00:55:00.636015+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.636015+0000","objects_scrubbed":5,"log_size":47,"log_dups_size":500,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:20:11.319690+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":882,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":1349,"num_read_kb":1326,"num_write":1164,"num_write_kb":393,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":381,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"266'848","reported_seq":2500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.378138+0000","last_change":"2024-09-12T00:54:43.377977+0000","last_active":"2024-09-12T00:54:43.378138+0000","last_peered":"2024-09-12T00:54:43.378138+0000","last_clean":"2024-09-12T00:54:43.378138+0000","last_became_active":"2024-09-12T00:11:47.924044+0000","last_became_peered":"2024-09-12T00:11:47.924044+0000","last_unstale":"2024-09-12T00:54:43.378138+0000","last_undegraded":"2024-09-12T00:54:43.378138+0000","last_fullsized":"2024-09-12T00:54:43.378138+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'848","last_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_deep_scrub":"266'848","last_deep_scrub_stamp":"2024-09-12T00:54:43.377796+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.377796+0000","objects_scrubbed":5,"log_size":48,"log_dups_size":800,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:14.837239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4091,"num_read_kb":3693,"num_write":1118,"num_write_kb":404,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":722,"num_omap_keys":3,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"266'191","reported_seq":1010,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.713942+0000","last_change":"2024-09-12T00:54:37.713942+0000","last_active":"2024-09-12T00:54:37.713942+0000","last_peered":"2024-09-12T00:54:37.713942+0000","last_clean":"2024-09-12T00:54:37.713942+0000","last_became_active":"2024-09-12T00:11:45.960039+0000","last_became_peered":"2024-09-12T00:11:45.960039+0000","last_unstale":"2024-09-12T00:54:37.713942+0000","last_undegraded":"2024-09-12T00:54:37.713942+0000","last_fullsized":"2024-09-12T00:54:37.713942+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:37.713849+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.713849+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:25:22.923192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399155,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":818,"num_read_kb":32535,"num_write":884,"num_write_kb":21398,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,5],"acting":[2,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.551937+0000","last_change":"2024-09-12T00:54:52.551709+0000","last_active":"2024-09-12T00:54:52.551937+0000","last_peered":"2024-09-12T00:54:52.551937+0000","last_clean":"2024-09-12T00:54:52.551937+0000","last_became_active":"2024-09-12T00:11:49.944251+0000","last_became_peered":"2024-09-12T00:11:49.944251+0000","last_unstale":"2024-09-12T00:54:52.551937+0000","last_undegraded":"2024-09-12T00:54:52.551937+0000","last_fullsized":"2024-09-12T00:54:52.551937+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.551408+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.551408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:35:19.893833+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.b","version":"266'134","reported_seq":718,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.735836+0000","last_change":"2024-09-12T00:55:01.735836+0000","last_active":"2024-09-12T00:55:01.735836+0000","last_peered":"2024-09-12T00:55:01.735836+0000","last_clean":"2024-09-12T00:55:01.735836+0000","last_became_active":"2024-09-12T00:11:51.947105+0000","last_became_peered":"2024-09-12T00:11:51.947105+0000","last_unstale":"2024-09-12T00:55:01.735836+0000","last_undegraded":"2024-09-12T00:55:01.735836+0000","last_fullsized":"2024-09-12T00:55:01.735836+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:55:01.735648+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:55:01.735648+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.735648+0000","objects_scrubbed":5,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:38:25.065258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7130,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":169,"num_read_kb":236,"num_write":88,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.620724+0000","last_change":"2024-09-12T00:55:08.620579+0000","last_active":"2024-09-12T00:55:08.620724+0000","last_peered":"2024-09-12T00:55:08.620724+0000","last_clean":"2024-09-12T00:55:08.620724+0000","last_became_active":"2024-09-12T00:11:53.970377+0000","last_became_peered":"2024-09-12T00:11:53.970377+0000","last_unstale":"2024-09-12T00:55:08.620724+0000","last_undegraded":"2024-09-12T00:55:08.620724+0000","last_fullsized":"2024-09-12T00:55:08.620724+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:08.620388+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:08.620388+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.620388+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:01.875295+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.5","version":"266'145","reported_seq":707,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.626780+0000","last_change":"2024-09-12T00:55:02.626619+0000","last_active":"2024-09-12T00:55:02.626780+0000","last_peered":"2024-09-12T00:55:02.626780+0000","last_clean":"2024-09-12T00:55:02.626780+0000","last_became_active":"2024-09-12T00:11:55.982657+0000","last_became_peered":"2024-09-12T00:11:55.982657+0000","last_unstale":"2024-09-12T00:55:02.626780+0000","last_undegraded":"2024-09-12T00:55:02.626780+0000","last_fullsized":"2024-09-12T00:55:02.626780+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'145","last_scrub_stamp":"2024-09-12T00:55:02.626426+0000","last_deep_scrub":"266'145","last_deep_scrub_stamp":"2024-09-12T00:55:02.626426+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.626426+0000","objects_scrubbed":2,"log_size":45,"log_dups_size":100,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:05:50.334371+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":336,"num_read_kb":276,"num_write":325,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"266'473","reported_seq":1974,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.801043+0000","last_change":"2024-09-12T00:54:43.800905+0000","last_active":"2024-09-12T00:54:43.801043+0000","last_peered":"2024-09-12T00:54:43.801043+0000","last_clean":"2024-09-12T00:54:43.801043+0000","last_became_active":"2024-09-12T00:11:47.925986+0000","last_became_peered":"2024-09-12T00:11:47.925986+0000","last_unstale":"2024-09-12T00:54:43.801043+0000","last_undegraded":"2024-09-12T00:54:43.801043+0000","last_fullsized":"2024-09-12T00:54:43.801043+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:43.800712+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.800712+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:52:56.152735+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2400,"num_read_kb":2232,"num_write":580,"num_write_kb":145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"266'169","reported_seq":791,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.292864+0000","last_change":"2024-09-12T00:54:43.292864+0000","last_active":"2024-09-12T00:54:43.292864+0000","last_peered":"2024-09-12T00:54:43.292864+0000","last_clean":"2024-09-12T00:54:43.292864+0000","last_became_active":"2024-09-12T00:11:45.931788+0000","last_became_peered":"2024-09-12T00:11:45.931788+0000","last_unstale":"2024-09-12T00:54:43.292864+0000","last_undegraded":"2024-09-12T00:54:43.292864+0000","last_fullsized":"2024-09-12T00:54:43.292864+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'169","last_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_deep_scrub":"266'169","last_deep_scrub_stamp":"2024-09-12T00:54:43.292636+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.292636+0000","objects_scrubbed":3,"log_size":69,"log_dups_size":100,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:50.241174+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263229,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":356,"num_read_kb":53604,"num_write":798,"num_write_kb":38888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,1],"acting":[3,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.466853+0000","last_change":"2024-09-12T00:54:59.466853+0000","last_active":"2024-09-12T00:54:59.466853+0000","last_peered":"2024-09-12T00:54:59.466853+0000","last_clean":"2024-09-12T00:54:59.466853+0000","last_became_active":"2024-09-12T00:11:49.935791+0000","last_became_peered":"2024-09-12T00:11:49.935791+0000","last_unstale":"2024-09-12T00:54:59.466853+0000","last_undegraded":"2024-09-12T00:54:59.466853+0000","last_fullsized":"2024-09-12T00:54:59.466853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.466666+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.466666+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.466666+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:53:14.960894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.8","version":"266'174","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.204352+0000","last_change":"2024-09-12T00:55:08.204100+0000","last_active":"2024-09-12T00:55:08.204352+0000","last_peered":"2024-09-12T00:55:08.204352+0000","last_clean":"2024-09-12T00:55:08.204352+0000","last_became_active":"2024-09-12T00:11:51.932592+0000","last_became_peered":"2024-09-12T00:11:51.932592+0000","last_unstale":"2024-09-12T00:55:08.204352+0000","last_undegraded":"2024-09-12T00:55:08.204352+0000","last_fullsized":"2024-09-12T00:55:08.204352+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'174","last_scrub_stamp":"2024-09-12T00:55:08.203826+0000","last_deep_scrub":"266'174","last_deep_scrub_stamp":"2024-09-12T00:55:08.203826+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.203826+0000","objects_scrubbed":9,"log_size":74,"log_dups_size":100,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:29:09.697458+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10780,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":225,"num_read_kb":295,"num_write":126,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"266'790","reported_seq":4507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.375288+0000","last_change":"2024-09-12T00:55:06.375133+0000","last_active":"2024-09-12T00:55:06.375288+0000","last_peered":"2024-09-12T00:55:06.375288+0000","last_clean":"2024-09-12T00:55:06.375288+0000","last_became_active":"2024-09-12T00:11:53.965158+0000","last_became_peered":"2024-09-12T00:11:53.965158+0000","last_unstale":"2024-09-12T00:55:06.375288+0000","last_undegraded":"2024-09-12T00:55:06.375288+0000","last_fullsized":"2024-09-12T00:55:06.375288+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'790","last_scrub_stamp":"2024-09-12T00:55:06.374948+0000","last_deep_scrub":"266'790","last_deep_scrub_stamp":"2024-09-12T00:55:06.374948+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.374948+0000","objects_scrubbed":1,"log_size":90,"log_dups_size":700,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:20.260953+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"266'112","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.674167+0000","last_change":"2024-09-12T00:55:04.674028+0000","last_active":"2024-09-12T00:55:04.674167+0000","last_peered":"2024-09-12T00:55:04.674167+0000","last_clean":"2024-09-12T00:55:04.674167+0000","last_became_active":"2024-09-12T00:11:55.974109+0000","last_became_peered":"2024-09-12T00:11:55.974109+0000","last_unstale":"2024-09-12T00:55:04.674167+0000","last_undegraded":"2024-09-12T00:55:04.674167+0000","last_fullsized":"2024-09-12T00:55:04.674167+0000","mapping_epoch":35,"log_start":"266'101","ondisk_log_start":"266'101","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'112","last_scrub_stamp":"2024-09-12T00:55:04.673811+0000","last_deep_scrub":"266'112","last_deep_scrub_stamp":"2024-09-12T00:55:04.673811+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.673811+0000","objects_scrubbed":2,"log_size":11,"log_dups_size":101,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:17:11.571983+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":415,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":148,"num_read_kb":126,"num_write":256,"num_write_kb":59,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"266'511","reported_seq":2021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.521426+0000","last_change":"2024-09-12T00:54:50.521426+0000","last_active":"2024-09-12T00:54:50.521426+0000","last_peered":"2024-09-12T00:54:50.521426+0000","last_clean":"2024-09-12T00:54:50.521426+0000","last_became_active":"2024-09-12T00:11:47.933057+0000","last_became_peered":"2024-09-12T00:11:47.933057+0000","last_unstale":"2024-09-12T00:54:50.521426+0000","last_undegraded":"2024-09-12T00:54:50.521426+0000","last_fullsized":"2024-09-12T00:54:50.521426+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:50.521244+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.521244+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":500,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:44:58.029014+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2650,"num_read_kb":2464,"num_write":683,"num_write_kb":234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"266'206","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.986855+0000","last_change":"2024-09-12T00:54:35.986855+0000","last_active":"2024-09-12T00:54:35.986855+0000","last_peered":"2024-09-12T00:54:35.986855+0000","last_clean":"2024-09-12T00:54:35.986855+0000","last_became_active":"2024-09-12T00:11:45.923958+0000","last_became_peered":"2024-09-12T00:11:45.923958+0000","last_unstale":"2024-09-12T00:54:35.986855+0000","last_undegraded":"2024-09-12T00:54:35.986855+0000","last_fullsized":"2024-09-12T00:54:35.986855+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'206","last_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_deep_scrub":"266'206","last_deep_scrub_stamp":"2024-09-12T00:54:35.986557+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.986557+0000","objects_scrubbed":6,"log_size":106,"log_dups_size":100,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:59:47.032800+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263232,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":355,"num_read_kb":7228,"num_write":905,"num_write_kb":18443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.541213+0000","last_change":"2024-09-12T00:54:53.541065+0000","last_active":"2024-09-12T00:54:53.541213+0000","last_peered":"2024-09-12T00:54:53.541213+0000","last_clean":"2024-09-12T00:54:53.541213+0000","last_became_active":"2024-09-12T00:11:49.933854+0000","last_became_peered":"2024-09-12T00:11:49.933854+0000","last_unstale":"2024-09-12T00:54:53.541213+0000","last_undegraded":"2024-09-12T00:54:53.541213+0000","last_fullsized":"2024-09-12T00:54:53.541213+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.540887+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.540887+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:30:37.677352+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.9","version":"266'226","reported_seq":877,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.727373+0000","last_change":"2024-09-12T00:55:00.727231+0000","last_active":"2024-09-12T00:55:00.727373+0000","last_peered":"2024-09-12T00:55:00.727373+0000","last_clean":"2024-09-12T00:55:00.727373+0000","last_became_active":"2024-09-12T00:11:51.953064+0000","last_became_peered":"2024-09-12T00:11:51.953064+0000","last_unstale":"2024-09-12T00:55:00.727373+0000","last_undegraded":"2024-09-12T00:55:00.727373+0000","last_fullsized":"2024-09-12T00:55:00.727373+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:55:00.727049+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:55:00.727049+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.727049+0000","objects_scrubbed":7,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:25.809988+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":17671,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":303,"num_read_kb":453,"num_write":160,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.421594+0000","last_change":"2024-09-12T00:55:05.421439+0000","last_active":"2024-09-12T00:55:05.421594+0000","last_peered":"2024-09-12T00:55:05.421594+0000","last_clean":"2024-09-12T00:55:05.421594+0000","last_became_active":"2024-09-12T00:11:53.952328+0000","last_became_peered":"2024-09-12T00:11:53.952328+0000","last_unstale":"2024-09-12T00:55:05.421594+0000","last_undegraded":"2024-09-12T00:55:05.421594+0000","last_fullsized":"2024-09-12T00:55:05.421594+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:05.421260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:05.421260+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.421260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:15:18.381893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"266'168","reported_seq":705,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.585645+0000","last_change":"2024-09-12T00:55:01.585367+0000","last_active":"2024-09-12T00:55:01.585645+0000","last_peered":"2024-09-12T00:55:01.585645+0000","last_clean":"2024-09-12T00:55:01.585645+0000","last_became_active":"2024-09-12T00:11:55.972558+0000","last_became_peered":"2024-09-12T00:11:55.972558+0000","last_unstale":"2024-09-12T00:55:01.585645+0000","last_undegraded":"2024-09-12T00:55:01.585645+0000","last_fullsized":"2024-09-12T00:55:01.585645+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'168","last_scrub_stamp":"2024-09-12T00:55:01.585026+0000","last_deep_scrub":"266'168","last_deep_scrub_stamp":"2024-09-12T00:55:01.585026+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.585026+0000","objects_scrubbed":1,"log_size":68,"log_dups_size":100,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:10:53.787732+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":474,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":255,"num_read_kb":228,"num_write":401,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.c","version":"266'473","reported_seq":1914,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.024560+0000","last_change":"2024-09-12T00:54:46.024560+0000","last_active":"2024-09-12T00:54:46.024560+0000","last_peered":"2024-09-12T00:54:46.024560+0000","last_clean":"2024-09-12T00:54:46.024560+0000","last_became_active":"2024-09-12T00:11:47.940521+0000","last_became_peered":"2024-09-12T00:11:47.940521+0000","last_unstale":"2024-09-12T00:54:46.024560+0000","last_undegraded":"2024-09-12T00:54:46.024560+0000","last_fullsized":"2024-09-12T00:54:46.024560+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'473","last_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_deep_scrub":"266'473","last_deep_scrub_stamp":"2024-09-12T00:54:46.024305+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.024305+0000","objects_scrubbed":2,"log_size":73,"log_dups_size":400,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:23:36.127769+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2456,"num_read_kb":2261,"num_write":618,"num_write_kb":175,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"266'213","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.570214+0000","last_change":"2024-09-12T00:54:39.570214+0000","last_active":"2024-09-12T00:54:39.570214+0000","last_peered":"2024-09-12T00:54:39.570214+0000","last_clean":"2024-09-12T00:54:39.570214+0000","last_became_active":"2024-09-12T00:11:45.943077+0000","last_became_peered":"2024-09-12T00:11:45.943077+0000","last_unstale":"2024-09-12T00:54:39.570214+0000","last_undegraded":"2024-09-12T00:54:39.570214+0000","last_fullsized":"2024-09-12T00:54:39.570214+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:39.570000+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.570000+0000","objects_scrubbed":3,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:42:44.813413+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262176,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":433,"num_read_kb":1957,"num_write":1001,"num_write_kb":29915,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,0],"acting":[7,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.d","version":"266'4","reported_seq":982,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.606327+0000","last_change":"2024-09-12T00:54:51.606327+0000","last_active":"2024-09-12T00:54:51.606327+0000","last_peered":"2024-09-12T00:54:51.606327+0000","last_clean":"2024-09-12T00:54:51.606327+0000","last_became_active":"2024-09-12T00:11:49.935988+0000","last_became_peered":"2024-09-12T00:11:49.935988+0000","last_unstale":"2024-09-12T00:54:51.606327+0000","last_undegraded":"2024-09-12T00:54:51.606327+0000","last_fullsized":"2024-09-12T00:54:51.606327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:51.606222+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.606222+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:00:53.762430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":470,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":716,"num_read_kb":714,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.e","version":"266'170","reported_seq":762,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.619760+0000","last_change":"2024-09-12T00:54:57.619760+0000","last_active":"2024-09-12T00:54:57.619760+0000","last_peered":"2024-09-12T00:54:57.619760+0000","last_clean":"2024-09-12T00:54:57.619760+0000","last_became_active":"2024-09-12T00:11:51.926195+0000","last_became_peered":"2024-09-12T00:11:51.926195+0000","last_unstale":"2024-09-12T00:54:57.619760+0000","last_undegraded":"2024-09-12T00:54:57.619760+0000","last_fullsized":"2024-09-12T00:54:57.619760+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T00:54:57.619550+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T00:54:57.619550+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.619550+0000","objects_scrubbed":7,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:22:58.330414+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8234,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":222,"num_read_kb":271,"num_write":174,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":15964,"num_omap_keys":38,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.536437+0000","last_change":"2024-09-12T00:54:55.536437+0000","last_active":"2024-09-12T00:54:55.536437+0000","last_peered":"2024-09-12T00:54:55.536437+0000","last_clean":"2024-09-12T00:54:55.536437+0000","last_became_active":"2024-09-12T00:11:53.967438+0000","last_became_peered":"2024-09-12T00:11:53.967438+0000","last_unstale":"2024-09-12T00:54:55.536437+0000","last_undegraded":"2024-09-12T00:54:55.536437+0000","last_fullsized":"2024-09-12T00:54:55.536437+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.536271+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.536271+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:47:31.775278+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.0","version":"266'115","reported_seq":620,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:08.302070+0000","last_change":"2024-09-12T00:55:08.302070+0000","last_active":"2024-09-12T00:55:08.302070+0000","last_peered":"2024-09-12T00:55:08.302070+0000","last_clean":"2024-09-12T00:55:08.302070+0000","last_became_active":"2024-09-12T00:11:55.961682+0000","last_became_peered":"2024-09-12T00:11:55.961682+0000","last_unstale":"2024-09-12T00:55:08.302070+0000","last_undegraded":"2024-09-12T00:55:08.302070+0000","last_fullsized":"2024-09-12T00:55:08.302070+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:08.301877+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:08.301877+0000","last_clean_scrub_stamp":"2024-09-12T00:55:08.301877+0000","objects_scrubbed":4,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:53:27.663319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":76,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":116,"num_read_kb":106,"num_write":253,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.d","version":"266'361","reported_seq":1774,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.211004+0000","last_change":"2024-09-12T00:54:54.211004+0000","last_active":"2024-09-12T00:54:54.211004+0000","last_peered":"2024-09-12T00:54:54.211004+0000","last_clean":"2024-09-12T00:54:54.211004+0000","last_became_active":"2024-09-12T00:11:47.926919+0000","last_became_peered":"2024-09-12T00:11:47.926919+0000","last_unstale":"2024-09-12T00:54:54.211004+0000","last_undegraded":"2024-09-12T00:54:54.211004+0000","last_fullsized":"2024-09-12T00:54:54.211004+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'361","last_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_deep_scrub":"266'361","last_deep_scrub_stamp":"2024-09-12T00:54:54.210799+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.210799+0000","objects_scrubbed":4,"log_size":61,"log_dups_size":300,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:50.984927+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2115,"num_read_kb":2013,"num_write":435,"num_write_kb":107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"266'180","reported_seq":829,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.277922+0000","last_change":"2024-09-12T00:54:42.277780+0000","last_active":"2024-09-12T00:54:42.277922+0000","last_peered":"2024-09-12T00:54:42.277922+0000","last_clean":"2024-09-12T00:54:42.277922+0000","last_became_active":"2024-09-12T00:11:45.916636+0000","last_became_peered":"2024-09-12T00:11:45.916636+0000","last_unstale":"2024-09-12T00:54:42.277922+0000","last_undegraded":"2024-09-12T00:54:42.277922+0000","last_fullsized":"2024-09-12T00:54:42.277922+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'180","last_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_deep_scrub":"266'180","last_deep_scrub_stamp":"2024-09-12T00:54:42.277535+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.277535+0000","objects_scrubbed":4,"log_size":80,"log_dups_size":100,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:04.627342+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029147,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":415,"num_read_kb":98751,"num_write":852,"num_write_kb":44948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.466092+0000","last_change":"2024-09-12T00:55:00.466092+0000","last_active":"2024-09-12T00:55:00.466092+0000","last_peered":"2024-09-12T00:55:00.466092+0000","last_clean":"2024-09-12T00:55:00.466092+0000","last_became_active":"2024-09-12T00:11:49.928641+0000","last_became_peered":"2024-09-12T00:11:49.928641+0000","last_unstale":"2024-09-12T00:55:00.466092+0000","last_undegraded":"2024-09-12T00:55:00.466092+0000","last_fullsized":"2024-09-12T00:55:00.466092+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:00.465889+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:00.465889+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.465889+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:55.760477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.f","version":"266'153","reported_seq":744,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.481188+0000","last_change":"2024-09-12T00:55:02.481188+0000","last_active":"2024-09-12T00:55:02.481188+0000","last_peered":"2024-09-12T00:55:02.481188+0000","last_clean":"2024-09-12T00:55:02.481188+0000","last_became_active":"2024-09-12T00:11:51.943909+0000","last_became_peered":"2024-09-12T00:11:51.943909+0000","last_unstale":"2024-09-12T00:55:02.481188+0000","last_undegraded":"2024-09-12T00:55:02.481188+0000","last_fullsized":"2024-09-12T00:55:02.481188+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'153","last_scrub_stamp":"2024-09-12T00:55:02.480984+0000","last_deep_scrub":"266'153","last_deep_scrub_stamp":"2024-09-12T00:55:02.480984+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.480984+0000","objects_scrubbed":7,"log_size":53,"log_dups_size":100,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:12:28.612551+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4675,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":199,"num_read_kb":249,"num_write":108,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.e","version":"266'760","reported_seq":4280,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.563296+0000","last_change":"2024-09-12T00:54:54.563296+0000","last_active":"2024-09-12T00:54:54.563296+0000","last_peered":"2024-09-12T00:54:54.563296+0000","last_clean":"2024-09-12T00:54:54.563296+0000","last_became_active":"2024-09-12T00:11:53.952096+0000","last_became_peered":"2024-09-12T00:11:53.952096+0000","last_unstale":"2024-09-12T00:54:54.563296+0000","last_undegraded":"2024-09-12T00:54:54.563296+0000","last_fullsized":"2024-09-12T00:54:54.563296+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'760","last_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_deep_scrub":"266'760","last_deep_scrub_stamp":"2024-09-12T00:54:54.563105+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.563105+0000","objects_scrubbed":1,"log_size":60,"log_dups_size":700,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:32:15.533407+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1","version":"266'136","reported_seq":636,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.671724+0000","last_change":"2024-09-12T00:55:03.671646+0000","last_active":"2024-09-12T00:55:03.671724+0000","last_peered":"2024-09-12T00:55:03.671724+0000","last_clean":"2024-09-12T00:55:03.671724+0000","last_became_active":"2024-09-12T00:11:55.979627+0000","last_became_peered":"2024-09-12T00:11:55.979627+0000","last_unstale":"2024-09-12T00:55:03.671724+0000","last_undegraded":"2024-09-12T00:55:03.671724+0000","last_fullsized":"2024-09-12T00:55:03.671724+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'136","last_scrub_stamp":"2024-09-12T00:55:03.671538+0000","last_deep_scrub":"266'136","last_deep_scrub_stamp":"2024-09-12T00:55:03.671538+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.671538+0000","objects_scrubbed":5,"log_size":36,"log_dups_size":100,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:16:14.251070+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2094,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":113,"num_read_kb":111,"num_write":326,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.e","version":"266'423","reported_seq":1959,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.827777+0000","last_change":"2024-09-12T00:54:44.827777+0000","last_active":"2024-09-12T00:54:44.827777+0000","last_peered":"2024-09-12T00:54:44.827777+0000","last_clean":"2024-09-12T00:54:44.827777+0000","last_became_active":"2024-09-12T00:11:47.929022+0000","last_became_peered":"2024-09-12T00:11:47.929022+0000","last_unstale":"2024-09-12T00:54:44.827777+0000","last_undegraded":"2024-09-12T00:54:44.827777+0000","last_fullsized":"2024-09-12T00:54:44.827777+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'423","last_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_deep_scrub":"266'423","last_deep_scrub_stamp":"2024-09-12T00:54:44.827583+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.827583+0000","objects_scrubbed":2,"log_size":23,"log_dups_size":400,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:48.105846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2234,"num_read_kb":2122,"num_write":469,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"266'205","reported_seq":969,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.317059+0000","last_change":"2024-09-12T00:54:41.316896+0000","last_active":"2024-09-12T00:54:41.317059+0000","last_peered":"2024-09-12T00:54:41.317059+0000","last_clean":"2024-09-12T00:54:41.317059+0000","last_became_active":"2024-09-12T00:11:45.933883+0000","last_became_peered":"2024-09-12T00:11:45.933883+0000","last_unstale":"2024-09-12T00:54:41.317059+0000","last_undegraded":"2024-09-12T00:54:41.317059+0000","last_fullsized":"2024-09-12T00:54:41.317059+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:41.316614+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.316614+0000","objects_scrubbed":8,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:17:11.862723+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3292722,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":768,"num_read_kb":199371,"num_write":991,"num_write_kb":32783,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"266'4","reported_seq":1457,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.467529+0000","last_change":"2024-09-12T00:54:50.467529+0000","last_active":"2024-09-12T00:54:50.467529+0000","last_peered":"2024-09-12T00:54:50.467529+0000","last_clean":"2024-09-12T00:54:50.467529+0000","last_became_active":"2024-09-12T00:11:49.915254+0000","last_became_peered":"2024-09-12T00:11:49.915254+0000","last_unstale":"2024-09-12T00:54:50.467529+0000","last_undegraded":"2024-09-12T00:54:50.467529+0000","last_fullsized":"2024-09-12T00:54:50.467529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'4","last_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_deep_scrub":"266'4","last_deep_scrub_stamp":"2024-09-12T00:54:50.467357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.467357+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:39:26.686465+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":943,"num_read_kb":943,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"266'77","reported_seq":604,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.575276+0000","last_change":"2024-09-12T00:54:57.575276+0000","last_active":"2024-09-12T00:54:57.575276+0000","last_peered":"2024-09-12T00:54:57.575276+0000","last_clean":"2024-09-12T00:54:57.575276+0000","last_became_active":"2024-09-12T00:11:51.934591+0000","last_became_peered":"2024-09-12T00:11:51.934591+0000","last_unstale":"2024-09-12T00:54:57.575276+0000","last_undegraded":"2024-09-12T00:54:57.575276+0000","last_fullsized":"2024-09-12T00:54:57.575276+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'77","last_scrub_stamp":"2024-09-12T00:54:57.575036+0000","last_deep_scrub":"266'77","last_deep_scrub_stamp":"2024-09-12T00:54:57.575036+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.575036+0000","objects_scrubbed":5,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:59:26.524340+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":75,"num_read_kb":70,"num_write":50,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.d","version":"266'798","reported_seq":2250,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.634055+0000","last_change":"2024-09-12T00:54:58.634055+0000","last_active":"2024-09-12T00:54:58.634055+0000","last_peered":"2024-09-12T00:54:58.634055+0000","last_clean":"2024-09-12T00:54:58.634055+0000","last_became_active":"2024-09-12T00:11:53.956859+0000","last_became_peered":"2024-09-12T00:11:53.956859+0000","last_unstale":"2024-09-12T00:54:58.634055+0000","last_undegraded":"2024-09-12T00:54:58.634055+0000","last_fullsized":"2024-09-12T00:54:58.634055+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'798","last_scrub_stamp":"2024-09-12T00:54:58.633950+0000","last_deep_scrub":"266'798","last_deep_scrub_stamp":"2024-09-12T00:54:58.633950+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.633950+0000","objects_scrubbed":1,"log_size":97,"log_dups_size":701,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:08:30.165647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"266'151","reported_seq":651,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.675913+0000","last_change":"2024-09-12T00:54:59.675774+0000","last_active":"2024-09-12T00:54:59.675913+0000","last_peered":"2024-09-12T00:54:59.675913+0000","last_clean":"2024-09-12T00:54:59.675913+0000","last_became_active":"2024-09-12T00:11:55.972601+0000","last_became_peered":"2024-09-12T00:11:55.972601+0000","last_unstale":"2024-09-12T00:54:59.675913+0000","last_undegraded":"2024-09-12T00:54:59.675913+0000","last_fullsized":"2024-09-12T00:54:59.675913+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'151","last_scrub_stamp":"2024-09-12T00:54:59.675592+0000","last_deep_scrub":"266'151","last_deep_scrub_stamp":"2024-09-12T00:54:59.675592+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.675592+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":100,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:49.816081+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":116,"num_read_kb":112,"num_write":339,"num_write_kb":79,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"266'761","reported_seq":2295,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.666891+0000","last_change":"2024-09-12T00:54:43.666617+0000","last_active":"2024-09-12T00:54:43.666891+0000","last_peered":"2024-09-12T00:54:43.666891+0000","last_clean":"2024-09-12T00:54:43.666891+0000","last_became_active":"2024-09-12T00:11:47.954993+0000","last_became_peered":"2024-09-12T00:11:47.954993+0000","last_unstale":"2024-09-12T00:54:43.666891+0000","last_undegraded":"2024-09-12T00:54:43.666891+0000","last_fullsized":"2024-09-12T00:54:43.666891+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'761","last_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_deep_scrub":"266'761","last_deep_scrub_stamp":"2024-09-12T00:54:43.666383+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.666383+0000","objects_scrubbed":2,"log_size":61,"log_dups_size":700,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:37:30.971115+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3604,"num_read_kb":3264,"num_write":992,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.8","version":"266'218","reported_seq":873,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.748716+0000","last_change":"2024-09-12T00:54:39.748564+0000","last_active":"2024-09-12T00:54:39.748716+0000","last_peered":"2024-09-12T00:54:39.748716+0000","last_clean":"2024-09-12T00:54:39.748716+0000","last_became_active":"2024-09-12T00:11:45.928644+0000","last_became_peered":"2024-09-12T00:11:45.928644+0000","last_unstale":"2024-09-12T00:54:39.748716+0000","last_undegraded":"2024-09-12T00:54:39.748716+0000","last_fullsized":"2024-09-12T00:54:39.748716+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.748286+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.748286+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:33:20.574571+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263224,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":497,"num_read_kb":31245,"num_write":954,"num_write_kb":40197,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,2],"acting":[4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.283527+0000","last_change":"2024-09-12T00:55:02.283527+0000","last_active":"2024-09-12T00:55:02.283527+0000","last_peered":"2024-09-12T00:55:02.283527+0000","last_clean":"2024-09-12T00:55:02.283527+0000","last_became_active":"2024-09-12T00:11:49.940266+0000","last_became_peered":"2024-09-12T00:11:49.940266+0000","last_unstale":"2024-09-12T00:55:02.283527+0000","last_undegraded":"2024-09-12T00:55:02.283527+0000","last_fullsized":"2024-09-12T00:55:02.283527+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:02.283345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:02.283345+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.283345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:21:27.352193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"266'230","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.555251+0000","last_change":"2024-09-12T00:54:54.555251+0000","last_active":"2024-09-12T00:54:54.555251+0000","last_peered":"2024-09-12T00:54:54.555251+0000","last_clean":"2024-09-12T00:54:54.555251+0000","last_became_active":"2024-09-12T00:11:51.946857+0000","last_became_peered":"2024-09-12T00:11:51.946857+0000","last_unstale":"2024-09-12T00:54:54.555251+0000","last_undegraded":"2024-09-12T00:54:54.555251+0000","last_fullsized":"2024-09-12T00:54:54.555251+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'230","last_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_deep_scrub":"266'230","last_deep_scrub_stamp":"2024-09-12T00:54:54.555026+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.555026+0000","objects_scrubbed":9,"log_size":30,"log_dups_size":200,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:18:19.736607+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7585,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":871,"num_read_kb":936,"num_write":1362,"num_write_kb":1232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487990,"num_omap_keys":1124,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.686865+0000","last_change":"2024-09-12T00:54:56.686865+0000","last_active":"2024-09-12T00:54:56.686865+0000","last_peered":"2024-09-12T00:54:56.686865+0000","last_clean":"2024-09-12T00:54:56.686865+0000","last_became_active":"2024-09-12T00:11:53.957091+0000","last_became_peered":"2024-09-12T00:11:53.957091+0000","last_unstale":"2024-09-12T00:54:56.686865+0000","last_undegraded":"2024-09-12T00:54:56.686865+0000","last_fullsized":"2024-09-12T00:54:56.686865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:56.686680+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:56.686680+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.686680+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:21:52.673507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"266'108","reported_seq":609,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.567930+0000","last_change":"2024-09-12T00:55:00.567791+0000","last_active":"2024-09-12T00:55:00.567930+0000","last_peered":"2024-09-12T00:55:00.567930+0000","last_clean":"2024-09-12T00:55:00.567930+0000","last_became_active":"2024-09-12T00:11:55.977588+0000","last_became_peered":"2024-09-12T00:11:55.977588+0000","last_unstale":"2024-09-12T00:55:00.567930+0000","last_undegraded":"2024-09-12T00:55:00.567930+0000","last_fullsized":"2024-09-12T00:55:00.567930+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'108","last_scrub_stamp":"2024-09-12T00:55:00.567594+0000","last_deep_scrub":"266'108","last_deep_scrub_stamp":"2024-09-12T00:55:00.567594+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.567594+0000","objects_scrubbed":2,"log_size":108,"log_dups_size":0,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:34:14.526248+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":99,"num_write":233,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"266'793","reported_seq":2444,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.287632+0000","last_change":"2024-09-12T00:54:52.287495+0000","last_active":"2024-09-12T00:54:52.287632+0000","last_peered":"2024-09-12T00:54:52.287632+0000","last_clean":"2024-09-12T00:54:52.287632+0000","last_became_active":"2024-09-12T00:11:47.925861+0000","last_became_peered":"2024-09-12T00:11:47.925861+0000","last_unstale":"2024-09-12T00:54:52.287632+0000","last_undegraded":"2024-09-12T00:54:52.287632+0000","last_fullsized":"2024-09-12T00:54:52.287632+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'793","last_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_deep_scrub":"266'793","last_deep_scrub_stamp":"2024-09-12T00:54:52.287309+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.287309+0000","objects_scrubbed":7,"log_size":93,"log_dups_size":700,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:48:21.498590+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":3892,"num_read_kb":3550,"num_write":1005,"num_write_kb":350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":945,"num_omap_keys":4,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"266'74","reported_seq":631,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.224931+0000","last_change":"2024-09-12T00:54:35.224884+0000","last_active":"2024-09-12T00:54:35.224931+0000","last_peered":"2024-09-12T00:54:35.224931+0000","last_clean":"2024-09-12T00:54:35.224931+0000","last_became_active":"2024-09-12T00:11:27.567651+0000","last_became_peered":"2024-09-12T00:11:27.567651+0000","last_unstale":"2024-09-12T00:54:35.224931+0000","last_undegraded":"2024-09-12T00:54:35.224931+0000","last_fullsized":"2024-09-12T00:54:35.224931+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'74","last_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_deep_scrub":"266'74","last_deep_scrub_stamp":"2024-09-12T00:54:35.224815+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.224815+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:34:03.397008+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"266'2","reported_seq":534,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.274653+0000","last_change":"2024-09-12T00:54:38.274584+0000","last_active":"2024-09-12T00:54:38.274653+0000","last_peered":"2024-09-12T00:54:38.274653+0000","last_clean":"2024-09-12T00:54:38.274653+0000","last_became_active":"2024-09-12T00:11:32.586291+0000","last_became_peered":"2024-09-12T00:11:32.586291+0000","last_unstale":"2024-09-12T00:54:38.274653+0000","last_undegraded":"2024-09-12T00:54:38.274653+0000","last_fullsized":"2024-09-12T00:54:38.274653+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:38.274494+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.274494+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:43:24.201817+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0015848119999999999,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"266'188","reported_seq":815,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.789372+0000","last_change":"2024-09-12T00:54:42.789217+0000","last_active":"2024-09-12T00:54:42.789372+0000","last_peered":"2024-09-12T00:54:42.789372+0000","last_clean":"2024-09-12T00:54:42.789372+0000","last_became_active":"2024-09-12T00:12:19.243156+0000","last_became_peered":"2024-09-12T00:12:19.243156+0000","last_unstale":"2024-09-12T00:54:42.789372+0000","last_undegraded":"2024-09-12T00:54:42.789372+0000","last_fullsized":"2024-09-12T00:54:42.789372+0000","mapping_epoch":38,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":39,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T00:54:42.788986+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.788986+0000","objects_scrubbed":5,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:13:41.647136+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7829240,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":397,"num_read_kb":15296,"num_write":922,"num_write_kb":28164,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.4","version":"266'5","reported_seq":976,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.966646+0000","last_change":"2024-09-12T00:54:51.966425+0000","last_active":"2024-09-12T00:54:51.966646+0000","last_peered":"2024-09-12T00:54:51.966646+0000","last_clean":"2024-09-12T00:54:51.966646+0000","last_became_active":"2024-09-12T00:11:49.927182+0000","last_became_peered":"2024-09-12T00:11:49.927182+0000","last_unstale":"2024-09-12T00:54:51.966646+0000","last_undegraded":"2024-09-12T00:54:51.966646+0000","last_fullsized":"2024-09-12T00:54:51.966646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'5","last_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_deep_scrub":"266'5","last_deep_scrub_stamp":"2024-09-12T00:54:51.966203+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.966203+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:10:02.641365+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1139,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":715,"num_read_kb":1177,"num_write":8,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"266'310","reported_seq":1024,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.211022+0000","last_change":"2024-09-12T00:55:07.210862+0000","last_active":"2024-09-12T00:55:07.211022+0000","last_peered":"2024-09-12T00:55:07.211022+0000","last_clean":"2024-09-12T00:55:07.211022+0000","last_became_active":"2024-09-12T00:11:51.935435+0000","last_became_peered":"2024-09-12T00:11:51.935435+0000","last_unstale":"2024-09-12T00:55:07.211022+0000","last_undegraded":"2024-09-12T00:55:07.211022+0000","last_fullsized":"2024-09-12T00:55:07.211022+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'310","last_scrub_stamp":"2024-09-12T00:55:07.210646+0000","last_deep_scrub":"266'310","last_deep_scrub_stamp":"2024-09-12T00:55:07.210646+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.210646+0000","objects_scrubbed":7,"log_size":110,"log_dups_size":200,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:24:27.265745+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":38032,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":556,"num_read_kb":812,"num_write":452,"num_write_kb":316,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":89064,"num_omap_keys":214,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.421374+0000","last_change":"2024-09-12T00:55:04.421246+0000","last_active":"2024-09-12T00:55:04.421374+0000","last_peered":"2024-09-12T00:55:04.421374+0000","last_clean":"2024-09-12T00:55:04.421374+0000","last_became_active":"2024-09-12T00:11:53.937258+0000","last_became_peered":"2024-09-12T00:11:53.937258+0000","last_unstale":"2024-09-12T00:55:04.421374+0000","last_undegraded":"2024-09-12T00:55:04.421374+0000","last_fullsized":"2024-09-12T00:55:04.421374+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:04.421057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:04.421057+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.421057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:55:46.700027+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.9","version":"266'191","reported_seq":899,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.081768+0000","last_change":"2024-09-12T00:55:00.081610+0000","last_active":"2024-09-12T00:55:00.081768+0000","last_peered":"2024-09-12T00:55:00.081768+0000","last_clean":"2024-09-12T00:55:00.081768+0000","last_became_active":"2024-09-12T00:11:55.972133+0000","last_became_peered":"2024-09-12T00:11:55.972133+0000","last_unstale":"2024-09-12T00:55:00.081768+0000","last_undegraded":"2024-09-12T00:55:00.081768+0000","last_fullsized":"2024-09-12T00:55:00.081768+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:55:00.081425+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:55:00.081425+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.081425+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:35:07.440493+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":826,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":459,"num_read_kb":448,"num_write":402,"num_write_kb":113,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":66,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"266'456","reported_seq":1928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.519445+0000","last_change":"2024-09-12T00:54:51.519310+0000","last_active":"2024-09-12T00:54:51.519445+0000","last_peered":"2024-09-12T00:54:51.519445+0000","last_clean":"2024-09-12T00:54:51.519445+0000","last_became_active":"2024-09-12T00:11:47.933249+0000","last_became_peered":"2024-09-12T00:11:47.933249+0000","last_unstale":"2024-09-12T00:54:51.519445+0000","last_undegraded":"2024-09-12T00:54:51.519445+0000","last_fullsized":"2024-09-12T00:54:51.519445+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.519121+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.519121+0000","objects_scrubbed":2,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:26:49.830324+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2501,"num_read_kb":2323,"num_write":568,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.242705+0000","last_change":"2024-09-12T00:54:37.242615+0000","last_active":"2024-09-12T00:54:37.242705+0000","last_peered":"2024-09-12T00:54:37.242705+0000","last_clean":"2024-09-12T00:54:37.242705+0000","last_became_active":"2024-09-12T00:11:32.587250+0000","last_became_peered":"2024-09-12T00:11:32.587250+0000","last_unstale":"2024-09-12T00:54:37.242705+0000","last_undegraded":"2024-09-12T00:54:37.242705+0000","last_fullsized":"2024-09-12T00:54:37.242705+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.242525+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.242525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:59:38.015711+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.001067618,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"266'204","reported_seq":823,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.526784+0000","last_change":"2024-09-12T00:54:42.526486+0000","last_active":"2024-09-12T00:54:42.526784+0000","last_peered":"2024-09-12T00:54:42.526784+0000","last_clean":"2024-09-12T00:54:42.526784+0000","last_became_active":"2024-09-12T00:11:45.951247+0000","last_became_peered":"2024-09-12T00:11:45.951247+0000","last_unstale":"2024-09-12T00:54:42.526784+0000","last_undegraded":"2024-09-12T00:54:42.526784+0000","last_fullsized":"2024-09-12T00:54:42.526784+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'204","last_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_deep_scrub":"266'204","last_deep_scrub_stamp":"2024-09-12T00:54:42.526184+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.526184+0000","objects_scrubbed":4,"log_size":104,"log_dups_size":100,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:12:15.774324+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":306325,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":403,"num_read_kb":6581,"num_write":989,"num_write_kb":20334,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.310008+0000","last_change":"2024-09-12T00:55:03.309849+0000","last_active":"2024-09-12T00:55:03.310008+0000","last_peered":"2024-09-12T00:55:03.310008+0000","last_clean":"2024-09-12T00:55:03.310008+0000","last_became_active":"2024-09-12T00:11:49.935245+0000","last_became_peered":"2024-09-12T00:11:49.935245+0000","last_unstale":"2024-09-12T00:55:03.310008+0000","last_undegraded":"2024-09-12T00:55:03.310008+0000","last_fullsized":"2024-09-12T00:55:03.310008+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:03.309659+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:03.309659+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.309659+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:36.319439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"266'853","reported_seq":2315,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.624299+0000","last_change":"2024-09-12T00:54:53.624156+0000","last_active":"2024-09-12T00:54:53.624299+0000","last_peered":"2024-09-12T00:54:53.624299+0000","last_clean":"2024-09-12T00:54:53.624299+0000","last_became_active":"2024-09-12T00:11:51.942692+0000","last_became_peered":"2024-09-12T00:11:51.942692+0000","last_unstale":"2024-09-12T00:54:53.624299+0000","last_undegraded":"2024-09-12T00:54:53.624299+0000","last_fullsized":"2024-09-12T00:54:53.624299+0000","mapping_epoch":31,"log_start":"266'800","ondisk_log_start":"266'800","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'853","last_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_deep_scrub":"266'853","last_deep_scrub_stamp":"2024-09-12T00:54:53.623958+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.623958+0000","objects_scrubbed":12,"log_size":53,"log_dups_size":800,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:12:03.095882+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66079,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":1175,"num_read_kb":1468,"num_write":286,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5938,"num_omap_keys":16,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":499,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.270488+0000","last_change":"2024-09-12T00:55:13.270242+0000","last_active":"2024-09-12T00:55:13.270488+0000","last_peered":"2024-09-12T00:55:13.270488+0000","last_clean":"2024-09-12T00:55:13.270488+0000","last_became_active":"2024-09-12T00:11:53.953826+0000","last_became_peered":"2024-09-12T00:11:53.953826+0000","last_unstale":"2024-09-12T00:55:13.270488+0000","last_undegraded":"2024-09-12T00:55:13.270488+0000","last_fullsized":"2024-09-12T00:55:13.270488+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:13.269978+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:13.269978+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.269978+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:38:52.961298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"266'209","reported_seq":734,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.291639+0000","last_change":"2024-09-12T00:55:09.291393+0000","last_active":"2024-09-12T00:55:09.291639+0000","last_peered":"2024-09-12T00:55:09.291639+0000","last_clean":"2024-09-12T00:55:09.291639+0000","last_became_active":"2024-09-12T00:11:55.981913+0000","last_became_peered":"2024-09-12T00:11:55.981913+0000","last_unstale":"2024-09-12T00:55:09.291639+0000","last_undegraded":"2024-09-12T00:55:09.291639+0000","last_fullsized":"2024-09-12T00:55:09.291639+0000","mapping_epoch":35,"log_start":"263'100","ondisk_log_start":"263'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'209","last_scrub_stamp":"2024-09-12T00:55:09.291169+0000","last_deep_scrub":"266'209","last_deep_scrub_stamp":"2024-09-12T00:55:09.291169+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.291169+0000","objects_scrubbed":3,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:37:41.354281+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":316,"num_read_kb":316,"num_write":470,"num_write_kb":137,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.7","version":"266'995","reported_seq":2854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.580114+0000","last_change":"2024-09-12T00:54:48.579986+0000","last_active":"2024-09-12T00:54:48.580114+0000","last_peered":"2024-09-12T00:54:48.580114+0000","last_clean":"2024-09-12T00:54:48.580114+0000","last_became_active":"2024-09-12T00:11:47.940715+0000","last_became_peered":"2024-09-12T00:11:47.940715+0000","last_unstale":"2024-09-12T00:54:48.580114+0000","last_undegraded":"2024-09-12T00:54:48.580114+0000","last_fullsized":"2024-09-12T00:54:48.580114+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'995","last_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_deep_scrub":"266'995","last_deep_scrub_stamp":"2024-09-12T00:54:48.579784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.579784+0000","objects_scrubbed":3,"log_size":95,"log_dups_size":900,"ondisk_log_size":95,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:48:38.249646+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4996,"num_read_kb":4506,"num_write":1358,"num_write_kb":566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.545793+0000","last_change":"2024-09-12T00:54:38.545567+0000","last_active":"2024-09-12T00:54:38.545793+0000","last_peered":"2024-09-12T00:54:38.545793+0000","last_clean":"2024-09-12T00:54:38.545793+0000","last_became_active":"2024-09-12T00:11:32.590491+0000","last_became_peered":"2024-09-12T00:11:32.590491+0000","last_unstale":"2024-09-12T00:54:38.545793+0000","last_undegraded":"2024-09-12T00:54:38.545793+0000","last_fullsized":"2024-09-12T00:54:38.545793+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:38.545294+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.545294+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:21:50.386532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00082138299999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"266'191","reported_seq":813,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.551347+0000","last_change":"2024-09-12T00:54:38.551347+0000","last_active":"2024-09-12T00:54:38.551347+0000","last_peered":"2024-09-12T00:54:38.551347+0000","last_clean":"2024-09-12T00:54:38.551347+0000","last_became_active":"2024-09-12T00:11:45.962951+0000","last_became_peered":"2024-09-12T00:11:45.962951+0000","last_unstale":"2024-09-12T00:54:38.551347+0000","last_undegraded":"2024-09-12T00:54:38.551347+0000","last_fullsized":"2024-09-12T00:54:38.551347+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'191","last_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_deep_scrub":"266'191","last_deep_scrub_stamp":"2024-09-12T00:54:38.551135+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.551135+0000","objects_scrubbed":3,"log_size":91,"log_dups_size":100,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:10:39.228607+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399318,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":402,"num_read_kb":16624,"num_write":912,"num_write_kb":36027,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"266'2","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.576791+0000","last_change":"2024-09-12T00:54:50.576517+0000","last_active":"2024-09-12T00:54:50.576791+0000","last_peered":"2024-09-12T00:54:50.576791+0000","last_clean":"2024-09-12T00:54:50.576791+0000","last_became_active":"2024-09-12T00:11:49.936661+0000","last_became_peered":"2024-09-12T00:11:49.936661+0000","last_unstale":"2024-09-12T00:54:50.576791+0000","last_undegraded":"2024-09-12T00:54:50.576791+0000","last_fullsized":"2024-09-12T00:54:50.576791+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:50.576297+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.576297+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:07:40.163460+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.5","version":"266'240","reported_seq":1301,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.014736+0000","last_change":"2024-09-12T00:54:57.014557+0000","last_active":"2024-09-12T00:54:57.014736+0000","last_peered":"2024-09-12T00:54:57.014736+0000","last_clean":"2024-09-12T00:54:57.014736+0000","last_became_active":"2024-09-12T00:11:51.949304+0000","last_became_peered":"2024-09-12T00:11:51.949304+0000","last_unstale":"2024-09-12T00:54:57.014736+0000","last_undegraded":"2024-09-12T00:54:57.014736+0000","last_fullsized":"2024-09-12T00:54:57.014736+0000","mapping_epoch":31,"log_start":"266'200","ondisk_log_start":"266'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'240","last_scrub_stamp":"2024-09-12T00:54:57.014349+0000","last_deep_scrub":"266'240","last_deep_scrub_stamp":"2024-09-12T00:54:57.014349+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.014349+0000","objects_scrubbed":9,"log_size":40,"log_dups_size":200,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:38:47.882649+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":175,"num_read_kb":167,"num_write":141,"num_write_kb":53,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5400,"num_omap_keys":12,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.624239+0000","last_change":"2024-09-12T00:55:06.624108+0000","last_active":"2024-09-12T00:55:06.624239+0000","last_peered":"2024-09-12T00:55:06.624239+0000","last_clean":"2024-09-12T00:55:06.624239+0000","last_became_active":"2024-09-12T00:11:53.967388+0000","last_became_peered":"2024-09-12T00:11:53.967388+0000","last_unstale":"2024-09-12T00:55:06.624239+0000","last_undegraded":"2024-09-12T00:55:06.624239+0000","last_fullsized":"2024-09-12T00:55:06.624239+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:06.623930+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:06.623930+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.623930+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:33.032507+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.b","version":"266'315","reported_seq":946,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.714992+0000","last_change":"2024-09-12T00:55:11.714992+0000","last_active":"2024-09-12T00:55:11.714992+0000","last_peered":"2024-09-12T00:55:11.714992+0000","last_clean":"2024-09-12T00:55:11.714992+0000","last_became_active":"2024-09-12T00:11:55.966279+0000","last_became_peered":"2024-09-12T00:11:55.966279+0000","last_unstale":"2024-09-12T00:55:11.714992+0000","last_undegraded":"2024-09-12T00:55:11.714992+0000","last_fullsized":"2024-09-12T00:55:11.714992+0000","mapping_epoch":35,"log_start":"266'300","ondisk_log_start":"266'300","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'315","last_scrub_stamp":"2024-09-12T00:55:11.714813+0000","last_deep_scrub":"266'315","last_deep_scrub_stamp":"2024-09-12T00:55:11.714813+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.714813+0000","objects_scrubbed":3,"log_size":15,"log_dups_size":300,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:42:49.232900+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":418,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":589,"num_read_kb":588,"num_write":600,"num_write_kb":171,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1193,"num_omap_keys":7,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.4","version":"266'380","reported_seq":1794,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.548331+0000","last_change":"2024-09-12T00:54:47.548188+0000","last_active":"2024-09-12T00:54:47.548331+0000","last_peered":"2024-09-12T00:54:47.548331+0000","last_clean":"2024-09-12T00:54:47.548331+0000","last_became_active":"2024-09-12T00:11:47.942723+0000","last_became_peered":"2024-09-12T00:11:47.942723+0000","last_unstale":"2024-09-12T00:54:47.548331+0000","last_undegraded":"2024-09-12T00:54:47.548331+0000","last_fullsized":"2024-09-12T00:54:47.548331+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'380","last_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_deep_scrub":"266'380","last_deep_scrub_stamp":"2024-09-12T00:54:47.548014+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.548014+0000","objects_scrubbed":1,"log_size":80,"log_dups_size":300,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:48.760777+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2011,"num_read_kb":1900,"num_write":441,"num_write_kb":96,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":944,"num_omap_keys":4,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"266'3","reported_seq":535,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.197523+0000","last_change":"2024-09-12T00:54:36.197440+0000","last_active":"2024-09-12T00:54:36.197523+0000","last_peered":"2024-09-12T00:54:36.197523+0000","last_clean":"2024-09-12T00:54:36.197523+0000","last_became_active":"2024-09-12T00:11:33.067340+0000","last_became_peered":"2024-09-12T00:11:33.067340+0000","last_unstale":"2024-09-12T00:54:36.197523+0000","last_undegraded":"2024-09-12T00:54:36.197523+0000","last_fullsized":"2024-09-12T00:54:36.197523+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'3","last_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_deep_scrub":"266'3","last_deep_scrub_stamp":"2024-09-12T00:54:36.197360+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.197360+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:06:08.561316+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0026190760000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"266'279","reported_seq":961,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:34.999799+0000","last_change":"2024-09-12T00:54:34.999658+0000","last_active":"2024-09-12T00:54:34.999799+0000","last_peered":"2024-09-12T00:54:34.999799+0000","last_clean":"2024-09-12T00:54:34.999799+0000","last_became_active":"2024-09-12T00:11:45.923506+0000","last_became_peered":"2024-09-12T00:11:45.923506+0000","last_unstale":"2024-09-12T00:54:34.999799+0000","last_undegraded":"2024-09-12T00:54:34.999799+0000","last_fullsized":"2024-09-12T00:54:34.999799+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'279","last_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_deep_scrub":"266'279","last_deep_scrub_stamp":"2024-09-12T00:54:34.999451+0000","last_clean_scrub_stamp":"2024-09-12T00:54:34.999451+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":200,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:57:22.247017+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":170347,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":651,"num_read_kb":17781,"num_write":1208,"num_write_kb":25804,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.529701+0000","last_change":"2024-09-12T00:54:49.529558+0000","last_active":"2024-09-12T00:54:49.529701+0000","last_peered":"2024-09-12T00:54:49.529701+0000","last_clean":"2024-09-12T00:54:49.529701+0000","last_became_active":"2024-09-12T00:11:49.946033+0000","last_became_peered":"2024-09-12T00:11:49.946033+0000","last_unstale":"2024-09-12T00:54:49.529701+0000","last_undegraded":"2024-09-12T00:54:49.529701+0000","last_fullsized":"2024-09-12T00:54:49.529701+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.529356+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.529356+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:37:46.730267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.6","version":"266'116","reported_seq":664,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.514099+0000","last_change":"2024-09-12T00:55:01.513954+0000","last_active":"2024-09-12T00:55:01.514099+0000","last_peered":"2024-09-12T00:55:01.514099+0000","last_clean":"2024-09-12T00:55:01.514099+0000","last_became_active":"2024-09-12T00:11:51.943383+0000","last_became_peered":"2024-09-12T00:11:51.943383+0000","last_unstale":"2024-09-12T00:55:01.514099+0000","last_undegraded":"2024-09-12T00:55:01.514099+0000","last_fullsized":"2024-09-12T00:55:01.514099+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'116","last_scrub_stamp":"2024-09-12T00:55:01.513747+0000","last_deep_scrub":"266'116","last_deep_scrub_stamp":"2024-09-12T00:55:01.513747+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.513747+0000","objects_scrubbed":7,"log_size":16,"log_dups_size":100,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:17:25.060624+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":140,"num_read_kb":134,"num_write":100,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3232,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:14.276690+0000","last_change":"2024-09-12T00:55:14.276537+0000","last_active":"2024-09-12T00:55:14.276690+0000","last_peered":"2024-09-12T00:55:14.276690+0000","last_clean":"2024-09-12T00:55:14.276690+0000","last_became_active":"2024-09-12T00:11:53.963486+0000","last_became_peered":"2024-09-12T00:11:53.963486+0000","last_unstale":"2024-09-12T00:55:14.276690+0000","last_undegraded":"2024-09-12T00:55:14.276690+0000","last_fullsized":"2024-09-12T00:55:14.276690+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:14.276365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:14.276365+0000","last_clean_scrub_stamp":"2024-09-12T00:55:14.276365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:26:47.649896+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"266'107","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.609090+0000","last_change":"2024-09-12T00:55:03.608951+0000","last_active":"2024-09-12T00:55:03.609090+0000","last_peered":"2024-09-12T00:55:03.609090+0000","last_clean":"2024-09-12T00:55:03.609090+0000","last_became_active":"2024-09-12T00:11:55.973511+0000","last_became_peered":"2024-09-12T00:11:55.973511+0000","last_unstale":"2024-09-12T00:55:03.609090+0000","last_undegraded":"2024-09-12T00:55:03.609090+0000","last_fullsized":"2024-09-12T00:55:03.609090+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'107","last_scrub_stamp":"2024-09-12T00:55:03.608770+0000","last_deep_scrub":"266'107","last_deep_scrub_stamp":"2024-09-12T00:55:03.608770+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.608770+0000","objects_scrubbed":0,"log_size":107,"log_dups_size":0,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:24:44.097958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":195,"num_read_kb":193,"num_write":248,"num_write_kb":57,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"266'427","reported_seq":1937,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.584216+0000","last_change":"2024-09-12T00:54:46.584085+0000","last_active":"2024-09-12T00:54:46.584216+0000","last_peered":"2024-09-12T00:54:46.584216+0000","last_clean":"2024-09-12T00:54:46.584216+0000","last_became_active":"2024-09-12T00:11:47.949184+0000","last_became_peered":"2024-09-12T00:11:47.949184+0000","last_unstale":"2024-09-12T00:54:46.584216+0000","last_undegraded":"2024-09-12T00:54:46.584216+0000","last_fullsized":"2024-09-12T00:54:46.584216+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'427","last_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_deep_scrub":"266'427","last_deep_scrub_stamp":"2024-09-12T00:54:46.583899+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.583899+0000","objects_scrubbed":2,"log_size":27,"log_dups_size":400,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:29.567951+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2227,"num_read_kb":2108,"num_write":476,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.5","version":"266'194","reported_seq":927,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:35.728770+0000","last_change":"2024-09-12T00:54:35.728711+0000","last_active":"2024-09-12T00:54:35.728770+0000","last_peered":"2024-09-12T00:54:35.728770+0000","last_clean":"2024-09-12T00:54:35.728770+0000","last_became_active":"2024-09-12T00:11:45.937701+0000","last_became_peered":"2024-09-12T00:11:45.937701+0000","last_unstale":"2024-09-12T00:54:35.728770+0000","last_undegraded":"2024-09-12T00:54:35.728770+0000","last_fullsized":"2024-09-12T00:54:35.728770+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:35.728619+0000","last_clean_scrub_stamp":"2024-09-12T00:54:35.728619+0000","objects_scrubbed":5,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:28:56.800395+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":263243,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":917,"num_read_kb":23524,"num_write":944,"num_write_kb":20703,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,4],"acting":[2,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.583032+0000","last_change":"2024-09-12T00:54:37.582880+0000","last_active":"2024-09-12T00:54:37.583032+0000","last_peered":"2024-09-12T00:54:37.583032+0000","last_clean":"2024-09-12T00:54:37.583032+0000","last_became_active":"2024-09-12T00:11:33.071020+0000","last_became_peered":"2024-09-12T00:11:33.071020+0000","last_unstale":"2024-09-12T00:54:37.583032+0000","last_undegraded":"2024-09-12T00:54:37.583032+0000","last_fullsized":"2024-09-12T00:54:37.583032+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:37.582700+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.582700+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:42:21.296604+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00082664399999999997,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.770800+0000","last_change":"2024-09-12T00:54:54.770670+0000","last_active":"2024-09-12T00:54:54.770800+0000","last_peered":"2024-09-12T00:54:54.770800+0000","last_clean":"2024-09-12T00:54:54.770800+0000","last_became_active":"2024-09-12T00:11:49.939951+0000","last_became_peered":"2024-09-12T00:11:49.939951+0000","last_unstale":"2024-09-12T00:54:54.770800+0000","last_undegraded":"2024-09-12T00:54:54.770800+0000","last_fullsized":"2024-09-12T00:54:54.770800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.770488+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.770488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:11:04.172382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"266'283","reported_seq":965,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.642804+0000","last_change":"2024-09-12T00:54:52.642804+0000","last_active":"2024-09-12T00:54:52.642804+0000","last_peered":"2024-09-12T00:54:52.642804+0000","last_clean":"2024-09-12T00:54:52.642804+0000","last_became_active":"2024-09-12T00:11:51.950527+0000","last_became_peered":"2024-09-12T00:11:51.950527+0000","last_unstale":"2024-09-12T00:54:52.642804+0000","last_undegraded":"2024-09-12T00:54:52.642804+0000","last_fullsized":"2024-09-12T00:54:52.642804+0000","mapping_epoch":31,"log_start":"263'200","ondisk_log_start":"263'200","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'283","last_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_deep_scrub":"266'283","last_deep_scrub_stamp":"2024-09-12T00:54:52.642577+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.642577+0000","objects_scrubbed":11,"log_size":83,"log_dups_size":200,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:58:44.027888+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":26101,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":392,"num_read_kb":552,"num_write":218,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3818,"num_omap_keys":8,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.721866+0000","last_change":"2024-09-12T00:54:55.721716+0000","last_active":"2024-09-12T00:54:55.721866+0000","last_peered":"2024-09-12T00:54:55.721866+0000","last_clean":"2024-09-12T00:54:55.721866+0000","last_became_active":"2024-09-12T00:11:53.956666+0000","last_became_peered":"2024-09-12T00:11:53.956666+0000","last_unstale":"2024-09-12T00:54:55.721866+0000","last_undegraded":"2024-09-12T00:54:55.721866+0000","last_fullsized":"2024-09-12T00:54:55.721866+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.721527+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.721527+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:01:14.324222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"266'152","reported_seq":676,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.296106+0000","last_change":"2024-09-12T00:55:12.296106+0000","last_active":"2024-09-12T00:55:12.296106+0000","last_peered":"2024-09-12T00:55:12.296106+0000","last_clean":"2024-09-12T00:55:12.296106+0000","last_became_active":"2024-09-12T00:11:55.981678+0000","last_became_peered":"2024-09-12T00:11:55.981678+0000","last_unstale":"2024-09-12T00:55:12.296106+0000","last_undegraded":"2024-09-12T00:55:12.296106+0000","last_fullsized":"2024-09-12T00:55:12.296106+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T00:55:12.295901+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T00:55:12.295901+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.295901+0000","objects_scrubbed":3,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:02:00.516313+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":723,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":206,"num_read_kb":182,"num_write":372,"num_write_kb":92,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3","version":"266'459","reported_seq":2087,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.594979+0000","last_change":"2024-09-12T00:54:45.594823+0000","last_active":"2024-09-12T00:54:45.594979+0000","last_peered":"2024-09-12T00:54:45.594979+0000","last_clean":"2024-09-12T00:54:45.594979+0000","last_became_active":"2024-09-12T00:11:47.940869+0000","last_became_peered":"2024-09-12T00:11:47.940869+0000","last_unstale":"2024-09-12T00:54:45.594979+0000","last_undegraded":"2024-09-12T00:54:45.594979+0000","last_fullsized":"2024-09-12T00:54:45.594979+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'459","last_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_deep_scrub":"266'459","last_deep_scrub_stamp":"2024-09-12T00:54:45.594645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.594645+0000","objects_scrubbed":2,"log_size":59,"log_dups_size":400,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:30:35.357485+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2408,"num_read_kb":2288,"num_write":499,"num_write_kb":87,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.4","version":"266'218","reported_seq":849,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.561793+0000","last_change":"2024-09-12T00:54:38.561566+0000","last_active":"2024-09-12T00:54:38.561793+0000","last_peered":"2024-09-12T00:54:38.561793+0000","last_clean":"2024-09-12T00:54:38.561793+0000","last_became_active":"2024-09-12T00:11:45.956546+0000","last_became_peered":"2024-09-12T00:11:45.956546+0000","last_unstale":"2024-09-12T00:54:38.561793+0000","last_undegraded":"2024-09-12T00:54:38.561793+0000","last_fullsized":"2024-09-12T00:54:38.561793+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:38.561353+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.561353+0000","objects_scrubbed":2,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:51:58.740390+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":428,"num_read_kb":4575,"num_write":1019,"num_write_kb":35414,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,4],"acting":[6,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":532,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.323676+0000","last_change":"2024-09-12T00:54:39.323452+0000","last_active":"2024-09-12T00:54:39.323676+0000","last_peered":"2024-09-12T00:54:39.323676+0000","last_clean":"2024-09-12T00:54:39.323676+0000","last_became_active":"2024-09-12T00:11:32.585905+0000","last_became_peered":"2024-09-12T00:11:32.585905+0000","last_unstale":"2024-09-12T00:54:39.323676+0000","last_undegraded":"2024-09-12T00:54:39.323676+0000","last_fullsized":"2024-09-12T00:54:39.323676+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:39.323253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.323253+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:06:56.936694+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.00093485699999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.968342+0000","last_change":"2024-09-12T00:54:53.968184+0000","last_active":"2024-09-12T00:54:53.968342+0000","last_peered":"2024-09-12T00:54:53.968342+0000","last_clean":"2024-09-12T00:54:53.968342+0000","last_became_active":"2024-09-12T00:11:49.928736+0000","last_became_peered":"2024-09-12T00:11:49.928736+0000","last_unstale":"2024-09-12T00:54:53.968342+0000","last_undegraded":"2024-09-12T00:54:53.968342+0000","last_fullsized":"2024-09-12T00:54:53.968342+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.967996+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.967996+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:51.436997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"266'188","reported_seq":765,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.581100+0000","last_change":"2024-09-12T00:54:56.580854+0000","last_active":"2024-09-12T00:54:56.581100+0000","last_peered":"2024-09-12T00:54:56.581100+0000","last_clean":"2024-09-12T00:54:56.581100+0000","last_became_active":"2024-09-12T00:11:51.940426+0000","last_became_peered":"2024-09-12T00:11:51.940426+0000","last_unstale":"2024-09-12T00:54:56.581100+0000","last_undegraded":"2024-09-12T00:54:56.581100+0000","last_fullsized":"2024-09-12T00:54:56.581100+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'188","last_scrub_stamp":"2024-09-12T00:54:56.580514+0000","last_deep_scrub":"266'188","last_deep_scrub_stamp":"2024-09-12T00:54:56.580514+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.580514+0000","objects_scrubbed":9,"log_size":88,"log_dups_size":100,"ondisk_log_size":88,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:34.929018+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":230,"num_read_kb":222,"num_write":188,"num_write_kb":56,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6272,"num_omap_keys":14,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.0","version":"266'800","reported_seq":2675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.597567+0000","last_change":"2024-09-12T00:54:56.597567+0000","last_active":"2024-09-12T00:54:56.597567+0000","last_peered":"2024-09-12T00:54:56.597567+0000","last_clean":"2024-09-12T00:54:56.597567+0000","last_became_active":"2024-09-12T00:11:53.945958+0000","last_became_peered":"2024-09-12T00:11:53.945958+0000","last_unstale":"2024-09-12T00:54:56.597567+0000","last_undegraded":"2024-09-12T00:54:56.597567+0000","last_fullsized":"2024-09-12T00:54:56.597567+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'800","last_scrub_stamp":"2024-09-12T00:54:56.597386+0000","last_deep_scrub":"266'800","last_deep_scrub_stamp":"2024-09-12T00:54:56.597386+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.597386+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":701,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:47:42.113206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"266'115","reported_seq":623,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.635235+0000","last_change":"2024-09-12T00:55:02.635235+0000","last_active":"2024-09-12T00:55:02.635235+0000","last_peered":"2024-09-12T00:55:02.635235+0000","last_clean":"2024-09-12T00:55:02.635235+0000","last_became_active":"2024-09-12T00:11:55.972521+0000","last_became_peered":"2024-09-12T00:11:55.972521+0000","last_unstale":"2024-09-12T00:55:02.635235+0000","last_undegraded":"2024-09-12T00:55:02.635235+0000","last_fullsized":"2024-09-12T00:55:02.635235+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:02.635060+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:02.635060+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.635060+0000","objects_scrubbed":2,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:54:00.741162+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":505,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":108,"num_write":262,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.0","version":"266'451","reported_seq":1864,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.779886+0000","last_change":"2024-09-12T00:54:44.779886+0000","last_active":"2024-09-12T00:54:44.779886+0000","last_peered":"2024-09-12T00:54:44.779886+0000","last_clean":"2024-09-12T00:54:44.779886+0000","last_became_active":"2024-09-12T00:11:47.942289+0000","last_became_peered":"2024-09-12T00:11:47.942289+0000","last_unstale":"2024-09-12T00:54:44.779886+0000","last_undegraded":"2024-09-12T00:54:44.779886+0000","last_fullsized":"2024-09-12T00:54:44.779886+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'451","last_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_deep_scrub":"266'451","last_deep_scrub_stamp":"2024-09-12T00:54:44.779697+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.779697+0000","objects_scrubbed":2,"log_size":51,"log_dups_size":400,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:11:42.485479+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2444,"num_read_kb":2251,"num_write":566,"num_write_kb":160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":253,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"266'250","reported_seq":920,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.721106+0000","last_change":"2024-09-12T00:54:38.720957+0000","last_active":"2024-09-12T00:54:38.721106+0000","last_peered":"2024-09-12T00:54:38.721106+0000","last_clean":"2024-09-12T00:54:38.721106+0000","last_became_active":"2024-09-12T00:11:45.943248+0000","last_became_peered":"2024-09-12T00:11:45.943248+0000","last_unstale":"2024-09-12T00:54:38.721106+0000","last_undegraded":"2024-09-12T00:54:38.721106+0000","last_fullsized":"2024-09-12T00:54:38.721106+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'250","last_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_deep_scrub":"266'250","last_deep_scrub_stamp":"2024-09-12T00:54:38.720733+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.720733+0000","objects_scrubbed":7,"log_size":50,"log_dups_size":200,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:35:06.451856+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2337134,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":628,"num_read_kb":14953,"num_write":1330,"num_write_kb":41908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":533,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.712764+0000","last_change":"2024-09-12T00:54:36.712634+0000","last_active":"2024-09-12T00:54:36.712764+0000","last_peered":"2024-09-12T00:54:36.712764+0000","last_clean":"2024-09-12T00:54:36.712764+0000","last_became_active":"2024-09-12T00:11:32.592391+0000","last_became_peered":"2024-09-12T00:11:32.592391+0000","last_unstale":"2024-09-12T00:54:36.712764+0000","last_undegraded":"2024-09-12T00:54:36.712764+0000","last_fullsized":"2024-09-12T00:54:36.712764+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:36.712454+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.712454+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:23:05.577210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001269166,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":507,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.294465+0000","last_change":"2024-09-12T00:55:01.294322+0000","last_active":"2024-09-12T00:55:01.294465+0000","last_peered":"2024-09-12T00:55:01.294465+0000","last_clean":"2024-09-12T00:55:01.294465+0000","last_became_active":"2024-09-12T00:11:49.929201+0000","last_became_peered":"2024-09-12T00:11:49.929201+0000","last_unstale":"2024-09-12T00:55:01.294465+0000","last_undegraded":"2024-09-12T00:55:01.294465+0000","last_fullsized":"2024-09-12T00:55:01.294465+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:01.294142+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:01.294142+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.294142+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:20:59.069922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"266'115","reported_seq":665,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.263371+0000","last_change":"2024-09-12T00:55:10.263231+0000","last_active":"2024-09-12T00:55:10.263371+0000","last_peered":"2024-09-12T00:55:10.263371+0000","last_clean":"2024-09-12T00:55:10.263371+0000","last_became_active":"2024-09-12T00:11:51.946870+0000","last_became_peered":"2024-09-12T00:11:51.946870+0000","last_unstale":"2024-09-12T00:55:10.263371+0000","last_undegraded":"2024-09-12T00:55:10.263371+0000","last_fullsized":"2024-09-12T00:55:10.263371+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'115","last_scrub_stamp":"2024-09-12T00:55:10.263055+0000","last_deep_scrub":"266'115","last_deep_scrub_stamp":"2024-09-12T00:55:10.263055+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.263055+0000","objects_scrubbed":6,"log_size":15,"log_dups_size":100,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:08:20.196677+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":128,"num_read_kb":122,"num_write":84,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"266'790","reported_seq":2353,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.454081+0000","last_change":"2024-09-12T00:55:03.453945+0000","last_active":"2024-09-12T00:55:03.454081+0000","last_peered":"2024-09-12T00:55:03.454081+0000","last_clean":"2024-09-12T00:55:03.454081+0000","last_became_active":"2024-09-12T00:11:53.968195+0000","last_became_peered":"2024-09-12T00:11:53.968195+0000","last_unstale":"2024-09-12T00:55:03.454081+0000","last_undegraded":"2024-09-12T00:55:03.454081+0000","last_fullsized":"2024-09-12T00:55:03.454081+0000","mapping_epoch":33,"log_start":"266'701","ondisk_log_start":"266'701","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'790","last_scrub_stamp":"2024-09-12T00:55:03.453762+0000","last_deep_scrub":"266'790","last_deep_scrub_stamp":"2024-09-12T00:55:03.453762+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.453762+0000","objects_scrubbed":1,"log_size":89,"log_dups_size":701,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:24:30.381039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.c","version":"266'190","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.254611+0000","last_change":"2024-09-12T00:55:10.254611+0000","last_active":"2024-09-12T00:55:10.254611+0000","last_peered":"2024-09-12T00:55:10.254611+0000","last_clean":"2024-09-12T00:55:10.254611+0000","last_became_active":"2024-09-12T00:11:55.972020+0000","last_became_peered":"2024-09-12T00:11:55.972020+0000","last_unstale":"2024-09-12T00:55:10.254611+0000","last_undegraded":"2024-09-12T00:55:10.254611+0000","last_fullsized":"2024-09-12T00:55:10.254611+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'190","last_scrub_stamp":"2024-09-12T00:55:10.254291+0000","last_deep_scrub":"266'190","last_deep_scrub_stamp":"2024-09-12T00:55:10.254291+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.254291+0000","objects_scrubbed":2,"log_size":90,"log_dups_size":100,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:24:19.599040+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":168,"num_read_kb":157,"num_write":445,"num_write_kb":131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1","version":"266'483","reported_seq":2178,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.777527+0000","last_change":"2024-09-12T00:54:41.777384+0000","last_active":"2024-09-12T00:54:41.777527+0000","last_peered":"2024-09-12T00:54:41.777527+0000","last_clean":"2024-09-12T00:54:41.777527+0000","last_became_active":"2024-09-12T00:11:47.919709+0000","last_became_peered":"2024-09-12T00:11:47.919709+0000","last_unstale":"2024-09-12T00:54:41.777527+0000","last_undegraded":"2024-09-12T00:54:41.777527+0000","last_fullsized":"2024-09-12T00:54:41.777527+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'483","last_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_deep_scrub":"266'483","last_deep_scrub_stamp":"2024-09-12T00:54:41.777199+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.777199+0000","objects_scrubbed":1,"log_size":83,"log_dups_size":400,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:41:25.825062+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2657,"num_read_kb":2530,"num_write":560,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"266'218","reported_seq":879,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.709035+0000","last_change":"2024-09-12T00:54:40.708851+0000","last_active":"2024-09-12T00:54:40.709035+0000","last_peered":"2024-09-12T00:54:40.709035+0000","last_clean":"2024-09-12T00:54:40.709035+0000","last_became_active":"2024-09-12T00:11:45.932953+0000","last_became_peered":"2024-09-12T00:11:45.932953+0000","last_unstale":"2024-09-12T00:54:40.709035+0000","last_undegraded":"2024-09-12T00:54:40.709035+0000","last_fullsized":"2024-09-12T00:54:40.709035+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:40.708626+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.708626+0000","objects_scrubbed":3,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:11:33.336367+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5989411,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":539,"num_read_kb":60723,"num_write":949,"num_write_kb":54504,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":531,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.310540+0000","last_change":"2024-09-12T00:54:40.310420+0000","last_active":"2024-09-12T00:54:40.310540+0000","last_peered":"2024-09-12T00:54:40.310540+0000","last_clean":"2024-09-12T00:54:40.310540+0000","last_became_active":"2024-09-12T00:11:32.589854+0000","last_became_peered":"2024-09-12T00:11:32.589854+0000","last_unstale":"2024-09-12T00:54:40.310540+0000","last_undegraded":"2024-09-12T00:54:40.310540+0000","last_fullsized":"2024-09-12T00:54:40.310540+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:40.310255+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.310255+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:29:59.694076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0.0018661960000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.797268+0000","last_change":"2024-09-12T00:54:53.797268+0000","last_active":"2024-09-12T00:54:53.797268+0000","last_peered":"2024-09-12T00:54:53.797268+0000","last_clean":"2024-09-12T00:54:53.797268+0000","last_became_active":"2024-09-12T00:11:49.927927+0000","last_became_peered":"2024-09-12T00:11:49.927927+0000","last_unstale":"2024-09-12T00:54:53.797268+0000","last_undegraded":"2024-09-12T00:54:53.797268+0000","last_fullsized":"2024-09-12T00:54:53.797268+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.797085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.797085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:02:00.567896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"266'349","reported_seq":1073,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.942607+0000","last_change":"2024-09-12T00:54:50.942474+0000","last_active":"2024-09-12T00:54:50.942607+0000","last_peered":"2024-09-12T00:54:50.942607+0000","last_clean":"2024-09-12T00:54:50.942607+0000","last_became_active":"2024-09-12T00:11:51.943373+0000","last_became_peered":"2024-09-12T00:11:51.943373+0000","last_unstale":"2024-09-12T00:54:50.942607+0000","last_undegraded":"2024-09-12T00:54:50.942607+0000","last_fullsized":"2024-09-12T00:54:50.942607+0000","mapping_epoch":31,"log_start":"266'300","ondisk_log_start":"266'300","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:50.942260+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.942260+0000","objects_scrubbed":9,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:31:21.958753+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":32232,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":487,"num_read_kb":703,"num_write":258,"num_write_kb":72,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.650701+0000","last_change":"2024-09-12T00:55:07.650462+0000","last_active":"2024-09-12T00:55:07.650701+0000","last_peered":"2024-09-12T00:55:07.650701+0000","last_clean":"2024-09-12T00:55:07.650701+0000","last_became_active":"2024-09-12T00:11:53.958260+0000","last_became_peered":"2024-09-12T00:11:53.958260+0000","last_unstale":"2024-09-12T00:55:07.650701+0000","last_undegraded":"2024-09-12T00:55:07.650701+0000","last_fullsized":"2024-09-12T00:55:07.650701+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.650237+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.650237+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.650237+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:18:51.752192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.d","version":"266'94","reported_seq":593,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.591231+0000","last_change":"2024-09-12T00:55:01.591231+0000","last_active":"2024-09-12T00:55:01.591231+0000","last_peered":"2024-09-12T00:55:01.591231+0000","last_clean":"2024-09-12T00:55:01.591231+0000","last_became_active":"2024-09-12T00:11:55.976577+0000","last_became_peered":"2024-09-12T00:11:55.976577+0000","last_unstale":"2024-09-12T00:55:01.591231+0000","last_undegraded":"2024-09-12T00:55:01.591231+0000","last_fullsized":"2024-09-12T00:55:01.591231+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'94","last_scrub_stamp":"2024-09-12T00:55:01.591042+0000","last_deep_scrub":"266'94","last_deep_scrub_stamp":"2024-09-12T00:55:01.591042+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.591042+0000","objects_scrubbed":3,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:58:48.103864+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":235,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":93,"num_read_kb":92,"num_write":215,"num_write_kb":51,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"266'152","reported_seq":730,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.753264+0000","last_change":"2024-09-12T00:55:12.753121+0000","last_active":"2024-09-12T00:55:12.753264+0000","last_peered":"2024-09-12T00:55:12.753264+0000","last_clean":"2024-09-12T00:55:12.753264+0000","last_became_active":"2024-09-12T00:11:55.986496+0000","last_became_peered":"2024-09-12T00:11:55.986496+0000","last_unstale":"2024-09-12T00:55:12.753264+0000","last_undegraded":"2024-09-12T00:55:12.753264+0000","last_fullsized":"2024-09-12T00:55:12.753264+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'152","last_scrub_stamp":"2024-09-12T00:55:12.752926+0000","last_deep_scrub":"266'152","last_deep_scrub_stamp":"2024-09-12T00:55:12.752926+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.752926+0000","objects_scrubbed":2,"log_size":52,"log_dups_size":100,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:29:08.244855+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":427,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":269,"num_read_kb":256,"num_write":365,"num_write_kb":82,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.13","version":"266'406","reported_seq":1803,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.789222+0000","last_change":"2024-09-12T00:54:45.789222+0000","last_active":"2024-09-12T00:54:45.789222+0000","last_peered":"2024-09-12T00:54:45.789222+0000","last_clean":"2024-09-12T00:54:45.789222+0000","last_became_active":"2024-09-12T00:11:47.919247+0000","last_became_peered":"2024-09-12T00:11:47.919247+0000","last_unstale":"2024-09-12T00:54:45.789222+0000","last_undegraded":"2024-09-12T00:54:45.789222+0000","last_fullsized":"2024-09-12T00:54:45.789222+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'406","last_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_deep_scrub":"266'406","last_deep_scrub_stamp":"2024-09-12T00:54:45.789043+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.789043+0000","objects_scrubbed":2,"log_size":106,"log_dups_size":300,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:59:36.351155+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2021,"num_read_kb":1900,"num_write":471,"num_write_kb":108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"266'186","reported_seq":868,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.238029+0000","last_change":"2024-09-12T00:54:45.238029+0000","last_active":"2024-09-12T00:54:45.238029+0000","last_peered":"2024-09-12T00:54:45.238029+0000","last_clean":"2024-09-12T00:54:45.238029+0000","last_became_active":"2024-09-12T00:11:45.929893+0000","last_became_peered":"2024-09-12T00:11:45.929893+0000","last_unstale":"2024-09-12T00:54:45.238029+0000","last_undegraded":"2024-09-12T00:54:45.238029+0000","last_fullsized":"2024-09-12T00:54:45.238029+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:45.237784+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.237784+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:25:44.782035+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33239,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":525,"num_read_kb":101459,"num_write":845,"num_write_kb":29263,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.524132+0000","last_change":"2024-09-12T00:54:54.524132+0000","last_active":"2024-09-12T00:54:54.524132+0000","last_peered":"2024-09-12T00:54:54.524132+0000","last_clean":"2024-09-12T00:54:54.524132+0000","last_became_active":"2024-09-12T00:11:49.939647+0000","last_became_peered":"2024-09-12T00:11:49.939647+0000","last_unstale":"2024-09-12T00:54:54.524132+0000","last_undegraded":"2024-09-12T00:54:54.524132+0000","last_fullsized":"2024-09-12T00:54:54.524132+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:54.523944+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.523944+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:18:44.210297+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.11","version":"266'148","reported_seq":735,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.599336+0000","last_change":"2024-09-12T00:54:59.599336+0000","last_active":"2024-09-12T00:54:59.599336+0000","last_peered":"2024-09-12T00:54:59.599336+0000","last_clean":"2024-09-12T00:54:59.599336+0000","last_became_active":"2024-09-12T00:11:51.928441+0000","last_became_peered":"2024-09-12T00:11:51.928441+0000","last_unstale":"2024-09-12T00:54:59.599336+0000","last_undegraded":"2024-09-12T00:54:59.599336+0000","last_fullsized":"2024-09-12T00:54:59.599336+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'148","last_scrub_stamp":"2024-09-12T00:54:59.599075+0000","last_deep_scrub":"266'148","last_deep_scrub_stamp":"2024-09-12T00:54:59.599075+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.599075+0000","objects_scrubbed":6,"log_size":48,"log_dups_size":100,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:17.491961+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13149,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":189,"num_read_kb":268,"num_write":102,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.622430+0000","last_change":"2024-09-12T00:54:57.622430+0000","last_active":"2024-09-12T00:54:57.622430+0000","last_peered":"2024-09-12T00:54:57.622430+0000","last_clean":"2024-09-12T00:54:57.622430+0000","last_became_active":"2024-09-12T00:11:53.965254+0000","last_became_peered":"2024-09-12T00:11:53.965254+0000","last_unstale":"2024-09-12T00:54:57.622430+0000","last_undegraded":"2024-09-12T00:54:57.622430+0000","last_fullsized":"2024-09-12T00:54:57.622430+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.622225+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.622225+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.622225+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:41.794751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1e","version":"266'126","reported_seq":628,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:03.610490+0000","last_change":"2024-09-12T00:55:03.610490+0000","last_active":"2024-09-12T00:55:03.610490+0000","last_peered":"2024-09-12T00:55:03.610490+0000","last_clean":"2024-09-12T00:55:03.610490+0000","last_became_active":"2024-09-12T00:11:55.974856+0000","last_became_peered":"2024-09-12T00:11:55.974856+0000","last_unstale":"2024-09-12T00:55:03.610490+0000","last_undegraded":"2024-09-12T00:55:03.610490+0000","last_fullsized":"2024-09-12T00:55:03.610490+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'126","last_scrub_stamp":"2024-09-12T00:55:03.610311+0000","last_deep_scrub":"266'126","last_deep_scrub_stamp":"2024-09-12T00:55:03.610311+0000","last_clean_scrub_stamp":"2024-09-12T00:55:03.610311+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":100,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:36:45.463442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":106,"num_read_kb":102,"num_write":290,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.12","version":"266'349","reported_seq":1872,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.754171+0000","last_change":"2024-09-12T00:54:46.754171+0000","last_active":"2024-09-12T00:54:46.754171+0000","last_peered":"2024-09-12T00:54:46.754171+0000","last_clean":"2024-09-12T00:54:46.754171+0000","last_became_active":"2024-09-12T00:11:47.934843+0000","last_became_peered":"2024-09-12T00:11:47.934843+0000","last_unstale":"2024-09-12T00:54:46.754171+0000","last_undegraded":"2024-09-12T00:54:46.754171+0000","last_fullsized":"2024-09-12T00:54:46.754171+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'349","last_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_deep_scrub":"266'349","last_deep_scrub_stamp":"2024-09-12T00:54:46.753992+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.753992+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":300,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:35.515601+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2024,"num_read_kb":1959,"num_write":372,"num_write_kb":46,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.15","version":"266'340","reported_seq":1021,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.976417+0000","last_change":"2024-09-12T00:54:37.976334+0000","last_active":"2024-09-12T00:54:37.976417+0000","last_peered":"2024-09-12T00:54:37.976417+0000","last_clean":"2024-09-12T00:54:37.976417+0000","last_became_active":"2024-09-12T00:11:45.942562+0000","last_became_peered":"2024-09-12T00:11:45.942562+0000","last_unstale":"2024-09-12T00:54:37.976417+0000","last_undegraded":"2024-09-12T00:54:37.976417+0000","last_fullsized":"2024-09-12T00:54:37.976417+0000","mapping_epoch":25,"log_start":"266'300","ondisk_log_start":"266'300","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'340","last_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_deep_scrub":"266'340","last_deep_scrub_stamp":"2024-09-12T00:54:37.976207+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.976207+0000","objects_scrubbed":2,"log_size":40,"log_dups_size":300,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:44:02.328642+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1992246,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":797,"num_read_kb":9288,"num_write":1291,"num_write_kb":22580,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,3],"acting":[0,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":506,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.735034+0000","last_change":"2024-09-12T00:54:55.735034+0000","last_active":"2024-09-12T00:54:55.735034+0000","last_peered":"2024-09-12T00:54:55.735034+0000","last_clean":"2024-09-12T00:54:55.735034+0000","last_became_active":"2024-09-12T00:11:49.941970+0000","last_became_peered":"2024-09-12T00:11:49.941970+0000","last_unstale":"2024-09-12T00:54:55.735034+0000","last_undegraded":"2024-09-12T00:54:55.735034+0000","last_fullsized":"2024-09-12T00:54:55.735034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.734861+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.734861+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:26:10.701469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.10","version":"266'57","reported_seq":569,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:02.743197+0000","last_change":"2024-09-12T00:55:02.743197+0000","last_active":"2024-09-12T00:55:02.743197+0000","last_peered":"2024-09-12T00:55:02.743197+0000","last_clean":"2024-09-12T00:55:02.743197+0000","last_became_active":"2024-09-12T00:11:51.949321+0000","last_became_peered":"2024-09-12T00:11:51.949321+0000","last_unstale":"2024-09-12T00:55:02.743197+0000","last_undegraded":"2024-09-12T00:55:02.743197+0000","last_fullsized":"2024-09-12T00:55:02.743197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'57","last_scrub_stamp":"2024-09-12T00:55:02.743015+0000","last_deep_scrub":"266'57","last_deep_scrub_stamp":"2024-09-12T00:55:02.743015+0000","last_clean_scrub_stamp":"2024-09-12T00:55:02.743015+0000","objects_scrubbed":3,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:46.675016+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":30,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":494,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.701161+0000","last_change":"2024-09-12T00:54:57.701161+0000","last_active":"2024-09-12T00:54:57.701161+0000","last_peered":"2024-09-12T00:54:57.701161+0000","last_clean":"2024-09-12T00:54:57.701161+0000","last_became_active":"2024-09-12T00:11:53.957484+0000","last_became_peered":"2024-09-12T00:11:53.957484+0000","last_unstale":"2024-09-12T00:54:57.701161+0000","last_undegraded":"2024-09-12T00:54:57.701161+0000","last_fullsized":"2024-09-12T00:54:57.701161+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:57.700977+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:57.700977+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.700977+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:20:41.098461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"266'196","reported_seq":726,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:06.724177+0000","last_change":"2024-09-12T00:55:06.724177+0000","last_active":"2024-09-12T00:55:06.724177+0000","last_peered":"2024-09-12T00:55:06.724177+0000","last_clean":"2024-09-12T00:55:06.724177+0000","last_became_active":"2024-09-12T00:11:55.977268+0000","last_became_peered":"2024-09-12T00:11:55.977268+0000","last_unstale":"2024-09-12T00:55:06.724177+0000","last_undegraded":"2024-09-12T00:55:06.724177+0000","last_fullsized":"2024-09-12T00:55:06.724177+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T00:55:06.723928+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T00:55:06.723928+0000","last_clean_scrub_stamp":"2024-09-12T00:55:06.723928+0000","objects_scrubbed":4,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:42:39.442636+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":625,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":296,"num_read_kb":287,"num_write":436,"num_write_kb":123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":398,"num_omap_keys":2,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"266'774","reported_seq":2195,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.737013+0000","last_change":"2024-09-12T00:54:45.737013+0000","last_active":"2024-09-12T00:54:45.737013+0000","last_peered":"2024-09-12T00:54:45.737013+0000","last_clean":"2024-09-12T00:54:45.737013+0000","last_became_active":"2024-09-12T00:11:47.925992+0000","last_became_peered":"2024-09-12T00:11:47.925992+0000","last_unstale":"2024-09-12T00:54:45.737013+0000","last_undegraded":"2024-09-12T00:54:45.737013+0000","last_fullsized":"2024-09-12T00:54:45.737013+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'774","last_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_deep_scrub":"266'774","last_deep_scrub_stamp":"2024-09-12T00:54:45.736834+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.736834+0000","objects_scrubbed":3,"log_size":74,"log_dups_size":700,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:22:29.215351+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3848,"num_read_kb":3364,"num_write":1169,"num_write_kb":533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":267,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.16","version":"266'193","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:36.705741+0000","last_change":"2024-09-12T00:54:36.705674+0000","last_active":"2024-09-12T00:54:36.705741+0000","last_peered":"2024-09-12T00:54:36.705741+0000","last_clean":"2024-09-12T00:54:36.705741+0000","last_became_active":"2024-09-12T00:11:45.915348+0000","last_became_peered":"2024-09-12T00:11:45.915348+0000","last_unstale":"2024-09-12T00:54:36.705741+0000","last_undegraded":"2024-09-12T00:54:36.705741+0000","last_fullsized":"2024-09-12T00:54:36.705741+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:36.705560+0000","last_clean_scrub_stamp":"2024-09-12T00:54:36.705560+0000","objects_scrubbed":5,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:21:37.794357+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":436,"num_read_kb":25665,"num_write":923,"num_write_kb":19893,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,4],"acting":[2,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":502,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.705205+0000","last_change":"2024-09-12T00:54:49.705205+0000","last_active":"2024-09-12T00:54:49.705205+0000","last_peered":"2024-09-12T00:54:49.705205+0000","last_clean":"2024-09-12T00:54:49.705205+0000","last_became_active":"2024-09-12T00:11:49.922851+0000","last_became_peered":"2024-09-12T00:11:49.922851+0000","last_unstale":"2024-09-12T00:54:49.705205+0000","last_undegraded":"2024-09-12T00:54:49.705205+0000","last_fullsized":"2024-09-12T00:54:49.705205+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:49.704924+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.704924+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:56:10.256859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"266'181","reported_seq":778,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.589082+0000","last_change":"2024-09-12T00:54:56.589082+0000","last_active":"2024-09-12T00:54:56.589082+0000","last_peered":"2024-09-12T00:54:56.589082+0000","last_clean":"2024-09-12T00:54:56.589082+0000","last_became_active":"2024-09-12T00:11:51.937543+0000","last_became_peered":"2024-09-12T00:11:51.937543+0000","last_unstale":"2024-09-12T00:54:56.589082+0000","last_undegraded":"2024-09-12T00:54:56.589082+0000","last_fullsized":"2024-09-12T00:54:56.589082+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'181","last_scrub_stamp":"2024-09-12T00:54:56.588880+0000","last_deep_scrub":"266'181","last_deep_scrub_stamp":"2024-09-12T00:54:56.588880+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.588880+0000","objects_scrubbed":5,"log_size":81,"log_dups_size":100,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:32:45.522846+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9915,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":233,"num_read_kb":302,"num_write":134,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.661285+0000","last_change":"2024-09-12T00:54:59.661285+0000","last_active":"2024-09-12T00:54:59.661285+0000","last_peered":"2024-09-12T00:54:59.661285+0000","last_clean":"2024-09-12T00:54:59.661285+0000","last_became_active":"2024-09-12T00:11:53.949884+0000","last_became_peered":"2024-09-12T00:11:53.949884+0000","last_unstale":"2024-09-12T00:54:59.661285+0000","last_undegraded":"2024-09-12T00:54:59.661285+0000","last_fullsized":"2024-09-12T00:54:59.661285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.661085+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.661085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.661085+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:57:22.480747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"266'105","reported_seq":619,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:21.376047+0000","last_change":"2024-09-12T00:55:21.376047+0000","last_active":"2024-09-12T00:55:21.376047+0000","last_peered":"2024-09-12T00:55:21.376047+0000","last_clean":"2024-09-12T00:55:21.376047+0000","last_became_active":"2024-09-12T00:11:55.958298+0000","last_became_peered":"2024-09-12T00:11:55.958298+0000","last_unstale":"2024-09-12T00:55:21.376047+0000","last_undegraded":"2024-09-12T00:55:21.376047+0000","last_fullsized":"2024-09-12T00:55:21.376047+0000","mapping_epoch":35,"log_start":"0'0","ondisk_log_start":"0'0","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'105","last_scrub_stamp":"2024-09-12T00:55:21.375847+0000","last_deep_scrub":"266'105","last_deep_scrub_stamp":"2024-09-12T00:55:21.375847+0000","last_clean_scrub_stamp":"2024-09-12T00:55:21.375847+0000","objects_scrubbed":1,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:21.223181+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":24,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":129,"num_read_kb":129,"num_write":255,"num_write_kb":58,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"266'809","reported_seq":2303,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.643771+0000","last_change":"2024-09-12T00:54:44.643771+0000","last_active":"2024-09-12T00:54:44.643771+0000","last_peered":"2024-09-12T00:54:44.643771+0000","last_clean":"2024-09-12T00:54:44.643771+0000","last_became_active":"2024-09-12T00:11:47.932199+0000","last_became_peered":"2024-09-12T00:11:47.932199+0000","last_unstale":"2024-09-12T00:54:44.643771+0000","last_undegraded":"2024-09-12T00:54:44.643771+0000","last_fullsized":"2024-09-12T00:54:44.643771+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'809","last_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_deep_scrub":"266'809","last_deep_scrub_stamp":"2024-09-12T00:54:44.643588+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.643588+0000","objects_scrubbed":1,"log_size":109,"log_dups_size":700,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:53:50.445327+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3700,"num_read_kb":3317,"num_write":1055,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"266'197","reported_seq":843,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.551808+0000","last_change":"2024-09-12T00:54:39.551664+0000","last_active":"2024-09-12T00:54:39.551808+0000","last_peered":"2024-09-12T00:54:39.551808+0000","last_clean":"2024-09-12T00:54:39.551808+0000","last_became_active":"2024-09-12T00:11:45.957620+0000","last_became_peered":"2024-09-12T00:11:45.957620+0000","last_unstale":"2024-09-12T00:54:39.551808+0000","last_undegraded":"2024-09-12T00:54:39.551808+0000","last_fullsized":"2024-09-12T00:54:39.551808+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'197","last_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_deep_scrub":"266'197","last_deep_scrub_stamp":"2024-09-12T00:54:39.551438+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.551438+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:19:31.232360+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2449224,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":463,"num_read_kb":36400,"num_write":906,"num_write_kb":36628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,1],"acting":[5,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":504,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.287499+0000","last_change":"2024-09-12T00:55:04.287499+0000","last_active":"2024-09-12T00:55:04.287499+0000","last_peered":"2024-09-12T00:55:04.287499+0000","last_clean":"2024-09-12T00:55:04.287499+0000","last_became_active":"2024-09-12T00:11:49.927580+0000","last_became_peered":"2024-09-12T00:11:49.927580+0000","last_unstale":"2024-09-12T00:55:04.287499+0000","last_undegraded":"2024-09-12T00:55:04.287499+0000","last_fullsized":"2024-09-12T00:55:04.287499+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:04.287222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:04.287222+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.287222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:51:01.892615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"266'134","reported_seq":703,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.006533+0000","last_change":"2024-09-12T00:54:55.006533+0000","last_active":"2024-09-12T00:54:55.006533+0000","last_peered":"2024-09-12T00:54:55.006533+0000","last_clean":"2024-09-12T00:54:55.006533+0000","last_became_active":"2024-09-12T00:11:51.950312+0000","last_became_peered":"2024-09-12T00:11:51.950312+0000","last_unstale":"2024-09-12T00:54:55.006533+0000","last_undegraded":"2024-09-12T00:54:55.006533+0000","last_fullsized":"2024-09-12T00:54:55.006533+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'134","last_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_deep_scrub":"266'134","last_deep_scrub_stamp":"2024-09-12T00:54:55.006347+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.006347+0000","objects_scrubbed":4,"log_size":34,"log_dups_size":100,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:55:12.305618+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6499,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":172,"num_read_kb":240,"num_write":94,"num_write_kb":23,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.593010+0000","last_change":"2024-09-12T00:54:59.593010+0000","last_active":"2024-09-12T00:54:59.593010+0000","last_peered":"2024-09-12T00:54:59.593010+0000","last_clean":"2024-09-12T00:54:59.593010+0000","last_became_active":"2024-09-12T00:11:53.969284+0000","last_became_peered":"2024-09-12T00:11:53.969284+0000","last_unstale":"2024-09-12T00:54:59.593010+0000","last_undegraded":"2024-09-12T00:54:59.593010+0000","last_fullsized":"2024-09-12T00:54:59.593010+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.592584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.592584+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.592584+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:31:37.408039+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1f","version":"266'725","reported_seq":2115,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.172748+0000","last_change":"2024-09-12T00:54:56.172604+0000","last_active":"2024-09-12T00:54:56.172748+0000","last_peered":"2024-09-12T00:54:56.172748+0000","last_clean":"2024-09-12T00:54:56.172748+0000","last_became_active":"2024-09-12T00:11:47.943867+0000","last_became_peered":"2024-09-12T00:11:47.943867+0000","last_unstale":"2024-09-12T00:54:56.172748+0000","last_undegraded":"2024-09-12T00:54:56.172748+0000","last_fullsized":"2024-09-12T00:54:56.172748+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'725","last_scrub_stamp":"2024-09-12T00:54:56.172411+0000","last_deep_scrub":"266'725","last_deep_scrub_stamp":"2024-09-12T00:54:56.172411+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.172411+0000","objects_scrubbed":3,"log_size":25,"log_dups_size":700,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:19:04.190295+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3395,"num_read_kb":3053,"num_write":954,"num_write_kb":355,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":487,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"266'194","reported_seq":821,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.582575+0000","last_change":"2024-09-12T00:54:40.582437+0000","last_active":"2024-09-12T00:54:40.582575+0000","last_peered":"2024-09-12T00:54:40.582575+0000","last_clean":"2024-09-12T00:54:40.582575+0000","last_became_active":"2024-09-12T00:11:45.966704+0000","last_became_peered":"2024-09-12T00:11:45.966704+0000","last_unstale":"2024-09-12T00:54:40.582575+0000","last_undegraded":"2024-09-12T00:54:40.582575+0000","last_fullsized":"2024-09-12T00:54:40.582575+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'194","last_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_deep_scrub":"266'194","last_deep_scrub_stamp":"2024-09-12T00:54:40.582154+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.582154+0000","objects_scrubbed":6,"log_size":94,"log_dups_size":100,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:49:08.450282+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755647,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":390,"num_read_kb":8092,"num_write":868,"num_write_kb":38666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,3],"acting":[5,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:55.539786+0000","last_change":"2024-09-12T00:54:55.539786+0000","last_active":"2024-09-12T00:54:55.539786+0000","last_peered":"2024-09-12T00:54:55.539786+0000","last_clean":"2024-09-12T00:54:55.539786+0000","last_became_active":"2024-09-12T00:11:49.938518+0000","last_became_peered":"2024-09-12T00:11:49.938518+0000","last_unstale":"2024-09-12T00:54:55.539786+0000","last_undegraded":"2024-09-12T00:54:55.539786+0000","last_fullsized":"2024-09-12T00:54:55.539786+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:55.539573+0000","last_clean_scrub_stamp":"2024-09-12T00:54:55.539573+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:40:02.177277+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"266'205","reported_seq":847,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.614176+0000","last_change":"2024-09-12T00:55:01.614176+0000","last_active":"2024-09-12T00:55:01.614176+0000","last_peered":"2024-09-12T00:55:01.614176+0000","last_clean":"2024-09-12T00:55:01.614176+0000","last_became_active":"2024-09-12T00:11:51.954237+0000","last_became_peered":"2024-09-12T00:11:51.954237+0000","last_unstale":"2024-09-12T00:55:01.614176+0000","last_undegraded":"2024-09-12T00:55:01.614176+0000","last_fullsized":"2024-09-12T00:55:01.614176+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:55:01.613970+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:55:01.613970+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.613970+0000","objects_scrubbed":7,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:11.791579+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19799,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":308,"num_read_kb":407,"num_write":194,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":24194,"num_omap_keys":44,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":493,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.659749+0000","last_change":"2024-09-12T00:54:58.659749+0000","last_active":"2024-09-12T00:54:58.659749+0000","last_peered":"2024-09-12T00:54:58.659749+0000","last_clean":"2024-09-12T00:54:58.659749+0000","last_became_active":"2024-09-12T00:11:53.969445+0000","last_became_peered":"2024-09-12T00:11:53.969445+0000","last_unstale":"2024-09-12T00:54:58.659749+0000","last_undegraded":"2024-09-12T00:54:58.659749+0000","last_fullsized":"2024-09-12T00:54:58.659749+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:58.659661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:58.659661+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.659661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:13:52.061740+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"266'156","reported_seq":663,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:13.308323+0000","last_change":"2024-09-12T00:55:13.308323+0000","last_active":"2024-09-12T00:55:13.308323+0000","last_peered":"2024-09-12T00:55:13.308323+0000","last_clean":"2024-09-12T00:55:13.308323+0000","last_became_active":"2024-09-12T00:11:55.982026+0000","last_became_peered":"2024-09-12T00:11:55.982026+0000","last_unstale":"2024-09-12T00:55:13.308323+0000","last_undegraded":"2024-09-12T00:55:13.308323+0000","last_fullsized":"2024-09-12T00:55:13.308323+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T00:55:13.308134+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T00:55:13.308134+0000","last_clean_scrub_stamp":"2024-09-12T00:55:13.308134+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:45:49.799531+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":170,"num_read_kb":181,"num_write":360,"num_write_kb":91,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1e","version":"266'503","reported_seq":2231,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.793156+0000","last_change":"2024-09-12T00:54:49.793156+0000","last_active":"2024-09-12T00:54:49.793156+0000","last_peered":"2024-09-12T00:54:49.793156+0000","last_clean":"2024-09-12T00:54:49.793156+0000","last_became_active":"2024-09-12T00:11:47.929183+0000","last_became_peered":"2024-09-12T00:11:47.929183+0000","last_unstale":"2024-09-12T00:54:49.793156+0000","last_undegraded":"2024-09-12T00:54:49.793156+0000","last_fullsized":"2024-09-12T00:54:49.793156+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'503","last_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_deep_scrub":"266'503","last_deep_scrub_stamp":"2024-09-12T00:54:49.792973+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.792973+0000","objects_scrubbed":4,"log_size":103,"log_dups_size":400,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:41.396328+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2928,"num_read_kb":2743,"num_write":606,"num_write_kb":167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3754,"num_omap_keys":15,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.19","version":"266'205","reported_seq":881,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.723302+0000","last_change":"2024-09-12T00:54:37.723164+0000","last_active":"2024-09-12T00:54:37.723302+0000","last_peered":"2024-09-12T00:54:37.723302+0000","last_clean":"2024-09-12T00:54:37.723302+0000","last_became_active":"2024-09-12T00:11:45.930055+0000","last_became_peered":"2024-09-12T00:11:45.930055+0000","last_unstale":"2024-09-12T00:54:37.723302+0000","last_undegraded":"2024-09-12T00:54:37.723302+0000","last_fullsized":"2024-09-12T00:54:37.723302+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'205","last_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_deep_scrub":"266'205","last_deep_scrub_stamp":"2024-09-12T00:54:37.722978+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.722978+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":100,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:24:13.296272+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":547,"num_read_kb":23120,"num_write":969,"num_write_kb":31101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,1],"acting":[4,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.723243+0000","last_change":"2024-09-12T00:54:53.723086+0000","last_active":"2024-09-12T00:54:53.723243+0000","last_peered":"2024-09-12T00:54:53.723243+0000","last_clean":"2024-09-12T00:54:53.723243+0000","last_became_active":"2024-09-12T00:11:49.939392+0000","last_became_peered":"2024-09-12T00:11:49.939392+0000","last_unstale":"2024-09-12T00:54:53.723243+0000","last_undegraded":"2024-09-12T00:54:53.723243+0000","last_fullsized":"2024-09-12T00:54:53.723243+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.722892+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.722892+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:34:10.871247+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"266'173","reported_seq":762,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.218477+0000","last_change":"2024-09-12T00:55:09.218477+0000","last_active":"2024-09-12T00:55:09.218477+0000","last_peered":"2024-09-12T00:55:09.218477+0000","last_clean":"2024-09-12T00:55:09.218477+0000","last_became_active":"2024-09-12T00:11:51.939891+0000","last_became_peered":"2024-09-12T00:11:51.939891+0000","last_unstale":"2024-09-12T00:55:09.218477+0000","last_undegraded":"2024-09-12T00:55:09.218477+0000","last_fullsized":"2024-09-12T00:55:09.218477+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'173","last_scrub_stamp":"2024-09-12T00:55:09.218279+0000","last_deep_scrub":"266'173","last_deep_scrub_stamp":"2024-09-12T00:55:09.218279+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.218279+0000","objects_scrubbed":8,"log_size":73,"log_dups_size":100,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:00:19.404309+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7301,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":226,"num_read_kb":291,"num_write":146,"num_write_kb":47,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":11460,"num_omap_keys":24,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:07.330367+0000","last_change":"2024-09-12T00:55:07.330367+0000","last_active":"2024-09-12T00:55:07.330367+0000","last_peered":"2024-09-12T00:55:07.330367+0000","last_clean":"2024-09-12T00:55:07.330367+0000","last_became_active":"2024-09-12T00:11:53.968382+0000","last_became_peered":"2024-09-12T00:11:53.968382+0000","last_unstale":"2024-09-12T00:55:07.330367+0000","last_undegraded":"2024-09-12T00:55:07.330367+0000","last_fullsized":"2024-09-12T00:55:07.330367+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:07.330163+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:07.330163+0000","last_clean_scrub_stamp":"2024-09-12T00:55:07.330163+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:31:58.603458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.12","version":"266'197","reported_seq":1071,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:22.403183+0000","last_change":"2024-09-12T00:55:22.403183+0000","last_active":"2024-09-12T00:55:22.403183+0000","last_peered":"2024-09-12T00:55:22.403183+0000","last_clean":"2024-09-12T00:55:22.403183+0000","last_became_active":"2024-09-12T00:11:55.970116+0000","last_became_peered":"2024-09-12T00:11:55.970116+0000","last_unstale":"2024-09-12T00:55:22.403183+0000","last_undegraded":"2024-09-12T00:55:22.403183+0000","last_fullsized":"2024-09-12T00:55:22.403183+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'197","last_scrub_stamp":"2024-09-12T00:55:22.402946+0000","last_deep_scrub":"266'197","last_deep_scrub_stamp":"2024-09-12T00:55:22.402946+0000","last_clean_scrub_stamp":"2024-09-12T00:55:22.402946+0000","objects_scrubbed":5,"log_size":97,"log_dups_size":100,"ondisk_log_size":97,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:49:43.492226+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1199,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":614,"num_read_kb":609,"num_write":543,"num_write_kb":136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"266'811","reported_seq":2321,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.633649+0000","last_change":"2024-09-12T00:54:45.633649+0000","last_active":"2024-09-12T00:54:45.633649+0000","last_peered":"2024-09-12T00:54:45.633649+0000","last_clean":"2024-09-12T00:54:45.633649+0000","last_became_active":"2024-09-12T00:11:47.945941+0000","last_became_peered":"2024-09-12T00:11:47.945941+0000","last_unstale":"2024-09-12T00:54:45.633649+0000","last_undegraded":"2024-09-12T00:54:45.633649+0000","last_fullsized":"2024-09-12T00:54:45.633649+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'811","last_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_deep_scrub":"266'811","last_deep_scrub_stamp":"2024-09-12T00:54:45.633450+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.633450+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":700,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:15:59.575094+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3844,"num_read_kb":3443,"num_write":1096,"num_write_kb":419,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1a","version":"266'210","reported_seq":822,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.236261+0000","last_change":"2024-09-12T00:54:38.236261+0000","last_active":"2024-09-12T00:54:38.236261+0000","last_peered":"2024-09-12T00:54:38.236261+0000","last_clean":"2024-09-12T00:54:38.236261+0000","last_became_active":"2024-09-12T00:11:45.950387+0000","last_became_peered":"2024-09-12T00:11:45.950387+0000","last_unstale":"2024-09-12T00:54:38.236261+0000","last_undegraded":"2024-09-12T00:54:38.236261+0000","last_fullsized":"2024-09-12T00:54:38.236261+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:38.236030+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.236030+0000","objects_scrubbed":2,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:37:45.112722+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":380,"num_read_kb":5549,"num_write":1015,"num_write_kb":44722,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.754225+0000","last_change":"2024-09-12T00:54:51.754225+0000","last_active":"2024-09-12T00:54:51.754225+0000","last_peered":"2024-09-12T00:54:51.754225+0000","last_clean":"2024-09-12T00:54:51.754225+0000","last_became_active":"2024-09-12T00:11:49.931699+0000","last_became_peered":"2024-09-12T00:11:49.931699+0000","last_unstale":"2024-09-12T00:54:51.754225+0000","last_undegraded":"2024-09-12T00:54:51.754225+0000","last_fullsized":"2024-09-12T00:54:51.754225+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.753927+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.753927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:03:23.486364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"266'155","reported_seq":745,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:00.612955+0000","last_change":"2024-09-12T00:55:00.612740+0000","last_active":"2024-09-12T00:55:00.612955+0000","last_peered":"2024-09-12T00:55:00.612955+0000","last_clean":"2024-09-12T00:55:00.612955+0000","last_became_active":"2024-09-12T00:11:51.946830+0000","last_became_peered":"2024-09-12T00:11:51.946830+0000","last_unstale":"2024-09-12T00:55:00.612955+0000","last_undegraded":"2024-09-12T00:55:00.612955+0000","last_fullsized":"2024-09-12T00:55:00.612955+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'155","last_scrub_stamp":"2024-09-12T00:55:00.612507+0000","last_deep_scrub":"266'155","last_deep_scrub_stamp":"2024-09-12T00:55:00.612507+0000","last_clean_scrub_stamp":"2024-09-12T00:55:00.612507+0000","objects_scrubbed":6,"log_size":55,"log_dups_size":100,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:13:41.877171+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":186,"num_read_kb":226,"num_write":104,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":500,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.598646+0000","last_change":"2024-09-12T00:54:58.598646+0000","last_active":"2024-09-12T00:54:58.598646+0000","last_peered":"2024-09-12T00:54:58.598646+0000","last_clean":"2024-09-12T00:54:58.598646+0000","last_became_active":"2024-09-12T00:11:53.965317+0000","last_became_peered":"2024-09-12T00:11:53.965317+0000","last_unstale":"2024-09-12T00:54:58.598646+0000","last_undegraded":"2024-09-12T00:54:58.598646+0000","last_fullsized":"2024-09-12T00:54:58.598646+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:58.598472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:58.598472+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.598472+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:19:24.699387+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.11","version":"266'156","reported_seq":653,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:19.355045+0000","last_change":"2024-09-12T00:55:19.355045+0000","last_active":"2024-09-12T00:55:19.355045+0000","last_peered":"2024-09-12T00:55:19.355045+0000","last_clean":"2024-09-12T00:55:19.355045+0000","last_became_active":"2024-09-12T00:11:55.983552+0000","last_became_peered":"2024-09-12T00:11:55.983552+0000","last_unstale":"2024-09-12T00:55:19.355045+0000","last_undegraded":"2024-09-12T00:55:19.355045+0000","last_fullsized":"2024-09-12T00:55:19.355045+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'156","last_scrub_stamp":"2024-09-12T00:55:19.354855+0000","last_deep_scrub":"266'156","last_deep_scrub_stamp":"2024-09-12T00:55:19.354855+0000","last_clean_scrub_stamp":"2024-09-12T00:55:19.354855+0000","objects_scrubbed":3,"log_size":56,"log_dups_size":100,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:52:44.141717+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":383,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":123,"num_read_kb":120,"num_write":346,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"266'791","reported_seq":2435,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.743302+0000","last_change":"2024-09-12T00:54:47.743302+0000","last_active":"2024-09-12T00:54:47.743302+0000","last_peered":"2024-09-12T00:54:47.743302+0000","last_clean":"2024-09-12T00:54:47.743302+0000","last_became_active":"2024-09-12T00:11:47.952777+0000","last_became_peered":"2024-09-12T00:11:47.952777+0000","last_unstale":"2024-09-12T00:54:47.743302+0000","last_undegraded":"2024-09-12T00:54:47.743302+0000","last_fullsized":"2024-09-12T00:54:47.743302+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'791","last_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_deep_scrub":"266'791","last_deep_scrub_stamp":"2024-09-12T00:54:47.743080+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.743080+0000","objects_scrubbed":2,"log_size":91,"log_dups_size":700,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:49:25.272707+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3790,"num_read_kb":3437,"num_write":1005,"num_write_kb":341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1b","version":"266'210","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.734334+0000","last_change":"2024-09-12T00:54:41.734334+0000","last_active":"2024-09-12T00:54:41.734334+0000","last_peered":"2024-09-12T00:54:41.734334+0000","last_clean":"2024-09-12T00:54:41.734334+0000","last_became_active":"2024-09-12T00:11:45.932324+0000","last_became_peered":"2024-09-12T00:11:45.932324+0000","last_unstale":"2024-09-12T00:54:41.734334+0000","last_undegraded":"2024-09-12T00:54:41.734334+0000","last_fullsized":"2024-09-12T00:54:41.734334+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:41.734103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.734103+0000","objects_scrubbed":6,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:17:03.931010+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1993302,"num_objects":6,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":525,"num_read_kb":30758,"num_write":1020,"num_write_kb":20733,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":505,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.755305+0000","last_change":"2024-09-12T00:54:59.755305+0000","last_active":"2024-09-12T00:54:59.755305+0000","last_peered":"2024-09-12T00:54:59.755305+0000","last_clean":"2024-09-12T00:54:59.755305+0000","last_became_active":"2024-09-12T00:11:49.943967+0000","last_became_peered":"2024-09-12T00:11:49.943967+0000","last_unstale":"2024-09-12T00:54:59.755305+0000","last_undegraded":"2024-09-12T00:54:59.755305+0000","last_fullsized":"2024-09-12T00:54:59.755305+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:59.755091+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:59.755091+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.755091+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:04:30.296128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1e","version":"266'103","reported_seq":637,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:11.263209+0000","last_change":"2024-09-12T00:55:11.263209+0000","last_active":"2024-09-12T00:55:11.263209+0000","last_peered":"2024-09-12T00:55:11.263209+0000","last_clean":"2024-09-12T00:55:11.263209+0000","last_became_active":"2024-09-12T00:11:51.937986+0000","last_became_peered":"2024-09-12T00:11:51.937986+0000","last_unstale":"2024-09-12T00:55:11.263209+0000","last_undegraded":"2024-09-12T00:55:11.263209+0000","last_fullsized":"2024-09-12T00:55:11.263209+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'103","last_scrub_stamp":"2024-09-12T00:55:11.262951+0000","last_deep_scrub":"266'103","last_deep_scrub_stamp":"2024-09-12T00:55:11.262951+0000","last_clean_scrub_stamp":"2024-09-12T00:55:11.262951+0000","objects_scrubbed":8,"log_size":103,"log_dups_size":0,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:50:45.225247+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":125,"num_read_kb":118,"num_write":136,"num_write_kb":76,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":18240,"num_omap_keys":46,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"266'756","reported_seq":2398,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:59.048217+0000","last_change":"2024-09-12T00:54:59.048059+0000","last_active":"2024-09-12T00:54:59.048217+0000","last_peered":"2024-09-12T00:54:59.048217+0000","last_clean":"2024-09-12T00:54:59.048217+0000","last_became_active":"2024-09-12T00:11:53.943926+0000","last_became_peered":"2024-09-12T00:11:53.943926+0000","last_unstale":"2024-09-12T00:54:59.048217+0000","last_undegraded":"2024-09-12T00:54:59.048217+0000","last_fullsized":"2024-09-12T00:54:59.048217+0000","mapping_epoch":33,"log_start":"266'700","ondisk_log_start":"266'700","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'756","last_scrub_stamp":"2024-09-12T00:54:59.047863+0000","last_deep_scrub":"266'756","last_deep_scrub_stamp":"2024-09-12T00:54:59.047863+0000","last_clean_scrub_stamp":"2024-09-12T00:54:59.047863+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":700,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:28:11.693776+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.10","version":"266'130","reported_seq":648,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:17.285920+0000","last_change":"2024-09-12T00:55:17.285920+0000","last_active":"2024-09-12T00:55:17.285920+0000","last_peered":"2024-09-12T00:55:17.285920+0000","last_clean":"2024-09-12T00:55:17.285920+0000","last_became_active":"2024-09-12T00:11:55.961234+0000","last_became_peered":"2024-09-12T00:11:55.961234+0000","last_unstale":"2024-09-12T00:55:17.285920+0000","last_undegraded":"2024-09-12T00:55:17.285920+0000","last_fullsized":"2024-09-12T00:55:17.285920+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'130","last_scrub_stamp":"2024-09-12T00:55:17.285747+0000","last_deep_scrub":"266'130","last_deep_scrub_stamp":"2024-09-12T00:55:17.285747+0000","last_clean_scrub_stamp":"2024-09-12T00:55:17.285747+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":100,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:15:44.686218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":187,"num_read_kb":169,"num_write":333,"num_write_kb":77,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"266'465","reported_seq":1954,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.746619+0000","last_change":"2024-09-12T00:54:46.746619+0000","last_active":"2024-09-12T00:54:46.746619+0000","last_peered":"2024-09-12T00:54:46.746619+0000","last_clean":"2024-09-12T00:54:46.746619+0000","last_became_active":"2024-09-12T00:11:47.941643+0000","last_became_peered":"2024-09-12T00:11:47.941643+0000","last_unstale":"2024-09-12T00:54:46.746619+0000","last_undegraded":"2024-09-12T00:54:46.746619+0000","last_fullsized":"2024-09-12T00:54:46.746619+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'465","last_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_deep_scrub":"266'465","last_deep_scrub_stamp":"2024-09-12T00:54:46.746430+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.746430+0000","objects_scrubbed":1,"log_size":65,"log_dups_size":400,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:06:31.460666+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2298,"num_read_kb":2148,"num_write":542,"num_write_kb":124,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"266'218","reported_seq":870,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.261923+0000","last_change":"2024-09-12T00:54:39.261923+0000","last_active":"2024-09-12T00:54:39.261923+0000","last_peered":"2024-09-12T00:54:39.261923+0000","last_clean":"2024-09-12T00:54:39.261923+0000","last_became_active":"2024-09-12T00:11:45.950370+0000","last_became_peered":"2024-09-12T00:11:45.950370+0000","last_unstale":"2024-09-12T00:54:39.261923+0000","last_undegraded":"2024-09-12T00:54:39.261923+0000","last_fullsized":"2024-09-12T00:54:39.261923+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'218","last_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_deep_scrub":"266'218","last_deep_scrub_stamp":"2024-09-12T00:54:39.261665+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.261665+0000","objects_scrubbed":10,"log_size":18,"log_dups_size":200,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:02:35.988750+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":457849,"num_objects":10,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":464,"num_read_kb":55718,"num_write":1000,"num_write_kb":47512,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,5],"acting":[1,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.492143+0000","last_change":"2024-09-12T00:54:53.492143+0000","last_active":"2024-09-12T00:54:53.492143+0000","last_peered":"2024-09-12T00:54:53.492143+0000","last_clean":"2024-09-12T00:54:53.492143+0000","last_became_active":"2024-09-12T00:11:49.916617+0000","last_became_peered":"2024-09-12T00:11:49.916617+0000","last_unstale":"2024-09-12T00:54:53.492143+0000","last_undegraded":"2024-09-12T00:54:53.492143+0000","last_fullsized":"2024-09-12T00:54:53.492143+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:53.491956+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.491956+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:20:33.502230+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"266'199","reported_seq":808,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.068069+0000","last_change":"2024-09-12T00:54:58.067933+0000","last_active":"2024-09-12T00:54:58.068069+0000","last_peered":"2024-09-12T00:54:58.068069+0000","last_clean":"2024-09-12T00:54:58.068069+0000","last_became_active":"2024-09-12T00:11:51.941962+0000","last_became_peered":"2024-09-12T00:11:51.941962+0000","last_unstale":"2024-09-12T00:54:58.068069+0000","last_undegraded":"2024-09-12T00:54:58.068069+0000","last_fullsized":"2024-09-12T00:54:58.068069+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'199","last_scrub_stamp":"2024-09-12T00:54:58.067708+0000","last_deep_scrub":"266'199","last_deep_scrub_stamp":"2024-09-12T00:54:58.067708+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.067708+0000","objects_scrubbed":11,"log_size":99,"log_dups_size":100,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:46:43.132974+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9612,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":245,"num_read_kb":305,"num_write":140,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":498,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:09.650304+0000","last_change":"2024-09-12T00:55:09.650138+0000","last_active":"2024-09-12T00:55:09.650304+0000","last_peered":"2024-09-12T00:55:09.650304+0000","last_clean":"2024-09-12T00:55:09.650304+0000","last_became_active":"2024-09-12T00:11:53.967682+0000","last_became_peered":"2024-09-12T00:11:53.967682+0000","last_unstale":"2024-09-12T00:55:09.650304+0000","last_undegraded":"2024-09-12T00:55:09.650304+0000","last_fullsized":"2024-09-12T00:55:09.650304+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:09.649922+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:09.649922+0000","last_clean_scrub_stamp":"2024-09-12T00:55:09.649922+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:36:45.268590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"266'127","reported_seq":635,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:04.659676+0000","last_change":"2024-09-12T00:55:04.659536+0000","last_active":"2024-09-12T00:55:04.659676+0000","last_peered":"2024-09-12T00:55:04.659676+0000","last_clean":"2024-09-12T00:55:04.659676+0000","last_became_active":"2024-09-12T00:11:55.975089+0000","last_became_peered":"2024-09-12T00:11:55.975089+0000","last_unstale":"2024-09-12T00:55:04.659676+0000","last_undegraded":"2024-09-12T00:55:04.659676+0000","last_fullsized":"2024-09-12T00:55:04.659676+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'127","last_scrub_stamp":"2024-09-12T00:55:04.659361+0000","last_deep_scrub":"266'127","last_deep_scrub_stamp":"2024-09-12T00:55:04.659361+0000","last_clean_scrub_stamp":"2024-09-12T00:55:04.659361+0000","objects_scrubbed":3,"log_size":27,"log_dups_size":100,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:47:16.848398+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":219,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":109,"num_read_kb":107,"num_write":288,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"266'929","reported_seq":2641,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.729243+0000","last_change":"2024-09-12T00:54:50.729243+0000","last_active":"2024-09-12T00:54:50.729243+0000","last_peered":"2024-09-12T00:54:50.729243+0000","last_clean":"2024-09-12T00:54:50.729243+0000","last_became_active":"2024-09-12T00:11:47.940003+0000","last_became_peered":"2024-09-12T00:11:47.940003+0000","last_unstale":"2024-09-12T00:54:50.729243+0000","last_undegraded":"2024-09-12T00:54:50.729243+0000","last_fullsized":"2024-09-12T00:54:50.729243+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:50.729071+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.729071+0000","objects_scrubbed":6,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:49:45.264752+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4370,"num_read_kb":3931,"num_write":1208,"num_write_kb":438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":930,"num_omap_keys":4,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"266'221","reported_seq":846,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.188603+0000","last_change":"2024-09-12T00:54:47.188603+0000","last_active":"2024-09-12T00:54:47.188603+0000","last_peered":"2024-09-12T00:54:47.188603+0000","last_clean":"2024-09-12T00:54:47.188603+0000","last_became_active":"2024-09-12T00:11:45.929790+0000","last_became_peered":"2024-09-12T00:11:45.929790+0000","last_unstale":"2024-09-12T00:54:47.188603+0000","last_undegraded":"2024-09-12T00:54:47.188603+0000","last_fullsized":"2024-09-12T00:54:47.188603+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'221","last_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_deep_scrub":"266'221","last_deep_scrub_stamp":"2024-09-12T00:54:47.188407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.188407+0000","objects_scrubbed":1,"log_size":21,"log_dups_size":200,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:41:18.153988+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":417,"num_read_kb":8883,"num_write":990,"num_write_kb":32035,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":501,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:52.762197+0000","last_change":"2024-09-12T00:54:52.762197+0000","last_active":"2024-09-12T00:54:52.762197+0000","last_peered":"2024-09-12T00:54:52.762197+0000","last_clean":"2024-09-12T00:54:52.762197+0000","last_became_active":"2024-09-12T00:11:49.932293+0000","last_became_peered":"2024-09-12T00:11:49.932293+0000","last_unstale":"2024-09-12T00:54:52.762197+0000","last_undegraded":"2024-09-12T00:54:52.762197+0000","last_fullsized":"2024-09-12T00:54:52.762197+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:52.761997+0000","last_clean_scrub_stamp":"2024-09-12T00:54:52.761997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:36:26.003820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"266'137","reported_seq":720,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:05.623381+0000","last_change":"2024-09-12T00:55:05.623154+0000","last_active":"2024-09-12T00:55:05.623381+0000","last_peered":"2024-09-12T00:55:05.623381+0000","last_clean":"2024-09-12T00:55:05.623381+0000","last_became_active":"2024-09-12T00:11:51.947679+0000","last_became_peered":"2024-09-12T00:11:51.947679+0000","last_unstale":"2024-09-12T00:55:05.623381+0000","last_undegraded":"2024-09-12T00:55:05.623381+0000","last_fullsized":"2024-09-12T00:55:05.623381+0000","mapping_epoch":31,"log_start":"266'100","ondisk_log_start":"266'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'137","last_scrub_stamp":"2024-09-12T00:55:05.622864+0000","last_deep_scrub":"266'137","last_deep_scrub_stamp":"2024-09-12T00:55:05.622864+0000","last_clean_scrub_stamp":"2024-09-12T00:55:05.622864+0000","objects_scrubbed":5,"log_size":37,"log_dups_size":100,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:05:28.404950+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8650,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":173,"num_read_kb":258,"num_write":92,"num_write_kb":27,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":496,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:16.292959+0000","last_change":"2024-09-12T00:55:16.292827+0000","last_active":"2024-09-12T00:55:16.292959+0000","last_peered":"2024-09-12T00:55:16.292959+0000","last_clean":"2024-09-12T00:55:16.292959+0000","last_became_active":"2024-09-12T00:11:53.963722+0000","last_became_peered":"2024-09-12T00:11:53.963722+0000","last_unstale":"2024-09-12T00:55:16.292959+0000","last_undegraded":"2024-09-12T00:55:16.292959+0000","last_fullsized":"2024-09-12T00:55:16.292959+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:16.292642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:16.292642+0000","last_clean_scrub_stamp":"2024-09-12T00:55:16.292642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:58:02.147093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"266'124","reported_seq":652,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:15.282681+0000","last_change":"2024-09-12T00:55:15.282529+0000","last_active":"2024-09-12T00:55:15.282681+0000","last_peered":"2024-09-12T00:55:15.282681+0000","last_clean":"2024-09-12T00:55:15.282681+0000","last_became_active":"2024-09-12T00:11:55.982706+0000","last_became_peered":"2024-09-12T00:11:55.982706+0000","last_unstale":"2024-09-12T00:55:15.282681+0000","last_undegraded":"2024-09-12T00:55:15.282681+0000","last_fullsized":"2024-09-12T00:55:15.282681+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'124","last_scrub_stamp":"2024-09-12T00:55:15.282342+0000","last_deep_scrub":"266'124","last_deep_scrub_stamp":"2024-09-12T00:55:15.282342+0000","last_clean_scrub_stamp":"2024-09-12T00:55:15.282342+0000","objects_scrubbed":2,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:55:46.675309+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":950,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":175,"num_write":298,"num_write_kb":67,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.19","version":"266'511","reported_seq":2140,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.644913+0000","last_change":"2024-09-12T00:54:42.644781+0000","last_active":"2024-09-12T00:54:42.644913+0000","last_peered":"2024-09-12T00:54:42.644913+0000","last_clean":"2024-09-12T00:54:42.644913+0000","last_became_active":"2024-09-12T00:11:47.945131+0000","last_became_peered":"2024-09-12T00:11:47.945131+0000","last_unstale":"2024-09-12T00:54:42.644913+0000","last_undegraded":"2024-09-12T00:54:42.644913+0000","last_fullsized":"2024-09-12T00:54:42.644913+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'511","last_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_deep_scrub":"266'511","last_deep_scrub_stamp":"2024-09-12T00:54:42.644589+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.644589+0000","objects_scrubbed":1,"log_size":111,"log_dups_size":400,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:54:44.947353+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2797,"num_read_kb":2612,"num_write":618,"num_write_kb":168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1e","version":"266'213","reported_seq":838,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.537375+0000","last_change":"2024-09-12T00:54:41.537375+0000","last_active":"2024-09-12T00:54:41.537375+0000","last_peered":"2024-09-12T00:54:41.537375+0000","last_clean":"2024-09-12T00:54:41.537375+0000","last_became_active":"2024-09-12T00:11:45.964188+0000","last_became_peered":"2024-09-12T00:11:45.964188+0000","last_unstale":"2024-09-12T00:54:41.537375+0000","last_undegraded":"2024-09-12T00:54:41.537375+0000","last_fullsized":"2024-09-12T00:54:41.537375+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'213","last_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_deep_scrub":"266'213","last_deep_scrub_stamp":"2024-09-12T00:54:41.537037+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.537037+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":200,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:18:47.685748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":42,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":449,"num_read_kb":6403,"num_write":967,"num_write_kb":15539,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,3],"acting":[5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":509,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.497212+0000","last_change":"2024-09-12T00:54:51.497088+0000","last_active":"2024-09-12T00:54:51.497212+0000","last_peered":"2024-09-12T00:54:51.497212+0000","last_clean":"2024-09-12T00:54:51.497212+0000","last_became_active":"2024-09-12T00:11:49.915019+0000","last_became_peered":"2024-09-12T00:11:49.915019+0000","last_unstale":"2024-09-12T00:54:51.497212+0000","last_undegraded":"2024-09-12T00:54:51.497212+0000","last_fullsized":"2024-09-12T00:54:51.497212+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:54:51.496915+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.496915+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:46:10.499895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"266'104","reported_seq":675,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.550906+0000","last_change":"2024-09-12T00:54:58.550906+0000","last_active":"2024-09-12T00:54:58.550906+0000","last_peered":"2024-09-12T00:54:58.550906+0000","last_clean":"2024-09-12T00:54:58.550906+0000","last_became_active":"2024-09-12T00:11:51.933461+0000","last_became_peered":"2024-09-12T00:11:51.933461+0000","last_unstale":"2024-09-12T00:54:58.550906+0000","last_undegraded":"2024-09-12T00:54:58.550906+0000","last_fullsized":"2024-09-12T00:54:58.550906+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'104","last_scrub_stamp":"2024-09-12T00:54:58.550730+0000","last_deep_scrub":"266'104","last_deep_scrub_stamp":"2024-09-12T00:54:58.550730+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.550730+0000","objects_scrubbed":3,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:23:46.144209+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6212,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":135,"num_read_kb":203,"num_write":64,"num_write_kb":17,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":495,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:18.318007+0000","last_change":"2024-09-12T00:55:18.318007+0000","last_active":"2024-09-12T00:55:18.318007+0000","last_peered":"2024-09-12T00:55:18.318007+0000","last_clean":"2024-09-12T00:55:18.318007+0000","last_became_active":"2024-09-12T00:11:53.952411+0000","last_became_peered":"2024-09-12T00:11:53.952411+0000","last_unstale":"2024-09-12T00:55:18.318007+0000","last_undegraded":"2024-09-12T00:55:18.318007+0000","last_fullsized":"2024-09-12T00:55:18.318007+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:18.317784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:18.317784+0000","last_clean_scrub_stamp":"2024-09-12T00:55:18.317784+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:40:55.970944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"266'170","reported_seq":1304,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:20.393568+0000","last_change":"2024-09-12T00:55:20.393332+0000","last_active":"2024-09-12T00:55:20.393568+0000","last_peered":"2024-09-12T00:55:20.393568+0000","last_clean":"2024-09-12T00:55:20.393568+0000","last_became_active":"2024-09-12T00:11:55.976859+0000","last_became_peered":"2024-09-12T00:11:55.976859+0000","last_unstale":"2024-09-12T00:55:20.393568+0000","last_undegraded":"2024-09-12T00:55:20.393568+0000","last_fullsized":"2024-09-12T00:55:20.393568+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'170","last_scrub_stamp":"2024-09-12T00:55:20.393104+0000","last_deep_scrub":"266'170","last_deep_scrub_stamp":"2024-09-12T00:55:20.393104+0000","last_clean_scrub_stamp":"2024-09-12T00:55:20.393104+0000","objects_scrubbed":4,"log_size":70,"log_dups_size":100,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:57:48.265773+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":400,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":892,"num_read_kb":860,"num_write":392,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"266'393","reported_seq":1795,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.733300+0000","last_change":"2024-09-12T00:54:47.733121+0000","last_active":"2024-09-12T00:54:47.733300+0000","last_peered":"2024-09-12T00:54:47.733300+0000","last_clean":"2024-09-12T00:54:47.733300+0000","last_became_active":"2024-09-12T00:11:47.935624+0000","last_became_peered":"2024-09-12T00:11:47.935624+0000","last_unstale":"2024-09-12T00:54:47.733300+0000","last_undegraded":"2024-09-12T00:54:47.733300+0000","last_fullsized":"2024-09-12T00:54:47.733300+0000","mapping_epoch":27,"log_start":"266'300","ondisk_log_start":"266'300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'393","last_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_deep_scrub":"266'393","last_deep_scrub_stamp":"2024-09-12T00:54:47.732939+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.732939+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":300,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:14:53.184825+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1998,"num_read_kb":1888,"num_write":456,"num_write_kb":93,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":474,"num_omap_keys":2,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"266'225","reported_seq":863,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.578613+0000","last_change":"2024-09-12T00:54:44.578362+0000","last_active":"2024-09-12T00:54:44.578613+0000","last_peered":"2024-09-12T00:54:44.578613+0000","last_clean":"2024-09-12T00:54:44.578613+0000","last_became_active":"2024-09-12T00:11:45.959651+0000","last_became_peered":"2024-09-12T00:11:45.959651+0000","last_unstale":"2024-09-12T00:54:44.578613+0000","last_undegraded":"2024-09-12T00:54:44.578613+0000","last_fullsized":"2024-09-12T00:54:44.578613+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'225","last_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_deep_scrub":"266'225","last_deep_scrub_stamp":"2024-09-12T00:54:44.577941+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.577941+0000","objects_scrubbed":5,"log_size":25,"log_dups_size":200,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:19:23.931116+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262170,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":457,"num_read_kb":20983,"num_write":1046,"num_write_kb":28907,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.19","version":"266'2","reported_seq":508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:58.760660+0000","last_change":"2024-09-12T00:54:58.760497+0000","last_active":"2024-09-12T00:54:58.760660+0000","last_peered":"2024-09-12T00:54:58.760660+0000","last_clean":"2024-09-12T00:54:58.760660+0000","last_became_active":"2024-09-12T00:11:49.934226+0000","last_became_peered":"2024-09-12T00:11:49.934226+0000","last_unstale":"2024-09-12T00:54:58.760660+0000","last_undegraded":"2024-09-12T00:54:58.760660+0000","last_fullsized":"2024-09-12T00:54:58.760660+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'2","last_scrub_stamp":"2024-09-12T00:54:58.760309+0000","last_deep_scrub":"266'2","last_deep_scrub_stamp":"2024-09-12T00:54:58.760309+0000","last_clean_scrub_stamp":"2024-09-12T00:54:58.760309+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T10:01:46.076140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1a","version":"266'183","reported_seq":785,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:12.285066+0000","last_change":"2024-09-12T00:55:12.285066+0000","last_active":"2024-09-12T00:55:12.285066+0000","last_peered":"2024-09-12T00:55:12.285066+0000","last_clean":"2024-09-12T00:55:12.285066+0000","last_became_active":"2024-09-12T00:11:51.952816+0000","last_became_peered":"2024-09-12T00:11:51.952816+0000","last_unstale":"2024-09-12T00:55:12.285066+0000","last_undegraded":"2024-09-12T00:55:12.285066+0000","last_fullsized":"2024-09-12T00:55:12.285066+0000","mapping_epoch":31,"log_start":"263'100","ondisk_log_start":"263'100","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'183","last_scrub_stamp":"2024-09-12T00:55:12.284872+0000","last_deep_scrub":"266'183","last_deep_scrub_stamp":"2024-09-12T00:55:12.284872+0000","last_clean_scrub_stamp":"2024-09-12T00:55:12.284872+0000","objects_scrubbed":6,"log_size":83,"log_dups_size":100,"ondisk_log_size":83,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:04:35.221329+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":9188,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":235,"num_read_kb":326,"num_write":136,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":497,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:10.672605+0000","last_change":"2024-09-12T00:55:10.672605+0000","last_active":"2024-09-12T00:55:10.672605+0000","last_peered":"2024-09-12T00:55:10.672605+0000","last_clean":"2024-09-12T00:55:10.672605+0000","last_became_active":"2024-09-12T00:11:53.964118+0000","last_became_peered":"2024-09-12T00:11:53.964118+0000","last_unstale":"2024-09-12T00:55:10.672605+0000","last_undegraded":"2024-09-12T00:55:10.672605+0000","last_fullsized":"2024-09-12T00:55:10.672605+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-12T00:55:10.672416+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-12T00:55:10.672416+0000","last_clean_scrub_stamp":"2024-09-12T00:55:10.672416+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:16:01.038683+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.14","version":"266'124","reported_seq":621,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:55:01.100910+0000","last_change":"2024-09-12T00:55:01.100910+0000","last_active":"2024-09-12T00:55:01.100910+0000","last_peered":"2024-09-12T00:55:01.100910+0000","last_clean":"2024-09-12T00:55:01.100910+0000","last_became_active":"2024-09-12T00:11:55.972540+0000","last_became_peered":"2024-09-12T00:11:55.972540+0000","last_unstale":"2024-09-12T00:55:01.100910+0000","last_undegraded":"2024-09-12T00:55:01.100910+0000","last_fullsized":"2024-09-12T00:55:01.100910+0000","mapping_epoch":35,"log_start":"266'100","ondisk_log_start":"266'100","created":35,"last_epoch_clean":36,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'124","last_scrub_stamp":"2024-09-12T00:55:01.100722+0000","last_deep_scrub":"266'124","last_deep_scrub_stamp":"2024-09-12T00:55:01.100722+0000","last_clean_scrub_stamp":"2024-09-12T00:55:01.100722+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":100,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T02:22:17.235489+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":645,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":139,"num_read_kb":122,"num_write":296,"num_write_kb":68,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.27","version":"266'499","reported_seq":2033,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.741827+0000","last_change":"2024-09-12T00:54:48.741666+0000","last_active":"2024-09-12T00:54:48.741827+0000","last_peered":"2024-09-12T00:54:48.741827+0000","last_clean":"2024-09-12T00:54:48.741827+0000","last_became_active":"2024-09-12T00:11:47.933318+0000","last_became_peered":"2024-09-12T00:11:47.933318+0000","last_unstale":"2024-09-12T00:54:48.741827+0000","last_undegraded":"2024-09-12T00:54:48.741827+0000","last_fullsized":"2024-09-12T00:54:48.741827+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'499","last_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_deep_scrub":"266'499","last_deep_scrub_stamp":"2024-09-12T00:54:48.741497+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.741497+0000","objects_scrubbed":1,"log_size":99,"log_dups_size":400,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:57:24.293528+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2637,"num_read_kb":2435,"num_write":618,"num_write_kb":176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2556,"num_omap_keys":10,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.20","version":"266'193","reported_seq":854,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.748016+0000","last_change":"2024-09-12T00:54:40.747873+0000","last_active":"2024-09-12T00:54:40.748016+0000","last_peered":"2024-09-12T00:54:40.748016+0000","last_clean":"2024-09-12T00:54:40.748016+0000","last_became_active":"2024-09-12T00:11:45.927468+0000","last_became_peered":"2024-09-12T00:11:45.927468+0000","last_unstale":"2024-09-12T00:54:40.748016+0000","last_undegraded":"2024-09-12T00:54:40.748016+0000","last_fullsized":"2024-09-12T00:54:40.748016+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'193","last_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_deep_scrub":"266'193","last_deep_scrub_stamp":"2024-09-12T00:54:40.747645+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.747645+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":100,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:56:07.125444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1069312,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":485,"num_read_kb":61937,"num_write":920,"num_write_kb":36630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,3],"acting":[2,6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"266'819","reported_seq":2328,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.636401+0000","last_change":"2024-09-12T00:54:46.636159+0000","last_active":"2024-09-12T00:54:46.636401+0000","last_peered":"2024-09-12T00:54:46.636401+0000","last_clean":"2024-09-12T00:54:46.636401+0000","last_became_active":"2024-09-12T00:11:47.955493+0000","last_became_peered":"2024-09-12T00:11:47.955493+0000","last_unstale":"2024-09-12T00:54:46.636401+0000","last_undegraded":"2024-09-12T00:54:46.636401+0000","last_fullsized":"2024-09-12T00:54:46.636401+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'819","last_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_deep_scrub":"266'819","last_deep_scrub_stamp":"2024-09-12T00:54:46.635949+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.635949+0000","objects_scrubbed":3,"log_size":19,"log_dups_size":800,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:58:39.192196+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3733,"num_read_kb":3344,"num_write":1064,"num_write_kb":383,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1184,"num_omap_keys":5,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.21","version":"266'189","reported_seq":832,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.614966+0000","last_change":"2024-09-12T00:54:40.614805+0000","last_active":"2024-09-12T00:54:40.614966+0000","last_peered":"2024-09-12T00:54:40.614966+0000","last_clean":"2024-09-12T00:54:40.614966+0000","last_became_active":"2024-09-12T00:11:45.937323+0000","last_became_peered":"2024-09-12T00:11:45.937323+0000","last_unstale":"2024-09-12T00:54:40.614966+0000","last_undegraded":"2024-09-12T00:54:40.614966+0000","last_fullsized":"2024-09-12T00:54:40.614966+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'189","last_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_deep_scrub":"266'189","last_deep_scrub_stamp":"2024-09-12T00:54:40.614609+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.614609+0000","objects_scrubbed":2,"log_size":89,"log_dups_size":100,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:02:12.172432+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":418,"num_read_kb":18747,"num_write":861,"num_write_kb":33488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.25","version":"266'1207","reported_seq":2895,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:57.174934+0000","last_change":"2024-09-12T00:54:57.174792+0000","last_active":"2024-09-12T00:54:57.174934+0000","last_peered":"2024-09-12T00:54:57.174934+0000","last_clean":"2024-09-12T00:54:57.174934+0000","last_became_active":"2024-09-12T00:11:47.923051+0000","last_became_peered":"2024-09-12T00:11:47.923051+0000","last_unstale":"2024-09-12T00:54:57.174934+0000","last_undegraded":"2024-09-12T00:54:57.174934+0000","last_fullsized":"2024-09-12T00:54:57.174934+0000","mapping_epoch":27,"log_start":"266'1100","ondisk_log_start":"266'1100","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1207","last_scrub_stamp":"2024-09-12T00:54:57.174594+0000","last_deep_scrub":"266'1207","last_deep_scrub_stamp":"2024-09-12T00:54:57.174594+0000","last_clean_scrub_stamp":"2024-09-12T00:54:57.174594+0000","objects_scrubbed":7,"log_size":107,"log_dups_size":1100,"ondisk_log_size":107,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:36:27.434860+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":5586,"num_read_kb":4944,"num_write":1634,"num_write_kb":669,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4666,"num_omap_keys":19,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"266'209","reported_seq":855,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.227394+0000","last_change":"2024-09-12T00:54:46.227154+0000","last_active":"2024-09-12T00:54:46.227394+0000","last_peered":"2024-09-12T00:54:46.227394+0000","last_clean":"2024-09-12T00:54:46.227394+0000","last_became_active":"2024-09-12T00:11:45.955425+0000","last_became_peered":"2024-09-12T00:11:45.955425+0000","last_unstale":"2024-09-12T00:54:46.227394+0000","last_undegraded":"2024-09-12T00:54:46.227394+0000","last_fullsized":"2024-09-12T00:54:46.227394+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'209","last_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_deep_scrub":"266'209","last_deep_scrub_stamp":"2024-09-12T00:54:46.226930+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.226930+0000","objects_scrubbed":2,"log_size":109,"log_dups_size":100,"ondisk_log_size":109,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:14:33.782653+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5753496,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":438,"num_read_kb":35398,"num_write":969,"num_write_kb":45071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"266'475","reported_seq":2066,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:54.529028+0000","last_change":"2024-09-12T00:54:54.528895+0000","last_active":"2024-09-12T00:54:54.529028+0000","last_peered":"2024-09-12T00:54:54.529028+0000","last_clean":"2024-09-12T00:54:54.529028+0000","last_became_active":"2024-09-12T00:11:47.924065+0000","last_became_peered":"2024-09-12T00:11:47.924065+0000","last_unstale":"2024-09-12T00:54:54.529028+0000","last_undegraded":"2024-09-12T00:54:54.529028+0000","last_fullsized":"2024-09-12T00:54:54.529028+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'475","last_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_deep_scrub":"266'475","last_deep_scrub_stamp":"2024-09-12T00:54:54.528706+0000","last_clean_scrub_stamp":"2024-09-12T00:54:54.528706+0000","objects_scrubbed":4,"log_size":75,"log_dups_size":400,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:14.173614+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2556,"num_read_kb":2395,"num_write":565,"num_write_kb":140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2762,"num_omap_keys":11,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"266'203","reported_seq":840,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.586363+0000","last_change":"2024-09-12T00:54:42.586198+0000","last_active":"2024-09-12T00:54:42.586363+0000","last_peered":"2024-09-12T00:54:42.586363+0000","last_clean":"2024-09-12T00:54:42.586363+0000","last_became_active":"2024-09-12T00:11:45.959303+0000","last_became_peered":"2024-09-12T00:11:45.959303+0000","last_unstale":"2024-09-12T00:54:42.586363+0000","last_undegraded":"2024-09-12T00:54:42.586363+0000","last_fullsized":"2024-09-12T00:54:42.586363+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'203","last_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_deep_scrub":"266'203","last_deep_scrub_stamp":"2024-09-12T00:54:42.585972+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.585972+0000","objects_scrubbed":2,"log_size":103,"log_dups_size":100,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:30:44.593597+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":40,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":427,"num_read_kb":18770,"num_write":983,"num_write_kb":30736,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,0],"acting":[5,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.23","version":"266'806","reported_seq":2344,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:53.489507+0000","last_change":"2024-09-12T00:54:53.489353+0000","last_active":"2024-09-12T00:54:53.489507+0000","last_peered":"2024-09-12T00:54:53.489507+0000","last_clean":"2024-09-12T00:54:53.489507+0000","last_became_active":"2024-09-12T00:11:47.930660+0000","last_became_peered":"2024-09-12T00:11:47.930660+0000","last_unstale":"2024-09-12T00:54:53.489507+0000","last_undegraded":"2024-09-12T00:54:53.489507+0000","last_fullsized":"2024-09-12T00:54:53.489507+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'806","last_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_deep_scrub":"266'806","last_deep_scrub_stamp":"2024-09-12T00:54:53.489176+0000","last_clean_scrub_stamp":"2024-09-12T00:54:53.489176+0000","objects_scrubbed":3,"log_size":106,"log_dups_size":700,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T00:57:12.643319+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3820,"num_read_kb":3432,"num_write":1056,"num_write_kb":381,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.24","version":"266'248","reported_seq":928,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:40.497646+0000","last_change":"2024-09-12T00:54:40.497352+0000","last_active":"2024-09-12T00:54:40.497646+0000","last_peered":"2024-09-12T00:54:40.497646+0000","last_clean":"2024-09-12T00:54:40.497646+0000","last_became_active":"2024-09-12T00:11:45.937875+0000","last_became_peered":"2024-09-12T00:11:45.937875+0000","last_unstale":"2024-09-12T00:54:40.497646+0000","last_undegraded":"2024-09-12T00:54:40.497646+0000","last_fullsized":"2024-09-12T00:54:40.497646+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'248","last_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_deep_scrub":"266'248","last_deep_scrub_stamp":"2024-09-12T00:54:40.497103+0000","last_clean_scrub_stamp":"2024-09-12T00:54:40.497103+0000","objects_scrubbed":3,"log_size":48,"log_dups_size":200,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:15:25.148164+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1730143,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":614,"num_read_kb":28384,"num_write":1056,"num_write_kb":34436,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,3],"acting":[6,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.22","version":"266'478","reported_seq":1948,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.025614+0000","last_change":"2024-09-12T00:54:49.025475+0000","last_active":"2024-09-12T00:54:49.025614+0000","last_peered":"2024-09-12T00:54:49.025614+0000","last_clean":"2024-09-12T00:54:49.025614+0000","last_became_active":"2024-09-12T00:11:47.930572+0000","last_became_peered":"2024-09-12T00:11:47.930572+0000","last_unstale":"2024-09-12T00:54:49.025614+0000","last_undegraded":"2024-09-12T00:54:49.025614+0000","last_fullsized":"2024-09-12T00:54:49.025614+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'478","last_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_deep_scrub":"266'478","last_deep_scrub_stamp":"2024-09-12T00:54:49.025287+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.025287+0000","objects_scrubbed":2,"log_size":78,"log_dups_size":400,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:33:36.458555+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2485,"num_read_kb":2315,"num_write":614,"num_write_kb":210,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":432,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.25","version":"266'293","reported_seq":1114,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.541081+0000","last_change":"2024-09-12T00:54:41.540937+0000","last_active":"2024-09-12T00:54:41.541081+0000","last_peered":"2024-09-12T00:54:41.541081+0000","last_clean":"2024-09-12T00:54:41.541081+0000","last_became_active":"2024-09-12T00:11:45.937270+0000","last_became_peered":"2024-09-12T00:11:45.937270+0000","last_unstale":"2024-09-12T00:54:41.541081+0000","last_undegraded":"2024-09-12T00:54:41.541081+0000","last_fullsized":"2024-09-12T00:54:41.541081+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'293","last_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_deep_scrub":"266'293","last_deep_scrub_stamp":"2024-09-12T00:54:41.540710+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.540710+0000","objects_scrubbed":4,"log_size":93,"log_dups_size":200,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T03:43:24.383696+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1398,"num_read_kb":1619,"num_write":1277,"num_write_kb":28927,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.21","version":"266'613","reported_seq":2352,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.590795+0000","last_change":"2024-09-12T00:54:50.590571+0000","last_active":"2024-09-12T00:54:50.590795+0000","last_peered":"2024-09-12T00:54:50.590795+0000","last_clean":"2024-09-12T00:54:50.590795+0000","last_became_active":"2024-09-12T00:11:47.947838+0000","last_became_peered":"2024-09-12T00:11:47.947838+0000","last_unstale":"2024-09-12T00:54:50.590795+0000","last_undegraded":"2024-09-12T00:54:50.590795+0000","last_fullsized":"2024-09-12T00:54:50.590795+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'613","last_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_deep_scrub":"266'613","last_deep_scrub_stamp":"2024-09-12T00:54:50.590357+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.590357+0000","objects_scrubbed":2,"log_size":13,"log_dups_size":600,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:23:41.152978+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3134,"num_read_kb":2907,"num_write":741,"num_write_kb":230,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.26","version":"266'228","reported_seq":851,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:38.694402+0000","last_change":"2024-09-12T00:54:38.694245+0000","last_active":"2024-09-12T00:54:38.694402+0000","last_peered":"2024-09-12T00:54:38.694402+0000","last_clean":"2024-09-12T00:54:38.694402+0000","last_became_active":"2024-09-12T00:11:45.921283+0000","last_became_peered":"2024-09-12T00:11:45.921283+0000","last_unstale":"2024-09-12T00:54:38.694402+0000","last_undegraded":"2024-09-12T00:54:38.694402+0000","last_fullsized":"2024-09-12T00:54:38.694402+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'228","last_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_deep_scrub":"266'228","last_deep_scrub_stamp":"2024-09-12T00:54:38.693931+0000","last_clean_scrub_stamp":"2024-09-12T00:54:38.693931+0000","objects_scrubbed":7,"log_size":28,"log_dups_size":200,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:49:45.558338+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7916704,"num_objects":7,"num_object_clones":0,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":432,"num_read_kb":17177,"num_write":1053,"num_write_kb":47434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"266'1256","reported_seq":3025,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.314701+0000","last_change":"2024-09-12T00:54:41.314574+0000","last_active":"2024-09-12T00:54:41.314701+0000","last_peered":"2024-09-12T00:54:41.314701+0000","last_clean":"2024-09-12T00:54:41.314701+0000","last_became_active":"2024-09-12T00:11:47.924275+0000","last_became_peered":"2024-09-12T00:11:47.924275+0000","last_unstale":"2024-09-12T00:54:41.314701+0000","last_undegraded":"2024-09-12T00:54:41.314701+0000","last_fullsized":"2024-09-12T00:54:41.314701+0000","mapping_epoch":27,"log_start":"266'1200","ondisk_log_start":"266'1200","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1256","last_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_deep_scrub":"266'1256","last_deep_scrub_stamp":"2024-09-12T00:54:41.314407+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.314407+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":1200,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:19:58.492484+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5758,"num_read_kb":5097,"num_write":1710,"num_write_kb":675,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"266'277","reported_seq":931,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.614515+0000","last_change":"2024-09-12T00:54:43.614374+0000","last_active":"2024-09-12T00:54:43.614515+0000","last_peered":"2024-09-12T00:54:43.614515+0000","last_clean":"2024-09-12T00:54:43.614515+0000","last_became_active":"2024-09-12T00:11:45.962337+0000","last_became_peered":"2024-09-12T00:11:45.962337+0000","last_unstale":"2024-09-12T00:54:43.614515+0000","last_undegraded":"2024-09-12T00:54:43.614515+0000","last_fullsized":"2024-09-12T00:54:43.614515+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'277","last_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_deep_scrub":"266'277","last_deep_scrub_stamp":"2024-09-12T00:54:43.614131+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.614131+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":200,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:40:24.435399+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":525343,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":548,"num_read_kb":15585,"num_write":1267,"num_write_kb":40650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2f","version":"266'829","reported_seq":2413,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.567505+0000","last_change":"2024-09-12T00:54:48.567505+0000","last_active":"2024-09-12T00:54:48.567505+0000","last_peered":"2024-09-12T00:54:48.567505+0000","last_clean":"2024-09-12T00:54:48.567505+0000","last_became_active":"2024-09-12T00:11:47.950377+0000","last_became_peered":"2024-09-12T00:11:47.950377+0000","last_unstale":"2024-09-12T00:54:48.567505+0000","last_undegraded":"2024-09-12T00:54:48.567505+0000","last_fullsized":"2024-09-12T00:54:48.567505+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'829","last_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_deep_scrub":"266'829","last_deep_scrub_stamp":"2024-09-12T00:54:48.567318+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.567318+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":800,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:12:51.422110+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4040,"num_read_kb":3629,"num_write":1104,"num_write_kb":427,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2299,"num_omap_keys":9,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.28","version":"266'251","reported_seq":901,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.243891+0000","last_change":"2024-09-12T00:54:48.243735+0000","last_active":"2024-09-12T00:54:48.243891+0000","last_peered":"2024-09-12T00:54:48.243891+0000","last_clean":"2024-09-12T00:54:48.243891+0000","last_became_active":"2024-09-12T00:11:45.962902+0000","last_became_peered":"2024-09-12T00:11:45.962902+0000","last_unstale":"2024-09-12T00:54:48.243891+0000","last_undegraded":"2024-09-12T00:54:48.243891+0000","last_fullsized":"2024-09-12T00:54:48.243891+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'251","last_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_deep_scrub":"266'251","last_deep_scrub_stamp":"2024-09-12T00:54:48.243504+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.243504+0000","objects_scrubbed":9,"log_size":51,"log_dups_size":200,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:37:31.911455+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10118774,"num_objects":9,"num_object_clones":0,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":591,"num_read_kb":58641,"num_write":1118,"num_write_kb":31879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,7],"acting":[3,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"266'1328","reported_seq":2859,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.982053+0000","last_change":"2024-09-12T00:54:49.982053+0000","last_active":"2024-09-12T00:54:49.982053+0000","last_peered":"2024-09-12T00:54:49.982053+0000","last_clean":"2024-09-12T00:54:49.982053+0000","last_became_active":"2024-09-12T00:11:47.934116+0000","last_became_peered":"2024-09-12T00:11:47.934116+0000","last_unstale":"2024-09-12T00:54:49.982053+0000","last_undegraded":"2024-09-12T00:54:49.982053+0000","last_fullsized":"2024-09-12T00:54:49.982053+0000","mapping_epoch":27,"log_start":"266'1300","ondisk_log_start":"266'1300","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'1328","last_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_deep_scrub":"266'1328","last_deep_scrub_stamp":"2024-09-12T00:54:49.981823+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.981823+0000","objects_scrubbed":1,"log_size":28,"log_dups_size":1300,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T07:33:42.896076+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5943,"num_read_kb":5253,"num_write":1919,"num_write_kb":817,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.29","version":"266'196","reported_seq":824,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:45.530369+0000","last_change":"2024-09-12T00:54:45.530369+0000","last_active":"2024-09-12T00:54:45.530369+0000","last_peered":"2024-09-12T00:54:45.530369+0000","last_clean":"2024-09-12T00:54:45.530369+0000","last_became_active":"2024-09-12T00:11:45.958332+0000","last_became_peered":"2024-09-12T00:11:45.958332+0000","last_unstale":"2024-09-12T00:54:45.530369+0000","last_undegraded":"2024-09-12T00:54:45.530369+0000","last_fullsized":"2024-09-12T00:54:45.530369+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'196","last_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_deep_scrub":"266'196","last_deep_scrub_stamp":"2024-09-12T00:54:45.530104+0000","last_clean_scrub_stamp":"2024-09-12T00:54:45.530104+0000","objects_scrubbed":3,"log_size":96,"log_dups_size":100,"ondisk_log_size":96,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:20:31.515428+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":262331,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":450,"num_read_kb":34280,"num_write":929,"num_write_kb":27755,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,0],"acting":[5,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2d","version":"266'556","reported_seq":2112,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:56.490261+0000","last_change":"2024-09-12T00:54:56.490261+0000","last_active":"2024-09-12T00:54:56.490261+0000","last_peered":"2024-09-12T00:54:56.490261+0000","last_clean":"2024-09-12T00:54:56.490261+0000","last_became_active":"2024-09-12T00:11:47.935155+0000","last_became_peered":"2024-09-12T00:11:47.935155+0000","last_unstale":"2024-09-12T00:54:56.490261+0000","last_undegraded":"2024-09-12T00:54:56.490261+0000","last_fullsized":"2024-09-12T00:54:56.490261+0000","mapping_epoch":27,"log_start":"266'500","ondisk_log_start":"266'500","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'556","last_scrub_stamp":"2024-09-12T00:54:56.490065+0000","last_deep_scrub":"266'556","last_deep_scrub_stamp":"2024-09-12T00:54:56.490065+0000","last_clean_scrub_stamp":"2024-09-12T00:54:56.490065+0000","objects_scrubbed":5,"log_size":56,"log_dups_size":500,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T04:07:18.778279+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":2752,"num_read_kb":2532,"num_write":696,"num_write_kb":218,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1195,"num_omap_keys":5,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2a","version":"266'229","reported_seq":972,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:37.285793+0000","last_change":"2024-09-12T00:54:37.285793+0000","last_active":"2024-09-12T00:54:37.285793+0000","last_peered":"2024-09-12T00:54:37.285793+0000","last_clean":"2024-09-12T00:54:37.285793+0000","last_became_active":"2024-09-12T00:11:45.922466+0000","last_became_peered":"2024-09-12T00:11:45.922466+0000","last_unstale":"2024-09-12T00:54:37.285793+0000","last_undegraded":"2024-09-12T00:54:37.285793+0000","last_fullsized":"2024-09-12T00:54:37.285793+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'229","last_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_deep_scrub":"266'229","last_deep_scrub_stamp":"2024-09-12T00:54:37.285624+0000","last_clean_scrub_stamp":"2024-09-12T00:54:37.285624+0000","objects_scrubbed":5,"log_size":29,"log_dups_size":200,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:31.468189+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3460242,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":746,"num_read_kb":61726,"num_write":1110,"num_write_kb":25147,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,2],"acting":[1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"266'703","reported_seq":2508,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.427718+0000","last_change":"2024-09-12T00:54:47.427718+0000","last_active":"2024-09-12T00:54:47.427718+0000","last_peered":"2024-09-12T00:54:47.427718+0000","last_clean":"2024-09-12T00:54:47.427718+0000","last_became_active":"2024-09-12T00:11:47.935731+0000","last_became_peered":"2024-09-12T00:11:47.935731+0000","last_unstale":"2024-09-12T00:54:47.427718+0000","last_undegraded":"2024-09-12T00:54:47.427718+0000","last_fullsized":"2024-09-12T00:54:47.427718+0000","mapping_epoch":27,"log_start":"266'600","ondisk_log_start":"266'600","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'703","last_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_deep_scrub":"266'703","last_deep_scrub_stamp":"2024-09-12T00:54:47.427536+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.427536+0000","objects_scrubbed":3,"log_size":103,"log_dups_size":600,"ondisk_log_size":103,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:27.740664+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3686,"num_read_kb":3366,"num_write":986,"num_write_kb":430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"266'210","reported_seq":828,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:43.759263+0000","last_change":"2024-09-12T00:54:43.759263+0000","last_active":"2024-09-12T00:54:43.759263+0000","last_peered":"2024-09-12T00:54:43.759263+0000","last_clean":"2024-09-12T00:54:43.759263+0000","last_became_active":"2024-09-12T00:11:45.944116+0000","last_became_peered":"2024-09-12T00:11:45.944116+0000","last_unstale":"2024-09-12T00:54:43.759263+0000","last_undegraded":"2024-09-12T00:54:43.759263+0000","last_fullsized":"2024-09-12T00:54:43.759263+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:43.758895+0000","last_clean_scrub_stamp":"2024-09-12T00:54:43.758895+0000","objects_scrubbed":4,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:10:11.039233+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4457515,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":433,"num_read_kb":13749,"num_write":936,"num_write_kb":19654,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,6],"acting":[4,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.2b","version":"266'966","reported_seq":2529,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:44.413623+0000","last_change":"2024-09-12T00:54:44.413623+0000","last_active":"2024-09-12T00:54:44.413623+0000","last_peered":"2024-09-12T00:54:44.413623+0000","last_clean":"2024-09-12T00:54:44.413623+0000","last_became_active":"2024-09-12T00:11:47.941543+0000","last_became_peered":"2024-09-12T00:11:47.941543+0000","last_unstale":"2024-09-12T00:54:44.413623+0000","last_undegraded":"2024-09-12T00:54:44.413623+0000","last_fullsized":"2024-09-12T00:54:44.413623+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'966","last_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_deep_scrub":"266'966","last_deep_scrub_stamp":"2024-09-12T00:54:44.413459+0000","last_clean_scrub_stamp":"2024-09-12T00:54:44.413459+0000","objects_scrubbed":3,"log_size":66,"log_dups_size":900,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:48.872760+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4541,"num_read_kb":4108,"num_write":1367,"num_write_kb":543,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":217,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"266'210","reported_seq":897,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:39.004309+0000","last_change":"2024-09-12T00:54:39.004309+0000","last_active":"2024-09-12T00:54:39.004309+0000","last_peered":"2024-09-12T00:54:39.004309+0000","last_clean":"2024-09-12T00:54:39.004309+0000","last_became_active":"2024-09-12T00:11:45.937311+0000","last_became_peered":"2024-09-12T00:11:45.937311+0000","last_unstale":"2024-09-12T00:54:39.004309+0000","last_undegraded":"2024-09-12T00:54:39.004309+0000","last_fullsized":"2024-09-12T00:54:39.004309+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'210","last_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_deep_scrub":"266'210","last_deep_scrub_stamp":"2024-09-12T00:54:39.004060+0000","last_clean_scrub_stamp":"2024-09-12T00:54:39.004060+0000","objects_scrubbed":5,"log_size":110,"log_dups_size":100,"ondisk_log_size":110,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T09:01:37.718332+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":777392,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":586,"num_read_kb":23861,"num_write":1050,"num_write_kb":45597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,6],"acting":[0,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2a","version":"266'754","reported_seq":2238,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:47.590559+0000","last_change":"2024-09-12T00:54:47.590559+0000","last_active":"2024-09-12T00:54:47.590559+0000","last_peered":"2024-09-12T00:54:47.590559+0000","last_clean":"2024-09-12T00:54:47.590559+0000","last_became_active":"2024-09-12T00:11:47.939939+0000","last_became_peered":"2024-09-12T00:11:47.939939+0000","last_unstale":"2024-09-12T00:54:47.590559+0000","last_undegraded":"2024-09-12T00:54:47.590559+0000","last_fullsized":"2024-09-12T00:54:47.590559+0000","mapping_epoch":27,"log_start":"266'700","ondisk_log_start":"266'700","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'754","last_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_deep_scrub":"266'754","last_deep_scrub_stamp":"2024-09-12T00:54:47.590381+0000","last_clean_scrub_stamp":"2024-09-12T00:54:47.590381+0000","objects_scrubbed":2,"log_size":54,"log_dups_size":700,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T11:12:16.432151+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3621,"num_read_kb":3255,"num_write":994,"num_write_kb":368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":694,"num_omap_keys":3,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2d","version":"266'164","reported_seq":776,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:49.259884+0000","last_change":"2024-09-12T00:54:49.259884+0000","last_active":"2024-09-12T00:54:49.259884+0000","last_peered":"2024-09-12T00:54:49.259884+0000","last_clean":"2024-09-12T00:54:49.259884+0000","last_became_active":"2024-09-12T00:11:45.934002+0000","last_became_peered":"2024-09-12T00:11:45.934002+0000","last_unstale":"2024-09-12T00:54:49.259884+0000","last_undegraded":"2024-09-12T00:54:49.259884+0000","last_fullsized":"2024-09-12T00:54:49.259884+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'164","last_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_deep_scrub":"266'164","last_deep_scrub_stamp":"2024-09-12T00:54:49.259672+0000","last_clean_scrub_stamp":"2024-09-12T00:54:49.259672+0000","objects_scrubbed":4,"log_size":64,"log_dups_size":100,"ondisk_log_size":64,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T12:44:01.483020+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":399130,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":371,"num_read_kb":3653,"num_write":817,"num_write_kb":22040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"266'837","reported_seq":2669,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.793185+0000","last_change":"2024-09-12T00:54:50.793185+0000","last_active":"2024-09-12T00:54:50.793185+0000","last_peered":"2024-09-12T00:54:50.793185+0000","last_clean":"2024-09-12T00:54:50.793185+0000","last_became_active":"2024-09-12T00:11:47.950464+0000","last_became_peered":"2024-09-12T00:11:47.950464+0000","last_unstale":"2024-09-12T00:54:50.793185+0000","last_undegraded":"2024-09-12T00:54:50.793185+0000","last_fullsized":"2024-09-12T00:54:50.793185+0000","mapping_epoch":27,"log_start":"266'800","ondisk_log_start":"266'800","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'837","last_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_deep_scrub":"266'837","last_deep_scrub_stamp":"2024-09-12T00:54:50.792947+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.792947+0000","objects_scrubbed":3,"log_size":37,"log_dups_size":800,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:54:52.531844+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4442,"num_read_kb":4073,"num_write":1093,"num_write_kb":392,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2733,"num_omap_keys":11,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2e","version":"266'220","reported_seq":889,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:41.603322+0000","last_change":"2024-09-12T00:54:41.603322+0000","last_active":"2024-09-12T00:54:41.603322+0000","last_peered":"2024-09-12T00:54:41.603322+0000","last_clean":"2024-09-12T00:54:41.603322+0000","last_became_active":"2024-09-12T00:11:45.925298+0000","last_became_peered":"2024-09-12T00:11:45.925298+0000","last_unstale":"2024-09-12T00:54:41.603322+0000","last_undegraded":"2024-09-12T00:54:41.603322+0000","last_fullsized":"2024-09-12T00:54:41.603322+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'220","last_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_deep_scrub":"266'220","last_deep_scrub_stamp":"2024-09-12T00:54:41.603085+0000","last_clean_scrub_stamp":"2024-09-12T00:54:41.603085+0000","objects_scrubbed":8,"log_size":20,"log_dups_size":200,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:46:05.399778+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2430198,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":499,"num_read_kb":27002,"num_write":976,"num_write_kb":39242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,3],"acting":[7,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.28","version":"266'448","reported_seq":2076,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:42.356262+0000","last_change":"2024-09-12T00:54:42.356125+0000","last_active":"2024-09-12T00:54:42.356262+0000","last_peered":"2024-09-12T00:54:42.356262+0000","last_clean":"2024-09-12T00:54:42.356262+0000","last_became_active":"2024-09-12T00:11:47.941546+0000","last_became_peered":"2024-09-12T00:11:47.941546+0000","last_unstale":"2024-09-12T00:54:42.356262+0000","last_undegraded":"2024-09-12T00:54:42.356262+0000","last_fullsized":"2024-09-12T00:54:42.356262+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'448","last_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_deep_scrub":"266'448","last_deep_scrub_stamp":"2024-09-12T00:54:42.355937+0000","last_clean_scrub_stamp":"2024-09-12T00:54:42.355937+0000","objects_scrubbed":1,"log_size":48,"log_dups_size":400,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:04:01.881468+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2394,"num_read_kb":2276,"num_write":525,"num_write_kb":103,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"266'186","reported_seq":816,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:50.293468+0000","last_change":"2024-09-12T00:54:50.293468+0000","last_active":"2024-09-12T00:54:50.293468+0000","last_peered":"2024-09-12T00:54:50.293468+0000","last_clean":"2024-09-12T00:54:50.293468+0000","last_became_active":"2024-09-12T00:11:45.963603+0000","last_became_peered":"2024-09-12T00:11:45.963603+0000","last_unstale":"2024-09-12T00:54:50.293468+0000","last_undegraded":"2024-09-12T00:54:50.293468+0000","last_fullsized":"2024-09-12T00:54:50.293468+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'186","last_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_deep_scrub":"266'186","last_deep_scrub_stamp":"2024-09-12T00:54:50.293253+0000","last_clean_scrub_stamp":"2024-09-12T00:54:50.293253+0000","objects_scrubbed":2,"log_size":86,"log_dups_size":100,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T08:41:08.784599+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":15,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":432,"num_read_kb":12744,"num_write":922,"num_write_kb":11949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"266'226","reported_seq":884,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.268108+0000","last_change":"2024-09-12T00:54:51.268108+0000","last_active":"2024-09-12T00:54:51.268108+0000","last_peered":"2024-09-12T00:54:51.268108+0000","last_clean":"2024-09-12T00:54:51.268108+0000","last_became_active":"2024-09-12T00:11:45.934772+0000","last_became_peered":"2024-09-12T00:11:45.934772+0000","last_unstale":"2024-09-12T00:54:51.268108+0000","last_undegraded":"2024-09-12T00:54:51.268108+0000","last_fullsized":"2024-09-12T00:54:51.268108+0000","mapping_epoch":25,"log_start":"266'200","ondisk_log_start":"266'200","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'226","last_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_deep_scrub":"266'226","last_deep_scrub_stamp":"2024-09-12T00:54:51.267890+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.267890+0000","objects_scrubbed":2,"log_size":26,"log_dups_size":200,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:32:47.302659+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194319,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":452,"num_read_kb":71383,"num_write":1072,"num_write_kb":60522,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,6],"acting":[3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"266'456","reported_seq":2148,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:51.803400+0000","last_change":"2024-09-12T00:54:51.803256+0000","last_active":"2024-09-12T00:54:51.803400+0000","last_peered":"2024-09-12T00:54:51.803400+0000","last_clean":"2024-09-12T00:54:51.803400+0000","last_became_active":"2024-09-12T00:11:47.952532+0000","last_became_peered":"2024-09-12T00:11:47.952532+0000","last_unstale":"2024-09-12T00:54:51.803400+0000","last_undegraded":"2024-09-12T00:54:51.803400+0000","last_fullsized":"2024-09-12T00:54:51.803400+0000","mapping_epoch":27,"log_start":"266'400","ondisk_log_start":"266'400","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'456","last_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_deep_scrub":"266'456","last_deep_scrub_stamp":"2024-09-12T00:54:51.803069+0000","last_clean_scrub_stamp":"2024-09-12T00:54:51.803069+0000","objects_scrubbed":1,"log_size":56,"log_dups_size":400,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T05:18:01.594700+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2545,"num_read_kb":2426,"num_write":530,"num_write_kb":99,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":237,"num_omap_keys":1,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.31","version":"266'208","reported_seq":966,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:46.549008+0000","last_change":"2024-09-12T00:54:46.549008+0000","last_active":"2024-09-12T00:54:46.549008+0000","last_peered":"2024-09-12T00:54:46.549008+0000","last_clean":"2024-09-12T00:54:46.549008+0000","last_became_active":"2024-09-12T00:11:45.959487+0000","last_became_peered":"2024-09-12T00:11:45.959487+0000","last_unstale":"2024-09-12T00:54:46.549008+0000","last_undegraded":"2024-09-12T00:54:46.549008+0000","last_fullsized":"2024-09-12T00:54:46.549008+0000","mapping_epoch":25,"log_start":"266'100","ondisk_log_start":"266'100","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'208","last_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_deep_scrub":"266'208","last_deep_scrub_stamp":"2024-09-12T00:54:46.548801+0000","last_clean_scrub_stamp":"2024-09-12T00:54:46.548801+0000","objects_scrubbed":4,"log_size":108,"log_dups_size":100,"ondisk_log_size":108,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T06:03:56.676960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194359,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":710,"num_read_kb":180313,"num_write":963,"num_write_kb":33029,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3],"acting":[5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.36","version":"266'929","reported_seq":2700,"reported_epoch":266,"state":"active+clean","last_fresh":"2024-09-12T00:54:48.418940+0000","last_change":"2024-09-12T00:54:48.418811+0000","last_active":"2024-09-12T00:54:48.418940+0000","last_peered":"2024-09-12T00:54:48.418940+0000","last_clean":"2024-09-12T00:54:48.418940+0000","last_became_active":"2024-09-12T00:11:47.939728+0000","last_became_peered":"2024-09-12T00:11:47.939728+0000","last_unstale":"2024-09-12T00:54:48.418940+0000","last_undegraded":"2024-09-12T00:54:48.418940+0000","last_fullsized":"2024-09-12T00:54:48.418940+0000","mapping_epoch":27,"log_start":"266'900","ondisk_log_start":"266'900","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"266'929","last_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_deep_scrub":"266'929","last_deep_scrub_stamp":"2024-09-12T00:54:48.418615+0000","last_clean_scrub_stamp":"2024-09-12T00:54:48.418615+0000","objects_scrubbed":3,"log_size":29,"log_dups_size":900,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-13T01:07:00.299961+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4522,"num_read_kb":4073,"num_write":1214,"num_write_kb":440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1532,"num_omap_keys":6,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":65,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6133,"num_read_kb":4372,"num_write":1988,"num_write_kb":886,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":7199,"num_omap_keys":15,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":961,"ondisk_log_size":961,"up":64,"acting":64,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":15195,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":14994,"num_read_kb":14657,"num_write":16707,"num_write_kb":4873,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":17,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2619,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":548864,"data_stored":30390,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1833,"ondisk_log_size":1833,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":662,"ondisk_log_size":662,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":338265,"num_objects":223,"num_object_clones":0,"num_object_copies":446,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":223,"num_whiteouts":0,"num_read":8580,"num_read_kb":10748,"num_write":5747,"num_write_kb":2671,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":23,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":671866,"num_omap_keys":1552,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1987,"ondisk_log_size":1987,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1793,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":2374,"num_read_kb":2834,"num_write":20,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":154,"num_object_clones":0,"num_object_copies":308,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":154,"num_whiteouts":0,"num_read":212393,"num_read_kb":193906,"num_write":55225,"num_write_kb":18786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":154,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":43256,"num_omap_keys":176,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3988,"ondisk_log_size":3988,"up":128,"acting":128,"num_store_stats":8},{"poolid":68,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":18,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1128,"num_omap_keys":12,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":104917588,"num_objects":239,"num_object_clones":0,"num_object_copies":717,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":239,"num_whiteouts":0,"num_read":33248,"num_read_kb":1979779,"num_write":63422,"num_write_kb":2052632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":159301632,"data_stored":159301632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4504,"ondisk_log_size":4504,"up":192,"acting":192,"num_store_stats":8},{"poolid":67,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":172,"num_read_kb":190493,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":7},{"poolid":66,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":170,"num_read_kb":189755,"num_write":188,"num_write_kb":131373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509976,"num_pgs":98,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":220400,"kb_used_data":18528,"kb_used_omap":1,"kb_used_meta":201854,"kb_avail":94151440,"statfs":{"total":96636764160,"available":96411074560,"internally_reserved":0,"allocated":18972672,"data_stored":16979463,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":206698954},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509977,"num_pgs":103,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":92208,"kb_used_data":20768,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94279632,"statfs":{"total":96636764160,"available":96542343168,"internally_reserved":0,"allocated":21266432,"data_stored":19245709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":73136582},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509978,"num_pgs":121,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":190576,"kb_used_data":28960,"kb_used_omap":1,"kb_used_meta":161598,"kb_avail":94181264,"statfs":{"total":96636764160,"available":96441614336,"internally_reserved":0,"allocated":29655040,"data_stored":27647840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":165476805},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509978,"num_pgs":124,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":230112,"kb_used_data":32336,"kb_used_omap":1,"kb_used_meta":197758,"kb_avail":94141728,"statfs":{"total":96636764160,"available":96401129472,"internally_reserved":0,"allocated":33112064,"data_stored":31105721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":202504647},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509979,"num_pgs":99,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":123728,"kb_used_data":24512,"kb_used_omap":1,"kb_used_meta":99198,"kb_avail":94248112,"statfs":{"total":96636764160,"available":96510066688,"internally_reserved":0,"allocated":25100288,"data_stored":23091639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":101579205},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509978,"num_pgs":93,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":293624,"kb_used_data":19496,"kb_used_omap":1,"kb_used_meta":274110,"kb_avail":94078216,"statfs":{"total":96636764160,"available":96336093184,"internally_reserved":0,"allocated":19963904,"data_stored":17949977,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":280689095},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":15,"seq":64424509977,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":127816,"kb_used_data":24440,"kb_used_omap":1,"kb_used_meta":103358,"kb_avail":94244024,"statfs":{"total":96636764160,"available":96505880576,"internally_reserved":0,"allocated":25026560,"data_stored":23006958,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":105839045},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":14,"seq":60129542686,"num_pgs":115,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":246392,"kb_used_data":20840,"kb_used_omap":1,"kb_used_meta":225534,"kb_avail":94125448,"statfs":{"total":96636764160,"available":96384458752,"internally_reserved":0,"allocated":21340160,"data_stored":19331103,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":230947269},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20770816,"data_stored":20770816,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":15126528,"data_stored":15126528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20856832,"data_stored":20856832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":28872704,"data_stored":28872704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":25411584,"data_stored":25411584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16506880,"data_stored":16506880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":17010688,"data_stored":17010688,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":14745600,"data_stored":14745600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1747,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":1364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":798,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":3703,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":5149,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":2964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":5892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":3537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":86016,"data_stored":4794,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":2082,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":65,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":66,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":67,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":68,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-12T00:56:00.027 DEBUG:teuthology.orchestra.run.smithi078:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-12T00:56:00.393 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-12T00:56:00.393 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-12T00:56:00.393 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-12T00:56:00.394 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:02.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2024-09-12T00:56:06.495 INFO:tasks.ceph.osd.0:Stopped 2024-09-12T00:56:06.496 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-12T00:56:06.496 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:06.586 INFO:tasks.ceph.osd.1:Stopped 2024-09-12T00:56:06.587 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-12T00:56:06.587 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:06.678 INFO:tasks.ceph.osd.2:Stopped 2024-09-12T00:56:06.678 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-12T00:56:06.678 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:08.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-09-12T00:56:08.628 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2024-09-12T00:56:12.780 INFO:tasks.ceph.osd.3:Stopped 2024-09-12T00:56:12.781 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-12T00:56:12.781 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:12.857 INFO:tasks.ceph.osd.4:Stopped 2024-09-12T00:56:12.858 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-12T00:56:12.858 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:14.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2024-09-12T00:56:14.335 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-09-12T00:56:18.959 INFO:tasks.ceph.osd.5:Stopped 2024-09-12T00:56:18.960 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-12T00:56:18.960 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:19.025 INFO:tasks.ceph.osd.6:Stopped 2024-09-12T00:56:19.025 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-12T00:56:19.025 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:19.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2024-09-12T00:56:19.840 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2024-09-12T00:56:25.127 INFO:tasks.ceph.osd.7:Stopped 2024-09-12T00:56:25.127 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-12T00:56:25.128 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-12T00:56:25.128 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:25.159 INFO:tasks.ceph.mgr.y:Stopped 2024-09-12T00:56:25.159 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-12T00:56:25.159 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:25.188 INFO:tasks.ceph.mgr.x:Stopped 2024-09-12T00:56:25.188 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-12T00:56:25.188 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-12T00:56:25.188 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~6s 2024-09-12T00:56:25.188 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-09-12T00:56:25.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-09-12T00:56:25.220 INFO:tasks.ceph.mon.a:Stopped 2024-09-12T00:56:25.221 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-12T00:56:25.221 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:25.277 INFO:tasks.ceph.mon.c:Stopped 2024-09-12T00:56:25.278 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-12T00:56:25.278 INFO:teuthology.orchestra.run:waiting for 300 2024-09-12T00:56:25.295 INFO:tasks.ceph.mon.b:Stopped 2024-09-12T00:56:25.295 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-12T00:56:25.296 DEBUG:teuthology.orchestra.run.smithi078:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1 2024-09-12T00:56:25.333 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:56:25.333 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-12T00:56:25.620 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:56:25.620 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-12T00:56:25.861 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:56:25.861 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-12T00:56:26.073 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:56:26.073 DEBUG:teuthology.orchestra.run.smithi078:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-12T00:56:26.304 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:56:26.304 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-12T00:56:26.474 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:56:26.474 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-12T00:56:26.717 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:56:26.717 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-12T00:56:26.864 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:56:26.864 DEBUG:teuthology.orchestra.run.smithi171:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-12T00:56:27.038 INFO:tasks.ceph:Archiving mon data... 2024-09-12T00:56:27.040 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/data/mon.a.tgz 2024-09-12T00:56:27.040 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-12T00:56:27.046 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.VOZ1gU5Fmy 2024-09-12T00:56:27.046 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VOZ1gU5Fmy 2024-09-12T00:56:27.219 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.VOZ1gU5Fmy 2024-09-12T00:56:27.283 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.VOZ1gU5Fmy is 504KB 2024-09-12T00:56:27.345 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.VOZ1gU5Fmy 2024-09-12T00:56:27.350 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/data/mon.c.tgz 2024-09-12T00:56:27.350 DEBUG:teuthology.orchestra.run.smithi078:> mktemp 2024-09-12T00:56:27.399 INFO:teuthology.orchestra.run.smithi078.stdout:/tmp/tmp.NFAYdUtCdQ 2024-09-12T00:56:27.399 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.NFAYdUtCdQ 2024-09-12T00:56:27.579 DEBUG:teuthology.orchestra.run.smithi078:> sudo chmod 0666 /tmp/tmp.NFAYdUtCdQ 2024-09-12T00:56:27.638 DEBUG:teuthology.orchestra.remote:smithi078:/tmp/tmp.NFAYdUtCdQ is 534KB 2024-09-12T00:56:27.701 DEBUG:teuthology.orchestra.run.smithi078:> rm -fr /tmp/tmp.NFAYdUtCdQ 2024-09-12T00:56:27.706 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/data/mon.b.tgz 2024-09-12T00:56:27.706 DEBUG:teuthology.orchestra.run.smithi171:> mktemp 2024-09-12T00:56:27.712 INFO:teuthology.orchestra.run.smithi171.stdout:/tmp/tmp.O6XLtAhP6r 2024-09-12T00:56:27.713 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.O6XLtAhP6r 2024-09-12T00:56:27.896 DEBUG:teuthology.orchestra.run.smithi171:> sudo chmod 0666 /tmp/tmp.O6XLtAhP6r 2024-09-12T00:56:27.959 DEBUG:teuthology.orchestra.remote:smithi171:/tmp/tmp.O6XLtAhP6r is 534KB 2024-09-12T00:56:28.025 DEBUG:teuthology.orchestra.run.smithi171:> rm -fr /tmp/tmp.O6XLtAhP6r 2024-09-12T00:56:28.031 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-12T00:56:28.031 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:56:28.033 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-12T00:56:28.093 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:56:28.135 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-12T00:56:28.135 INFO:tasks.ceph:Archiving crash dumps... 2024-09-12T00:56:28.137 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/remote/smithi078/crash 2024-09-12T00:56:28.138 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:56:28.151 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/remote/smithi171/crash 2024-09-12T00:56:28.152 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-12T00:56:28.195 INFO:tasks.ceph:Compressing logs... 2024-09-12T00:56:28.195 DEBUG:teuthology.orchestra.run.smithi078:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:56:28.198 DEBUG:teuthology.orchestra.run.smithi171:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-12T00:56:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33201.log 2024-09-12T00:56:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36948.log 2024-09-12T00:56:28.227 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33201.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156083.log 2024-09-12T00:56:28.228 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33201.log.gz 2024-09-12T00:56:28.228 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.36948.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56978.log 2024-09-12T00:56:28.228 INFO:teuthology.orchestra.run.smithi078.stderr: 43.9% -- replaced with /var/log/ceph/ceph-client.0.36948.log.gz 2024-09-12T00:56:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.156083.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66655.log 2024-09-12T00:56:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56978.log: 90.3% -- replaced with /var/log/ceph/ceph-client.admin.156083.log.gz 2024-09-12T00:56:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78074.log 2024-09-12T00:56:28.230 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95775.log 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.66655.log.gz 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150651.log 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.78074.log: /var/log/ceph/ceph-client.admin.95775.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.95775.log.gz 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.150651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114067.log 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.150651.log.gz 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/rgw.ceph.client.0.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.78074.log.gz 2024-09-12T00:56:28.231 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58269.log 2024-09-12T00:56:28.233 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.114067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32828.log 2024-09-12T00:56:28.233 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.114067.log.gz 2024-09-12T00:56:28.233 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55035.log 2024-09-12T00:56:28.233 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124097.log 2024-09-12T00:56:28.233 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32828.log.gz 2024-09-12T00:56:28.233 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55035.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-09-12T00:56:28.233 INFO:teuthology.orchestra.run.smithi078.stderr: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.55035.log.gz 2024-09-12T00:56:28.234 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.124097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129408.log 2024-09-12T00:56:28.234 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.124097.log.gz 2024-09-12T00:56:28.234 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33215.log 2024-09-12T00:56:28.236 INFO:teuthology.orchestra.run.smithi078.stderr: 93.4% -- replaced with /var/log/ceph/ceph-client.admin.56978.log.gz 2024-09-12T00:56:28.236 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.129408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162742.log 2024-09-12T00:56:28.236 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.129408.log.gz 2024-09-12T00:56:28.236 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154263.log 2024-09-12T00:56:28.236 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33215.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33215.log.gz 2024-09-12T00:56:28.236 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.162742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131768.log 2024-09-12T00:56:28.236 INFO:teuthology.orchestra.run.smithi078.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162742.log.gz 2024-09-12T00:56:28.237 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.154263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33441.log 2024-09-12T00:56:28.237 INFO:teuthology.orchestra.run.smithi078.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.154263.log.gz 2024-09-12T00:56:28.237 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.131768.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179937.log 2024-09-12T00:56:28.237 INFO:teuthology.orchestra.run.smithi078.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.131768.log.gz 2024-09-12T00:56:28.237 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22023.log 2024-09-12T00:56:28.237 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33441.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33441.log.gz 2024-09-12T00:56:28.239 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33632.log 2024-09-12T00:56:28.239 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179937.log.gz 2024-09-12T00:56:28.239 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.tmp-client.admin.22023.log: 0.0%gzip -- replaced with /var/log/ceph/ceph.tmp-client.admin.22023.log.gz 2024-09-12T00:56:28.239 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.132358.log 2024-09-12T00:56:28.239 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33632.log: /var/log/ceph/ceph-client.admin.179572.log 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33632.log.gz 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.admin.58269.log.gz 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.132358.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.132358.log.gz 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179572.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168334.log 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179572.log.gz 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118787.log 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.168334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50797.log 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr: 81.3% -- replaced with /var/log/ceph/ceph-client.0.168334.log.gz 2024-09-12T00:56:28.240 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.130588.log 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118787.log: /var/log/ceph/ceph-client.admin.50797.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.50797.log.gz 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33605.log 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60850.log 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.130588.log: /var/log/ceph/ceph-client.admin.33605.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33605.log.gz 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27010.log 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.130588.log.gz 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.143571.log 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.118787.log.gz 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60850.log: /var/log/ceph/ceph-client.admin.27010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160257.log 2024-09-12T00:56:28.244 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27010.log.gz 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.143571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156058.log 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.160257.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52617.log 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.156058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179494.log 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156058.log.gz 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.143571.log.gz 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52617.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.60850.log.gz 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr: 94.1% -- replaced with /var/log/ceph/ceph-client.admin.160257.log.gz 2024-09-12T00:56:28.245 INFO:teuthology.orchestra.run.smithi078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.52617.log.gz 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33005.log 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179494.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179494.log.gz 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54465.log 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.146521.log 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33005.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33005.log.gz 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.114657.log 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr: 54.0% -- replaced with /var/log/ceph/ceph-client.admin.54465.log.gz 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.146521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106397.log 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.146521.log.gz 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.114657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53207.log 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9%/var/log/ceph/ceph-client.admin.106397.log: -- replaced with /var/log/ceph/ceph-client.admin.114657.log.gz 2024-09-12T00:56:28.251 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49617.log 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106397.log.gz 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97545.log 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.53207.log.gz 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33200.log 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.49617.log.gz 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.97545.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40617.log 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr: 82.3%/var/log/ceph/ceph-client.admin.33200.log: -- replaced with /var/log/ceph/ceph-client.admin.97545.log.gz 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41207.log 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33200.log.gz 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.95185.log 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41207.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.40617.log.gz 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose 0.0% -- /var/log/ceph/ceph-client.admin.64293.log -- replaced with /var/log/ceph/ceph-client.admin.41207.log.gz 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-12T00:56:28.252 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.95185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58914.log 2024-09-12T00:56:28.253 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.95185.log.gz 2024-09-12T00:56:28.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57623.log 2024-09-12T00:56:28.253 INFO:teuthology.orchestra.run.smithi078.stderr: 81.1% -- replaced with /var/log/ceph/ceph-client.admin.64293.log.gz 2024-09-12T00:56:28.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.58914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83385.log 2024-09-12T00:56:28.253 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.57623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32993.log 2024-09-12T00:56:28.258 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.83385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.113477.log 2024-09-12T00:56:28.258 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32993.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.83385.log.gz 2024-09-12T00:56:28.258 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164509.log 2024-09-12T00:56:28.258 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32993.log.gz 2024-09-12T00:56:28.258 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179833.log 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.113477.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.58914.log.gz 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.113477.log.gz 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.164509.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.164509.log.gz 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177605.log 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176892.log 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179833.log.gz 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62791.log 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177605.log.gz 2024-09-12T00:56:28.259 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34606.log 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176892.log.gz 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.admin.57623.log.gz 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81024.log 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.34606.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.34606.log.gz 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173644.log 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.81024.log: /var/log/ceph/ceph-client.0.173644.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.81024.log.gz 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32803.log 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.0.173644.log.gz 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101085.log 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32803.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177532.log 2024-09-12T00:56:28.260 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.32803.log.gz 2024-09-12T00:56:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5/var/log/ceph/ceph-client.admin.101085.log: --verbose -- /var/log/ceph/ceph-client.admin.77484.log 2024-09-12T00:56:28.261 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9%/var/log/ceph/ceph-client.admin.177532.log: -- replaced with /var/log/ceph/ceph-client.admin.101085.log.gzgzip 2024-09-12T00:56:28.261 INFO:teuthology.orchestra.run.smithi078.stderr: -5 --verbose -- /var/log/ceph/ceph-client.0.68559.log 2024-09-12T00:56:28.261 INFO:teuthology.orchestra.run.smithi078.stderr: 24.4% -- replaced with /var/log/ceph/ceph-client.admin.177532.log.gz 2024-09-12T00:56:28.261 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.77484.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.77484.log.gz 2024-09-12T00:56:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33199.log 2024-09-12T00:56:28.266 INFO:teuthology.orchestra.run.smithi078.stderr: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.62791.log.gz 2024-09-12T00:56:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.68559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85745.log 2024-09-12T00:56:28.266 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67294.log 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33199.log.gz 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.85745.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73354.log 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69814.log 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.85745.log.gz 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.67294.log: /var/log/ceph/ceph-client.admin.73354.log: 84.5% -- replaced with /var/log/ceph/ceph-client.0.67294.log.gz 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.73354.log.gz 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54438.log 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.69814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88695.log 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr: 82.6% 92.0% -- replaced with /var/log/ceph/ceph-client.0.68559.log.gz 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.69814.log.gz/var/log/ceph/ceph-client.admin.54438.log: 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142978.log 2024-09-12T00:56:28.267 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137078.log 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.88695.log: /var/log/ceph/ceph-client.admin.142978.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74534.log 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.88695.log.gz 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.142978.log.gz 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.137078.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.137078.log.gz 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.74534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170694.log 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.74534.log.gz 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32925.log 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179676.log 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.170694.log: /var/log/ceph/ceph-client.admin.32925.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.170694.log.gz 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32925.log.gz 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94595.log 2024-09-12T00:56:28.268 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91055.log 2024-09-12T00:56:28.269 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179676.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179676.log.gz 2024-09-12T00:56:28.271 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.94595.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.94595.log.gz 2024-09-12T00:56:28.271 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168924.log 2024-09-12T00:56:28.271 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.91055.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175689.log 2024-09-12T00:56:28.271 INFO:teuthology.orchestra.run.smithi078.stderr: 81.6% -- replaced with /var/log/ceph/ceph-client.admin.91055.log.gz 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.168924.log: 83.6% -- replaced with /var/log/ceph/ceph-client.0.168924.log.gz 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72764.log 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.175689.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.88105.log 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.175689.log.gz 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72764.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.72764.log.gz 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112887.log 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.88105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46027.log 2024-09-12T00:56:28.272 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.112887.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.88105.log.gz 2024-09-12T00:56:28.273 INFO:teuthology.orchestra.run.smithi078.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.112887.log.gz 2024-09-12T00:56:28.274 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75714.log 2024-09-12T00:56:28.274 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.94005.log 2024-09-12T00:56:28.274 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.46027.log.gz/var/log/ceph/ceph-client.admin.75714.log: 2024-09-12T00:56:28.274 INFO:teuthology.orchestra.run.smithi078.stderr: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.75714.log.gz 2024-09-12T00:56:28.275 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121147.log 2024-09-12T00:56:28.275 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.94005.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86335.log 2024-09-12T00:56:28.275 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.94005.log.gz 2024-09-12T00:56:28.275 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121147.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.121147.log.gz 2024-09-12T00:56:28.281 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26969.log 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26849.log 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26945.log 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26969.log.gz 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26849.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26849.log.gz 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26897.log 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26945.log.gz 2024-09-12T00:56:28.282 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26825.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26897.log: /var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26873.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26897.log.gz 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26921.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26825.log.gz 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26873.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26873.log.gz 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26921.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26921.log.gz 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:56:28.283 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26993.log 2024-09-12T00:56:28.285 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-12T00:56:28.285 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-client.admin.26993.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-12T00:56:28.285 INFO:teuthology.orchestra.run.smithi171.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26993.log.gz 2024-09-12T00:56:28.285 INFO:teuthology.orchestra.run.smithi171.stderr:/var/log/ceph/ceph-mon.b.log: /var/log/ceph/ceph-osd.4.log: 90.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:56:28.290 INFO:teuthology.orchestra.run.smithi171.stderr: 87.7% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:56:28.295 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109347.log 2024-09-12T00:56:28.295 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.86335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92235.log 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109347.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.86335.log.gz 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.109347.log.gz 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78664.log 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.92235.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53860.log 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.92235.log.gz 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.78664.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.78664.log.gz 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54438.log.gz 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76304.log 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.53860.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33003.log 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr: 59.6% -- replaced with /var/log/ceph/ceph-client.admin.53860.log.gz/var/log/ceph/ceph-client.admin.76304.log: 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117607.log 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.76304.log.gz 2024-09-12T00:56:28.296 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179650.log 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33003.log: /var/log/ceph/ceph-client.admin.117607.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33003.log.gz 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76894.log 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.117607.log.gz 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44257.log 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179650.log: /var/log/ceph/ceph-client.admin.76894.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179650.log.gz 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr: 81.4% -- replaced with /var/log/ceph/ceph-client.admin.76894.log.gz 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176279.log 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127048.log 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44257.log: /var/log/ceph/ceph-client.admin.176279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180095.log 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.44257.log.gz 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.176279.log.gz 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.127048.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.127048.log.gz 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33426.log 2024-09-12T00:56:28.297 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180095.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33393.log 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180095.log.gz 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33426.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177656.log 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33426.log.gz 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37532.log 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33393.log.gz 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33648.log 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52027.log 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.177656.log.gz 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.37532.log: /var/log/ceph/ceph-client.admin.33648.log: 43.9% -- replaced with /var/log/ceph/ceph-client.0.37532.log.gz 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33648.log.gz 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33213.log 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46617.log 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr: 83.8% -- replaced with /var/log/ceph/ceph-client.admin.52027.log.gz 2024-09-12T00:56:28.298 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33213.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39437.log 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33213.log.gz 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45437.log 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.46617.log: /var/log/ceph/ceph-client.admin.39437.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.46617.log.gz 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr: 83.6% -- replaced with /var/log/ceph/ceph-client.admin.39437.log.gz 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65474.log 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.45437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179963.log 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.45437.log.gz/var/log/ceph/ceph-client.admin.65474.log: 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35190.log 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179963.log.gz 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.65474.log.gz 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145341.log 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.35190.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108757.log 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr: 81.0% -- replaced with /var/log/ceph/ceph-client.0.35190.log.gz 2024-09-12T00:56:28.299 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.145341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51977.log 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179911.log 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108757.log: /var/log/ceph/ceph-client.admin.51977.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.108757.log.gz 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51977.log.gz 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179781.log 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.145341.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.167152.log 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179911.log: /var/log/ceph/ceph-client.admin.179781.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179911.log.gz 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179781.log.gz 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119377.log 2024-09-12T00:56:28.300 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.167152.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105805.log 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr: 80.5% -- replaced with /var/log/ceph/ceph-client.0.167152.log.gz/var/log/ceph/ceph-client.admin.119377.log: 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180045.log 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.119377.log.gz 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.105805.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.105805.log.gz 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160846.log 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180045.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64882.log 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180045.log.gz 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.160846.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.64882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179520.log 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.160846.log.gz 2024-09-12T00:56:28.301 INFO:teuthology.orchestra.run.smithi078.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.64882.log.gz 2024-09-12T00:56:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.150061.log 2024-09-12T00:56:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144161.log 2024-09-12T00:56:28.306 INFO:teuthology.orchestra.run.smithi078.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179520.log.gz 2024-09-12T00:56:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.120557.log 2024-09-12T00:56:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.150061.log: /var/log/ceph/ceph-client.admin.144161.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.150061.log.gz 2024-09-12T00:56:28.306 INFO:teuthology.orchestra.run.smithi078.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.144161.log.gz 2024-09-12T00:56:28.306 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.136488.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115247.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.120557.log: /var/log/ceph/ceph-client.admin.136488.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.136488.log.gz 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.120557.log.gz 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33000.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72174.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.115247.log.gz 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33000.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33000.log.gz 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165961.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.72174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138258.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.165961.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.72174.log.gz 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.165961.log.gz 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41847.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.138258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158754.log 2024-09-12T00:56:28.307 INFO:teuthology.orchestra.run.smithi078.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.138258.log.gz 2024-09-12T00:56:28.308 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41847.log: 85.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178849.log 2024-09-12T00:56:28.308 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.41847.log.gz 2024-09-12T00:56:28.308 INFO:teuthology.orchestra.run.smithi171.stderr: 95.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-12T00:56:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.158754.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104625.log 2024-09-12T00:56:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.178849.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.158754.log.gz 2024-09-12T00:56:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.93415.log 2024-09-12T00:56:28.309 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104625.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.178849.log.gz 2024-09-12T00:56:28.310 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.118197.log 2024-09-12T00:56:28.310 INFO:teuthology.orchestra.run.smithi078.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.104625.log.gz 2024-09-12T00:56:28.310 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.93415.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173054.log 2024-09-12T00:56:28.311 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.118197.log: 82.9% -- replaced with /var/log/ceph/ceph-client.admin.93415.log.gz 2024-09-12T00:56:28.312 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90465.log 2024-09-12T00:56:28.312 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.118197.log.gz 2024-09-12T00:56:28.312 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.173054.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.117017.log 2024-09-12T00:56:28.312 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.90465.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.173054.log.gz 2024-09-12T00:56:28.312 INFO:teuthology.orchestra.run.smithi078.stderr: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.90465.log.gz 2024-09-12T00:56:28.312 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140618.log 2024-09-12T00:56:28.314 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80434.log 2024-09-12T00:56:28.314 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.117017.log: /var/log/ceph/ceph-client.admin.140618.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.117017.log.gz 2024-09-12T00:56:28.314 INFO:teuthology.orchestra.run.smithi078.stderr: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.140618.log.gz 2024-09-12T00:56:28.314 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147111.log 2024-09-12T00:56:28.314 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101675.log 2024-09-12T00:56:28.315 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.80434.log: /var/log/ceph/ceph-client.admin.147111.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.80434.log.gz 2024-09-12T00:56:28.315 INFO:teuthology.orchestra.run.smithi078.stderr: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.147111.log.gz 2024-09-12T00:56:28.315 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179468.log 2024-09-12T00:56:28.315 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.101675.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.101675.log.gz 2024-09-12T00:56:28.316 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.admin.log 2024-09-12T00:56:28.316 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107577.log 2024-09-12T00:56:28.316 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179468.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179468.log.gz 2024-09-12T00:56:28.317 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ops-log-ceph-client.admin.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-12T00:56:28.317 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.107577.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.107577.log.gz 2024-09-12T00:56:28.318 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84565.log 2024-09-12T00:56:28.322 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-osd.1.log: 94.1% -- replaced with /var/log/ceph/ops-log-ceph-client.admin.log.gz 2024-09-12T00:56:28.327 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166562.log 2024-09-12T00:56:28.328 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.84565.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.84565.log.gz 2024-09-12T00:56:28.329 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43642.log 2024-09-12T00:56:28.330 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.166562.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.166562.log.gz 2024-09-12T00:56:28.330 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33909.log 2024-09-12T00:56:28.331 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43642.log.gz 2024-09-12T00:56:28.331 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125867.log 2024-09-12T00:56:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33909.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33909.log.gz 2024-09-12T00:56:28.332 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105215.log 2024-09-12T00:56:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.125867.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.125867.log.gz 2024-09-12T00:56:28.333 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153623.log 2024-09-12T00:56:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.105215.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.105215.log.gz 2024-09-12T00:56:28.334 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179807.log 2024-09-12T00:56:28.335 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.153623.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.153623.log.gz 2024-09-12T00:56:28.336 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100495.log 2024-09-12T00:56:28.336 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179807.log.gz 2024-09-12T00:56:28.337 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55687.log 2024-09-12T00:56:28.338 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.100495.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.100495.log.gz 2024-09-12T00:56:28.338 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.152443.log 2024-09-12T00:56:28.354 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55687.log: 94.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40027.log 2024-09-12T00:56:28.355 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.152443.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.152443.log.gz 2024-09-12T00:56:28.355 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55687.log.gz 2024-09-12T00:56:28.367 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67246.log 2024-09-12T00:56:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.40027.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.40027.log.gz 2024-09-12T00:56:28.368 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33427.log 2024-09-12T00:56:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.67246.log: 25.3% -- replaced with /var/log/ceph/ceph-client.admin.67246.log.gz 2024-09-12T00:56:28.369 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67884.log 2024-09-12T00:56:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33427.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33427.log.gz 2024-09-12T00:56:28.370 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163331.log 2024-09-12T00:56:28.371 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.67884.log: 84.1% -- replaced with /var/log/ceph/ceph-client.0.67884.log.gz 2024-09-12T00:56:28.372 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.115837.log 2024-09-12T00:56:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.163331.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.163331.log.gz 2024-09-12T00:56:28.373 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33004.log 2024-09-12T00:56:28.374 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.115837.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.115837.log.gz 2024-09-12T00:56:28.374 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154213.log 2024-09-12T00:56:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33004.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33004.log.gz 2024-09-12T00:56:28.375 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33645.log 2024-09-12T00:56:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.154213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154213.log.gz 2024-09-12T00:56:28.376 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179754.log 2024-09-12T00:56:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33645.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33645.log.gz 2024-09-12T00:56:28.377 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.126457.log 2024-09-12T00:56:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179754.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179754.log.gz 2024-09-12T00:56:28.378 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50207.log 2024-09-12T00:56:28.379 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.126457.log: 81.5% -- replaced with /var/log/ceph/ceph-client.admin.126457.log.gz 2024-09-12T00:56:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154238.log 2024-09-12T00:56:28.380 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.50207.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.50207.log.gz 2024-09-12T00:56:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171284.log 2024-09-12T00:56:28.381 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.154238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.154238.log.gz 2024-09-12T00:56:28.382 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.26815.log 2024-09-12T00:56:28.383 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.171284.log: 80.4% -- replaced with /var/log/ceph/ceph-client.0.171284.log.gz 2024-09-12T00:56:28.383 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89285.log 2024-09-12T00:56:28.384 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.26815.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.26815.log.gz 2024-09-12T00:56:28.384 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44847.log 2024-09-12T00:56:28.385 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.89285.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.89285.log.gz 2024-09-12T00:56:28.385 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33885.log 2024-09-12T00:56:28.386 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.44847.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.44847.log.gz 2024-09-12T00:56:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33192.log 2024-09-12T00:56:28.387 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33885.log.gz 2024-09-12T00:56:28.388 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177555.log 2024-09-12T00:56:28.388 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33192.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33192.log.gz 2024-09-12T00:56:28.389 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.86925.log 2024-09-12T00:56:28.389 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177555.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177555.log.gz 2024-09-12T00:56:28.390 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102855.log 2024-09-12T00:56:28.390 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.86925.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.86925.log.gz 2024-09-12T00:56:28.391 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.34008.log 2024-09-12T00:56:28.392 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.102855.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102855.log.gz 2024-09-12T00:56:28.392 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48977.log 2024-09-12T00:56:28.394 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.34008.log: 95.9% -- replaced with /var/log/ceph/ceph-client.0.34008.log.gz 2024-09-12T00:56:28.394 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49592.log 2024-09-12T00:56:28.395 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48977.log: 84.5% -- replaced with /var/log/ceph/ceph-client.admin.48977.log.gz 2024-09-12T00:56:28.395 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180071.log 2024-09-12T00:56:28.396 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49592.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49592.log.gz 2024-09-12T00:56:28.396 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161435.log 2024-09-12T00:56:28.397 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180071.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180071.log.gz 2024-09-12T00:56:28.397 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33397.log 2024-09-12T00:56:28.398 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.161435.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.161435.log.gz 2024-09-12T00:56:28.399 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55098.log 2024-09-12T00:56:28.399 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33397.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33397.log.gz 2024-09-12T00:56:28.400 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104035.log 2024-09-12T00:56:28.401 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55098.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.55098.log.gz 2024-09-12T00:56:28.401 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59559.log 2024-09-12T00:56:28.402 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.104035.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.104035.log.gz 2024-09-12T00:56:28.402 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151241.log 2024-09-12T00:56:28.405 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.59559.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.59559.log.gz 2024-09-12T00:56:28.405 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-12T00:56:28.406 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151241.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.151241.log.gz 2024-09-12T00:56:28.406 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42437.log 2024-09-12T00:56:28.417 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.log: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56333.log 2024-09-12T00:56:28.418 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.42437.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.42437.log.gz 2024-09-12T00:56:28.419 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph.log.gz 2024-09-12T00:56:28.419 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.87515.log 2024-09-12T00:56:28.420 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.56333.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.56333.log.gz 2024-09-12T00:56:28.420 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.131178.log 2024-09-12T00:56:28.421 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.87515.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.87515.log.gz 2024-09-12T00:56:28.422 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159343.log 2024-09-12T00:56:28.422 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.131178.log: 82.4% -- replaced with /var/log/ceph/ceph-client.admin.131178.log.gz 2024-09-12T00:56:28.423 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103445.log 2024-09-12T00:56:28.424 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.159343.log: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.159343.log.gz 2024-09-12T00:56:28.424 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176942.log 2024-09-12T00:56:28.425 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.103445.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.103445.log.gz 2024-09-12T00:56:28.425 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179624.log 2024-09-12T00:56:28.426 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176942.log: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.176942.log.gz 2024-09-12T00:56:28.427 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176917.log 2024-09-12T00:56:28.427 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179624.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179624.log.gz 2024-09-12T00:56:28.428 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71584.log 2024-09-12T00:56:28.428 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176917.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.176917.log.gz 2024-09-12T00:56:28.429 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47207.log 2024-09-12T00:56:28.429 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.71584.log: 80.7% -- replaced with /var/log/ceph/ceph-client.admin.71584.log.gz 2024-09-12T00:56:28.430 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-09-12T00:56:28.431 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47207.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.47207.log.gz 2024-09-12T00:56:28.431 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52002.log 2024-09-12T00:56:28.432 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33205.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-09-12T00:56:28.432 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179546.log 2024-09-12T00:56:28.433 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.52002.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52002.log.gz 2024-09-12T00:56:28.433 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60204.log 2024-09-12T00:56:28.434 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179546.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179546.log.gz 2024-09-12T00:56:28.434 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141208.log 2024-09-12T00:56:28.450 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.60204.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111117.log 2024-09-12T00:56:28.451 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141208.log: 81.8% -- replaced with /var/log/ceph/ceph-client.admin.141208.log.gz 2024-09-12T00:56:28.463 INFO:teuthology.orchestra.run.smithi078.stderr: 95.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33649.log 2024-09-12T00:56:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111117.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.111117.log.gz 2024-09-12T00:56:28.464 INFO:teuthology.orchestra.run.smithi078.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60204.log.gz 2024-09-12T00:56:28.464 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83975.log 2024-09-12T00:56:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33649.log.gz 2024-09-12T00:56:28.465 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54413.log 2024-09-12T00:56:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.83975.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.83975.log.gz 2024-09-12T00:56:28.466 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.139438.log 2024-09-12T00:56:28.467 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54413.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54413.log.gz 2024-09-12T00:56:28.467 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-12T00:56:28.468 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.139438.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.139438.log.gz 2024-09-12T00:56:28.469 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157263.log 2024-09-12T00:56:28.483 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128818.log 2024-09-12T00:56:28.484 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.157263.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.157263.log.gz 2024-09-12T00:56:28.495 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.133538.log 2024-09-12T00:56:28.496 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.128818.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.128818.log.gz 2024-09-12T00:56:28.511 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.128228.log 2024-09-12T00:56:28.513 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.133538.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.133538.log.gz 2024-09-12T00:56:28.519 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48387.log 2024-09-12T00:56:28.519 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.128228.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.128228.log.gz 2024-09-12T00:56:28.527 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35780.log 2024-09-12T00:56:28.528 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.48387.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.48387.log.gz 2024-09-12T00:56:28.535 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.112297.log 2024-09-12T00:56:28.535 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.35780.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.35780.log.gz 2024-09-12T00:56:28.543 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.169514.log 2024-09-12T00:56:28.544 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.112297.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.112297.log.gz 2024-09-12T00:56:28.551 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171874.log 2024-09-12T00:56:28.551 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.169514.log: 80.5% -- replaced with /var/log/ceph/ceph-client.0.169514.log.gz 2024-09-12T00:56:28.559 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75124.log 2024-09-12T00:56:28.559 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.171874.log: 84.0% -- replaced with /var/log/ceph/ceph-client.0.171874.log.gz 2024-09-12T00:56:28.567 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41232.log 2024-09-12T00:56:28.567 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.75124.log: 90.1% -- replaced with /var/log/ceph/ceph-client.admin.75124.log.gz 2024-09-12T00:56:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177580.log 2024-09-12T00:56:28.575 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41232.log.gz 2024-09-12T00:56:28.583 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33935.log 2024-09-12T00:56:28.583 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177580.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177580.log.gz 2024-09-12T00:56:28.591 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99315.log 2024-09-12T00:56:28.591 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33935.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33935.log.gz 2024-09-12T00:56:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43667.log 2024-09-12T00:56:28.599 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.99315.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.99315.log.gz 2024-09-12T00:56:28.607 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174824.log 2024-09-12T00:56:28.607 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43667.log: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.43667.log.gz 2024-09-12T00:56:28.615 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.85155.log 2024-09-12T00:56:28.615 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.174824.log: 80.3% -- replaced with /var/log/ceph/ceph-client.0.174824.log.gz 2024-09-12T00:56:28.623 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102265.log 2024-09-12T00:56:28.623 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.85155.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.85155.log.gz 2024-09-12T00:56:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54102.log 2024-09-12T00:56:28.631 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.102265.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.102265.log.gz 2024-09-12T00:56:28.639 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54181.log 2024-09-12T00:56:28.639 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54102.log: 57.4% -- replaced with /var/log/ceph/ceph-client.admin.54102.log.gz 2024-09-12T00:56:28.647 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.124687.log 2024-09-12T00:56:28.647 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54181.log: 52.5% -- replaced with /var/log/ceph/ceph-client.admin.54181.log.gz 2024-09-12T00:56:28.655 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32292.log 2024-09-12T00:56:28.655 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.124687.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.124687.log.gz 2024-09-12T00:56:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122917.log 2024-09-12T00:56:28.663 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32292.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32292.log.gz 2024-09-12T00:56:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68522.log 2024-09-12T00:56:28.671 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.122917.log: 80.8% -- replaced with /var/log/ceph/ceph-client.admin.122917.log.gz 2024-09-12T00:56:28.678 INFO:teuthology.orchestra.run.smithi078.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-12T00:56:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179598.log 2024-09-12T00:56:28.679 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.68522.log: 50.7% -- replaced with /var/log/ceph/ceph-client.admin.68522.log.gz 2024-09-12T00:56:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33183.log 2024-09-12T00:56:28.680 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179598.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179598.log.gz 2024-09-12T00:56:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61495.log 2024-09-12T00:56:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33183.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33183.log.gz 2024-09-12T00:56:28.681 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.147701.log 2024-09-12T00:56:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.61495.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.61495.log.gz 2024-09-12T00:56:28.683 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.153033.log 2024-09-12T00:56:28.684 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.147701.log: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.147701.log.gz 2024-09-12T00:56:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33424.log 2024-09-12T00:56:28.685 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.153033.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.153033.log.gz 2024-09-12T00:56:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32899.log 2024-09-12T00:56:28.686 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33424.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33424.log.gz 2024-09-12T00:56:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.89875.log 2024-09-12T00:56:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32899.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32899.log.gz 2024-09-12T00:56:28.687 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.125277.log 2024-09-12T00:56:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.89875.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.89875.log.gz 2024-09-12T00:56:28.689 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.155443.log 2024-09-12T00:56:28.691 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.125277.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.125277.log.gz 2024-09-12T00:56:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-12T00:56:28.692 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.155443.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.155443.log.gz 2024-09-12T00:56:28.693 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151263.log 2024-09-12T00:56:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32853.log 2024-09-12T00:56:28.703 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151263.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.151263.log.gz 2024-09-12T00:56:28.727 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43617.log 2024-09-12T00:56:28.728 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32853.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32853.log.gz 2024-09-12T00:56:28.731 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.141798.log 2024-09-12T00:56:28.731 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43617.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43617.log.gz 2024-09-12T00:56:28.739 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108167.log 2024-09-12T00:56:28.740 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.141798.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.141798.log.gz 2024-09-12T00:56:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-12T00:56:28.747 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.108167.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.108167.log.gz 2024-09-12T00:56:28.755 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135308.log 2024-09-12T00:56:28.758 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph.audit.log: 94.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-12T00:56:28.763 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55062.log 2024-09-12T00:56:28.763 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.135308.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.135308.log.gz 2024-09-12T00:56:28.771 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.144751.log 2024-09-12T00:56:28.771 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.55062.log: 21.6% -- replaced with /var/log/ceph/ceph-client.admin.55062.log.gz 2024-09-12T00:56:28.779 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162024.log 2024-09-12T00:56:28.779 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.144751.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.144751.log.gz 2024-09-12T00:56:28.787 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178253.log 2024-09-12T00:56:28.787 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.162024.log: 92.3% -- replaced with /var/log/ceph/ceph-client.admin.162024.log.gz 2024-09-12T00:56:28.795 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96365.log 2024-09-12T00:56:28.795 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.178253.log: 80.9% -- replaced with /var/log/ceph/ceph-client.0.178253.log.gz 2024-09-12T00:56:28.803 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.119967.log 2024-09-12T00:56:28.803 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96365.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.96365.log.gz 2024-09-12T00:56:28.811 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.170104.log 2024-09-12T00:56:28.811 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.119967.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.119967.log.gz 2024-09-12T00:56:28.819 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156673.log 2024-09-12T00:56:28.820 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.170104.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.170104.log.gz 2024-09-12T00:56:28.821 INFO:teuthology.orchestra.run.smithi078.stderr: 94.6% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-12T00:56:28.821 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33425.log 2024-09-12T00:56:28.822 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.156673.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.156673.log.gz 2024-09-12T00:56:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.121737.log 2024-09-12T00:56:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33425.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33425.log.gz 2024-09-12T00:56:28.824 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27062.log 2024-09-12T00:56:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.121737.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.121737.log.gz 2024-09-12T00:56:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32873.log 2024-09-12T00:56:28.825 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.27062.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.27062.log.gz 2024-09-12T00:56:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62145.log 2024-09-12T00:56:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32873.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32873.log.gz 2024-09-12T00:56:28.826 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.135898.log 2024-09-12T00:56:28.828 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.62145.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.62145.log.gz 2024-09-12T00:56:28.828 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41257.log 2024-09-12T00:56:28.829 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.135898.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.135898.log.gz 2024-09-12T00:56:28.829 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98725.log 2024-09-12T00:56:28.830 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.41257.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.41257.log.gz 2024-09-12T00:56:28.830 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33809.log 2024-09-12T00:56:28.831 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.98725.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.98725.log.gz 2024-09-12T00:56:28.832 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.127638.log 2024-09-12T00:56:28.832 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33809.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33809.log.gz 2024-09-12T00:56:28.832 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.122327.log 2024-09-12T00:56:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.127638.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.127638.log.gz 2024-09-12T00:56:28.833 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33985.log 2024-09-12T00:56:28.834 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.122327.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.122327.log.gz 2024-09-12T00:56:28.834 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49567.log 2024-09-12T00:56:28.835 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33985.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33985.log.gz 2024-09-12T00:56:28.835 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91645.log 2024-09-12T00:56:28.835 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.49567.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49567.log.gz 2024-09-12T00:56:28.836 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96955.log 2024-09-12T00:56:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.91645.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.91645.log.gz 2024-09-12T00:56:28.837 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32999.log 2024-09-12T00:56:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.96955.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.96955.log.gz 2024-09-12T00:56:28.838 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179442.log 2024-09-12T00:56:28.839 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32999.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32999.log.gz 2024-09-12T00:56:28.839 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.174234.log 2024-09-12T00:56:28.839 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179442.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179442.log.gz 2024-09-12T00:56:28.840 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134128.log 2024-09-12T00:56:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.174234.log: 84.2% -- replaced with /var/log/ceph/ceph-client.0.174234.log.gz 2024-09-12T00:56:28.841 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82204.log 2024-09-12T00:56:28.842 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.134128.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.134128.log.gz 2024-09-12T00:56:28.842 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33959.log 2024-09-12T00:56:28.842 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.82204.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.82204.log.gz 2024-09-12T00:56:28.843 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.134718.log 2024-09-12T00:56:28.843 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33959.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33959.log.gz 2024-09-12T00:56:28.844 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148881.log 2024-09-12T00:56:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.134718.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.134718.log.gz 2024-09-12T00:56:28.845 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.92825.log 2024-09-12T00:56:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.148881.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.148881.log.gz 2024-09-12T00:56:28.846 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179989.log 2024-09-12T00:56:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.92825.log: 82.3% -- replaced with /var/log/ceph/ceph-client.admin.92825.log.gz 2024-09-12T00:56:28.847 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179859.log 2024-09-12T00:56:28.848 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179989.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179989.log.gz 2024-09-12T00:56:28.848 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177631.log 2024-09-12T00:56:28.848 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179859.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179859.log.gz 2024-09-12T00:56:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.129998.log 2024-09-12T00:56:28.849 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.177631.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.177631.log.gz 2024-09-12T00:56:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.149471.log 2024-09-12T00:56:28.850 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.129998.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.129998.log.gz 2024-09-12T00:56:28.851 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.132948.log 2024-09-12T00:56:28.851 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.149471.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.149471.log.gz 2024-09-12T00:56:28.852 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165372.log 2024-09-12T00:56:28.852 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.132948.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.132948.log.gz 2024-09-12T00:56:28.853 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73944.log 2024-09-12T00:56:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.165372.log: 93.6% -- replaced with /var/log/ceph/ceph-client.admin.165372.log.gz 2024-09-12T00:56:28.854 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.110527.log 2024-09-12T00:56:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.73944.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.73944.log.gz 2024-09-12T00:56:28.855 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.148291.log 2024-09-12T00:56:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.110527.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.110527.log.gz 2024-09-12T00:56:28.856 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.137668.log 2024-09-12T00:56:28.857 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.148291.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.148291.log.gz 2024-09-12T00:56:28.857 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.116427.log 2024-09-12T00:56:28.859 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.137668.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.137668.log.gz 2024-09-12T00:56:28.860 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82794.log 2024-09-12T00:56:28.860 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.116427.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.116427.log.gz 2024-09-12T00:56:28.861 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32951.log 2024-09-12T00:56:28.862 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.82794.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.82794.log.gz 2024-09-12T00:56:28.862 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33409.log 2024-09-12T00:56:28.862 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32951.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32951.log.gz 2024-09-12T00:56:28.863 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70994.log 2024-09-12T00:56:28.863 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33409.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33409.log.gz 2024-09-12T00:56:28.863 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47797.log 2024-09-12T00:56:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70994.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.70994.log.gz 2024-09-12T00:56:28.864 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99905.log 2024-09-12T00:56:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.47797.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.47797.log.gz 2024-09-12T00:56:28.865 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38847.log 2024-09-12T00:56:28.866 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.99905.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.99905.log.gz 2024-09-12T00:56:28.866 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.142388.log 2024-09-12T00:56:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.38847.log: 83.0% -- replaced with /var/log/ceph/ceph-client.admin.38847.log.gz 2024-09-12T00:56:28.867 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33835.log 2024-09-12T00:56:28.868 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.142388.log: 82.0% -- replaced with /var/log/ceph/ceph-client.admin.142388.log.gz 2024-09-12T00:56:28.868 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.172464.log 2024-09-12T00:56:28.869 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33835.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33835.log.gz 2024-09-12T00:56:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33647.log 2024-09-12T00:56:28.870 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.172464.log: 83.5% -- replaced with /var/log/ceph/ceph-client.0.172464.log.gz 2024-09-12T00:56:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106987.log 2024-09-12T00:56:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33647.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33647.log.gz 2024-09-12T00:56:28.871 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98135.log 2024-09-12T00:56:28.872 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.106987.log: 81.9% -- replaced with /var/log/ceph/ceph-client.admin.106987.log.gz 2024-09-12T00:56:28.872 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69149.log 2024-09-12T00:56:28.874 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.98135.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.98135.log.gz 2024-09-12T00:56:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180019.log 2024-09-12T00:56:28.875 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.69149.log: 80.2% -- replaced with /var/log/ceph/ceph-client.0.69149.log.gz 2024-09-12T00:56:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33601.log 2024-09-12T00:56:28.876 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.180019.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.180019.log.gz 2024-09-12T00:56:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.140028.log 2024-09-12T00:56:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33601.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33601.log.gz 2024-09-12T00:56:28.877 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36364.log 2024-09-12T00:56:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.140028.log: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.140028.log.gz 2024-09-12T00:56:28.878 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33861.log 2024-09-12T00:56:28.879 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.36364.log: 44.2% -- replaced with /var/log/ceph/ceph-client.0.36364.log.gz 2024-09-12T00:56:28.880 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.123507.log 2024-09-12T00:56:28.880 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33861.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33861.log.gz 2024-09-12T00:56:28.880 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43027.log 2024-09-12T00:56:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.123507.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.123507.log.gz 2024-09-12T00:56:28.881 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.167744.log 2024-09-12T00:56:28.882 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.43027.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.43027.log.gz 2024-09-12T00:56:28.882 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54490.log 2024-09-12T00:56:28.883 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.167744.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.167744.log.gz 2024-09-12T00:56:28.884 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79844.log 2024-09-12T00:56:28.885 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54490.log: 91.9% -- replaced with /var/log/ceph/ceph-client.admin.54490.log.gz 2024-09-12T00:56:28.885 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79254.log 2024-09-12T00:56:28.885 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.79844.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.79844.log.gz 2024-09-12T00:56:28.887 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33001.log 2024-09-12T00:56:28.887 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.79254.log: 82.2% -- replaced with /var/log/ceph/ceph-client.admin.79254.log.gz 2024-09-12T00:56:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33633.log 2024-09-12T00:56:28.888 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33001.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33001.log.gz 2024-09-12T00:56:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66064.log 2024-09-12T00:56:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.33633.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33633.log.gz 2024-09-12T00:56:28.889 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51387.log 2024-09-12T00:56:28.890 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.66064.log: 81.3% -- replaced with /var/log/ceph/ceph-client.admin.66064.log.gz 2024-09-12T00:56:28.890 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.138848.log 2024-09-12T00:56:28.891 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.51387.log: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.51387.log.gz 2024-09-12T00:56:28.891 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.158161.log 2024-09-12T00:56:28.892 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.138848.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.138848.log.gz 2024-09-12T00:56:28.892 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179728.log 2024-09-12T00:56:28.893 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.0.158161.log: 84.3% -- replaced with /var/log/ceph/ceph-client.0.158161.log.gz 2024-09-12T00:56:28.893 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63442.log 2024-09-12T00:56:28.894 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179728.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179728.log.gz 2024-09-12T00:56:28.894 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.111707.log 2024-09-12T00:56:28.895 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.63442.log: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.63442.log.gz 2024-09-12T00:56:28.895 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179702.log 2024-09-12T00:56:28.896 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.111707.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.111707.log.gz 2024-09-12T00:56:28.896 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156033.log 2024-09-12T00:56:28.897 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179702.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179702.log.gz 2024-09-12T00:56:28.898 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.154853.log 2024-09-12T00:56:28.898 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.156033.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.156033.log.gz 2024-09-12T00:56:28.898 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.151853.log 2024-09-12T00:56:28.899 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.154853.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.154853.log.gz 2024-09-12T00:56:28.899 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163920.log 2024-09-12T00:56:28.900 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.151853.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.151853.log.gz 2024-09-12T00:56:28.900 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179885.log 2024-09-12T00:56:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.163920.log: 92.2% -- replaced with /var/log/ceph/ceph-client.admin.163920.log.gz 2024-09-12T00:56:28.901 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81614.log 2024-09-12T00:56:28.902 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.179885.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.179885.log.gz 2024-09-12T00:56:28.902 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54368.log 2024-09-12T00:56:28.904 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.81614.log: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.81614.log.gz 2024-09-12T00:56:28.905 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70404.log 2024-09-12T00:56:28.905 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.54368.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.54368.log.gz 2024-09-12T00:56:28.906 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176869.log 2024-09-12T00:56:28.906 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.70404.log: 81.7% -- replaced with /var/log/ceph/ceph-client.admin.70404.log.gz 2024-09-12T00:56:28.906 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32991.log 2024-09-12T00:56:28.907 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.176869.log: 25.8% -- replaced with /var/log/ceph/ceph-client.admin.176869.log.gz 2024-09-12T00:56:28.907 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.109937.log 2024-09-12T00:56:28.908 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.32991.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32991.log.gz 2024-09-12T00:56:28.908 INFO:teuthology.orchestra.run.smithi078.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.145931.log 2024-09-12T00:56:28.909 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.109937.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.109937.log.gz 2024-09-12T00:56:28.910 INFO:teuthology.orchestra.run.smithi078.stderr:/var/log/ceph/ceph-client.admin.145931.log: 82.1% -- replaced with /var/log/ceph/ceph-client.admin.145931.log.gz 2024-09-12T00:56:29.172 INFO:teuthology.orchestra.run.smithi171.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-12T00:56:29.545 INFO:teuthology.orchestra.run.smithi078.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-12T00:56:30.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2024-09-12T00:56:30.189 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-09-12T00:56:30.190 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-09-12T00:56:30.228 INFO:teuthology.orchestra.run.smithi078.stderr: 91.3% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-12T00:56:31.858 INFO:teuthology.orchestra.run.smithi078.stderr: 93.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-12T00:56:36.516 INFO:teuthology.orchestra.run.smithi171.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-12T00:56:36.825 INFO:teuthology.orchestra.run.smithi171.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-12T00:56:37.314 INFO:teuthology.orchestra.run.smithi078.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-12T00:56:37.337 INFO:teuthology.orchestra.run.smithi078.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-12T00:56:40.291 INFO:teuthology.orchestra.run.smithi078.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-12T00:56:40.579 INFO:teuthology.orchestra.run.smithi171.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-12T00:56:44.500 INFO:teuthology.orchestra.run.smithi078.stderr: 94.2% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-12T00:56:44.501 INFO:teuthology.orchestra.run.smithi078.stderr: 2024-09-12T00:56:44.501 INFO:teuthology.orchestra.run.smithi078.stderr:real 0m16.301s 2024-09-12T00:56:44.501 INFO:teuthology.orchestra.run.smithi078.stderr:user 0m52.093s 2024-09-12T00:56:44.501 INFO:teuthology.orchestra.run.smithi078.stderr:sys 0m1.931s 2024-09-12T00:56:45.537 INFO:teuthology.orchestra.run.smithi171.stderr: 94.5% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-12T00:56:45.538 INFO:teuthology.orchestra.run.smithi171.stderr: 2024-09-12T00:56:45.538 INFO:teuthology.orchestra.run.smithi171.stderr:real 0m17.294s 2024-09-12T00:56:45.538 INFO:teuthology.orchestra.run.smithi171.stderr:user 0m45.606s 2024-09-12T00:56:45.538 INFO:teuthology.orchestra.run.smithi171.stderr:sys 0m1.696s 2024-09-12T00:56:45.539 INFO:tasks.ceph:Archiving logs... 2024-09-12T00:56:45.539 DEBUG:teuthology.misc:Transferring archived files from smithi078:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/remote/smithi078/log 2024-09-12T00:56:45.540 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:56:51.731 DEBUG:teuthology.misc:Transferring archived files from smithi171:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/remote/smithi171/log 2024-09-12T00:56:51.732 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-12T00:56:57.238 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-12T00:56:57.249 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-12T00:56:57.250 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:56:57.252 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-12T00:56:57.341 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-12T00:56:57.353 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-12T00:56:57.354 DEBUG:teuthology.orchestra.run.smithi078:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:56:57.356 DEBUG:teuthology.orchestra.run.smithi171:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-12T00:56:57.366 INFO:teuthology.orchestra.run.smithi078.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:56:57.367 INFO:teuthology.orchestra.run.smithi078.stdout:============================================================================== 2024-09-12T00:56:57.367 INFO:teuthology.orchestra.run.smithi078.stdout:*hv01.front.sepi 67.205.162.81 3 u 30 128 377 0.156 -4.464 0.529 2024-09-12T00:56:57.367 INFO:teuthology.orchestra.run.smithi078.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 128 377 0.186 -3.904 0.503 2024-09-12T00:56:57.367 INFO:teuthology.orchestra.run.smithi078.stdout:+hv03.front.sepi 74.6.168.72 3 u 73 128 377 0.179 -4.412 0.967 2024-09-12T00:56:57.367 INFO:teuthology.orchestra.run.smithi078.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T00:56:57.369 INFO:teuthology.orchestra.run.smithi171.stdout: remote refid st t when poll reach delay offset jitter 2024-09-12T00:56:57.369 INFO:teuthology.orchestra.run.smithi171.stdout:============================================================================== 2024-09-12T00:56:57.369 INFO:teuthology.orchestra.run.smithi171.stdout:*hv01.front.sepi 67.205.162.81 3 u 29 64 377 0.093 -1.470 0.368 2024-09-12T00:56:57.369 INFO:teuthology.orchestra.run.smithi171.stdout:+hv02.front.sepi 63.231.80.2 3 u 32 64 377 0.109 -0.579 0.203 2024-09-12T00:56:57.369 INFO:teuthology.orchestra.run.smithi171.stdout:+hv03.front.sepi 74.6.168.72 3 u 26 128 377 0.078 -2.620 0.275 2024-09-12T00:56:57.369 INFO:teuthology.orchestra.run.smithi171.stdout: hv04.front.sepi .INIT. 16 u - 1024 0 0.000 +0.000 0.000 2024-09-12T00:56:57.369 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-12T00:56:57.385 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-12T00:56:57.386 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-12T00:56:57.445 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-12T00:56:57.456 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-12T00:56:57.468 INFO:teuthology.task.internal:Duration was 3381.521052 seconds 2024-09-12T00:56:57.469 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-12T00:56:57.479 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-12T00:56:57.480 DEBUG:teuthology.orchestra.run.smithi078:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:56:57.482 DEBUG:teuthology.orchestra.run.smithi171:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-12T00:56:57.521 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-12T00:56:57.521 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi078.front.sepia.ceph.com 2024-09-12T00:56:57.521 DEBUG:teuthology.orchestra.run.smithi078:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:56:57.568 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi171.front.sepia.ceph.com 2024-09-12T00:56:57.569 DEBUG:teuthology.orchestra.run.smithi171:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-12T00:56:57.579 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-12T00:56:57.579 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:56:57.612 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-12T00:56:57.649 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-12T00:56:57.649 DEBUG:teuthology.orchestra.run.smithi078:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:56:57.680 DEBUG:teuthology.orchestra.run.smithi171:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-12T00:56:57.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-12T00:56:57.759 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-12T00:56:57.759 DEBUG:teuthology.orchestra.run.smithi078:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:56:57.770 DEBUG:teuthology.orchestra.run.smithi171:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-12T00:56:57.781 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-12T00:56:57.794 DEBUG:teuthology.orchestra.run.smithi078:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:56:57.816 DEBUG:teuthology.orchestra.run.smithi171:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:56:57.825 INFO:teuthology.orchestra.run.smithi078.stdout:kernel.core_pattern = core 2024-09-12T00:56:57.833 INFO:teuthology.orchestra.run.smithi171.stdout:kernel.core_pattern = core 2024-09-12T00:56:57.872 DEBUG:teuthology.orchestra.run.smithi078:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:56:57.882 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:56:57.883 DEBUG:teuthology.orchestra.run.smithi171:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-12T00:56:57.918 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-12T00:56:57.919 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-12T00:56:57.938 INFO:teuthology.task.internal:Transferring archived files... 2024-09-12T00:56:57.939 DEBUG:teuthology.misc:Transferring archived files from smithi078:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/remote/smithi078 2024-09-12T00:56:57.939 DEBUG:teuthology.orchestra.run.smithi078:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:56:57.965 DEBUG:teuthology.misc:Transferring archived files from smithi171:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-09-11_23:33:24-rgw-wip-cls-rgw-busy-resharding-distro-default-smithi/7901830/remote/smithi171 2024-09-12T00:56:57.965 DEBUG:teuthology.orchestra.run.smithi171:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-12T00:56:57.990 INFO:teuthology.task.internal:Removing archive directory... 2024-09-12T00:56:57.991 DEBUG:teuthology.orchestra.run.smithi078:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:56:58.005 DEBUG:teuthology.orchestra.run.smithi171:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-12T00:56:58.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-12T00:56:58.043 INFO:teuthology.task.internal:Not uploading archives. 2024-09-12T00:56:58.043 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-12T00:56:58.071 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-12T00:56:58.071 DEBUG:teuthology.orchestra.run.smithi078:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:56:58.073 DEBUG:teuthology.orchestra.run.smithi171:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-12T00:56:58.077 INFO:teuthology.orchestra.run.smithi078.stdout: 658639 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:56 /home/ubuntu/cephtest 2024-09-12T00:56:58.079 INFO:teuthology.orchestra.run.smithi171.stdout: 658636 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 12 00:56 /home/ubuntu/cephtest 2024-09-12T00:56:58.080 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-12T00:56:58.104 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-12T00:56:58.260 INFO:teuthology.run:Summary data: description: rgw/verify/{0-install accounts$/{none} clusters/fixed-2 datacache/no_datacache frontend/beast ignore-pg-availability inline-data$/{on} msgr-failures/few objectstore/bluestore-bitmap overrides proto/http rgw_pool_type/ec s3tests-branch sharding$/{default} striping$/{stripe-equals-chunk} supported-random-distro$/{ubuntu_latest} tasks/{bucket-check cls mp_reupload ragweed reshard s3tests-java s3tests versioning} validater/lockdep} duration: 3381.5210518836975 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-09-12T00:56:58.260 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-12T00:56:58.355 INFO:teuthology.run:pass